Ok, suppose $M,N$ are Riemannian manifolds and $F:M\to N$ is a smooth map between them. In a book I have here they consider that $\dim M=m \geq \dim N=n$ and that $x\in M$ is a regular point such that the derivative $DF(x):T_x M\to T_{F(x)}N$ is surjective. With this conditions, note that $\ker DF(X)^\perp$ is isomorphic to $T_{F(x)}N$.
So far so good, the problem comes when they start to talk about the determinant of $DF(x)$. As far as I know, we talk about determinant in the context of matrices. So here started my trouble, for $DF(x)$ is a linear map between abstract spaces, there is no obvious way to make $DF(x)$ into a matrix.
After a search on Google, I got these two definitions, which I wanted to share here to be sure they are valid. For the first one, fortunately, I had some knowledge of differential forms, so I didn't got so confused when seeing it.
Definition 1: given any base $(v_1,\ldots,v_n)$ of $\ker DF(x)^\perp$, we define $$\det (DF(x)) = \frac{\omega(DF(x)v_1,\ldots,DF(x)v_n)}{\mu(v_1,\ldots,v_n)},$$ where $\omega$ is the volume form on $N$ and $\mu$ is the volume form on $M$.
The second definition was told me by a friend and I couldn't find something useful on the Internet about it.
Definition 2: let $(\varphi, U)$ be a orthonormal coordinate system on $x$ and $(\psi, V)$ a orthonormal coordinate system on $F(x)$. Then $\det (DF(x)) = \det \left(D\Phi(\varphi^{-1}(x))\right)$, where $\Phi=\psi^{-1}\circ F\circ\varphi$.
This second definition also makes sense, assuming that the determinant doesn't depend on the charts chosen. In fact, this second definition is better, because it reduces the problem to the computation of a determinant of some matrix, which is something familiar. Just to be clear, $\varphi$ is a map from $U\subset \mathbb{R}^m$ to $M$ and $\psi$ is a map from $V\subset \mathbb{R}^n$ to $N$.
I have more than one question, some of them probably you will find easy to answer (assuming you are used to Riemannian Geometry).
1) This is a terminology question. Instead saying $(\varphi,U)$ is an orthonormal coordinate system, could I say it is an orthonormal chart ? I'm asking this because looks like it's common to use the term charts, except when you are gonna say it is orthogonal or orthonormal. In this case I found most of people prefer to use it with the term coordinate system.
2) From my reading, $(\varphi,U)$ is an orthogonal (orthonormal) coordinate system (or chart?) when $\left(\frac{\partial}{\partial x_1}|_x,\ldots,\frac{\partial}{\partial x_m}|_x\right)$ is an orthogonal (orthonormal) base for $T_xM$. Is my understanding correct?
3) The definitions 1 and 2 are really equivalent? I got a little suspicious about using "orthonormal" in definition 2. Maybe it could be "orthogonal", I don't know.
PS: questions 1 and 2 are important but are technical details necessary to ask question 3. The last question is the most important of all.
Both definitions you suggest do not compile:
In order to clarify things let me discuss first the linear algebra relevant for your question. The main point is that there is no notion of determinant for a linear map between two vector spaces of different dimensions and there is no notion of determinant for a linear map between two different vector spaces of the same dimension without a choice of an extra data.
If $T \colon V \rightarrow V$ is a linear operator on a finite dimensional vector space (so the domain and codomain are the same), you can define $\det(T)$ by choosing a basis $\mathcal{B}$ for $V$ and defining $\det(T) := \det([T]_{\mathcal{B}})$ where $[T]_{\mathcal{B}} \in M_n(\mathbb{F})$ is the square matrix that represents the operator $T$ with respect to the basis $\mathcal{B}$. This definition uses a basis but is, in fact, independent of the basis we work with as $$\det([T]_{\mathcal{B}'}) = \det(P^{-1} [T]_{\mathcal{B}} P) = \det([T]_{\mathcal{B}}) $$ where $P$ is the change of basis matrix $P =[\operatorname{id}]_{\mathcal{B}}^{\mathcal{B'}}$.
If $T \colon V \rightarrow W$ is a linear map between two vector spaces of the same (finite) dimension, you can try and define $\det(T)$ by representing $T$ as a matrix. However, to represent $T$ as a matrix you need to pick two different bases $\mathcal{B}$ for $V$ and $\mathcal{C}$ for $W$ and if $\mathcal{B}', \mathcal{C}'$ are other bases, we have
$$ [T]_{\mathcal{C}}^{\mathcal{B}} = [\operatorname{id}]^{\mathcal{C}'}_{\mathcal{C}}[T]^{\mathcal{B}'}_{\mathcal{C}'} [\operatorname{id}]^{\mathcal{B}}_{\mathcal{B}'}$$
and so there's no reason that $\det([T]_{\mathcal{C}}^{\mathcal{B}}) = \det([T]^{\mathcal{B}'}_{\mathcal{C}'})$.
To save the situation, we should go back to the case $T \colon V \rightarrow V$ and reinterpret $\det(T)$ differently. If $V = \mathbb{R}^n,$ the scalar $\det(T)$ is the signed factor by which $T$ scales the volume of an $n$-dimensional parallelotope. In an abstract vector space $V$, we have no natural notion of (signed) volume of an $n$-dimensional parallelotope. Such notion is provided by a choice of a volume form $0 \neq \omega_V \in \Lambda^{\text{top}}(V^{*})$. Given such a volume form, we can define $\det(T)$ as the unique scalar such that $T^{*}(\omega_V) = \det(T) \omega_V$ and the nice thing is that this definition is actually independent of the volume form!
Finally, to define a notion of a determinant for a map $T \colon V \rightarrow W$, we equip $V$ and $W$ with volume forms $\omega_V \in \Lambda^{\text{top}}(V^{*})$ and $\omega_W \in \Lambda^{\text{top}}(W^{*})$ and define $\det(T)$ by the equation $T^{*}(\omega_W) = \det(T) \omega_V$. This definition depends on both $\omega_V$ and $\omega_W$.
Now assume $(V, g_V)$ is an inner product space. Even though you provided extra data, there is still no natural volume form that is defined on $V$. In order to define a natural form, you need to choose an orientation for $V$ (and equivalence class $\mathfrak{o}_V$ of elements of $\Lambda^{\operatorname{top}}(V)$ or $\Lambda^{\operatorname{top}}(V^{*})$ depending on your definitions). Once chosen, there is a unique volume form $\omega_{g_V,\mathfrak{o}_V}$ that behaves nicely with the metric and the orientation (this is precisely the Riemannian volume form). It is determined by the fact that if $(e_1, \dots, e_n)$ is a positive orthonormal basis of $V$ then $\omega_{g_V,\mathfrak{o}_V}(e_1 \wedge \dots \wedge e_n) = 1$.
In your situation you have a surjective linear map $T \colon (V, g_V, \mathfrak{o}_V,\omega_V) \rightarrow (W, g_W, \mathfrak{o}_V,\omega_W)$ with $\dim V = m, \dim W = n$. The map $T|_{(\ker T)^{\perp}} \colon (\ker T)^{\perp} \rightarrow W$ is a linear map between two vector spaces of the same dimension and so we can try and make sense of $\det \left( T|_{(\ker T)^{\perp}} \right)$. The right hand side has by assumption a volume form but the left hand side is only a subspace of a space that has a volume form. In general, a subspace of a space with a volume form doesn't get a volume form but $(\ker L)^{\perp}$ has an inner product (the restriction of $g_V$) and we can give it an orientation using the map $T$ and these two structures endow $(\ker T)^{\perp}$ with an orientation and allow us to talk of the determinant.
Finally, we can provide corrected versions of your definitions for $\det T$:
I'll leave it to you to verify that the definitions are equivalent and consistent with what I described before.