Before writing this post, I want to say thank you for every people who answered and commented to me. Thanks to mathematicians being active in this site, I think that I finally understood a little more than before about stationarity of random process.
In first-order stationarity,
A continuous-time random process $\{X(t), t\in\mathbb{R}\}$ is strict-sense stationary if $$ \forall t_1\in\mathbb{R}, \forall \Delta\in\mathbb{R},\\ F_{X(t_1)}(x_1) = F_{X(t_1+\Delta)}(x_1) $$
A continuous-time random process $\{X(t), t\in\mathbb{R}\}$ is wide-sense stationary if $$ E[X(t_1)]=E[X(t_1+\Delta)]\\ $$
In second-order stationarity,
A continuous-time random process $\{X(t), t\in\mathbb{R}\}$ is strict-sense stationary if $$ \forall t_1, t_2\in\mathbb{R}, \forall \Delta\in\mathbb{R},\\ F_{X(t_1)X(t_2)}(x_1, x_2) = F_{X(t_1+\Delta)X(t_2+\Delta)}(x_1, x_2) $$
A continuous-time random process $\{X(t), t\in\mathbb{R}\}$ is wide-sense stationary if $$ E[X(t_1)]=E[X(t_2)]\\ E[X(t_1)X(t_2)]=E[X(t_1+\Delta)X(t_2+\Delta)] $$
In n-th-order stationarity,
A continuous-time random process $\{X(t), t\in\mathbb{R}\}$ is strict-sense stationary if $$ \forall t_1, t_2, \cdots, t_n\in\mathbb{R}, \forall \Delta\in\mathbb{R},\\ F_{X(t_1)X(t_2)\cdots X(t_n)}(x_1, x_2, \cdots, x_n) = F_{X(t_1+\Delta)X(t_2+\Delta)\cdots X(t_n+\Delta)}(x_1, x_2, \cdots, x_n) $$
A continuous-time random process $\{X(t), t\in\mathbb{R}\}$ is wide-sense stationary if $$ E[X(t_1)]=E[X(t_2)]\\ E[X(t_1)X(t_2)]=E[X(t_1+\Delta)X(t_2+\Delta)]\\ E[X(t_1)X(t_2)X(t_3)]=E[X(t_1+\Delta)X(t_2+\Delta)X(t_3+\Delta)]\\ \cdots\\ E[X(t_1)X(t_2)\cdots X(t_n)]=E[X(t_1+\Delta)X(t_2+\Delta)\cdots X(t_n+\Delta)] $$
Just order is how many JOINT there exist.
Strict-sense is a perspective on PDF (CDF).
Wide-sense is a perspective on Expectation.
Right? I do hope I'm right.
No i dont think you are right.
I will mainly focus on wide-sense stationarity and i will use a different notation, from Probability and Random Processes by Grimmet and Stirzaker which is a commonly used book. But i think you will understand.
If the stationary condition $(*)$ of a random process $X(t)$ does not hold for all $n$ but holds for $n \leq k$, then we say that the process $X(t)$ is stationary to order $k$. If $X(t)$ is stationary to order $2$, then $X(t)$ is said to be wide-sense stationary (WSS). If $X(t)$ is a WSS random process, then we have
$1.$ $E[X(t)] = \mu$ (constant)
$2.$ $R_x(t_1, t_2) = E[X(t_1)X(t_2)] = R_X(|t_2 - t_1|) = R_X(\tau)$
WSS processes are completely characterized by only the first- and second-order distributions.
$\mu$ does not depend on $t$ since $F_{X(t)}(x)$ does not depend on $t$ and $R_X(t, t+\tau)$ does not depend on $t$ since $F_{X(t), X(t + \tau)}(x_1, x_2)$ does not depend on $t$.
And strict sense stationary $\Rightarrow$ WSS obviously.