Hi Im fairly new to SDE theory and am struggling with the difference between a weak ( or martingale ) solution and a strong solution to an SDE :
$$ d(X_{t})=b(t,X_{t})dt + \sigma(t,X_{t})dW_{t} $$
Are these two differences and what do they really mean in detail?
For a strong solution we are given an initial value, whereas for weak solutions only a probability law?
For strong solutions we know what probability space we are working in and have a Brownian Motion $W$ in that space. For a weak solution we can only say that there exists some probability space where the SDE holds (with a new brownian motion in the space).
As you can tell I am confused with this topic some clarifications would be amazing.
The main difference between weak and strong solutions is indeed that for strong solutions we are given a Brownian motion on a given probability space whereas for weak solutions we are free to choose the Brownian motion and the probability space.
As a consequence of these definitions, we have to consider different notions of uniqueness. For strong solutions we are typically looking for pathwise unique solutions, i.e. if $(X_t^{(1)})_{t \geq 0}$ and $(X_t^{(2)})_{t \geq 0}$ are strong solutions to $(1)$ with the same initial condition, then pathwise uniqueness means $$\mathbb{P} \left( \sup_{t \geq 0} |X_t^{(1)}-X_t^{(2)}|=0 \right)=1.$$ As the following simple example shows it doesn't make sense to talk about pathwise uniqueness of weak solutions.
What do we learn from this? Since weak solutions might be defined on different probability spaces, there is no (immediate) way to compute probabilities of the form $\mathbb{P}(X_t^{(1)}=X_t^{(2)})$ for two weak solutions $(X_t^{(1)})_{t \geq 0}$ and $(X_t^{(2)})_{t \geq 0}$, and therefore we cannot even attempt to talk about pathwise uniqueness. For the same reason, it doesn't make sense to talk about pointwise initial conditions $\xi$ for weak solutions (... for this we would need to fix some probability space on which $\xi$ lives...); instead we only prescribe the initial distribution of $X_0$.
The next example shows that we cannot expect to have pathwise uniqueness even if the weak solutions are defined on the same probability space.
The "good" notion of uniqueness for weak solutions is weak uniqueness, i.e. uniqueness in distribution (= the solutions have the same finite-dimensional distributions).
Typically it is much easier to prove the existence (and/or uniqueness of) a weak solution the the existence (and/or uniqueness) of a strong solution.
Let's prove that the SDE has a weak solution. Let $(X_t,\mathcal{F}_t)_{t \geq 0}$ be some Brownian motion and define $$W_t := -\int_0^t \text{sgn} \, (X_s) \, dX_s.$$ It follows from Lévy's characterization that $(W_t,\mathcal{F}_t)$ is also a Brownian motion. Since $$dW_t = - \text{sgn} \, (X_t) \, dX_t$$ implies $$dX_t = - \text{sgn} \, (X_t) \, dW_t$$ this means that $(X_t)_{t \geq 0}$ is a weak solution to $(2)$. For a proof that a strong solution does not exist see e.g. Example 19.16 in the book by Schilling & Partzsch on Brownian motion.
Let me finally mention that weak solutions are closely related to martingale problems; in this answer I tried to give some insights on the connection between the two notions.