The question tell me that there is a boundary layer at $x=0$ for this differential equation $$\epsilon y''+y y'-y=0, 0<x<1$$ where $y(0)=0, y(1)=3$.
My question is how do we know the boundary layer is at $x=0$, also is the thickness of order $\epsilon$?
Let $\xi = x \epsilon^{- \alpha}, {d\xi \over dx} = \epsilon^{- \alpha}, {d^2\xi \over dx^2} = 0$
$y'(x)={\partial y \over \partial \xi} \cdot {\partial \xi \over \partial x} = \epsilon^{-\alpha} y'(\xi)$
$y''(x)={\partial^2y \over \partial \xi^2}({\partial\xi \over \partial x})^2 + {\partial y \over \partial \xi}{\partial^2 \xi \over \partial x^2} = \epsilon^{-2 \alpha} y''(\xi)$
So I get
$$\epsilon^{-2\alpha}y''+\epsilon^{-\alpha}yy'-y=0$$
Which part I did wrong ?



If the reduced differential equation, i.e. $yy'-y=0$, is a different type then, in general, it will not be able to fulfill the boundary conditions of the original problem, or will not have the differentiability of the exact solution.
This is a little heuristic. The type of a ODE is given by its order, since the order of your PDE changes from 2 to 1, you can expact a boundary layer. There also could be a boundary layer at $x=1$.
To examine the boundary layer at $x=0$ we have to switch to local variables $\xi=x\varepsilon^{-\alpha}$. You can think of them as magnifying glas. Plugging this in: $$\varepsilon^{1-2\alpha}y''+\varepsilon^{-\alpha}yy'-y=0$$ and for $\varepsilon\rightarrow 0$ we find $$yy'=0\qquad \text{for } 0<\alpha<1\\ -y''+yy'=0\qquad \text{for } \alpha=1\\ -y''=0\qquad \text{for } \alpha>1\\$$ Now to make things precise I would have to define significant degeneration... The main idea is, that for $\alpha=1$ you have the most information left and therefore this is the thickness... I think. it depends on your definition on thickness. I only read stuff on this topic in german and I am not familiar with the terminology ^^ I hope it helped. Maybe you can look it up in O'Malley book on Singular Perturbation Methods for ODE or any other book. Does this help you in any way?