Back in high school, I was taught
$$\dfrac{d}{dy} e^x = e^x \dfrac{dx}{dy}$$
Then why do I see people on the internet saying it's $0$. Even the derivative calculator says it's $0$
I thought that was suppose to be partial differentiation's job to treat other variables as constants?

If $x=x(y)$ is a function of $y$, then
$$ \frac{d}{dy} e^x = x' e^x = \frac{dx}{dy} \cdot e^x $$
Otherwise it is zero as the calculator says.