For example, given a general nonlinear system where we want to show that the error system is stable $e=x-x_d$ is it necessary for the Lyapunov candidate to be continuously differentiable at the equilibrium point since we are only concerned about what happens around the equilibrium point?
At the end of the day I would like to show that $\vert\vert e\vert\vert$ is a valid Lyapunov candidate. However, this is not differentiable at $e=0$ since the derivative is $\frac{e^{T}\dot{e}}{\vert\vert e\vert\vert}$.
My current digging into this topic has found the following paper: Vector Norms as Lyapunov Functions for Linear Systems by Kiendl. However, this paper is restricted to linear systems (plus other restrictions).
Note: this is a follow up to a question I asked yesterday but I believe this is better said and is more direct.
Thanks for your input
Well, nondifferentiable Lyapunov functions are very common in the analysis of discontinuous control systems and the situation will be very simple if the right-hand side of your equation is continuous.
Suppose the right-hand side of your equation is continuous (otherwise you would have mentioned it, lol). Then by the set-valued Lie derivative, the Lyapunov function $\|e\|$ is monotonically decreasing if $\max(\partial_{x}\|e\|\dot{e})\leq0$, where $\partial_{x}\|e\|$ is the generalized gradient of $\|e\|$. Hence, if $\dot{e}=0$ at $e=0$, then your Lyapunov function works.