Help with Gelfand and Fomin section 3 theorem 2, calculus of variations

Question

This question is probably pretty stupid, but I can't figure it out so...

I'm trying to read Gelfand and Fomin's "Calculus of Variations" and on page 12, for some functional $J$ on a normed vector space $S$ they first define: $$\Delta J [y;h] = J[y+h] - J[y], y,h\in S$$ and then say if we can write: $$\Delta J[y;h] = \delta J[y;h]+ \epsilon ||h||$$ where $\delta J$ is a functional linear in $h$ and $\lim_{||h||\to 0} \epsilon = 0$, then we call $\delta J[y;h]$ the variation of $J$ at $y$. Quick sanity check for myself: in general, $\epsilon$ is a functional of $h$, right? Why don't we write: $$\Delta J[y;h] = \delta J[y;h] + \epsilon[y;h] ||h||?$$ Anyway, a few pages later, in the proof of theorem 2, they assert that since $\lim_{||h||\to 0} \epsilon =0 $ then there must exist some $\delta$ s.t. $\forall h \in S$ s.t. $||h||<\delta$ we must have that the sign of $\delta J[y;h]$ is the same as the sign of $\Delta J[y;h]$. Why is this the case?

Answer 1

After looking at peek-a-boo's link, I have come up with a complete proof of the theorem which I am happy with. I will post it here for future reference.

Theorem: A necessary condition for a differential function $J : S \to \mathbb{R}$ to have an extremum at $y_0 \in S$ is that its variation $\delta J_{y_0}(h) = 0$ for all $h \in S$.

Proof: For definiteness, suppose $J$ has a maximum at $y_0$, the proof for minimum follows similarly. Then by definition, $\exists \delta > 0 \forall h \in S: ||h|| < \delta \implies \Delta J_{y_0} (h) \leq 0$. Now suppose $\delta J \neq 0$, i.e. $\exists h_0 \in S: \delta J (h_0) \neq 0$. By the definition of differentiablility, we have: $$\Delta J(h) = \delta J(h) + \epsilon(h)||h|| (\epsilon \to_{||h||\to 0} 0)$$ Which is to say $\forall \mu > 0 \exists \gamma>0 \forall h \in S : ||h||<\gamma \implies |\epsilon(h)|<\mu$, or equivalently, $\forall \mu < 0 \exists \gamma > 0 \forall h \in S: ||h||<\gamma \implies |\Delta J(h) -\delta J (h)|< \mu ||h||$. Take $\mu = \frac{|\delta J(h_0)|}{2||h_0||}$. Then there is some $\gamma > 0$ s.t. $\forall h \in S: ||h||<\gamma \implies |\Delta J(h) - \delta J(h)| < \frac{|\delta J(h_0)| ||h||}{2||h_0||}$. Take $\alpha \neq 0$ s.t. $0<\delta J (\alpha h_0) = \alpha \delta J(h_0)$ and $||\alpha h_0|| = |\alpha|||h_0|| < \gamma$ and $||\alpha h_0|| < \delta$. Then we have: $$|\Delta J(\alpha h_0) - \delta J(\alpha h_0)| < \frac{|\delta J(h_0)|||\alpha h_0||}{2||h_0||} = \frac{\alpha\delta J(h_0)}{2}$$ Thus we have: $$\frac{\alpha \delta J (h_0)}{2} < \Delta J(\alpha h_0) < \frac{3 \alpha \delta J(h_0)}{2}$$ But we choose $\alpha \delta J(h_0)$ to be positive, thus $\Delta J(\alpha h_0)$ is positive. But we have $||\alpha h_0|| < \delta$ hence by choice of $\delta$, $\Delta J(\alpha h_0) \leq 0$. Contradiction. Thus $\delta J (h) = 0, \forall h \in S$.

Answer 2

This has also bothered me for a while, but it can be eventually shown quite simply using an analogous argument from page 12.

Suppose $\delta J[h_0] \neq 0$ for some $h_0$ in the normed linear space where the functional is defined. We then set

$$h_n = \frac{h_0}{n}$$

so that $||h_n|| \rightarrow 0$ as $n \rightarrow \infty$. Therefore,

\begin{align} \Delta J[h_n] & = \delta J[h_n]+\epsilon||h_n|| \\ & = \frac{1}{n} ( \delta J[h_0]+\epsilon||h_0|| ) \\ \end{align}

We notice that the second term in the parenthesis tends to $0$ as $n \rightarrow \infty$, since $\epsilon \rightarrow 0$ as $n \rightarrow \infty$ (i.e. $||h_n|| \rightarrow 0$). So eventually $\Delta J[h_n]$ and $\delta J[h_0]$ will share the same sign.

However, $y$ maximises $J[y;h]$ (for example), so for sufficiently large $n$ we have $\Delta J[h_n] \geqslant 0$ and therefore, $\delta J[h_0] \geqslant 0$ and especially, $\delta J[h_0] > 0$, since $\delta J[h_0] \neq 0$.

Now let us set

$$h'_0 = -h_0$$

so that

$$\delta J[h'_0] = -\delta J[h_0] < 0$$

We then run through the same above argument with

$$h'_n = \frac{h'_0}{n}$$

and conclude once again that $J[h'_0]>0$, which leads to a contradiction.