This is problem 13 from Chapter 13, Section 14 of Apostol's Calculus Vol 1.
I need to prove or disprove the formula $\vec{a}\times(\vec{a}\times(\vec{a}\times\vec{b}))\cdot\vec{c} = -\|\vec{a}\|^2\vec{a}\cdot\vec{b}\times\vec{c}$.
This is what I have so far:
We have $\vec{a}\times(\vec{a}\times(\vec{a}\times\vec{b})) = k\vec{a}\times\vec{b}$ for some $k\in\mathbb{R}$.Hence $\vec{a}\times(\vec{a}\times(\vec{a}\times\vec{b}))\cdot\vec{c} = k\vec{a}\cdot\vec{b}\times\vec{c} $ and thus we need to determine if $k=-\|\vec{a}\|^2$. Using the identities $\vec{x}\cdot\vec{y} = \|\vec{x}\|\,\|\vec{y}\|\,\cos\theta$, where $\theta$ is the angle between $x$ and $y$, and $\|\vec{x}\times\vec{y}\|=\|\vec{x}\|\,\|\vec{y}\|\sin\theta$, we get $$ \|\vec{a}\|^3\,\|\vec{b}\|\,\|\vec{c}\|\,\cos\theta_1\sin\theta_3\sin\theta_4\sin\theta_5 = k\|\vec{a}\|\,\|\vec{b}\|\,\|\vec{c}\|\,\cos\theta_2\sin\theta_4 \ . $$ The angles correspond to: \begin{align*} &\theta_1 \ : \quad k\vec{a}\times\vec{b} \ \text{and} \ \vec{c} \\ &\theta_2 \ : \quad \vec{a} \ \text{and} \ \vec{b}\times\vec{c} \\ &\theta_3 \ : \quad \vec{a} \ \text{and} \ \vec{a}\times(\vec{a}\times\vec{b}) \\ &\theta_4 \ : \quad \vec{a} \ \text{and} \ \vec{b} \\ &\theta_5 \ : \quad \vec{a} \ \text{and} \ \vec{a}\times\vec{b}. \end{align*}
If $\vec{a},\vec{b},\vec{c}$ are dependent, then the equality we wish to prove becomes $0=0$ and is thus true. Assume that $\vec{a},\vec{b},\vec{c}$ are independent.Then we can simplify the previous equation to $$ \|\vec{a}\|^2\cos\theta_1\sin\theta_3\sin\theta_5 = k\cos\theta_2 \ . $$ Notice that $\theta_3=\theta_5=\frac{\pi}{2}$. Therefore $\|\vec{a}\|^2\cos\theta_1 = k\cos\theta_2.$
This is where I am stuck. Any hints or suggestions? Am I making this a lot harder than it needs to be?
If you know the triple product identity $$ u \times (v \times w) = (u \cdot w)v - (u \cdot v)w, $$ and the cyclic identity $a \times b \cdot c = b \times c \cdot a$, you can simply write $$ a \times (a \times (a \times b)) \cdot c = a \times ((a \cdot b)a - (a \cdot a)b) \cdot c = \cdots $$