If $\vec{a}$ and $\vec{b}$ are two unit vectors and $\vec{c}$ be a vector such that $2(\vec{a}\times \vec{b})+\vec{c}=\vec{b}\times \vec{c}$. Then maximum value of $|(\vec{a}\times \vec{c})\cdot \vec{b}|$
Try: From $2(\vec{a}\times \vec{b})+ \vec{c}=\vec{b}\times \vec{c}$.
Taking dot product of $\vec{c}$ on both side, we have
$2[\vec{a}\vec{b}\vec{c}]=|\vec{c}|^2/2$
So $$|(\vec{a}\times \vec{c})\cdot \vec{b}|=|[\vec{a}\vec{b}\vec{c}]|=\frac{|\vec{c}|^2}{2}$$
Could some help me to solve it, thanks
Let $\vec{c}=\alpha\vec{a}+\beta\vec{b}+\gamma\vec{a}\times\vec{b}$.
\begin{align*} \vec{b}\times\vec{c}&=\alpha\vec{b}\times\vec{a}+\beta\vec{b}\times\vec{b}+\gamma\vec{b}\times(\vec{a}\times\vec{b})\\ &=-\alpha\vec{a}\times\vec{b}+\gamma[(\vec{b}\cdot\vec{b})\vec{a}-(\vec{b}\cdot\vec{a})\vec{b}]\\ &=\gamma\vec{a}-\gamma(\vec{a}\cdot\vec{b})\vec{b}-\alpha\vec{a}\times\vec{b} \end{align*}
$$2(\vec{a}\times\vec{b})+\vec{c}=\alpha\vec{a}+\beta\vec{b}+(\gamma+2)\vec{a}\times\vec{b}$$
Therefore, $\gamma=\alpha$, $-\gamma(\vec{a}\cdot\vec{b})=\beta$ and $-\alpha=\gamma+2$.
Solving, $\alpha=\gamma=-1$ and $\beta=\vec{a}\cdot\vec{b}$.
So, $\vec{c}=-\vec{a}+(\vec{a}\cdot\vec{b})\vec{b}-\vec{a}\times\vec{b}$.
\begin{align*} \vec{c}\cdot\vec{c}&=\vec{a}\cdot\vec{a}+(\vec{a}\cdot\vec{b})^2(\vec{b}\cdot\vec{b})+(\vec{a}\times\vec{b})\cdot(\vec{a}\times\vec{b})-2(\vec{a}\cdot\vec{b})(\vec{a}\cdot\vec{b})\\ |\vec{c}|^2&=1-(\vec{a}\cdot\vec{b})^2+|\vec{a}\times\vec{b}|^2\\ &=2|\vec{a}\times\vec{b}|^2 \end{align*}
and its greatest value is $2$.
The greatest value of $|(\vec{a}\times\vec{c})\cdot\vec{b}|$ is $1$.