Let $a, b$ and $c$ be the $7$th, $11$th and $13$th terms respectively of a non-constant AP. If these are also the three consecutive terms of a GP, then $\cfrac{a}{c}$ is equal to:
APPROACH:
$a = A+6d = a\ \ \ $ ; $ \ \ \ b = A+10d = ar \ \ \ $ ; $\ \ \ c = A+12d = ar^2$
Where: $A$ is the first term of the AP, $ \ \ d$ is the common difference of the AP, and $ \ \ r$ is the common ratio of the GP.
$\cfrac {c}{a}= \dfrac {1}{r^2}$
Also,
$$(A+6d)r = (A+10d) \implies Ar+6rd = A+10d $$
$$\implies \cfrac{A}{d} = \cfrac{6r-10}{r-1}$$
Now, we know that:
$$(A+10d)^2 = (A+6d)(A+12d)$$
$$[k(6r-10)+ 10k(r-1)]^2 = [k(6r-10)+6k(r-1)] \ \cdot \ [k(6r-10)+12k(r-1)]$$
where $k$ is the proportionality constant.
$k$ gets cancelled leaving us with the following:
$$(16r - 20)^2 = (12r-16)(18r-22)$$
on solving further, I got:
$$ 5r^2 - 11r +6 = 0$$
Which gives $r = \cfrac{6}{5}$ or $5$.
so, $\cfrac{1}{r^2} = \cfrac{25}{36}$ or $\cfrac{1}{25}$.
Unfortunately, this isn't the answer. I do not see any flaw in my reasoning. Please help me with my mistake and suggestions of better methods would be most appreciated.
The value of $\frac Ad$ you have obtained is incorrect. $$\frac Ad=\frac {10-6r}{r-1}$$ is the correct value. Hence the following work becomes incorrect too. $$[k(10-6r)+10k(r-1)]^2=[k(10-6r)+6k(r-1)][k(10-6r)+12k(r-1)]$$ So that $$ 16r^2=4(6r-2)$$ $$ 2r^2=3r-1$$ $$ 2r^2-3r+1=0$$ $$ (2r-1)(r-1)=0$$ So either $\frac ac=1$, or $4$, but $r=1$ will not be considered, as AP is non-constant.