This is true if $A$ and $B$ are statements, but formulas are statements too, so I expect the answer to be yes. But let's consider this simple example:
Formula A: $$\sum_{k=0}^{n-1}x^k=\dfrac{1-x^n}{1-x}$$
Formula B: $$\sum_{k=0}^\infty x^k=\dfrac{1}{1-x},\,\,\,\, |x|<1$$
Proof that $A\to B$: Just take the limit $n\to \infty $ in $A$ assuming $|x|<1$.
Proof that $B\to A$: $$\sum_{k=0}^\infty x^k=\sum_{k=0}^{n-1}\sum_{m=0}^\infty x^{k+mn} = \sum_{k=0}^{n-1}x^k\cdot \sum_{m=0}^\infty x^{mn}$$ From this using $B$ we get $$\dfrac{1}{1-x}=\sum_{k=0}^{n-1}x^k\cdot \dfrac{1}{1-x^n},\,\,\,\, |x|<1 $$ So we get that $A$ is true if $|x|<1$. But the condition $|x|<1$ can be dropped because this is a polynomial relation, thus $A$ follows.
But clearly $A$ and $B$ are not equivalent. Am I missing something here?
This is a definitional issue. The two statements that you present both imply each other (as you correctly identify). Therefore, they are equivalent to one another. They may not seem equivalent because they are saying different things, but if one of the statements is true, then it is immediately true that the other holds. Therefore, if one of these two statements doesn’t hold, then it is necessarily the case that the other formula does not hold.
In everyday English, we use equivalent to mean things that are the same. Mathematically, two statements can be saying two very different things, but they may still be equivalent to each other, as long as they are both are implied by each other (as is the case here).