Can someone please verify if my proof is correct, and add to it if it isn't?
Since we're given that $B$ is countable, we know $B$ is either finite or has the same cardinality as, say, the set $\mathbb{Q}$. So $\vert B \vert = \aleph_0$.
Similarly, if $A$ is infinite, then we know the result $\aleph_0 \leq \vert A \vert$.
This implies that $ \vert B \vert \leq \vert A \vert$.
Then $\vert A \cup B \vert = \vert A \vert$.
Am I missing something here?
You are missing something, yes. You only wrote down the following relations:
There is nothing here for you to conclude that $|A\cup B|=|A|$. For that, you would have to prove that $|A|\leq |A\cup B|$ (this should be easy) and that $|A\cup B|\leq |A|$ (this one should prove a little harder, as you need a surjection from $A$ to $A\cup B$ to prove this inequality).