Let $M$ be a matroid and $I\in M$. For any $x\not\in I$, it is true that there exists $y\in I$ such that $(I\setminus\{y\})\cup \{x\}\in M$?
If $I\cup\{x\}\in M$, then we know any subset of it is also in $M$. What if $I\cup\{x\}$ is not an independent set?
As I stated in the comments, the answer is no. If $\{x\}$ is a circuit then $(I\setminus\{y\})\cup\{x\}$ contains a dependent set and hence is dependent itself.
In that case there exists a unique circuit $C\subseteq I\cup\{x\}$ such that $x\in C$. This is known as the Unique Circuit Property.
Proof: