Let $R$ be a commutative domain and suppose that $I \subseteq R$ is an ideal of $R$ maximal with respect to the property that $I^{-1} \not\subseteq R$. Show that $I$ is a prime ideal.
This is deemed a harder homework question by my instructor. Some of my thoughts are as below.
Notationally, if $J$ is an ideal of $R$ and $K$ is the field of fractions for $R$, then $$J^{-1} = \{k \in K \mid kJ \subset R \}$$
Begining of possible proof:
Take $r,s$ in $R$. Suppose that that their product $rs$ is in $I$, but that $r$ is not in $I$. Then we have that the following ideal of $R$ properly contains $I$: $$\langle r \rangle + I$$ where $ \langle r \rangle$ is the ideal generated by $r$ in $R$. We know $$I \subsetneq (\langle r \rangle + I) \subseteq R.$$
Note that clearly $\langle r \rangle^{-1} = \left\{\dfrac{z}{r}\mid z \in R\right\}$.
If $r = 1_R$, then $\langle r \rangle^{-1} = \langle r \rangle = R$. Otherwise, $\langle r \rangle^{-1} \not\subseteq R$. It should be relatively evident that $(\langle r \rangle + I)^{-1} = \langle r \rangle^{-1} \cap I^{-1}$. This can be thought of by considering that the only things that will invert both $\langle r \rangle$ and $I$ will lie in the intersection of the two ideal inverses.
I perhaps want to use this to somehow show that $(\langle r \rangle + I)^{-1} \not\subseteq R$, which by maximality would imply that $(\langle r \rangle + I) = R$. This would allow me to write $(rx) + a = 1$ for $rx \in \langle r \rangle, a \in I$.
Then $s(rx) + sa =(sr)x + sa= s$. We know that $sr \in I$, so $(sr)x \in I$. Also, by absorption, $sa$ is in $I$. So $s$ must be in $I$ and we are done.
The one thing I cannot see how to show is that $(\langle r \rangle + I) = R$. Any thoughts?
Picking $I \subseteq R$ to be maximal with respect to this condition, you would then have that for $0\neq r\in R-I$, $I\subsetneq (r)+I$. Thus we must have $((r)+I)^{-1}\subseteq R$. So what you're trying to show is a contradiction to the very condition you are starting with.
Instead, consider that $((r)+I)^{-1}=R$. This means that the set $\{\dfrac{z}{r}\vert z\in R-(r)\}\bigcap I^{-1}=\emptyset$. But we're assuming that $rs\in I$ and $\exists k\in I^{-1}-R$; now all such $k$ have the property that $krs\in R$, so in particular, any "denominator" in $k$ must be cleared out by $rs$. But it can't be cleared out by r.
Edit
I guess what I was trying to say was that the proof runs cleaner without shooting for that contradiction. Let $I\subsetneq R$ be maximal with respect to this condition, and suppose we have $r,s\in R$ such that $rs\in I$ and $r\notin I$. Then $((r)+I)$ is an ideal of $R$ and $I\subsetneq ((r)+I)$, whence by maximality we have $((r)+I)^{-1}=R$. Now, as noted above $((r)+I)^{-1}=(r)^{-1}\bigcap I^{-1}=\{\dfrac{z}{r}\vert z\in R\}\bigcap \{k\in K\vert kI\subseteq R\}$.
Picking $k\in I^{-1}-R$ by the above we see that $kr\notin R$ and $krs\in R$. Thus $kr=\frac{z}{s}$ for some $z\in R-(s)$. Then $((s)+ I)^{-1}\not\subseteq R$. Now as $I$ is maximal with respect to $I^{-1}\not\subseteq R$, and $I\subseteq ((s)+I)$, we must have equality, whence $s\in I$, so I is prime.