Is it possible for a function(f) to be $O(f)$ but not $o(f)$? or $o(f)$ but not $O(f)$?
I guess it might be possible for a function that is not monotonically increasing.
Is there an example of this case?
Added: Is it correct if I say subtracting $\theta(f)$ from $O(f)$ equals $o(f)$?
Certainly: the function $f(x)=x$ is such a function. In fact $f$ is always $O(f)$ and never $o(f)$ (when these both make sense).
Added: As Did points out in the comments, I am assuming here that $f$ is not identically $0$ in a neighborhood of the target; in particular, if we’re looking at the behavior of $f$ as $x\to\infty$, I’m assuming that $f$ is not eventually $0$.