I know $d/dx$ means derivative with respect to x (perhaps I am a little unclear on what precisely that means - I'm not quite sure - but I do think I have at least some sense of its meaning). I know (I think!) that... $$\frac{d}{dx} f(x)=f'(x)$$ Here is my question (it's been bugging me incessantly for the last couple weeks): What does $f'(x)$ mean? Does it mean the derivative of $f$ with respect to x? Or, rather, does it mean the derivative of $f$ with respect to x, evaluated at the point x? Or something totally different?
To make my question more clear, let me ask this too: What does $f'(a)$ mean? Does it mean the derivative with respect to $a$? Or the derivative with respect to $x$ evaluated at some point $a$? (so that the "with respect to x" is actually "encoded" in the $f'$ part of the notation!). Etc. Even worse, take $f'(ax)$, which appears in some derivative computation rules. Does that mean derivative with respect to $ax$??
I suspect this confusion may be somewhat related to the maddeningly persistent confusion -- both for me and virtually everyone else -- between a function and its value at a point. Also, teachers tend to use somewhat imprecise notation and language, so I, being someone who likes precision, can sometimes get confused.
While I'm at it, I'll note that this confusion may be related to my additional confusion over language like "the derivative of the sum of two functions," where the two "functions" are, say, $x^2$ and $x^3$. But I thought those were mere polynomials, not functions. One might say $f(x)=x^2$, but one would never say the function itself, $f$, was equal to $x^2$, right? I'm confused. We shouldn't say things like "the function $x^2$," right? :(
I'm going to steer clear of high level definitions for functions and instead give you a more intuitive sense for what this notation means. Later on, if you stick with mathematics, you will be exposed to more accurate and rigorous definitions for functions as "mappings" between sets that have special characteristics.
It seems like part of your confusion stems from a lack of understanding as to what a function is. It's helpful to think of a function as some operation that's being defined, and we typically give that operation a name like $f$ or $g$. The notation $f(x) = x^2$ simply means "there exists an operation, called $f$, performed on the variable $x$, and that operation is performed by taking the square of $x$." Another example is $g(x)=2x^3+4$. This is simply notation that means "there exists an operation, called $g$, performed on the variable $x$, and that operation is $2x^3+4$." You are correct in saying $x^2$ and $2x^3+4$ are polynomials. In the notation just used, they are more generally being referred to as operations with specific names, $f$ and $g$, respectively. Any given mathematical expression is not either a function or a polynomial; it can be both.
Now, as for derivatives... the notation $f'(x) = x +4$ simply means "there exists an operation, called $f'$, performed on the variable $x$, and that operation is $x+4$." Now, the addition of the prime symbol $'$ after the $f$ is the convention that is used to let you know that this particular function, or "operation," is actually the derivative of another function, that function being $f$. So in short we say $f'(x)$ is "the derivative of $f$ with respect to $x$."
You also seem to be confused by the phrase "with respect to $x$." Remember that $x$ is simply a variable. It represents some arbitrary number in the domain, but it is NOT any particular number in the domain. So $f'(x)$ meaning "the derivative of $f$ with respect to $x$" is another way of saying "the derivative of $f$ taken at some arbitrary number in the domain of $f$." It is difficult to tell you what $f'(a)$ means without any context, but this is most likely the author or your teacher using the letter $a$ to represent a particular number in the domain of $f$ as opposed to any arbitrary number in the domain of $f$. In other words, $f'(a)$ is "the derivative of $f$ where $x=a$." Some people may still use the words "the derivative of $f$ with respect to $a$," but what they mean is "the derivative of $f$ where $x=a$." As you mentioned already, you could also interpret this as "the derivative of $f$ at the point where $x=a$." All of these are different ways of saying the same essential thing.
If you see $f'(ax)$, this means that the input to the function $f$ is some arbitrary number $x$ multiplied by some particular number $a$.
The notation $\frac{d}{dx}f(x)$ is just another way expressing $f'(x)$. They represent and mean the exact same thing; the reason they are both used is part tradition and part utility. Calculus was developed independently by Newton and Leibniz long ago, and they each developed their own notation that remains in use today, albeit with some changes along the way. Sometimes $f'(x)$ is preferred because it is more compact; at other times $\frac{d}{dx}$ is preferred because it clearly demonstrates that a derivative is the ratio of two infinitesimal quantities, which in some proofs or applications is quite useful.