So I am working with a first order ODE: $$\frac{dy}{dx}= y\cos^2(x)$$
We are told to draw by hand three separate solution curves for each initial value points: $y(0)=0, y(0)=\frac{1}{2}, y(0)=-\frac{1}{2}.$
I already have the general solution. Am I supposed to solve for $C$ with each of the initial values? I am confused by the idea of the solution curve. I mean the line $y=0$ passes through the singular point $y(0)=0,$ but is that a solution curve? Couldn't you construct an infinite number of lines to pass through any initial value? I am very lost. $x=0$ passes through $y(0)=\frac{1}{2}$. Please help.

I can think of two ways to solve this. One would be to draw the slope field for this ODE. That would essentially tell you how to draw any solution curve. The other method is exactly what you described: for each initial condition, find the arbitrary constant and plot up the solution. The equation is linear, and there are existence and uniqueness theorems for linear equations, so no, you can't have infinitely many solutions going through an initial value.
So, for one example. You say you have the general solution - that's great. I'll just re-derive it here for completeness. \begin{align*} \frac{dy}{dx}&=y\cos^2(x)\\ \int\frac{dy}{y}&=\int\cos^2(x)\,dx \\ \ln|y|&=\frac{x}{2}+\frac{1}{4}\,\sin (2 x)+C \\ y&=C\exp\left(\frac{x}{2}+\frac{1}{4}\,\sin (2 x)\right). \end{align*} If we take the $y(0)=1/2$ initial condition, we find that \begin{align*} \frac12&=C\\ y&=\frac12\,\exp\left(\frac{x}{2}+\frac{1}{4}\,\sin (2 x)\right). \end{align*} Then you can plot that on an interval containing $x=0.$