I guess a lot of people with previous exposure to differential geometry have had this naive question pop out in their mind when studying schemes for the first time.
The category of compact smooth real manifolds is contra-equivalent to the category of smooth rings on them $C^{\infty} (-)$. The inverse functor to the global section functor takes maximal ideals and makes sheafs out of the smooth rings. By a partion of unity argument the ring of global sections determines the sheaf so wer'e good. (At least, I hope we are. It's not something I found written explicitly in any book).
On the other hand, the famous result for schemes gives the equivalence $\mathsf {Aff} \cong (\mathsf{Ring})^{op}$. This suggests that the correct and uniform way to think about rings geometrically is studying the functor $Spec$.
There are many reasons for why studying $\operatorname{Spec}C^{\infty}(M)$ Is not so fruitfull. Elaboration on this in answers would be welcome as well, though my question is a more philosophical one.
Question: Given what we know about the unsuitability of scheme theory for the study of smooth rings why should we believe that it's the right generalization for algebraic geometry over arbitrary rings?
Personally, (and I hope It's okay to express my opinion despite my ignonrance) I think this is a good argument for studying general locally ringed spaces (Of which schemes are a part of but not at the center necessarily)... What do you think?
It might pay to be even more naive: given some category $\mathcal{C}$ of with some algebraic structure, define the category of affine $\mathcal{C}$-schemes to be $\mathcal{C}^{op}$.
For example, there is a well-known paper of Toën and Vaquié in which they let $\mathcal{C}$ be the category of commutative monoids over a symmetric monoidal category $\mathcal{A}$, e.g. if $\mathcal{A}$ is the category of abelian groups with tensor products, then $\mathcal{C}$ is the category of commutative rings.
I don't have a reference offhand, but I believe that other authors have successfully modified this construction for analytic-type objects. Whether or not this can be directly extended to smooth manifolds (I believe it can), this should provide some philosophical motivation.
In any case, there are many tools available, notably the "functor of points" approach, that allow us to do geometry by "gluing" elements of $\mathcal{C}^{op}$ in a suitable Grothendieck topology. Then the question becomes: how do we know that this approach should have anything to do with topological spaces?
One way is to note that the notion of "point" can be recovered categorically. We will say that an object $P$ in our category of affine schemes is a point if every morphism $P\to X$, where $X$ is not the initial object, is a monomorphism. A point of an object $X$ is a morphism $P\to X$ for some point $P$.
One nice result is that, if $\mathcal{C}$ is the category of commutative rings, then a ring $K$ is a field if and only if it is a point in $\mathcal{C}^{op}$. So there is an immediate connection between morphisms $R\to K$, for $K$ a field, and points of $\operatorname{Spec} R$. Up to a suitable equivalence (required to guarantee that the collection of points is a set!), a morphism from $R$ to a field is exactly a prime ideal of $R$.
One more brief note: Suppose that we do something like this for two categories $\mathcal{C}'\subset \mathcal{C}$, and suppose that we apply the wrong spectrum functor, i.e. we take an object of $\mathcal{C}'$ and consider the associated affine scheme in $\mathcal{C}^{op}$. In general, it may have too many points, because there are objects outside of $\mathcal{C}'$ that become points, or it may not have enough points, because an object of $\mathcal{C}'$ might become a point in one category and not the other. So it should somehow not be too surprising that $\operatorname{Spec}C^{\infty} (M)$ has all the "right" points, coming from morphisms $C^{\infty} (M) \to\mathbb{R}$, and lots of "wrong" points, coming from morphisms $C^{\infty} (M) \to K$, where $K$ is a transcendental extension of $\mathbb{R}$ that has nothing to do with analysis.