A central automorphism is an automorphism $\theta$ for which $x^{-1}\theta(x)\in Z(G)$ for each $x\in G$.
It's not difficult to prove that the set of central automorphisms forms a subgroup of $\operatorname{Aut}(G)$ which I've seen written $\operatorname{Aut}_c(G)$.
Why are central automorphisms studied? What are they used for? Are they important conceptually, and if so, what is the intuition behind them? Is there anything special about how they work when $G$ is finite, nilpotent, or of prime order?
See, e.g.,
Bunina, E.I. Automorphisms of Chevalley groups of type $B_l$ over local rings with $1/2$. J. Math. Sci., New York 169, No. 5, 557-588 (2010); translation from Fundam. Prikl. Mat. 15, No. 7, 3-46 (2009).
Summary from Zentralblatt: We prove that every automorphism of a Chevalley group of type $B_l$, $l\ge 2$, over a commutative local ring with $1/2$ is standard, i.e., it is a composition of ring, inner, and central automorphisms.