Let $\mathcal{F}$ be a sheaf on a topological space $X$. An open cover $\mathcal{U} = \{U_i\}_{i\in I}$ of $X$ is called acyclic for $\mathcal{F}$ if for all $i_0, \dots, i_p \in I$, $H^q(U_{i_0}\cap\dots\cap U_{i_q}, \mathcal{F}) = 0$ for every $q \geq 1$. Not every sheaf admits an acyclic cover as is shown here.
Let $X$ be a complex manifold and consider the sheaf $\mathcal{O}$ of holomorphic functions on $X$. Does $X$ always admit an open cover which is acyclic for $\mathcal{O}$? What about for the sheaf $\mathcal{O}^*$ of nowhere zero holomorphic functions on $X$?
If $X$ is a complex space, not necessarily a manifold nor even reduced, any cover $\mathcal U=(U_i)_{i\in I}$ by open subsets $U$ which are Stein is acyclic for any coherent sheaf.
Indeed any finite intersection $U=U_1\cap\dots\cap U_n $ of sets $U\in \mathcal U$ is Stein : this is trivial if you define "Stein" as holomorphically convex and holomorphically separable.
But is it legitimate to define "Stein" that way?
Sure! That's what the brothers Ludger and Burchard Kaup do in their extremely pedagogical book Holomorphic functions of Several Variables
One may say that the basic theory of Stein spaces consists of proving (in about 100 pages!) the equivalence of several definitions of Stein spaces, in particular the one that says that a Stein space is a complex space for which theorem B holds!
Reminders/complements
1) A complex space $Y$ is said to be holomorphically convex if, given a compact subset $K\subset Y$, its holomorphic hull $h(K)$ is also compact.
That hull is defined as the set of $y\in Y$ such that for all $f\in \mathcal O(Y)$ we have $\mid f(y)\mid\leq \sup_{k\in K} \mid f(k)\mid$
A (non-trivially!) equivalent definition of holomorphically convex is:
Given a discrete closed subset $D\subset Y$, there exists a holomorphic function $h\in \mathcal O(Y)$ such that $\sup_{d\in D} \mid h(d)\mid=\infty$.
2) A complex space $Y$ is said to be holomorphically separable if, given $y\neq y'\in Y$, there exists $g \in \mathcal O(Y)$ with $g(y)\neq g(y')$ .
3) Very roughly one might divide complex analysis into two parts:
$\bullet$ The kingdom of partial differential equations with its emphasis on plurisubharmonicity, pseudoconvexity, $L^2$-estimates, $\bar {\partial}$-operator, $\dots$ The basic book here is Hörmander's.
$\bullet \bullet$ The kingdom of geometry and algebra with its emphasis on sheaves, homological and commutative algebra, non-reduced spaces, algebraic topology, $\dots$
The Kaups's book and the above answer are written in the spirit of this second point of view (I used holomorphic convexity instead of pseudoconvexity) , which is more adapted to the study of the general non reduced complex spaces introduced by Grauert under the influence of Grothendieck.
The definitive reference on Stein spaces written by Grauert-Remmert, the masters themselves, Theory of Stein spaces doesn't even mention plurisubharmonicity and pseudoconvexity (although, needless to say, these are extremely useful tools in many contexts).
4) How do I know this? Because in my youth I betrayed the first Kingdom for the second and then I betrayed the second for the Scheming Empire of Algebraic Geometry...