In stochastic integration one considers integrals as $L^2(P)$ limits of simple functions w.r.t $dB_{t}(\omega)$ where $B$ is standard brownian motion.
It is not clear to me what kind of object this $ dB_{t}(\omega)$ is, it is certaintly not a measure in the usual sense. How should one think about this object? And is there a name for it in general?
This is not a measure in the usual sense, but in a probabilistic sense.
Specifically, let $\mathcal B_f(\mathbb{R})$ denote the family of Borel sets having finite Lebesgue measure.
Using it, you can define various objects like
Wiener process (Brownian motion) $B_t = B([0,t])$;
stochastic integral etc.
However, here are some important remarks.
In the Gaussian case, the independence is equivalent to orthogonality, and the almost sure convergence of a series with independent terms is equivalent (thanks to the Kolmogorov three series theorem) to the mean-square convergence. So any reference on measures with orthogonal increments will do.
Despite the $\sigma$-additivity is in almost-sure sense, the exceptional set depends on the particular sequence of sets. And there is no version of $B$ which is a signed measure for almost all $\omega$, so it is not possible to define the integral w.r.t. $B$ as that w.r.t. a signed measure; it can just be defined in the mean-square sense (you should know this already).