Definition of Statistical Model

90 Views Asked by At

From Wikipedia:

"...a statistical model is usually thought of as a pair $\mathcal{(S,P)}$, where $\mathcal{S}$ is the set of possible observations, i.e. the sample space, and $\mathcal{P}$ is a set of probability distributions on $\mathcal{S}$.

The intuition behind this definition is as follows. It is assumed that there is a "true" probability distribution induced by the process that generates the observed data. We choose $\mathcal{P}$ to represent a set (of distributions) which contains a distribution that adequately approximates the true distribution."

I would like to have som clarity in regard to what is meant by process in this context. The observable data is generated as a result of reality/our world so does process refer to reality/our world in its entirety? Because reality/our world is after all what generates the observable data.

Or, does it refer to any process in reality/our world which generates the observable data. If this is the case then I struggle with the fact that this definition says "process" in singular as if there is only one process in reality/our world that generates the observable data. If a process is an abstract human made description of some aspect of reality/our world which generates observable data, then isn't it possible to imagine an infinite number of possible processes all of which on their own can describe the observable data? All those processes could still induce the same "true" probability distribution that generates the observed data, but every process could represent some specific aspects of reality/our world. Right??