Given a monoidal category $\mathcal{V}$, is there a categorical characterisation of an object in $\mathcal{V}$ such that it is a group if $\mathcal{V} = Set$ and a field if $\mathcal{V} = Ab$? Or does anybody know of useful references? This would be much appreciated!
Ofcourse I do not expect it by simple means of extra data as groups cannot be descriped operadically, but rather by universal properties or something similar.
EDIT: As noted in the comments: I am looking for something different than group objects, as they do not encompass fields. So I am looking for some categorical framework in which both can fit.
As far as I know there is no such characterization. Groups are, of course, the group objects in $\text{Set}$; to my mind the cleanest way to characterize fields is that they are the simple objects in the category of commutative rings (the ones with no nontrivial quotient objects, where by "quotient object" I mean "effective epimorphism.")
Groups and fields are just not actually that analogous. Fields are required to be commutative and inverses are only defined for nonzero elements, so they aren't actually "algebraic." And there's no way to talk about group objects in a monoidal category that isn't cartesian; the closest you get is talking about Hopf algebras, which are very different from fields.