A basic definition question:
"the Klein four group V is the simplest group that is not cyclic."
Does this simply mean you need two (non-identity) elements of the group to generate the entire group? (as opposed to only one element?)
Also, why is the distinction of cyclic vs non-cyclic important?
Groups of order $2$ and $3$ are cyclic. So the first possibility of having a non-cyclic group could be for order $4$ and Klein-4 happens to be one.
A non-cyclic group simply means it CANNOT be generated by just one element. In case of the Klein-4 group ($\cong \mathbb{Z}_2 \times \mathbb{Z}_2$), it can be generated by two elements ($(1,0), (0,1)$). However in general it doesn't mean that two elements will generate a non-cyclic group. For example take $(\mathbb{R},+)$, it is non-cyclic and cannot be generated by two elements (can you see why?).
The reason cyclic groups are sought after is because of their simplicity. Only one element (the generator) can tell you pretty much everything about the group.