My (naïve) idea of symmetry is that it requires some form of invariance under transformation, but I struggle to see how this survives the idea of the symmetric group $ S_n$.
Beyond the bijective property what, if anything, is invariant in a permutation? And if the answer is nothing, what separates a permutation from, say, the rotation of an equilateral triangle through an arbitrary angle?
For an equilateral triangle you can exchange any two points and it will still look the same. You could do the same thing with a tetrahedron, but you need 4 dimensions.
With a square (4 points, 4 sides) it looks different if you swap two adjacent corners without also swapping the opposite corners. However if you also had the diagonals drawn for the square, then you could, as the points and all the connections would stll look the same.
The groups of symmetries generalise this.
Imagine a number of points arranged equally spaced around a circle. Suppose there are lines joining every pair of points. If you swap any two points (moving the lines appropriately) it will still look the same.
You actually don't need any particular arrangement, but the circle may make it a little easier to visualise.
It is the collection of points that remains invariant. If you rotate a triangle through an arbitrary angle the vertices will probably not occupy the same 3 places.