I found my kid more interested in shapes than numbers, adding 14 and 7 to get 21 is boring, while triangle, rectangle and heart shape is fun.
But what could I introduce, besides the basic shapes, e.g. triangle, rectangle, parallelogram, diamond, circle, line, and angle?
I couldn't really go on to Elements; that will kill the interest. Any suggestion on how to keep the introduction basic and fun and still encourage some thinking?
I've assisted in teaching kids aged 10–14 mathematical art, and found a lot of success with the following project:
Invent a polyhedron and try to make it! Basically, take construction paper, and have them use straightedge and compass to make shapes and subsequently cut them out. The most "appealing" are regular shapes. Since your child is 4, you should probably cut the shapes for them.
Here were some especially nice moments:
One student tries to make a vertex with $6$ equilateral triangles and asks me why it wasn't working.
Multiple students worked on constructing pentagons, which was a bit of a challenge (for me too!)
Some students finished early and started coloring their polyhedra, with $4$ or $5$ colors. Of course I bothered them by asking if they could have done it with fewer.
Some students couldn't "See" the shape, so we would use projections to form planar graphs, or use "nets" to help. This was often a bit of a brain cramp but a lot of fun.
here is a blog post chronicling a collection of activities we did (some were more advanced than others: triangle inequalities, pythagorean theorem, finding a way to approximate pi with arbitrary precision etc.) that might have some nice ideas for you!