Given four points in the plane, there exists a one-dimensional family of conics through these, often called a pencil of conics. The locus of the centers of symmetry for all of these conics is again a conic. What's the most elegant way of computing it?
I know I could choose five arbitrary elements from the pencil, compute their centers and then take the conic defined by these. I can also do so on a symbolic level, to obtain a general formula. But that formula is at the coordinate level, and my CAS is still struggeling with the size of the polynomials involved here. There has to be a better way.
Bonus points if you know a name for this conic. Or – as the center is the pole of the line at infinity – a name for the more general locus of the pole of an arbitrary line with respect to a given pencil of conics.

While there were many good answers here, I feel that two comments were even more useful to me, so I'll combine them to a CW answer.
@JeanMarie quoted Wikipedia:
So this gives a name to the conic I described. It also characterizes it as a conic passing through the centers of the sides as well as through the points of intersections of opposite sides.
The former of these properties is something @achille hui deduced from my specification of the conic:
So yes, taking the midpoint for every pair of points, dropping one of these and then constructing the conic through the other five is an elegant approach.
It is not perfect in terms of simplicity of the resulting formulation, though. Labeling the points $A,B,C,D$ and taking all pairwise midpoints except for $\frac12(C+D)$ (or rather $D_z\cdot C + C_z\cdot D$ in homogeneous coordinates), I found the following removable common factor in a homogeneous formulation of this construction:
$$A_z^3\cdot B_z^3\cdot C_z\cdot D_z\cdot\begin{vmatrix} A_zB_x-B_zA_x & C_zD_x-D_zC_x \\ A_zB_y-B_zA_y & C_zD_y-D_zC_y \end{vmatrix}$$
The first four factors indicate that the construction outlined above has a removable singularity (resulting in a null matrix instead of some conic) if one of the defining points is at infinity. This should not be a problem in non-projective scenarios where all inputs are guaranteed to be finite. It's also not surprising as the midpoint of a segment with one endpoint at infinity will be said point at infinity, so three of the six pairwise midpoints will be identical.
The last term, the determinant, characterizes a situation where the line $AB$ and the line $CD$ are parallel. In that case, four of the five defining points would lie on the parallel halfway between $AB$ and $CD$, and the remaining midpoint of $AB$ is not enough to define the second line of this degenerate conic. So be sure that the midpoint you omit corresponds to a line which is not parallel to its counterpart.
My other answer discusses a formulation which avoids these removable singularities.