Vectors are defined as having magnitude and direction. If I understand it correctly, their magnitude is their length, meaning they have the properties of a line segment. What does it mean for a vector to have a direction? Let me be more specific:
Let $\vec v=\begin{bmatrix}2\\3\end{bmatrix}$
The angle of this vector is $\arctan(\frac y x)=\arctan(\frac3 2)$ from the positive $x$ axis and we know that the direction of this vector is "pointing to the upper right". What does this mean geometrically? What defines direction for a vector? (I am new to the topic so go easy on me.)
That is the correct definition in physics. If you incorporate the correct definition of a vector in maths, you can easily understand the "direction" concept alternatively.
In physics the direction associated with a vector means you first fix a coordinate system and see in which direction the effect of the vector is as a whole. For example take velocity v.
So say $v=a\hat{i}$. This means that the velocity is entirely in the direction of x axis of your chosen coordinate system. That effect of a vector is 0 in the direction perpendicular to the direction in which it's effect is as a whole. Now you could represent the same vector for velocity in another basis. But logically changing basis should not change the vector ( the velocity of any object has to be in the same direction in which ever coordinate system you represent it). So in the new coordinate system the entire effect of the vector ( v here) would still be in the x direction ( of your previous coordinate system) with the only change that you are representing your vector in a different coordinate system.
Mathematically a vector is an element of a vector space and there are vectors with which you cannot associate any sense direction. Like a wavefunction is a vector but you cannot define a direction with it. A matrix is a vector but you cannot associate a direction with it in the normal sense.
I should mention that only in our 3 dimensional space or Euclidean space can we sensibly denote a sense of direction to a vector and not generally in other spaces. Because our sense of direction itself doesn't exist for other spaces. You will need to first define what a direction means in a vector space and only then can a vector in that space be given a sense of direction. That direction might be completely different in sense than the directions we are used to understand in our world. So you see how algebra helps us do things in higher dimensions where geometry couldn't.
I hope that helped