I'm messing around with doing a visualization that has nothing to do with the primes and in order to execute it correctly I need an ordered list of all point in the order that the Ulam Spiral crosses them. I've tried some of my work but have only run in to abundantly complicated paths to solution. Also is there a name for looking for pattern that generally occur in spiral, whether they are related to primes or not?
E.g.: Starting with this image:
if $1$ is at the origin, then the list would be as follows: $$(0,0),(1,0),(1,1),(0,1),(-1,1),(-1,0),(-1,-1),(0,-1),(1,-1),(2,-1),(2,0),...$$

You are lucky because it seems that a very similar pair of sequences is already at OEIS.
The $x$-coordinates are sequence A174344 ("List of $x$-coordinates of point moving in clockwise spiral") and $y$-coordinates ("List of $y$-coordinates of point moving in clockwise spiral") are sequence A268038.
List of $x$-coordinates of point moving in clockwise spiral.
List of $y$-coordinates of point moving in clockwise spiral.
In the referred OEIS pages there are formulas to calculate each sequence of coordinates.