I have three vectors in 3d that originate at a point. If I look at them along a line perpendicular to a plane that intersects two of them, how do I find the angles between those two vectors and the third one?
Clarification because this is frickin difficult to explain:
I'll also accept a way to find how much of the longest line is on either side of the shorter line, because that's ultimately what I need.

Hi the dot product (1) is a great way to do that
here is a random video
it seems I need to develop here a bit further sorry about the links I just wanna help^^
lets $\vec{OA}=\vec{A},\vec{OB}=\vec{B},\vec{OC}=\vec{C}$ be three vectors in 3D.
In the special case where $\vec{A}$ is perpendicular to $\vec{B}$ you can project $\vec{C}$ into the plane define by the two vectors $\vec{A}$ and $\vec{B}$ as the following sum
"the projection of $\vec{C}$ on $\vec{A}$" + "the projection of $\vec{C}$ on $\vec{B}$"
so $\vec{C_{proj}} =(\frac{\vec{C}\cdotp\vec{A}}{\vec{A}\cdotp\vec{A}}\vec{A}+\frac{\vec{C}\cdotp\vec{B}}{\vec{B}\cdotp\vec{B}}\vec{B}) $
next you can find the angle between $\vec{C_{proj}}$ and $\vec{A}$ with the formule from the dot product:
$\theta=\arccos (\frac{\vec{C_{proj}}\cdotp\vec{A}}{\|\vec{C_{proj}}\|\|\vec{A}\|})$
EDITED for the case where $\vec{A}$ is not perpendicular to $\vec{B}$
the general case: $\vec{C_{proj}} = \vec{C}-\frac{\vec{C}\cdotp(\vec{A}\times\vec{B})}{(\vec{A}\times\vec{B})\cdotp(\vec{A}\times\vec{B})}(\vec{A}\times\vec{B})$
note:
$(\vec{A}\times\vec{B})$ is call the cross product of $\vec{A}$ and $\vec{B}$
$(\vec{A}\cdotp\vec{B})$ is call the dot product of $\vec{A}$ and $\vec{B}$
ps: don't forget there is always two possibles answers for the angle between two vectors $\theta$ and $(360-\theta)$ and think about rad or degrees
ANOTHER SOLUTION:
using @amd resoning you can find another formula for your end goal:
Let $\vec{N}=(\vec{A}\times\vec{B})\times\vec{C}$
then $\frac{\vec{A}\cdotp\vec{N}}{\vec{A}\cdotp\vec{N}+\vec{B}\cdotp\vec{N}}\|\vec{A}-\vec{B}\|$ and $\frac{\vec{B}\cdotp\vec{N}}{\vec{A}\cdotp\vec{N}+\vec{B}\cdotp\vec{N}}\|\vec{A}-\vec{B}\|$ are how much of the longest line is on either side of the shorter line.
you can interpret "the direction of $\vec{C_{proj}}$" as "the vertical black vector", $\vec{N}$ as X , the fraction in front as the ratio between one of the rectangle(green or red) divide by both combine while $\|\vec{A}-\vec{B}\|$ is the lenght of the "longest line" as you call it.
cheers