I feel like different sources use the term "rank" differently, which is perhaps leading to my confusion.
When I think of rank I think of number of linearly independent columns/rows, number of pivots in RREF, etc... So a vector always has a rank of 1. A $n \times m$ matrix has $rank \leq min(m,n)$.
For tensors, I have always been under the impression that: a scalar is a 0-th order tensor; a vector is a 1st order tensor; a matrix is a 2nd order tensor.
When reading this https://www.sandia.gov/~tgkolda/pubs/pubfiles/TensorReview.pdf, I came across the term "rank-one tensor." See page 463 (page number is located on top right), in the sentence below Fig. 3.1, it states "The CP decomposition factorizes a tensor into a sum of component rank-one tensors." In this context, is rank-one tensor just a vector? That's what it seems like from studying Eq. (3.1). Does the term "rank" here have anything to do with the number of linearly independent columns or is it just describing the order of the tensor, i.e., the number of dimensions of the tensor? For example, a rank-2 tensor would then be a matrix and a rank-0 tensor would be a scalar?