If $n$ is a Carmichael number, then for all values $a$ such that $0<a<n$ (and $a \perp n$):
$a^{n-1} \equiv 1 \mod n$
However, is it not necessary to check check all $a$ values because for a given $a$ value, and $j$ such that:
$0<j< n$,
$a^{j(p-1)} \equiv 1 \mod n$,
$(a^j)^{p-1} \equiv 1 \mod n$.
Therefore all values generated by $a^j \mod n$ also pass the test.
We also know that if
$(a)^{p-1} \equiv 1 \mod n$,
$(a')^{p-1} \equiv 1 \mod n$,
$(aa')^{p-1} \equiv 1 \mod n$.
Therefore checking values such that $a$ is prime is only necessary.
My question is what is the smallest value $b$ (generically) such that performing all tests $1 \le a \le b$ guarantees that all values $0 < a < n$ also pass the test (thus verifying that $n$ is a Carmichael Number).
Actually your definition was slightly off: (now corrected)
If $n$ is a Carmichael number, then for all values $a$ coprime to $n$ such that $0<a<n$:
$a^{n-1} \equiv 1 \mod n$
(However it is true for Carmichael numbers that for all values $a$, $a^{n} \equiv a \mod n$ )
So for sure you could detect - with this test - that a Carmichael number is composite by getting to the first prime factor $p_1 < \sqrt[3] n$ (since Carmichael numbers have at least three distinct prime factors) and you only need to test primes on the way.
There are more efficient ways to detect composite numbers of course, Miller-Rabin as an example that builds on the Fermat concept.