According to calculus - an intuitive and physical approach(2nd) my Morris Kline 177p,
$$\lim\limits_{r_1\to \infty} \frac {GM}{r_1}\tag{66}\label{66}$$ We should note that we do not substitute $\infty$ for $r_1$. As we have previously noted, $\infty$ is not a number.
As $r_1$ becomes larger and larger, the fraction in (66) must become smaller because the numerator is a constant. Moreover, because $r_1$ takes on values such as $10^6, 10^{12}, ...,$ the fraction becomes as small and smaller than any small quantity one may name. That is, the fraction must come closer and closer to $0$ in value as $r_1$ becomes infinite. Then $$\lim\limits_{r_1\to \infty} \frac {GM}{r_1} = 0$$
If $\infty$ is not a number then $\lim\limits_{r_1\to \infty} \frac {GM}{r_1} = 0$ should be written as $\lim\limits_{r_1\to \infty} \frac {GM}{r_1} = \lim\limits_{x\to 0}x$. Because $GM$ is divided by $\infty$ which is not a number so I think the result is also not a number. Is my thought right?
No. The limit of the gravitational potential, $GM/r$, is $0$ as the distance $r$ goes to infinity. In other words, gravity has no effect on an object infinitely far away from it. That is the physical thought process.
Mathematically speaking: Yes, $\lim\limits_{r_1\to \infty} \frac {GM}{r_1} = \lim\limits_{x\to 0}x$ because they are both equal to zero. However, when you say:
this is not a very good way to think about it. In calculus, the concept of a limit is the value of an input when its variable approaches a certain number. Saying that $\lim\limits_{r_1\to \infty} \frac {GM}{r_1}$ is not a number would simply incorrect.