The number of customers arriving at a bank counter is in accordance with a Poisson distribution with mean rate of 5 customers in 3 minutes. Service time at the counter follows exponential distribution with mean service rate of 6 customers in 2 minutes. If there were 20 customers waiting in the line just before opening the counter, what is the probability that more than 20 customers will be waiting in the line, 2 hours after opening the counter? Assume that no customers leave the line without service.
Here arrival rate is $\lambda=5/3$ and service rate is $\mu=3$. If $W$ is the average number of people waiting in the line then $W= \lambda/(\mu - \lambda)$ . But I don't know how to calculate number of waiting customer using a given time span. I didn't find any formula to do it in the book. Please help.
Extended Comment, not Answer.
I do not believe all of the speculations in the Question and Comments are exactly correct and relevant. Here are some things I believe are correct, assuming you are dealing with an M/M/1 queue.
The formula $W = \lambda/(\mu - \lambda) = \rho/(1 - \rho),$ where $\rho = \lambda/\mu$ is for the average number of customers in an M/M/1 queueing system at equilibrium, including anyone being served. The formula $W_Q = \rho^2/(1-\rho)$ is for the average number waiting to be served (again when the system is at equilibrium).
Such systems reach equilibrium quickly for values of $\lambda$ and $\mu$ such as yours. Agreeing with @Michael, I think the 2 hours is supposed to indicate enough time to reach equilibrium. (Markov processes have some memory, but after 'time to equilibrium' memory of the starting state is assumed irrelevant.)
The distribution at equilibrium of an M/M/1 queue is well known, and should be in your text or notes--along with much of what I have said earlier on.