I'm no mathematician, so a simple answer with omitted technicalities could still be appreciated. While discussing with a friend, I've came to that question :
Say that there is initially a pool of 10 000 people, 50% being male and 50% female. Assume for simplicity that there is no immigration, and that, on average, a couple of two individuals have 4 children. Assume for simplicity that every generation have children at the same age.
How many generations would it take for the probability of two individual from the resulting population of having ancestors in common to reach 0.5? What about 0.8?
Thanks a lot.
Say we're on generation N, so that there are $P_N=10000\cdot 2^N$ people. The probability that two people in this generation don't share parents is $\frac{P_N-3}{P_N}$. Given that they don't share parents, the probability that they don't share grandparents is $\frac{3}{P_{N-1}}\left(\frac{(P_{N-1}-4)(P_{N-1}-5)}{(P_{N-1}-2)(P_{N-1}-3)}\right)+\frac{P_{N-1}-3}{P_{N-1}}\left(\frac{P_{N-1}-8)(P_{N-1}-9)}{(P_{N-1}-2)(P_{N-1}-3)}\right)$, where here we are conditioning on the event that one of the parents are themselves from the same family. After that the calculations get a bit hairy, unless you assume no direct inbreeding, in which case the probability of sharing no grandparents given distinct parents is now $\frac{(P_{N-1}-8)(P_{N-1}-12)}{6(P_{N-1}-8)+(P_{N-1}-8)(P_{N-1}-12)}$. If you can see where im going with these probabilities then the probably of sharing no ancestors is the product of all these probabilities from N back to 1. If you can set this product greater than, say 0.8 to find N, although you may need a computer program. Interestingly I think as your parents are having more than 2 children I think you could find that some probabilities will never be reached for any $N$.