Puzzle – Patience is a virtue?
April 25, 2010 – 3:08 pmLet’s say you’re playing a coin-tossing game. You start with $10 and are looking to double your money. The game is very simple: you pick an amount to wager on each toss, and if you toss heads you win the amount you wagered (as well as keeping the wagered amount), and if you toss tails you lose the amount you wagered. If you get to $0 you go bust and can’t play anymore. Moreover, when you get to your $20 target, you stop playing and take your winnings.
You take a bold approach and decide to wager your entire $10 on the first toss. You have a 50/50 chance of doubling your money, and whether you do or go bust will be determined on the first toss.
Would it have been better to take a more patient approach and only bet $1 on each toss?
You can probably answer this quickly just by thinking about the symmetry of the problem. In the patient approach, you have an equal chance of gaining or of losing $1 at each turn. You are the same number of steps from going bust as you are from doubling your money. So, just as with the bold gambler, your chances of doubling your money will be 50/50.
Now let’s say you start with $10 and want to get to $20, but this time the coin is weighted in your favor and you have a 2/3 chance of rolling heads. Similarly, let’s say you’re betting on even/odd in roulette where you have an 18/38 chance – slightly less than half – of winning on each roll. In these cases, is it better to be a bold gambler or a patient gambler?
Let’s call P the probability that we win this game (by reaching $20 before we go bust) and 1-P the probability that we’ll lose this game (by going bust before ever reaching $20). We’ll also call x our starting amount ($10 in this case) and y our target amount ($20 in this case).
Here’s the key insight: if this game kept going even after you’d reached the the target, there would be two ways to eventually go bust – never reaching the target, or reaching the target and then going bust.
Remember from the prior post that from any starting position x, the chances of eventually going bust if we don’t stop at a target amount are ((1-p)/p)^x.
In other words the probability of eventually going bust from our starting position if we didn’t stop after reaching our target (which we get from the above formula) is equal to the probability of eventually going bust without ever reaching our target (which is effectively 1-P, the probability of losing the game), plus the probability of reaching the target (which is P, the probability that we win the game), and then keeping going from the target and eventually going bust from there (which using the above formula we know is ((1-p)/p)^y.
So we can write:
((1-p)/p)^x = (1-P) + P * ((1-p)/p)^y
With some algebra you get the following:
P = (1 – ((1-p)/p)^x)) / (1 – ((1-p)/p)^y))
Something strange happens here when we plug in p=1/2 into the above formula – we get an indeterminate 0/0. To understand what is going on and how to solve this, read L’Hopital’s rule in wikipedia. Using this rule you’ll find that the answer for the p=1/2 case is that P = x/y, or 1/2.
So in the case of the fair coin, as per our argument from symmetry, it makes no difference whether you’re a bold or patient gambler. But what if the coin is weighted?
If p=2/3, the bold gambler has a has a 2/3 change of winning. Using the above formula, the patient gambler’s chances of winning are almost certain – something like 99.9%.
In the case of p=1/3, the bold gambler has a 1/3 chance of winning the game. The patient gambler’s chances of winning are vanishingly small – something like 0.1%.
What about the roulette case? From the above, we can probably suspect that where p is less than 1/2, the patient gambler’s chances of winning plummet much more quickly than the bold gambler’s chances.
In fact, while the bold gambler’s chances of winning are 18/38 – or something like 47% – the patient gambler’s chances of winning are only about 26%.
One Response to “Puzzle – Patience is a virtue?”
Inverting the problem is also interesting: assume for the moment that you’re a casino operator and you want to make as much money as possible. Is it in your best interest to encourage bold gambling or patient gambling?
Or, to put it another way, why do casinos offer “free” drinks to people who stay at the tables for awhile?
By Peter on May 11, 2010