The Probability Toolkit

Why Small Samples Mislead

See how short runs of spins, flips or hands can look very different from long-run averages, with checked examples and tips for reading streaks honestly.

On this page
  1. The problem in one sentence
  2. A coin example you can check
  3. Why small samples scatter
  4. A roulette illustration
  5. Streaks look special but are ordinary
  6. How small samples shape beliefs
  7. How big is big enough?
  8. Using this sensibly

Casino games are games of chance with a built-in house edge. No strategy, system or timing changes the odds in the player’s favor over time, and most players lose money over time. Nobody should gamble money they cannot afford to lose. A few good or bad results tell you very little about a game, and nothing about what comes next.

The problem in one sentence

The average of a small number of trials can sit far from the true long-run average, and people routinely read meaning into those deviations.

A coin example you can check

Flip a fair coin 10 times. How many heads should you “expect”? Five. But how likely is it to get exactly five?

The number of ways to choose which 5 of the 10 flips are heads is C(10, 5) = 252, out of 2^10 = 1,024 equally likely sequences. So the chance of exactly 5 heads is 252/1,024, about 24.6%. Roughly three out of four times, the count is not the “expected” five.

How often does a lopsided result occur? The chance of 7 or more heads is (120 + 45 + 10 + 1)/1,024 = 176/1,024, about 17.2%. The same is true for 7 or more tails. These cannot both happen in the same 10 flips, so the chance that one side shows up at least 7 times is 352/1,024, about 34.4%.

More than a third of the time, a perfectly fair coin produces a 7-3 or more lopsided split in just 10 flips. Anyone watching those flips could easily conclude the coin is biased, and they would be wrong. The counts behind these numbers use the same arrangement counting that underlies card combinations.

Why small samples scatter

The spread of results around the average, measured by standard deviation, is large compared with the average when there are only a few trials. As the number of trials grows, the share of heads concentrates around one half, which is the law of large numbers. With few trials, that process has barely started.

For 10 flips the standard deviation of the number of heads is about 1.58 (the square root of 10 × 0.5 × 0.5 = 2.5). A swing of one or two heads either way is entirely ordinary, and that is a swing of 10 to 20 percentage points in the share.

A roulette illustration

On a single-zero wheel, the chance that a specific number comes up on a given spin is 1/37. Over 10 spins, the chance that it comes up at least once is 1 − (36/37)^10 = 1 − 0.760, about 24%.

Now think about a player who sees “17” come up twice within a few spins. The player may feel the wheel is “hot” at 17. But with 37 numbers, some number repeating or clustering over a short stretch is entirely normal, even though any particular number doing so is uncommon. Picking out the number after seeing it is the trap; the pattern was found after the fact, not predicted.

The long-term frequencies of a fair wheel are very close to equal, but only across thousands of spins. A few hundred spins can show some numbers far more often than others by chance alone. Claims about biased wheels need large records and careful testing, as the history of wheel bias shows.

Streaks look special but are ordinary

Sequences of five or six of the same color in a row get remarked on, yet over a long enough sequence of independent spins they are expected to appear from time to time. The chance of five reds in five specific spins on a single-zero wheel is (18/37)^5, about 2.7%. That is small for a given five-spin window, but across a night of many spins many windows exist, so a streak somewhere is not remarkable.

Because every spin is independent, the length of a streak says nothing about the next spin. Reading a streak as a signal either way, “it must end soon” or “it will continue,” is the gamblers fallacy or its mirror, the hot hand belief.

How small samples shape beliefs

  • Selective memory. A big win is retold, a hundred ordinary losses are forgotten. The remembered sample is not representative.
  • Stopping when ahead. A person who plays until they are up and then leaves will report a success, but this does not change the expected result per bet; each bet still carries its edge.
  • Testing a system briefly. A betting system that “worked” over an evening may simply have been lucky. A system tested on 50 bets is no evidence at all, a recurring issue with betting systems.
  • Short-run “win rates.” A slot that paid out three times in twenty spins has not shown anything about its return. Published return figures reflect a model’s very long-run average, not a typical visit.
  • Cognitive biases. People tend to see patterns in noise, which is among the well-known cognitive biases that make short samples feel meaningful.

How big is big enough?

There is no single threshold. The needed number of trials depends on how rare the event is and how precise you want the answer to be. Estimating a 1-in-37 event to within a small margin requires thousands of trials. Rare big wins need far more. That is why designers and testers rely on simulation and on exact math rather than on watching a few hundred spins, and why a single player’s experience cannot confirm or refute a published figure.

Using this sensibly

  • Treat your own results, good or bad, as one small sample.
  • Do not infer that a game or a number is “running hot,” “cold,” or “due.”
  • If you are ahead, remember it is not evidence that the edge has gone away.
  • If you are behind, do not raise your bets to get back to even. Chasing losses tends to make things worse, and a small sample of bad luck is not owed a recovery.

Small samples cannot tell you the odds, but the math that does is straightforward and well established. Every outcome still carries uncertainty, and the safest assumption for any house-banked game is that it costs money to play. If gambling stops feeling like a choice, contact a local support service.

The complete guide to the probability toolkit

Probability Basics for Casino Games
Read the guide

Keep exploring

Guides from other topics

All topics →