Concept

Martingale

A sequence of fortunes in a fair game: whatever has happened so far, the expected next value equals the current one. Stopped at a sensible moment it still averages its starting value, which turns waiting times and winning chances into bookkeeping about fair bets.

Named by 10 essays across 2 fields — each of them below, with the objects they name alongside it.

A walk with a barrier at each end. Three games played to absorption on a table of 12, beside the chance of ruin from each starting stake — a straight line, because the walk is fair.

Two barriers and a fair game

A fair walk between two absorbing barriers is ruined with a probability that is a straight line in the starting stake, and lasts for a number of steps that is the product of what each side can lose. Both facts come from the same two-line recurrence, and both are bad news for the smaller player.

probability · Random walk
How much the first player can guarantee, as the coin's bias moves. A plot of the first player's best guaranteed winning chance in Penney's game against the probability of heads, a third on a fair coin and rising past one half only when the coin is heavily biased.

A coin that lets the first player win

On a fair coin the second player in Penney's game always has a better pattern than the first, and the first can hold them to no worse than two to one. Bend the coin and every overlap is paid for in the letters it uses: the replies change, the first player's share swings between a third and a half, and past a heads chance of 1/∛2 the first player simply names HHH and wins.

probability · Expectation
Three patterns that beat one another in a circle: HHHT, TTHH, HTTH. Three coin-toss patterns at the corners of a triangle with arrows showing which beats which in two-way races, and each pattern's chance of winning when all three race.

Three patterns in a circle

Race three coin patterns at once and the gamblers' accounting still gives each one's chance of arriving first — one fairness equation per pattern. What it does not give is any way to read the three-way result off the two-way ones. HHHT, TTHH and HTTH beat one another in a circle, and HHH loses both its head-to-head races and still finishes ahead of one of the patterns that beat it.

probability · Expectation
Evidence as steps on a scale of decibans. A horizontal decibel scale of odds with a starting dot at the prior and one arrow per piece of evidence, ending at a posterior probability of 44.2%.

Evidence measured in decibans

Write a probability as odds and take the logarithm, and every piece of evidence becomes a length. A positive result on a good test is thirteen decibans; a negative one is minus twenty. Lay the lengths end to end from the prior and the posterior is where they stop, in any order. The rule fails in exactly one way — when two pieces of evidence share a cause — and Turing built a code-breaking method on the arithmetic.

probability · Bayes
Walks that prefer the steps they have taken. 12 Pólya-urn walks of 2000 steps, each heading off along its own straight line, with final speeds 0.99, −0.87, −0.02, −0.66, 0.01, 0.78, 0.47, 0.44, −0.04, 0.38, 0.83, 0.55, against the ±2√n band of an ordinary walk.

A walk that follows its own footsteps

Let a walk step up with probability equal to the share of up-steps it has taken so far, and every count of up-steps after twenty steps is exactly equally likely. The walk leaves along a straight line at a speed chosen by its first few steps, and although it is expected to come back to its start infinitely often, almost every run comes back only a few times.

probability · Random walk
Running totals of random steps, stopped as they pass 4. Four staircases of uniform steps stopped on passing 4, taking 11, 8, 8, 10 steps; the exact mean is 8.666604.

Two-thirds of a step past the line

Add random numbers between nought and one until the total passes one, and it takes e of them on average. Ask the same about passing any t and the answer is an exact finite sum that settles, within a few units, onto the line 2t + 2/3. The slope is one over the average step. The two-thirds is the interesting part: it is what the one step that crosses the line charges for being chosen by its length, and it is set entirely by how much the steps vary.

probability · Expectation
Watching a fair coin until it looks unfair. Fair coins, 2000 runs to 100000: share reaching p<0.05 by 10³ 0.468, by 10⁵ 0.697; share reaching BF₁₀≥20 by 10³ 0.0280, by 10⁵ 0.0340.

Peeking until the answer is yes

Toss a fair coin, test for bias after every toss, and stop the moment the result is significant at 5%. Within a thousand tosses nearly half of fair coins have been declared biased, and with no limit on the tosses every one of them is. Watch a Bayes factor the same way, stopping at twenty to one, and no amount of watching gets more than one fair coin in twenty past the line.

probability · Bayes
Twelve studies of one coin, three ways of adding them up. theta=0.6, 12 studies of 40: heads 26,21,25,25,25,22,25,20,23,34,22,27; log10 learned product 0.06,-0.33,0.10,0.56,1.05,1.00,1.49,1.13,1.30,3.42,3.35,4.27; fresh 0.06,-0.63,-0.80,-0.98,-1.16,-1.78,-1.96,-2.67,-3.19,0.66,0.03,0.38; Fisher p 8.07e-2,2.58e-1,1.71e-1,1.19e-1,8.54e-2,1.34e-1,9.71e-2,1.72e-1,1.96e-1,7.44e-4,1.40e-3,4.71e-4; cross at 7 (learned e) and 10 (p).

Evidence that can be multiplied

A p-value from one study and a p-value from the next cannot simply be multiplied, and a researcher who decides whether to run the next study by looking at the last one quietly breaks the rule that combines them. An e-value — a number whose average under the null is at most one — can be multiplied, study after study, under any rule for continuing, and never passes twenty to one more than one time in twenty. What it costs is tosses, and what it demands is a decision about which alternatives to be good at finding.

probability · Bayes
When to stop tossing a coin. 1:1 2:2 3:3 4:2 5:3 6:2 7:3 8:2 9:3 10:4 11:3 12:4 13:3 14:4 15:3 16:4 17:5 18:4 19:5 20:4 21:5 22:4 23:5 24:4 25:5 26:4 27:5 28:4 29:5 30:6

When to stop tossing a coin

Toss a fair coin as many times as you like and stop whenever you choose; you are paid the proportion of heads so far. Stopping after a first head pays one, so the only question is what to do after a tail. Waiting for the first moment heads lead pays exactly π/4 on average. Waiting for a lead of two pays exactly ln 2. The best possible rule pays about 0.79295, a number known to six decimal places only since 2013 — and it stops when the lead reaches about 0.84 times the square root of the number of tosses, a constant that comes from Brownian motion.

probability · Optimal stopping
A set's share of a shrinking window, at three points. a point of the set x=0.33155689: density at r=1e-1 0.5633, 1e-3 0.9885, 1e-5 0.99695; the middle of a gap x=0.07812500: density at r=1e-1 0.6250, 1e-3 0.0000, 1e-5 0.00000; the end of a gap x=0.07031250: density at r=1e-1 0.6250, 1e-3 0.4971, 1e-5 0.49998

No set fills half of every interval

A fat Cantor set has length one half and contains no interval, so every interval holds some of it and some of its gaps. Look closely at any one point, though, and the window around it ends up almost all set or almost all gap. Lebesgue proved in 1910 that this is forced for every set with a length: the share of a shrinking window is 0 or 1 almost everywhere. So no set can fill exactly half of every interval, however it is built.

analysis · Measure

Named alongside it

The objects these essays reach for when they reach for this one.

Random walkExpectationMarkov chainBayes factorBeta distributionConditional probabilityFinite automatonLikelihoodP-valueRecurrenceStopping timeAbsorbing state

All concepts