Concept

Approximation

A value put in place of another, together with a stated bound on how far apart the two can be. What makes one usable is the bound rather than the value: without a stated error it says nothing about the quantity it replaces.

Named by 34 essays across 8 fields — each of them below, with the objects they name alongside it.

Rotating by φ − 1 of a turn, 21 times. Points on a circle produced by repeatedly turning through the same angle.

Three gaps and no more

Turn a circle by the same irrational angle over and over. The points never repeat and never settle, and yet at every single stage the gaps they leave take at most three different lengths — never four, at any number of steps, for any angle.

dynamics · Golden ratio
All 24 arrangements of 4 objects, and the 9 that move every one. Every permutation of 4 objects drawn as a grid of cells, with the diagonal — where an object stays where it began — shaded, and the arrangements that avoid it entirely marked.

Nobody gets their own hat

Hand back a pile of hats at random and ask for the chance that not one person gets their own. The answer barely moves as the crowd grows — it is a third and a bit at four people, and a third and a bit at four thousand.

probability · Inclusion exclusion
Waiting for all 6 kinds. One bar per new kind: the expected number of draws needed to see a kind not yet seen, rising as fewer of them are left, and adding to 14.70 draws in total.

How long until every one turns up

Draw at random from six equally likely kinds until all six have appeared. The wait is not six draws, and it is not sixty; it is fourteen point seven, and the number is a harmonic sum wearing a hat.

probability · Expectation
Four staircases against a quarter circle, all of length 2. A quarter circle with staircases of 1, 2, 4, 16 steps drawn over it; each hugs the curve more closely than the last and every one of them is exactly 2 long.

The staircase that is not the diagonal

A staircase can be made to follow a quarter circle as closely as anyone likes. Its length is 2 at every stage and the arc's length is 1.5708, and no amount of refinement closes the gap — which is a fact about length rather than about staircases.

analysis · Arc length
x ↦ cos x: two starts, one destination. A map whose graph is nowhere steeper than a fixed factor under one, with staircases from two different starting points converging on the same crossing, and the distance to it falling under a geometric bound.

A map that shrinks everything

One extra hypothesis — that every distance is shortened by at least a fixed factor — turns the existence of a fixed point into its uniqueness, an algorithm for finding it, and a bound on the error after any number of steps.

analysis · Fixed points
π(x) against its two estimates, up to 20,000. The ratio of the prime counting function to x over the logarithm of x, and to the logarithmic integral, plotted against x. The first is above one and coming down slowly; the second is close to one throughout.

Counting what has no formula

There is no expression that gives the nth prime, and yet the number of primes below a bound is predictable to within a fraction of a per cent — by a function that is not a formula for the primes but an integral of the wrong-looking quantity.

number · Prime distribution
How fast a sum becomes a bell curve. The largest gap between the distribution of a standardised sum and the bell curve, against the number of terms, on logarithmic axes. Both summands fall along a line of slope about minus a half.

How fast the bell arrives

The limit theorem says a standardised sum approaches the bell curve and says nothing about when. The rate is one over the square root of the number of terms, the constant in front is made of the third moment, and both are visible.

probability · Central limit
A rectangle grown on two sides. A rectangle x by √x, with both sides grown by the change a step of h makes. The new area is the old one, two strips, and a small corner rectangle that has both increments in it.

A rectangle grown on two sides

A product of two changing quantities is the area of a rectangle whose sides both move. The extra area is two strips and a corner, and the whole of the product rule is the observation that the corner is negligible and the strips are not.

analysis · The derivative
A curved map of the plane, and the flat one that fits it at a point. The map (x² − y², 2xy) carrying a small square patch of grid. Beside it, the image of the same patch under the linear map given by the matrix of partial derivatives, drawn dashed on top of the curved image.

The flat map that fits closest

A derivative is usually met as a number, which works because a line through a point is described by one. In more than one dimension the object that plays the same role is a linear map, and the number was always a one-by-one instance of it.

analysis · The derivative
eˣ and its inverse, reflected in the diagonal. A curve, the line y = x, and the curve reflected in it — which is the graph of the inverse function. Tangents are drawn at matched pairs of points, and the two slopes at each pair multiply to one.

The slope of the mirror image

Undoing a function is reflecting its graph in the diagonal, and a reflection turns a slope into its reciprocal. That single observation supplies the derivative of every inverse — the logarithm, the roots, the inverse trigonometric functions — without differentiating any of them.

analysis · The derivative
What the map does to a circle. The unit circle with two perpendicular directions marked, and its image under [1.6, 1.2, −0.4, 1.1] — an ellipse whose axes are the images of those two directions, of lengths 2.04 and 1.10.

What a map does to a circle

Every linear map sends the unit circle to an ellipse. Two perpendicular directions go to two perpendicular directions, whatever the map is — even a map with no invariant direction at all, and even one that is not square.

algebra · Eigenvectors
The share of arrangements that fix nothing, up to 8 objects. A bar per number of objects, giving the proportion of its arrangements that leave nothing in place, against the horizontal line at 1/e.

The constant that counts what does not happen

Nothing grows in a shuffled pack of cards, and nothing grows in a factorial. Yet e sits in the middle of both — as the chance that a shuffle leaves nothing in place, and as the base that makes n! nearly a power.

analysis · The exponential
Sampling the orders, and how fast the answer arrives. The largest error in the estimated shares against the number of orderings sampled, both on logarithmic axes, with the square-root rate drawn through the first point.

Too many orders to list

The rule is an average over every order the players could have arrived in. At seven players that is five thousand orders and at twenty it is more than there are seconds in the age of the universe — so the average is sampled, and the error falls at a rate that can be measured.

applied · Shapley value
A lattice of determinant 3, and the ellipse that must hold a point. A lattice with the parallelogram its basis spans, an ellipse centred at the origin, and the nearest non-zero lattice point it contains.

One point in every big enough shape

A determinant measures a lattice, not the basis that happened to describe it — and that measurement is an exchange rate. Any symmetric convex region with more than four times that area has to swallow a lattice point.

algebra · Determinant
p(n) to 60, against the Hardy–Ramanujan estimate. The number of partitions of each number up to sixty on a logarithmic scale, with the asymptotic estimate drawn over it and the ratio of the two tabulated.

The size of a number with no formula

There is no closed expression for the number of partitions of n. There is an expression for how large it is — with a square root in the exponent and a π in front — and it is accurate enough that rounding a few terms of its refinement gives the exact count.

number · Partitions
One subtraction clears a direction. Gram–Schmidt on two planar vectors, in 3 panels: the pair as given, the shadow of the second on the first, and the perpendicular pair that is left when the shadow is removed.

One subtraction clears a direction

A basis is a set of directions to measure along, and most bases are awkward because the directions get in each other's way. Removing one shadow at a time turns any basis into one where every coordinate is a shadow and nothing interferes.

algebra · Inner product
The nearest point of the plane the columns span. A target vector in space, the plane spanned by two columns, the point of that plane nearest the target, and the residual joining them, which meets the plane at a right angle.

The nearest point of a flat thing

More equations than unknowns almost never have a solution. Asking instead for the point of a plane nearest to where the answer should have been turns an unanswerable question into a shadow, and the shadow is what a line of best fit is.

algebra · Inner product
What the degree-5 sum costs, and what the bound claims. The error of the degree-5 Taylor polynomial of sin x against x, on a logarithmic scale, with Lagrange's bound drawn above it. The bound exceeds the error by a factor of 1.8 at the right-hand end.

An error with an unknown in it

Taylor's theorem does not say a partial sum is close to anything. It says the error is one more derivative evaluated somewhere nobody can name, and everything the theorem is worth comes from what happens when that somewhere is replaced by the worst case.

analysis · Taylor series
11 points, equally spaced. 1/(1 + x²) and the polynomial of degree 10 through 11 of its points, spaced evenly across the interval. The worst error is 2.48e-1, at x = -2.350.

The points that ruin the fit

A polynomial through eleven points of a gentle curve should be a good approximation to it, and adding more points should make it better. On evenly spaced points it makes it worse, without limit, and the reason is not the polynomial but where the points were put.

analysis · Taylor series
ln(1 + x) past its radius, with a denominator allowed. ln(1 + x), its Taylor sum of degree 8, and its Padé approximants of order 2 and 4. At x = 3 the Taylor sum is out by 5.95e+2 and the highest-order approximant by 2.97e-4.

A denominator that reaches past the radius

The Taylor series of ln(1 + x) is useless beyond x = 1 however many terms it is given. The same coefficients spent on a numerator and a denominator converge at x = 3, and at x = 100, because a polynomial cannot imitate a singularity and a quotient of two polynomials can.

analysis · Taylor series
A series that gets better, then worse. The error of Euler's series against the number of terms kept, at x = 0.05 and 0.1 and 0.2. At 0.05 the error falls to 1.1e-8 at 20 terms and then climbs without limit. At 0.1 the error falls to 1.8e-4 at 10 terms and then climbs without limit. At 0.2 the error falls to 1.8e-2 at 5 terms and then climbs without limit.

A series that converges nowhere

Expand Euler's integral in powers of x and the coefficients are the factorials, so the series converges at no x but nought. Stopped at its smallest term it still computes the integral to within about e^(−1/x) — and every term added after that makes the answer worse.

analysis · Taylor series
A polygon of 4 points averaged down to its curve at t = 0.40. A control polygon of 4 points, the 3 rounds of weighted averaging at t = 0.40 drawn as nested polylines, the single point they end at, and the whole curve those points trace. The weights on the control points are 0.216, 0.432, 0.288, 0.064.

Averaging down the triangle

Change one word in the rule that builds Pascal's triangle — take a share of each entry above instead of adding them — and the triangle stops counting and starts averaging. The same rule then draws smooth curves from polygons and approximates every continuous function by polynomials, at a rate that no amount of smoothness can improve.

discrete · Pascals triangle
A 6-sided die rolled 6 to 40 times: some face missing, and the sum stopped early. Curves of the chance that some face of a die has not yet appeared against the number of rolls, with the inclusion–exclusion sum stopped after one, two and three terms drawn around the exact curve.

A sum stopped early still says something

Inclusion–exclusion corrects an overcount, then the correction's overcount, and so on to the end. Stop after any number of terms and the result is not merely an approximation: after an odd number it is too high and after an even number too low, always. So two or three terms bracket an answer whose full sum is out of reach — as long as the events being counted are rare.

probability · Inclusion exclusion
Inscribed polygons in a quarter circle, and the length they climb towards. Four polygons inscribed in a quarter circle with increasing numbers of corners, each drawn over the curve, with its length beneath it — the lengths increase towards the curve's own.

Which curves have a length at all

A length is defined as a supremum over inscribed polygons, which behaves because every refinement is longer than the last. It is also sometimes infinite — and the condition separating the two cases is a sum of absolute differences that either settles or does not.

analysis · Arc length
One curve, 3 parametrisations, 3 lengths. Several maps from an interval with the same image drawn side by side, each with marks at equal parameter steps and its length beneath it — the same point set reported at different lengths.

The length belongs to the journey

Three maps from an interval with exactly the same image, and three different lengths. The picture of a curve is the set of points it passes through, and that set does not determine how far anything travelled along it.

analysis · Arc length
How rare a sum of two squares is. Two curves against the logarithm of the bound: the fraction of numbers below it that are sums of two squares, falling; and that count times the square root of the logarithm, divided by the bound, which is nearly constant.

Almost no number is one

Sums of two squares look common — a sixth of all numbers up to a million are one. The fraction is falling to nothing, at a rate so slow that no computation will ever make it obvious, and the constant in front of it has been computed to fifty places and identified with nothing.

number · Sums of two squares
Waiting for all 6 when they are not equally likely. One bar per kind giving the expected wait for that kind on its own, with the rarest much the tallest, and the expected wait for the whole collection printed above them.

The one that hardly ever comes up

Make the kinds unequally likely and the tidy decomposition into stages fails, because a stage's rate now depends on which kinds turned up rather than on how many. What replaces it is an alternating sum over every subset — and the rarest kind turns out to be nearly the whole answer.

probability · Expectation
A circle trapped between two 12-sided polygons. A circle with a regular polygon of 12 sides inscribed in it and another circumscribed about it, beside a table of the bounds on pi obtained by doubling the side count.

Pinned between two sequences

The ring dissection makes the answer obvious and proves nothing. Archimedes' method proves it and makes nothing obvious — it never exhibits the area at all, it rules out every other value — and the recursion that drives it computes π by hand with one square root a step.

geometry · Circle area
The sum of the first 6 squares, as a staircase over a curve. Bars of height k^2 for k from 1 to 6, totalling 91, drawn over the curve y = x^2, whose area up to 6 is 72.00. The slivers between staircase and curve hold 19.00, close to half the last bar.

Sums of powers, read off a staircase

Add the first n squares, or cubes, or seventh powers, and the answer is always a polynomial in n. Its first term is the area under a curve, its second is half of the last step, and every term after that is a correction for the corners of a staircase — which is where the Bernoulli numbers come from, and why they eventually grow without bound.

geometry · Figurate numbers
Three places cut apart for 13. A network of eight places with road capacities, three of them lettered, coloured by which of the three sides of the cheapest three-way cut each place falls on, with the cut roads dashed.

Three places cut apart

Separating two places as cheaply as possible is solved exactly by a flow. Separating three from one another is a different problem: no flow measures it, the pairwise answers do not add up to it, and the best shortcut known in 1994 — cut each place off on its own and throw the dearest cut away — is guaranteed only to within a third of the truth.

discrete · Network flow
The best degree-3 polynomial to eˣ: its error touches its largest size 5 times. The error curve of the best uniform polynomial approximation of degree 3 to eˣ on the interval from −1 to 1. It reaches its maximum size 5.528 × 10⁻³ at 5 points, alternately above and below, at x = -1.000, -0.682, 0.050, 0.732, 1.000.

The error that keeps coming back to its worst

Judge a polynomial by its largest error on an interval and there is exactly one best one of each degree. It is recognised without comparing it to anything else — its error rises to the same largest size, alternately above and below, one more time than there are coefficients.

analysis · Taylor series
A disc of radius 0.2 and an ellipse of size 1.22 around the same interval. For 1/(1 + 25x²): the interval from −1 to 1 on the real axis, poles at 0 + 0.2i and 0 − 0.2i, the Taylor disc at 0 of radius 0.20, and the Bernstein ellipse with foci ±1 through the poles, with ρ = 1.2198.

An ellipse, not a disc

A Taylor series converges on a disc, and the disc's radius is the distance to the nearest singularity. Ask instead how well polynomials can follow a function on an interval, and the answer is an ellipse with the interval's ends as its foci — the largest one the function is smooth inside.

analysis · Taylor series
Secants closing on the slope of the folium x³ + y³ = 3xy. The curve x³ + y³ = 3xy with secants from (1.001, 0.348) of slopes 1.274, 0.953, 0.830, 0.777, approaching the tangent slope 0.744 given by the equation's partial derivatives.

A slope for a curve that is no function

The folium x³ + y³ = 3xy loops back over itself, so no formula y = f(x) describes it, and yet at almost every point it has a perfectly good tangent. Differentiating the equation as it stands gives the slope, −(∂F/∂x) ÷ (∂F/∂y), and the only points where that fails are the ones where the curve turns vertical or crosses itself — which are exactly the points where it stops being a graph.

analysis · The derivative
Dodgson's rule: the fewest swaps that make a Condorcet winner. Profile of 9 ballots with no Condorcet winner; Dodgson scores A 1, B 2, C 3, D 6; Borda scores A 15, B 16, C 14, D 9; Copeland A 1, B 1, C 1, D −3.

The fewest swaps to a winner

When no candidate beats every other head to head, Charles Dodgson proposed in 1876 to elect the one that is closest to doing so — the candidate that the fewest swaps of neighbouring names on the ballots would turn into a winner of every contest. The rule is easy to state and hard to compute: the count needs a search, and deciding the winner is provably among the hardest problems of its kind. A much simpler count, the votes still to be won, usually agrees, more often the larger the electorate.

applied · Voting rules

Named alongside it

The objects these essays reach for when they reach for this one.

LimitConvergenceConvergence rateDerivativeCounterexampleCounting argumentLinearityBasisContinuityOrthogonalityRadius of convergenceTaylor series

All concepts