Concept

Linearity

The property that a quantity applied to a sum is the sum of the quantities, and scales with a multiple. It is what makes superposition work, and it is the property every approximation in this collection tries to arrange locally.

Named by 10 essays across 5 fields — each of them below, with the objects they name alongside it.

The syndrome of 1011010, and the bit it names. A parity-check matrix over a received word, with the resulting syndrome matched against the table of single-error syndromes.

Finding the error without reading the message

Three parity checks on a seven-bit word produce three bits. If they are all zero nothing is wrong; otherwise they are the number of the position that broke. The message is never consulted, because the answer does not depend on it.

computation · Error-correcting codes
Waiting for all 6 kinds. One bar per new kind: the expected number of draws needed to see a kind not yet seen, rising as fewer of them are left, and adding to 14.70 draws in total.

How long until every one turns up

Draw at random from six equally likely kinds until all six have appeared. The wait is not six draws, and it is not sixty; it is fourteen point seven, and the number is a harmonic sum wearing a hat.

probability · Expectation
A whole line arrives at the origin. A linear map whose determinant is zero, drawn before and after. One line of the plane is sent to the origin and the whole plane is sent onto another line; the dimension lost and the dimension kept add to two.

What a map throws away

A linear map redraws the grid, and the determinant measures how much it stretches area. When that measurement comes out zero the map has flattened the plane onto a line — and the question worth asking is not how much was lost but how much survived, because the two always add to what there was.

algebra · Linear maps
A rectangle grown on two sides. A rectangle x by √x, with both sides grown by the change a step of h makes. The new area is the old one, two strips, and a small corner rectangle that has both increments in it.

A rectangle grown on two sides

A product of two changing quantities is the area of a rectangle whose sides both move. The extra area is two strips and a corner, and the whole of the product rule is the observation that the corner is negligible and the strips are not.

analysis · The derivative
A curved map of the plane, and the flat one that fits it at a point. The map (x² − y², 2xy) carrying a small square patch of grid. Beside it, the image of the same patch under the linear map given by the matrix of partial derivatives, drawn dashed on top of the curved image.

The flat map that fits closest

A derivative is usually met as a number, which works because a line through a point is described by one. In more than one dimension the object that plays the same role is a linear map, and the number was always a one-by-one instance of it.

analysis · The derivative
Waiting for all 6 when they are not equally likely. One bar per kind giving the expected wait for that kind on its own, with the rarest much the tallest, and the expected wait for the whole collection printed above them.

The one that hardly ever comes up

Make the kinds unequally likely and the tidy decomposition into stages fails, because a stage's rate now depends on which kinds turned up rather than on how many. What replaces it is an alternating sum over every subset — and the rarest kind turns out to be nearly the whole answer.

probability · Expectation
How long 4 equally likely patterns take to appear. A bar for each of 4 patterns of 3 coin tosses giving the expected number of tosses before it first appears, with the lengths at which each pattern overlaps itself listed.

Two patterns, one chance, different waits

HTH and HTT are equally likely in any given window of three tosses. Waiting for HTH takes ten tosses on average and waiting for HTT takes eight, and the difference is not about probability at all — it is about what a failed attempt leaves behind.

probability · Expectation
2 independent rows and 2 independent columns. An array of 3 rows and 4 columns beside its transpose, with the independent rows of each shaded, showing the same count on both.

Counted across and counted down

A rectangular array has a number of independent rows and a number of independent columns. The two are counted in different spaces, from different objects, by computations that share nothing — and they are always the same number, which is why 'rank' is one word.

algebra · Linear maps
An additive function that is nowhere a line. A square window with 1157 points of the graph of an additive function that sends √2 to 0, scattered across the window and meeting every part of it, beside a dashed diagonal marking the straight line y = x.

A function that adds and is nowhere a line

Every continuous function with f(x + y) = f(x) + f(y) is a straight line through the origin. Drop continuity and, given the axiom of choice, there are others — functions that add perfectly and whose graphs are scattered densely over the whole plane. A finite piece of the construction can be drawn exactly; the whole of it needs a basis of the real numbers that no one can write down.

logic · Axiom of choice
Secants closing on the slope of the folium x³ + y³ = 3xy. The curve x³ + y³ = 3xy with secants from (1.001, 0.348) of slopes 1.274, 0.953, 0.830, 0.777, approaching the tangent slope 0.744 given by the equation's partial derivatives.

A slope for a curve that is no function

The folium x³ + y³ = 3xy loops back over itself, so no formula y = f(x) describes it, and yet at almost every point it has a perfectly good tangent. Differentiating the equation as it stands gives the slope, −(∂F/∂x) ÷ (∂F/∂y), and the only points where that fails are the ones where the curve turns vertical or crosses itself — which are exactly the points where it stops being a graph.

analysis · The derivative

Named alongside it

The objects these essays reach for when they reach for this one.

ApproximationBasisDerivativeExpectationLimitMatrixSample spaceConvergence rateDeterminantDimensionHarmonic seriesKernel

All concepts