Concept

Derivative

The instantaneous rate at which a quantity is changing, and the slope of the tangent to its graph. In more than one variable it is a linear map rather than a number, and the number was always the one-dimensional case of that.

Named by 27 essays across 7 fields — each of them below, with the objects they name alongside it.

A circle unrolled into a sine wave. On the left a radius turns through an angle; on the right the height of its tip is plotted against the angle, tracing a sine curve.

A sine wave is a circle seen from the side

Sine is introduced as a ratio in a right triangle, which is true and explains nothing about why its graph is a wave. There is a better picture.

analysis · Circular functions
eˣ and its tangent lines. The exponential curve with tangent lines at several points; at each point the slope equals the height.

The curve that is its own slope

There is exactly one shape of exponential curve whose steepness at every point equals its height at that point. The number that produces it is 2.71828…, and it was not chosen for elegance.

analysis · The exponential
Partial sums of sin x. sin x with its Taylor partial sums of degree 1, 3, 5, 9 about zero. Each extra term buys agreement over a wider interval and none of them is right everywhere.

One point's worth of information

A Taylor series claims that everything a function does, everywhere, is encoded in its behaviour at a single point. That claim is extraordinary, it is often true, and the cases where it fails are the interesting ones.

analysis · Taylor series
Secants closing on the tangent to x². Secant lines through x = 1 and a second point 1.2, 0.8, 0.5, 0.28, 0.12 away, with the slope of each. They approach 2, the derivative there.

The slope of a single point

A slope needs two points. A derivative is the slope at one. The construction that bridges the gap is a sequence of secants, and the whole difficulty of calculus is in what "the limit of that sequence" is allowed to mean.

analysis · The derivative
Area is the undoing of slope. Above, a positive function with the area from 0 to 1.80 shaded. Below, that area plotted against where it stops. The lower curve's slope at 1.80 is 1.129, which is exactly the upper curve's height there.

Area is the undoing of slope

Two operations invented for unrelated reasons — measuring a region and measuring a rate — turn out to be inverse. The picture is two panels sharing one axis, and the claim is that the lower curve's steepness is the upper curve's height.

analysis · The integral
A fixed point that attracts, and one that does not. The same map at two parameters, with the staircase walking towards the crossing in one and away in the other.

A point that pulls, and a point that pushes

Every crossing of a curve with the diagonal is a value the rule leaves alone. Whether anything ever arrives there is decided by one number — the slope at the crossing — and the picture makes the reason obvious.

dynamics · Fixed points
The Lyapunov exponent, 2.8 to 4. The average rate at which nearby orbits separate, plotted against the parameter.

How fast two orbits part

The word "sensitive" is an adjective. Averaging the logarithm of one derivative along an orbit turns it into a number — one that says how many steps of prediction the map allows, and whose sign says whether it allows any.

dynamics · Sensitive dependence
The basins of Newton's method on z³ = 1. The complex plane coloured by which cube root of one Newton's method converges to from each starting point.

Where Newton's method goes instead

An algorithm designed to find roots, run from every starting point at once. Three roots, three basins, and a boundary at which all three are arbitrarily close — so a rule with no randomness in it has starting points whose answer cannot be predicted.

dynamics · Newton basins
What one more unit of constraint 1 is worth. The optimum of a linear program plotted against one of its right-hand sides, as an exact piecewise linear graph, with the breakpoints marked and each piece's slope named as a dual variable.

What a constraint is worth

A linear program and its dual reach the same number. What the dual's variables are is a separate question, and the answer converts a solution into a rate for every constraint — piecewise constant, zero on the constraints that are not doing any work.

applied · Duality
Four staircases against a quarter circle, all of length 2. A quarter circle with staircases of 1, 2, 4, 16 steps drawn over it; each hugs the curve more closely than the last and every one of them is exactly 2 long.

The staircase that is not the diagonal

A staircase can be made to follow a quarter circle as closely as anyone likes. Its length is 2 at every stage and the arc's length is 1.5708, and no amount of refinement closes the gap — which is a fact about length rather than about staircases.

analysis · Arc length
x ↦ cos x: two starts, one destination. A map whose graph is nowhere steeper than a fixed factor under one, with staircases from two different starting points converging on the same crossing, and the distance to it falling under a geometric bound.

A map that shrinks everything

One extra hypothesis — that every distance is shortened by at least a fixed factor — turns the existence of a fixed point into its uniqueness, an algorithm for finding it, and a bound on the error after any number of steps.

analysis · Fixed points
A rectangle grown on two sides. A rectangle x by √x, with both sides grown by the change a step of h makes. The new area is the old one, two strips, and a small corner rectangle that has both increments in it.

A rectangle grown on two sides

A product of two changing quantities is the area of a rectangle whose sides both move. The extra area is two strips and a corner, and the whole of the product rule is the observation that the corner is negligible and the strips are not.

analysis · The derivative
A curved map of the plane, and the flat one that fits it at a point. The map (x² − y², 2xy) carrying a small square patch of grid. Beside it, the image of the same patch under the linear map given by the matrix of partial derivatives, drawn dashed on top of the curved image.

The flat map that fits closest

A derivative is usually met as a number, which works because a line through a point is described by one. In more than one dimension the object that plays the same role is a linear map, and the number was always a one-by-one instance of it.

analysis · The derivative
eˣ and its inverse, reflected in the diagonal. A curve, the line y = x, and the curve reflected in it — which is the graph of the inverse function. Tangents are drawn at matched pairs of points, and the two slopes at each pair multiply to one.

The slope of the mirror image

Undoing a function is reflecting its graph in the diagonal, and a reflection turns a slope into its reciprocal. That single observation supplies the derivative of every inverse — the logarithm, the roots, the inverse trigonometric functions — without differentiating any of them.

analysis · The derivative
The area that names the number. The curve 1/x with the area under it from 1 to 2.7183 shaded, measuring 1.0000.

The area that names the number

The number e can be defined without mentioning slopes at all. Slide right along the curve 1/x until the area underneath reaches exactly one, and stop. That is where e is, and the reason logarithms turn multiplication into addition is visible in the same picture.

analysis · The exponential
The slopes the equation demands, and the curves that obey them. A field of short segments whose slope at each point is 0.9 times the height there, with 3 solution curves integrated through it; each doubles over an interval of 0.770 wherever that interval is taken.

The equation with only one answer

A rate of change proportional to the current amount is the most common description in nature, and it pins down the function completely. There is exactly one curve through each starting point, and a half-life and a doubling time are the same measurement.

analysis · The exponential
The polynomial that squeezes π. On the left, xⁿ(π − x)ⁿ/n! drawn at several degrees, its largest value falling toward nothing; on the right, the derivatives of the same polynomial at zero, every one a whole number.

An integral that cannot be a whole number

Niven's proof that π is not a fraction is the same squeeze as the one for e, with a much harder multiplier. A polynomial supplies the whole number; its own smallness supplies the contradiction; and both halves are computable.

number · Irrationality
How fast an iteration arrives. The distance from the fixed point plotted against the step number on a logarithmic vertical axis, for two ordinary iterations and for Newton's method, whose curve bends downward.

How fast the staircase arrives

The slope at a crossing decides whether an orbit reaches it. The same number decides how fast — and when the slope is zero the arithmetic changes kind, from a fixed factor per step to a doubling of the correct digits.

dynamics · Iteration
A staircase with no steps. The Cantor function drawn to several stages: a continuous non-decreasing curve from nought to one which is constant on every interval of the complement of the middle-thirds set, so its whole rise happens on a set of measure zero.

A staircase with no steps

A function that rises from nought to one, is continuous everywhere, and has derivative zero at almost every point. All of its climbing happens on a set of no length at all, which is possible because that set has uncountably many points.

analysis · Measure
A line under every point of x². The curve x² with 4 tangent lines drawn, each extended across the whole interval and each staying below the curve throughout.

A line under every point

The chord above the curve is one definition of convexity. There is a second — a line under the curve at every point, staying under everywhere — and it is the one that turns a statement about a derivative at a point into a statement about the whole function.

analysis · Convexity
What the degree-5 sum costs, and what the bound claims. The error of the degree-5 Taylor polynomial of sin x against x, on a logarithmic scale, with Lagrange's bound drawn above it. The bound exceeds the error by a factor of 1.8 at the right-hand end.

An error with an unknown in it

Taylor's theorem does not say a partial sum is close to anything. It says the error is one more derivative evaluated somewhere nobody can name, and everything the theorem is worth comes from what happens when that somewhere is replaced by the worst case.

analysis · Taylor series
One curve, 3 parametrisations, 3 lengths. Several maps from an interval with the same image drawn side by side, each with marks at equal parameter steps and its length beneath it — the same point set reported at different lengths.

The length belongs to the journey

Three maps from an interval with exactly the same image, and three different lengths. The picture of a curve is the set of points it passes through, and that set does not determine how far anything travelled along it.

analysis · Arc length
The roots of the derivative inside the hull of the roots. Three polynomials of degree five, each drawn as its roots with their convex hull shaded, and the four roots of its derivative marked. Every root of the derivative lies inside the hull.

The roots of the slope stay inside

Mark the roots of a polynomial in the complex plane and stretch a band around them. However the roots are arranged, the roots of the derivative land inside the band — never outside, never on a new frontier. The reason is a balance of pushes, the same reason makes the derivative of a cubic mark the foci of an ellipse nobody asked for, and a question about how far inside the roots must sit has been open since 1958.

algebra · Polynomial roots
Counting the real roots of x⁵ − 5x³ + x² + 3x − 1 with Euclid's algorithm. Above, the graph of a polynomial over an interval with its real roots marked; below, a step function counting sign changes in the polynomial's Sturm chain, which drops by one at each root; beside them the chain of polynomials listed.

The remainders that count the roots

Run Euclid's algorithm on a polynomial and its derivative, flipping the sign of each remainder, and write down the signs of the whole chain at any point. The number of sign changes drops by exactly one each time the point passes a real root — so the roots in any interval can be counted, exactly, without finding a single one.

geometry · Euclidean algorithm
The Cantor function has length 2. The graph of a singular or partly singular increasing function on the unit interval with an inscribed polygon, beside a table of inscribed lengths by stage and the value the derivative formula gives.

The length the derivative never sees

The Cantor function climbs from 0 to 1 with a slope of zero almost everywhere, so the formula ∫√(1 + f′²) dx says its graph has length 1 — the length of a flat line. The inscribed polygons say 2. Mix it half and half with the diagonal and the length becomes exactly the golden ratio, while the formula still reports only the part the slope can see.

analysis · Arc length
How many steps Newton's method needs on (z − 1)²(z + 1). A square of the complex plane shaded in bands by the number of iterations a root-finding method needs from each starting point, darker meaning slower, with the roots marked.

A double root halves the error instead of squaring it

Near an ordinary root, Newton's method squares its error at every step and a handful of steps reach full precision. Near a double root it only halves the error — twenty steps where five would do, and a ceiling of about eight correct digits that no number of steps can break through. Doubling the step repairs the double root and ruins the simple one.

dynamics · Newton basins
Square roots of 2, lifted from one power of 7 to the next. A tree whose rows are the square roots of 2 modulo 7 to the powers 1 to 4, each joined to the root it reduces to; counts 2, 2, 2, 2.

A root lifted one digit at a time

On a dial of seven, 3 × 3 is 2. On a dial of forty-nine the square root of 2 must reduce to 3, so there are only seven candidates, and exactly one of them works: 10. On a dial of 343 exactly one lift of 10 works: 108. Each step adds one digit on the left, found by solving a linear equation, and the digits go on for ever — a number …21216213 whose square is 2, in a world where closeness means divisibility by seven.

discrete · Modular arithmetic

Named alongside it

The objects these essays reach for when they reach for this one.

LimitApproximationContinuityConvergenceIntegralIterationLogarithmNewtons methodArc lengthAreaConvergence ratee, the number

All concepts