Concept

Eigenvalue

The factor by which a linear map stretches one of the directions it does not turn. It is a root of the characteristic polynomial, and its size decides whether repeated application of the map grows or shrinks that direction.

Named by 22 essays across 7 fields — each of them below, with the objects they name alongside it.

The directions the map leaves alone. Unit vectors and their images under the map. On the two marked lines the image points the same way as the original, stretched by 3.00 and 1.00.

The directions a map leaves alone

Almost every arrow comes out of a transformation pointing somewhere else. A few come out pointing exactly where they went in, only longer or shorter. Those few decide nearly everything the map does.

algebra · Eigenvectors
The unit square, mapped: area × 5. The unit square and the parallelogram it becomes under a linear map, with the area of that parallelogram computed from its own corners and set against ad − bc.

The number that says how much room is left

A linear map takes the unit square to a parallelogram. The area of that parallelogram is one number, it is computable from the four entries of the matrix, and almost everything the determinant is used for is a restatement of that sentence.

algebra · Determinant
The polynomial whose roots are the stretches. The determinant of A − λI plotted against λ for the map [2, 1, 1, 2], with its roots at 3 and 1 marked.

The polynomial whose roots are the stretches

Finding the directions a map leaves alone means finding the numbers at which it crushes something to nothing. Those numbers are the roots of one quadratic, and everything the map does is written in its two coefficients.

algebra · Eigenvectors
The same map, written in the basis of its own eigenvectors. Three panels: the map [2, 1, 1, 2] on the standard grid, the diagonal stretch by 3 and 1 it becomes on the eigenvector grid, and the two put back together.

The same map in a better basis

Measured along its own invariant directions, a linear map stops shearing and becomes two independent stretches. Nothing about the map has changed; the grid it is described against has.

algebra · Eigenvectors
The level curve, and the axes the matrix chooses. The curve xᵀAx = 1 for the matrix [2, 0.8, 0.8, 1.4], drawn by solving for the radius at each angle, with the two eigen-directions marked; they cross at a right angle and are the axes of the curve.

Symmetry forces a right angle

A matrix equal to its own reflection across the diagonal always has real stretches and always has perpendicular directions to stretch along. Neither is true of matrices in general, and both follow from one line of algebra.

algebra · Eigenvectors
The flow of a linear equation, and the matrix that runs it for one unit of time. Paths of points moving so that their velocity is [0.25, −1.2, 1.2, 0.25] applied to their position, with the position after time 1 marked on each; the matrix taking start to finish is e^A.

The exponential of a square

The series for e makes perfect sense with a matrix in it. What comes out solves a system of equations the way the ordinary exponential solves one, and a skew matrix exponentiates into a rotation with no trigonometry anywhere.

analysis · The exponential
How fast a chain forgets where it started. The total variation distance to the stationary distribution plotted logarithmically against the number of steps, for each of 3 starting states. The curves are straight lines of equal slope.

How long until it forgets

The essays before this one settle where a chain ends up and how much time it spends there, and none of them asks how long the settling takes. That question has an exact answer, it is a single number, and it is the only thing any practical use of a chain depends on.

probability · Markov chains
One sign decides which curve it is. 3 conics drawn from the general quadratic, each labelled with its discriminant B² − 4AC and the curve that sign names, checked against how many times the curve meets a large circle.

One sign decides which curve

The general quadratic in two variables has six coefficients and draws a conic. Which of the four it draws is settled by a single combination of three of them, and the other three cannot change the answer however they are chosen.

geometry · Conic sections
A map drawn through the cycle 0 → 1/3 → 1, and the graph its pieces make. The graph of a map made of two straight pieces through a cycle of three points, with the cycle drawn as a staircase, beside a two-node graph showing which piece may follow which and the matrix of that graph.

A matrix that counts the returns

Draw a map straight through the cycle 0 → 1/3 → 1 and its two pieces carry each other in a fixed pattern: the left piece only across the right, the right across both. The orbits' words are then walks on a two-node graph, and the number of points that come back after n steps is the trace of that graph's matrix to the nth power — 1, 3, 4, 7, 11, 18 — each one checked by solving for the points exactly.

dynamics · Symbolic dynamics
Four shapes of perimeter 300 between their inner and outer circles. A square, an ellipse, a Reuleaux triangle and a stadium, each drawn with the largest circle inside it and the smallest circle around it, the ring between the two shaded, with the ring's width and the widest ring allowed.

Nearly the most means nearly round

A shape that holds almost as much as a circle of the same perimeter must almost be a circle. Bonnesen made that exact: the ring between a convex shape's largest inscribed circle and smallest enclosing circle is never wider than √(L² − 4πA)/π. Three quite different shapes holding 99% of the circle's area all have rings under 9.55 wide, and not one of 200 random convex shapes breaks the bound.

geometry · Isoperimetric
9 corners of the 4-cube: some corner always has 2 chosen neighbours. The 4-dimensional cube with 9 of its corners chosen so that no chosen corner has more than 2 chosen neighbours, the fewest possible, with the edges between chosen corners drawn heavy.

Half the cube and √n neighbours

Choose more than half the corners of an n-dimensional cube, any way at all, and some chosen corner has at least √n chosen neighbours. That statement about a cube settled a thirty-year question about how sensitive a truth function must be to its inputs, and its proof is a matrix of plus and minus ones whose square is n times the identity. A search over every choice for the 4-cube finds the bound exactly: nine corners, and some corner always has two chosen neighbours.

logic · Truth functions
Discs from the rows, and the eigenvalues inside them. The complex plane with one disc per row of a 3×3 matrix — centred on its diagonal entry, with radius the sum of the sizes of the rest of the row — and the 3 eigenvalues marked: 4.14, −5.09, −1.06.

Discs that fence in the eigenvalues

Draw one disc for each row of a square matrix, centred on the diagonal entry, with a radius equal to the sum of the sizes of everything else in that row. Every eigenvalue lies inside one of the discs, and a group of discs set apart from the rest holds exactly as many eigenvalues as it has discs. Nothing is solved to find them.

algebra · Eigenvectors
The largest value on each plane, over every direction of space. A longitude–latitude map of directions u in three dimensions, each shaded by the largest value of xᵀAx on the plane perpendicular to u. The smallest such value is the middle eigenvalue 1.829, reached at ±v₁; the largest is 3.622, reached along a great circle.

The highest point on the sphere is an eigenvalue

For a symmetric matrix, walk a unit arrow over every direction and record the value of xᵀAx. The highest value reached is the largest eigenvalue, the lowest is the smallest, and every eigenvalue in between is a saddle height, a minimum of maxima. From that one description comes a theorem no formula for the roots could give: delete a row and its column, and every eigenvalue of what is left sits between two of the original's.

algebra · Eigenvectors
Powers of a matrix that shrink in the end. Three curves of the norm of the n-th power of a two-by-two matrix against n on a logarithmic axis: one decays steadily, two rise to peaks of about 18 and 7 before decaying.

A geometric series whose ratio is a matrix

1 + r + r² + … adds to 1/(1 − r) when r is smaller than one. Put a matrix in place of r and the same formula holds, with the inverse matrix in place of the fraction — but what must be smaller than one is not the matrix's size. It is its largest eigenvalue. A matrix whose eigenvalues are 0.9 and 0.8 can stretch vectors ten times over before its powers begin to shrink, and the series still converges, after a detour the eigenvalues say nothing about.

analysis · Geometric series
The trace–determinant plane and the flows it sorts. The plane of trace against determinant, divided by the horizontal axis and the parabola tr² = 4 det into saddle, node, spiral and centre regions, with 6 matrices marked and their phase portraits drawn alongside.

Two numbers decide the flow

A linear system in the plane has four coefficients, and what its solutions do forever afterwards — spiral in, race out, swing round, or split along two lines — is decided by two of the numbers made from them. The plane of trace against determinant is a complete map of the possibilities, and the only places it cannot decide are the lines where it changes its mind.

analysis · The exponential
Which real 2 × 2 matrices have a real logarithm, read off their eigenvalues. Eigenvalues of 7 matrices plotted in the complex plane with the negative real axis emphasised, beside a table saying for each whether a real logarithm exists and why: A yes, B yes, C yes, D no, E no, F yes, G no.

The matrix that has no logarithm

Every square matrix has an exponential, and a matrix exponential is always invertible. The converse fails, and it fails in a way that can be read straight off the eigenvalues — a real matrix with eigenvalues −1 and −2 is no exponential at all, while minus the identity is the exponential of a whole continuum of matrices that do not even commute with each other.

analysis · The exponential
The narrowest door in two 6-cliques joined by one edge, and the gap it pins down. two 6-cliques joined by one edge, with the vertex set of smallest conductance coloured and the 1 edges leaving it thickened. Beside it a logarithmic ruler marks half the conductance squared, the spectral gap and twice the conductance, in that order from the bottom.

The narrowest door sets the pace

How fast a chain forgets is an eigenvalue, and nobody can compute the eigenvalues of a chain worth studying. Cheeger's inequality trades the eigenvalue for a picture — the narrowest door in the state space — and pins the one between the square of the other and twice it. Both ends of that range are reached, on graphs small enough to search completely.

probability · Markov chains
Two different graphs with the same adjacency matrix eigenvalues. a star with four arms: adjacency matrix eigenvalues 2, 0³, −2; a square and a lone point: adjacency matrix eigenvalues 2, 0³, −2. The characteristic polynomials are identical.

Two graphs the eigenvalues cannot tell apart

A graph's matrix has eigenvalues, and they count a surprising amount of the drawing: its edges, its triangles, every closed walk of every length. They do not count everything. A star with four arms and a square beside a lone point have the same eigenvalues exactly, although one of them is in two pieces — and on six points ten of the 156 graphs have a twin of this kind.

algebra · Linear maps
The Hoffman–Singleton graph: five pentagons, five pentagrams. Fifty vertices of degree seven and girth five, built from five pentagons and five pentagrams joined by the rule j of pentagon h to h·i + j of pentagram i.

As many points as two steps allow

In a graph where every point has d neighbours and every point is within two steps of every other, there can be at most d² + 1 points — one, its d neighbours, and d(d − 1) more reached through them. Graphs that meet the bound exactly are rare to the point of absurdity. The pentagon does it for d = 2, the Petersen graph for d = 3, a fifty-point graph found in 1960 for d = 7, and an eigenvalue argument proves there is nothing else — except possibly one graph with 3,250 points and 57 neighbours each, which nobody has found or ruled out.

discrete · Extremal graphs
How many three-state chains constant rates can produce. s 0.05: 94.9%; s 0.1: 90.2%; s 0.2: 79.6%; s 0.3: 70.3%; s 0.5: 47.7%; s 0.7: 22.9%; s 1: 4.3%.

When a table of moves came from steady rates

A process that jumps between states at constant rates, watched once a year, produces a table of yearly moves that is the exponential of its rates. Most tables that anyone could write down are not — a random three-state table is only about one time in twenty-three — and the few that are can have two different sets of rates behind them, but only once the process has forgotten where it started.

analysis · The exponential
The lowest mode of the regular pentagon. Level lines of the first Dirichlet eigenfunction of a regular 5-gon; λ times area 18.9191.

Three sides and four are proved

Among all shapes of a given area, the disc has the smallest lowest eigenvalue. Among triangles it is the equilateral one, among quadrilaterals the square — both proved by sliding chords to an axis. For five sides the regular pentagon wins every computation, every nudge raises its value by the square of the nudge, and there is still no proof.

geometry · Isoperimetric
Five urns, each drawn as walks. Simulated walks of 2000 draws for urns with replacement matrices (0,1,1,0), (2,1,1,2), (3,1,1,3), (7,1,1,7), (1,0,0,1).

An urn forgets its start only below one half

Let each draw from an urn add balls of both colours in fixed amounts, and the long run depends on a single ratio of two eigenvalues. Below one half the urn behaves like a coin, its fluctuations spread like the square root of the draws and settle into a bell. Above one half the first few draws decide most of the outcome, the spread grows faster, and the shape that results is not a bell and depends on how the urn began.

probability · Random walk

Named alongside it

The objects these essays reach for when they reach for this one.

MatrixDeterminantEigenvectorTraceBasisCharacteristic polynomialMatrix exponentialDiagonalisationExhaustive searchInvariant directionMarkov chainQuadratic form

All concepts