Orthogonality
Named by 19 essays across 4 fields — each of them below, with the objects they name alongside it.
A square wave built entirely out of round ones
Add enough sine waves together and flat tops and vertical cliffs appear from nothing. Almost — there is a 9% overshoot that never goes away, and it is not a bug.
The dot product is a shadow
Multiply the matching coordinates and add them up. That rule explains nothing, and it hides the fact that the answer is a length — how far one arrow reaches along another, times how long that other one is.
The directions a map leaves alone
Almost every arrow comes out of a transformation pointing somewhere else. A few come out pointing exactly where they went in, only longer or shorter. Those few decide nearly everything the map does.
Two right angles and the diagonal of a box
The theorem applied once gives the diagonal of a floor. Applied again, standing on the first result, it gives the diagonal of the room — and the pattern does not stop at three, which is where a fact about triangles quietly becomes the definition of distance.
Where the coefficients come from
The recipe for a square wave has a four over pi in front and a one over three on the second term, and the essay that built a square wave from sines used them without saying where they came from. They come from multiplying by one harmonic and taking the area.
![The level curve, and the axes the matrix chooses. The curve xᵀAx = 1 for the matrix [2, 0.8, 0.8, 1.4], drawn by solving for the radius at each angle, with the two eigen-directions marked; they cross at a right angle and are the axes of the curve.](/f/the-level-curve-and-the-axes-the-matrix-chooses-81b169af.svg)
Symmetry forces a right angle
A matrix equal to its own reflection across the diagonal always has real stretches and always has perpendicular directions to stretch along. Neither is true of matrices in general, and both follow from one line of algebra.
![What the map does to a circle. The unit circle with two perpendicular directions marked, and its image under [1.6, 1.2, −0.4, 1.1] — an ellipse whose axes are the images of those two directions, of lengths 2.04 and 1.10.](/f/what-the-map-does-to-a-circle-29ac1dac.svg)
What a map does to a circle
Every linear map sends the unit circle to an ellipse. Two perpendicular directions go to two perpendicular directions, whatever the map is — even a map with no invariant direction at all, and even one that is not square.
When the label may be a matrix
A permutation carries exactly one bit into any commutative target, and commutativity is the restriction doing all the work. Drop it — let the label be a matrix — and what survives is a short finite table, computed here from traces and checked for orthogonality over every pair of rows.
The square that cannot be negative
Cauchy–Schwarz is the load-bearing inequality of the whole subject and is nearly always stated without proof. It is one line away from a fact nobody would argue with, and the line is a parabola with no room to cross the axis.
One subtraction clears a direction
A basis is a set of directions to measure along, and most bases are awkward because the directions get in each other's way. Removing one shadow at a time turns any basis into one where every coordinate is a shadow and nothing interferes.
The nearest point of a flat thing
More equations than unknowns almost never have a solution. Asking instead for the point of a plane nearest to where the answer should have been turns an unanswerable question into a shadow, and the shadow is what a line of best fit is.
Two families that cross at right angles
Fix two points and draw every ellipse with those foci, then every hyperbola with the same two. Each curve of the first family meets each of the second at a right angle, so between them they are a coordinate system — and the reason is one sentence about angle bisectors.
Moving a map across a product
The transpose looks like a fact about a matrix: reflect its entries in the diagonal. It is a fact about the inner product. Measure lengths and angles differently and the map that slides to the other side of the product is a different matrix, and a matrix that was symmetric stops being so.
A denominator that reaches past the radius
The Taylor series of ln(1 + x) is useless beyond x = 1 however many terms it is given. The same coefficients spent on a numerator and a denominator converge at x = 3, and at x = 100, because a polynomial cannot imitate a singularity and a quotient of two polynomials can.
A plane disguised as an arrow
The cross product of two arrows is an arrow perpendicular to both, as long as the area of their parallelogram. Reflect everything in a mirror and it points the wrong way, because it was never an arrow: it is a plane, written as the one direction a plane in three dimensions leaves over.
Equal diagonals in a curved quadrilateral
Two ellipses and two hyperbolas sharing the same foci cut out a four-sided region with curved sides and no symmetry to speak of. Its two diagonals are nevertheless exactly equal. The reason is a stretch that carries one ellipse onto the other and moves every pair of points so that crossed distances match — a property only confocal curves have.
Every third coefficient
Add every third number in the twelfth row of Pascal's triangle and the answer is 1366 — a third of 4096, rounded up. Which way the rounding goes is decided by two arrows of length one in the complex plane, and the same average over the roots of unity counts dice totals, subsets and necklaces.
The subsequence that has to exist
Every bounded list of numbers has a part that settles down. A bounded list of functions need not: the waves sin 2πkx never come within 1.76 of one another. One extra condition — that no member may change faster than a bound they all share — restores the guarantee, and it is the reason a differential equation with a continuous rule has a solution at all.
A sphere that is nearly all equator
On an ordinary globe, the band within a tenth of the radius of the equator holds a tenth of the surface. On a sphere in a thousand dimensions the same band holds 99.85% of it, and the band of a fifth holds all but about two parts in ten billion. Almost every point of a high-dimensional sphere is near every equator at once — and so any function that cannot change quickly is, over almost all of the sphere, almost constant.
Named alongside it
The objects these essays reach for when they reach for this one.
Inner productProjectionApproximationBasisDot productEigenvectorMatrixCauchy schwarzConvergenceDeterminantLeast squaresPositive definite