Orthogonality
Named by 12 essays across 3 fields — each of them below, with the objects they name alongside it.
A square wave built entirely out of round ones
Add enough sine waves together and flat tops and vertical cliffs appear from nothing. Almost — there is a 9% overshoot that never goes away, and it is not a bug.
The dot product is a shadow
Multiply the matching coordinates and add them up. That rule explains nothing, and it hides the fact that the answer is a length — how far one arrow reaches along another, times how long that other one is.
The directions a map leaves alone
Almost every arrow comes out of a transformation pointing somewhere else. A few come out pointing exactly where they went in, only longer or shorter. Those few decide nearly everything the map does.
Two right angles and the diagonal of a box
The theorem applied once gives the diagonal of a floor. Applied again, standing on the first result, it gives the diagonal of the room — and the pattern does not stop at three, which is where a fact about triangles quietly becomes the definition of distance.
Where the coefficients come from
The recipe for a square wave has a four over pi in front and a one over three on the second term, and the first rung of this ladder used them without saying where they came from. They come from multiplying by one harmonic and taking the area.
![The level curve, and the axes the matrix chooses. The curve xᵀAx = 1 for the matrix [2, 0.8, 0.8, 1.4], drawn by solving for the radius at each angle, with the two eigen-directions marked; they cross at a right angle and are the axes of the curve.](/f/the-level-curve-and-the-axes-the-matrix-chooses-81b169af.svg)
Symmetry forces a right angle
A matrix equal to its own reflection across the diagonal always has real stretches and always has perpendicular directions to stretch along. Neither is true of matrices in general, and both follow from one line of algebra.
![What the map does to a circle. The unit circle with two perpendicular directions marked, and its image under [1.6, 1.2, −0.4, 1.1] — an ellipse whose axes are the images of those two directions, of lengths 2.04 and 1.10.](/f/what-the-map-does-to-a-circle-29ac1dac.svg)
What a map does to a circle
Every linear map sends the unit circle to an ellipse. Two perpendicular directions go to two perpendicular directions, whatever the map is — even a map with no invariant direction at all, and even one that is not square.
When the label may be a matrix
A permutation carries exactly one bit into any commutative target, and commutativity is the restriction doing all the work. Drop it — let the label be a matrix — and what survives is a short finite table, computed here from traces and checked for orthogonality over every pair of rows.
The square that cannot be negative
Cauchy–Schwarz is the load-bearing inequality of the whole subject and is nearly always asserted. It is one line away from a fact nobody would argue with, and the line is a parabola with no room to cross the axis.
One subtraction clears a direction
A basis is a set of directions to measure along, and most bases are awkward because the directions get in each other's way. Removing one shadow at a time turns any basis into one where every coordinate is a shadow and nothing interferes.
The nearest point of a flat thing
More equations than unknowns almost never have a solution. Asking instead for the point of a plane nearest to where the answer should have been turns an unanswerable question into a shadow, and the shadow is what a line of best fit is.
Two families that cross at right angles
Fix two points and draw every ellipse with those foci, then every hyperbola with the same two. Each curve of the first family meets each of the second at a right angle, so between them they are a coordinate system — and the reason is one sentence about angle bisectors.
Named alongside it
The objects these essays reach for when they reach for this one.
Inner productProjectionBasisDot productApproximationEigenvectorMatrixCauchy schwarzConvergenceDeterminantDiagonalisationEigenvalue