Concept

Held-out validation — where it appears

Evaluating a fitted model on data it was not fitted to, which is the only way a residual becomes evidence about anything but the fit. It detects overfitting reliably and detects an unconstrained direction only if the held-out data happen to vary along it.

Named by 7 essays across 3 fields — each of them below, with the objects they name alongside it.

What a camera matrix reports on its own chart, and what it delivers off it. The same camera fitted on charts of increasing chromatic range. The left bar of each pair is the mean error on the chart the matrix was fitted to, which is the number a profile comes with; the right bar is the error on a saturated set it never saw. At the thinnest chart the fit reports 0.19 ΔE00 and delivers 1.65, a factor of 8.6. The gap closes as the chart widens, and it closes because the chart improves rather than because the camera does.

The chart decides the profile

A camera's colour matrix is nine numbers fitted to a set of patches somebody chose, and the number that comes with it is the error on those patches. On a chart with no chromatic range that number is 0.19 ΔE00 and the matrix delivers 1.65 — and a second matrix, indistinguishable on the chart, delivers 2.03.

imaging · Capture
A camera matrix fitted under each light, used under each light. Mean ΔE00 over the same surfaces, with the matrix fitted under the row's light and the scene under the column's. The diagonal is what a profile's data sheet quotes and is between 1.0 and 1.2 everywhere. Off it the numbers rise steeply: the matrix fitted under illuminant A reports 1.17 there and delivers 9.34 under a 9000 K daylight, a factor of 8.0. Nothing about the camera changes between cells.

A matrix is fitted under one light

A camera's colour matrix is nine numbers determined by a chart photographed under a particular illuminant, and the error it quotes is the error under that illuminant. Fitted under a tungsten lamp and used under a cold sky it delivers eight times as much — and the two-matrix scheme every real profile uses turns out not to be a compromise at all.

imaging · Capture
What each fitted thing in these essays carries, what its data fix, and what is left. Three columns per row: how many numbers the model has, how many the stated data determine, and the difference — the dimension of the family that fits equally well. The third column is the one nobody publishes. A zero there does not mean the model is right; it means it is determined, which is a much weaker property and is compatible with being determined badly, as the camera row is.

A fit can be exact and empty

Every fitted object here reports one number, the residual on the data it was fitted to, and every one of them has two more that nobody publishes — how many of its parameters the data actually determine, and how large the family of equally good answers is. The third column is where the failures live.

limits · Limits
What the next thousand patches buy a printer profile. A profile is a table, exact at its nodes and interpolated everywhere else. Each mark is a grid: the horizontal axis is how many patches somebody had to print and measure, the vertical is the worst error found between the nodes. Going from 135 patches to 3645 — 27.0× the work — buys 8.4× the accuracy. The error falls with the square of the spacing and the count rises with its cube.

A profile is a fit between its nodes

A printer profile is a table, exact at every patch that was printed and interpolated everywhere else — and everywhere else is where every job lives. Going from a hundred and thirty-five patches to three and a half thousand is twenty-seven times the work for eight times the accuracy, and the exponents say that is as good as it gets.

applied · Delivery
Each departure over forty-two surfaces rather than one. The same six departures measured over a family of forty-two analytic reflectances — an absorption band of stated centre, width and depth — with the smallest, the median, the ninety-fifth percentile and the largest marked. Every one of them spans more than a factor of three, and the ranking between them is not stable across the family: what decides a departure's size is which sample it is asked about, because a departure is a pairing and the sample is one of the two factors. Quoting any single number for what an observer's age is worth is quoting a choice of example.

The chart was measured by an observer too

A camera profile is fitted so that the camera's numbers reproduce the chart's measured tristimulus values. Those values were computed through the 1931 observer, so the fit inherits every departure in this round — and the fit's own residual, at 0.19 ΔE₀₀ on the chart, is fifteen times smaller than the term it cannot see.

imaging · Capture
Three corrections for the corner of a frame, each made under daylight. The mean colour difference over twenty-four coloured patches between the centre of a frame and its corner, against the angle light arrives at, after three corrections each fitted under daylight, D65 and used under it: a grey-card gain map, a correction confined to the red channel's row, and a full three-by-three matrix. All three leave the grey exact. At 25° the gain map leaves 1.86, the red row 0.93 and the matrix 0.90; at 35°, 3.81, 1.95 and 1.81. Six more numbers buy almost nothing, because the moved edge is in one channel.

A corner is corrected by one row

A grey-card gain map makes the corner of a frame exactly right on grey and leaves coloured patches 1.86 colour differences wrong at twenty-five degrees. A three-by-three matrix fitted at that position halves it — and six of its nine numbers do nothing, because the moved filter edge is in one channel. The three that matter rebuild the lost red from green and blue, they carry to another lamp better than a gain map in eleven cases of twelve, and in the twelfth, a row fitted under tungsten and used in daylight, they leave the grey 9.2 off.

imaging · Capture
Four ways to correct the corner, under each of four lamps, at 25°. The mean colour error left on the chart's coloured patches at the corner of the frame, under each lamp, after: the red row fitted under that lamp; one red row fitted on the chart under all four lamps with the grey held under daylight; a grey-card gain map calibrated under daylight; and the worst of the other lamps' rows used by mistake. daylight: 0.93, 1.33, 1.86, 4.91; tungsten: 0.99, 1.45, 1.87, 3.26; white LED: 0.36, 1.39, 3.28, 1.77; fluorescent: 0.37, 1.56, 3.09, 2.45. The pooled row holds every lamp between 1.33 and 1.56.

One row for every lamp costs the lamps that lose least

A corner correction fitted under one lamp is right under that lamp and can be badly wrong under another, so a converter unsure of its lamp was offered a single row fitted under several at once. Pooled over four lamps, one row holds every lamp's corner between 1.33 and 1.56 colour differences — no lamp worse than a grey-card map, and none near the 4.91 a wrong row can leave. The price falls on the white LED and the fluorescent tube, which it leaves four times worse than their own rows, because they lose the least red at the corner and the pooled row is built to repair the lamps that lose the most. Two rows, one per class of lamp, keep almost all of both.

imaging · Capture

Named alongside it

The objects these essays reach for when they reach for this one.

CalibrationCamera rawColour matrixIdentifiabilityLeast-squaresIlluminantSpectral sensitivityWhite balanceDegrees of freedomThe ICC profileInfraredInterpolation

All concepts