Series

Capture — the series

73 essays on one idea, from the one that introduces it to the one that assumes the rest.
  1. A camera's spectral sensitivities, after the infrared-cut filter. Silicon quantum efficiency times the colour-filter dye times the infrared-cut filter, per channel, on a grid running to 1100 nm rather than to 780. With the filter removed, 68 per cent of the area under the three curves lies beyond the visible band, and all three curves are the same curve out there.

    A camera is a fourth observer

    The 1931 functions, the 1964 functions and a person's own cones are three sets of three curves that collapse a spectrum onto three numbers. A camera is a fourth, built from silicon and dye rather than from pigment and neural wiring, and it agrees with none of them.

    part 1 · imaging
  2. Everything between the photons and the picture, and what each stage decides. The 8 stages of a camera pipeline. Only the second is physics; every one after it is a decision somebody made, and the reason two cameras pointed at the same scene disagree is that they made different ones.

    Raw is not a picture

    A raw file is three integrals per site and a list of decisions nobody has taken yet. Every one of those decisions has a defensible answer and none of them has a correct one, which is why two converters open the same file and disagree.

    part 1 · imaging
  3. The blue channel, as the three things multiplied to make it. Silicon's quantum efficiency, the colour-filter dye's transmittance, and their product. The dye is the only stage carrying any colour information and it is clear above about 800 nm — transmittance 0.92 at 900 nm against 0.06 at 550.

    Silicon sees past the visible

    A sensor's response ends at 1107 nanometres because that is the band gap, and the colour-filter dyes have stopped absorbing three hundred nanometres before it. So all three channels measure the same thing over the last third of the range, and every published sensitivity plot is drawn after the component that hides it.

    part 2 · imaging
  4. How much of what an unfiltered sensor records is invisible. The share of a camera's raw signal coming from beyond 780 nm, against the colour temperature of the lamp, for one surface with a near-infrared reflectance of 0.62. Without the filter it runs from 98 per cent at 2000 K to 51 at 9000; with it, under five per cent everywhere.

    The filter that makes colour possible

    An infrared-cut filter is not a refinement on a colour camera. Removing it collapses the separation between the three channels by a factor of nearly nine under tungsten, and the component that keeps colour photography working is the one nobody photographs.

    part 2 · imaging
  5. A silicon sensor's best possible impersonation of the standard observer. The 1931 matching functions in outline, and the closest linear combination of the sensor's three sensitivities laid over them; underneath, what is left over at each wavelength. The residual is 31.7 per cent of the matching functions' own magnitude, worst at 440 nm. Colour reproduction is exact if and only if this is zero.

    Luther said when it would work

    There is an exact condition under which a fixed three-by-three matrix converts camera raw to XYZ correctly for every spectrum in existence. It was stated in 1927, it is a theorem rather than a guideline, and no camera ever built satisfies it.

    part 2 · imaging
  6. A grey edge, reconstructed from a Bayer row, arrives coloured. Above: an achromatic step through 24 sensor sites, with green sampled on the even ones and red on the odd. Interpolating each channel separately reconstructs them from data taken on either side of the edge, so their ratio moves. Below: the resulting chroma, peaking at 144 per cent of the local mean, and 112 per cent once colour differences are interpolated instead.

    A grey edge arrives coloured

    A sensor site measures one channel and the other two are interpolated from neighbours that sat somewhere else. Across a black-and-white step that reconstruction gives an achromatic scene a chroma of 144 per cent of its own local mean, and nothing in the scene or the sensor was coloured.

    part 2 · imaging
  7. One reflectance, four different infrared tails, and what the camera makes of each. The same visible reflectance continued past 780 nm to four different near-infrared values. A spectrophotometer reports only the left-hand part; an unfiltered sensor integrates all of it. The channel spread falls from 0.14 at a tail of 0.05 to 0.02 at 0.85, with nothing about the visible half changed.

    Most things are pale in the infrared

    A spectrophotometer stops at 780 nanometres and a black cotton shirt reflecting five per cent of visible light reflects more than half the near infrared. The measurement everybody has and the quantity a camera integrates are different quantities, and nothing in the first says so.

    part 3 · imaging
  8. Two reflectances the camera records as identical. Constructed by projecting onto the null space of the sensor's own sensitivities, so the two raw triples agree to 0.0000 per cent. To the eye they are ΔE00 15.33 apart, which the swatches show.

    The camera has its own metamers

    Two surfaces a camera records as identical can be plainly different to a person, and two a person cannot tell apart can be recorded as different. Both pairs are constructed rather than found, from one projection, used for both.

    part 3 · imaging
  9. A camera profile is a fit, and the sample set is a hidden argument to it. Per-surface ΔE00 after the best 3 × 3 from raw to XYZ, fitted on 12 surfaces at chroma 0.2 and tested twice: on those same surfaces (mean 0.65) and on 12 at chroma 0.9 (mean 1.75). Both bars come from the same matrix; only the surfaces differ.

    A camera profile is a fit

    Since no matrix is exact, the one a manufacturer ships is a least-squares compromise over a set of surfaces somebody chose. Fitted on desaturated patches it is excellent on desaturated patches — and the sample set is a hidden argument to every camera profile in existence.

    part 3 · imaging
  10. A clipped channel turns the hue of what is left. CIELAB hue shift against exposure for one saturated stimulus, measured against the same stimulus rendered without clipping. Nothing moves until the first channel reaches the ceiling at 0.25 stops; after that the recorded hue rotates by as much as 67 degrees, with nothing in the scene having changed colour.

    A blown highlight turns

    An exposure that clips nothing changes no hue at all. Once one channel reaches the ceiling the recorded hue rotates by as much as sixty-seven degrees, with nothing in the scene having changed colour — and every response a converter can make to that is an invention.

    part 3 · imaging
  11. The best a camera profile can do on the surfaces it was fitted to. Per-surface ΔE00 after the best 3 × 3 from raw to XYZ, fitted on 12 surfaces at chroma 0.7 and tested on those same 12 surfaces — mean 1.45, worst 2.58. This is the most favourable measurement it is possible to make of a camera and it is the one usually published.

    No matrix is right everywhere

    The best three-by-three this sensor admits, fitted and tested on the same twenty-four surfaces, leaves a worst case of ΔE00 2.85. A control sensor built to satisfy Luther's condition reaches ten to the minus seven under the identical computation, which is what makes the first number a measurement.

    part 4 · imaging
  12. Recovering the lamp from a highlight rather than from an assumption. A green scene under illuminant A. The faint curve is the true lamp; the solid one is what the interface component of the glossy surfaces recovers, which is 0.30° from it. Grey-world on the same scene is 42.1° and max-RGB 17.5°, because both are assumptions about the surfaces and a Fresnel reflection is not.

    The highlight is the white balance

    Every estimator a camera uses is an assumption about the scene wearing the costume of a measurement. The specular component of a glossy surface is not — it carries the illuminant to within a third of a degree on a scene where averaging is fifty times worse, and it does so without knowing what colour the paint underneath is.

    part 4 · imaging
  13. Correcting colour costs noise, and the two cannot both be least. Sweeping the colour matrix from its own diagonal — a white balance with no cross terms — to the full least-squares fit. Mean ΔE00 falls from 18.61 to 1.29; photon noise rises by a factor of 1.03. At 10000 photons per pixel.

    Correcting colour costs noise

    The matrix that turns a sensor's raw into XYZ has large off-diagonal terms of both signs, because that is what correcting a sensor which fails Luther's condition requires. Differences of large numbers are where noise grows, and the full correction amplifies photon noise by 1.66 times.

    part 4 · imaging
  14. A camera's spectral sensitivities, with the filter removed. Silicon quantum efficiency times the colour-filter dye times nothing else, per channel, on a grid running to 1100 nm rather than to 780. With the filter removed, 68 per cent of the area under the three curves lies beyond the visible band, and all three curves are the same curve out there.

    The grid outside every figure

    Every figure here is computed on 380 to 780 nanometres, which is exactly right for an eye and insufficient for a sensor. This field met the first subject the grid cannot hold, and the decision was not to widen it — because widening it honestly is impossible.

    part 4 · imaging
  15. Everything between the photons and the picture, and what each stage decides. The 8 stages of a camera pipeline. Only the second is physics; every one after it is a decision somebody made, and the reason two cameras pointed at the same scene disagree is that they made different ones.

    A photograph is not a measurement

    A photograph is a measurement made by an instrument whose kernel nobody published, under an illuminant nobody recorded, corrected by a matrix fitted to somebody else's surfaces, with two thirds of every pixel invented. It supports relative claims well and absolute ones badly, and it is used for the second.

    part 5 · imaging
  16. How wrong a camera profile is, and who it is wrong for. A colour matrix fitted against the 1931 observer, evaluated four ways. Its residual against that observer is ΔE00 0.92 — the Luther failure, which is a property of the sensor and is the honest measurement of the camera. Against a person drawn from a population of 160, the worst-off twentieth report 3.35. And a camera with no spectral error whatever, reporting the standard observer's own tristimulus values exactly, would leave 3.47. The camera is not the problem. It was fitted to somebody who does not exist, and so is the standard it was fitted against.

    Fitted to an eye nobody has

    A camera profile's residual against the observer it was fitted to is under a unit, and that is the number everybody quotes. Against a person drawn from a population it is 3.35 at the ninety-fifth percentile — and a camera with no spectral error whatever, reporting the standard observer's tristimulus values exactly, would carry 3.47. The camera is not the problem.

    part 6 · imaging
  17. The same flicker, written across the frame. A rolling shutter exposes each row of the sensor at a different moment, so a lamp that flickers above fusion is recorded as bands. There are 1.7 of them here — the readout time times the lamp's frequency, which is a camera setting and not a property of the light — spanning 2.37 stops. Held at matched luminance the lightest band and the darkest are still ΔE00 5.40 apart in colour, because the two drive currents are two spectra and the shutter caught one of each.

    The shutter samples the lamp

    A lamp switched between two drive currents at a hundred hertz is one steady colour to a person and two spectra to a camera. A thousandth-of-a-second exposure catches whichever phase the shutter opened at — two and a third stops of exposure and five units of colour, decided by nothing but timing — and a rolling shutter writes the difference across the frame as bands.

    part 6 · imaging
  18. The lamps the four conditions shine, where they differ. The short-wave half of what each measurement condition puts on the sample, plotted to 560 nanometres because past that the three are indistinguishable in shape. M₁ is D50 with its ultraviolet; M₂ is the same lamp behind a cut filter at 400 nanometres, and at 360 it is 0.0 per cent of what M₁ delivers; M₀ is a tungsten lamp, which has some ultraviolet, has less than daylight, and is not specified at all by the standard — so two M₀ instruments need not agree with each other. M₃ is not plotted because its lamp is M₂'s; what makes it a fourth condition is a polariser.

    The lamp that stopped emitting ultraviolet

    A blue-pumped white LED has a die at 450 nanometres and emits nothing shorter. Between about 2005 and 2020 that lamp replaced almost every other indoor source, which removed the excitation supply from a great many rooms — so brightened materials stopped glowing indoors without a single one of them being reformulated.

    part 6 · imaging
  19. The basis a camera balances in is a different basis for every light. A camera's white balance is a per-channel gain on raw values, which is a von Kries adaptation in whatever basis the filter dyes give it. That basis is not a property of the dyes alone: it is the dyes and the light in the room, and it moves when the light does. Each bar is how far the basis has turned, in degrees, from where it sits under D65. A sensor satisfying the Luther condition would have a bar of exactly zero on every row, because for such a sensor the light cancels — which is the one property nobody buys a sensor for.

    A camera balances in another basis

    White balance is a per-channel gain on raw values, which makes it a von Kries adaptation in whatever axes the filter dyes happen to give. Those axes are not a property of the dyes alone — they move with the light, by up to seventeen degrees across the adaptation census — and the sensor for which they would not move is the one that adapts worst of all.

    part 7 · imaging
  20. Two lamps of the same colour, and one sheet that is two colours under them. The same brightened sheet under a xenon flash, the same flash behind its cover glass, and a phosphor-converted white LED of nearly the same chromaticity. Each patch is computed relative to its own lamp's white, which is what a perfect white balance does — so everything a camera can see and correct has already been removed. What is left is ΔE00 11.8 between the first and the last, against 3.2 between the two lamps themselves. The LED has no emission below 380 nanometres at all, because its pump die is at 450, so the sheet simply does not fluoresce under it and nothing in the photograph records why.

    A camera cannot record the excitation

    Two lamps of nearly the same chromaticity, one with ultraviolet and one with none, put a brightened sheet twelve units apart after a perfect white balance. Nothing in the camera measured the difference — the filter stack removed the band before the sensor saw it — so the correction that would fix the picture needs a quantity the file does not contain.

    part 8 · imaging
  21. What a camera matrix reports on its own chart, and what it delivers off it. The same camera fitted on charts of increasing chromatic range. The left bar of each pair is the mean error on the chart the matrix was fitted to, which is the number a profile comes with; the right bar is the error on a saturated set it never saw. At the thinnest chart the fit reports 0.19 ΔE00 and delivers 1.65, a factor of 8.6. The gap closes as the chart widens, and it closes because the chart improves rather than because the camera does.

    The chart decides the profile

    A camera's colour matrix is nine numbers fitted to a set of patches somebody chose, and the number that comes with it is the error on those patches. On a chart with no chromatic range that number is 0.19 ΔE00 and the matrix delivers 1.65 — and a second matrix, indistinguishable on the chart, delivers 2.03.

    part 9 · imaging
  22. A camera matrix fitted under each light, used under each light. Mean ΔE00 over the same surfaces, with the matrix fitted under the row's light and the scene under the column's. The diagonal is what a profile's data sheet quotes and is between 1.0 and 1.2 everywhere. Off it the numbers rise steeply: the matrix fitted under illuminant A reports 1.17 there and delivers 9.34 under a 9000 K daylight, a factor of 8.0. Nothing about the camera changes between cells.

    A matrix is fitted under one light

    A camera's colour matrix is nine numbers determined by a chart photographed under a particular illuminant, and the error it quotes is the error under that illuminant. Fitted under a tungsten lamp and used under a cold sky it delivers eight times as much — and the two-matrix scheme every real profile uses turns out not to be a compromise at all.

    part 9 · imaging
  23. The dyes a camera has, and the dyes an adaptation basis would want. Three sensor sensitivities drawn twice: faintly, the silicon-and-filter-array set this collection models, and boldly, three Gaussian dyes chosen to make the inverse of their own response matrix a good basis for a white-balance gain. The designed dyes sit at 610, 542, 449 nm with widths of 35, 26, 30 nm — narrower and further apart than the real ones, which is what sharpening looks like when a search rather than a committee does it. They leave 0.97 ΔE00 against the real sensor's 1.62, and they are held within 0.28 of the Luther condition so that the result is still a camera.

    A sensor designed for its inverse

    A camera's white balance is a gain in a basis made from its own dyes and the light in the room. Choose the dyes for that basis instead of for cost and quantum efficiency, hold the sensor within a stated distance of the Luther condition, and the design reaches the best adaptation figure any basis achieves — and then the room moves it.

    part 10 · imaging
  24. Four cameras that all satisfy the Luther condition exactly. Four sensors whose sensitivities are linear combinations of the colour-matching functions — the theoretical ideal, satisfying the condition to machine precision, each with an adaptation basis that does not move when the light does. They differ only in which linear combination, which the condition does not constrain, and they leave 2.46, 0.97, 1.65, 2.37 ΔE00 after a white balance. The best of them reaches 0.974, which is the best any basis at all achieves. Being a perfect colorimeter costs nothing in adaptation; what costs is the mixing matrix, and the control measured here carries one nobody chose.

    The condition chooses no axes

    It has long been said here that a sensor satisfying the Luther condition exactly adapts worse than a silicon one, and offered a reason — that its channels are the matching functions, and a gain on those is the oldest mistake in the subject. The measurement was of one sensor. The condition leaves the axes entirely free.

    part 10 · imaging
  25. A camera's dye widths are free under one requirement and not under another. Three panels, one per dye. In each, a pair of bars per requirement: how far that dye's centre wavelength and its bandwidth can move before the requirement gets five per cent worse. Under the adaptation objective — the one the previous round measured — every width has far more room than its centre, which is the finding that put a tolerance budget on the centres. Throughput and the colour matrix's noise gain, the two requirements that objective was said to be silent about, reach the edge of the search in every direction and hold nothing. What tightens the widths is the Luther residual, which was in the model already. The bottom pair in each panel is what survives all four.

    The widths were free because nothing else was asked

    A camera's three dye bandwidths carry almost all of the flattest direction of the adaptation objective, so that objective says a tolerance budget belongs on the centre wavelengths. The two requirements it was said to be silent about turn out not to bind either — and the one that does was in the model already.

    part 10 · imaging
  26. Which of a camera's three dyes each direction moves. A grid with one column per direction — stiffest on the left, flattest on the right — and one row per parameter of a camera's three dyes. Each cell's bar length is that parameter's share of that direction, so a column with one long bar is a direction that moves one thing. The stiffest column is dominated by blue centre, at a weight of 0.96. The flattest column is spread across blue width, red width, green width — a combination rather than any single number, which is why a specification listing one tolerance per parameter cannot express it.

    Where a camera is blind to itself

    A colour filter array is six numbers — three dye centres and three bandwidths — and how well the resulting sensor adapts is far more sensitive to some combinations than to others. The stiffest direction is almost entirely where the blue dye sits. The flattest is all three bandwidths at once, and the design can move twenty-five times further along it for the same cost.

    part 11 · imaging
  27. What a camera's dye 1 is allowed to be, under four requirements. The plane a colour-filter dye is designed in: its centre wavelength across, its bandwidth up, both in nanometres, so the two axes are comparable and the shapes mean something. Four outlines, one per requirement, each the set of dyes within five per cent of the designed one on that requirement; the shaded region is where all four hold. Two of the four — throughput and the colour matrix's noise gain — reach the edge of the search in every direction and are invisible as boundaries. The intersection is ±6.8 nanometres of centre and ±13.3 of width, against the adaptation objective's own ±20.6 in width alone.

    Two tolerances do not meet in a tolerance

    A specification lists requirements separately and a manufacturer has to satisfy them together. Where two long thin regions cross at an angle, what is left is much smaller than either, its longest direction is neither of theirs, and no list of tolerances describes it.

    part 11 · imaging
  28. How far each census row moves when the test set's own description does. A grid of bars, one row per change of light in the census and one bar in each row per number that describes the region the test surfaces are drawn from: how saturated they are, how bright, and how far the two modulations may go together. A bar's length is the elasticity — the proportional change in the published residual for a proportional change in that number. Saturation runs from 0.49 to 0.91 and brightness averages 0.104, so a test set's chroma range is nearly everything and its lightness range is nearly nothing. For scale, the largest elasticity found anywhere among this collection's five declared population widths is about a half — and those at least have declared ranges, while these three numbers have never been quoted with one.

    A chart decides what a camera scores

    A camera profile's reported error changes by a factor of five when the test chart's saturation changes, with the camera and its matrix untouched. The elasticity is 0.67 — the same figure, to two per cent, that an entirely unrelated measurement over an entirely unrelated set of surfaces gives.

    part 11 · imaging
  29. Two sensitivities from two libraries, under every unit. Two quantities that share no code, no test set and no physical question: how much the adaptation census's residual depends on how saturated its surfaces are, and how much a camera profile's reported error depends on how saturated its test chart is. The first is a mean over fourteen changes of light built from cosine combinations; the second is one number about one silicon sensor scored on Gaussian bumps. Under the published unit they sit at 0.687 and 0.656. Across the whole menu they move together, from about 0.5 under the appearance unit to about 1.15 under plain CIELAB, staying within 12 per cent of each other at the worst point. Two numbers agreeing once is a coincidence; two curves agreeing at six points across a factor of two and a half is a shared mechanism, and the mechanism is the compression the unit applies to a chroma difference.

    The coincidence was a mechanism

    Two sensitivities from two libraries with no shared code came out two per cent apart, and the claim made about them was that they share a mechanism rather than a number. That claim has a colour-difference formula inside it, so it can be tested by changing the formula — and both curves move together across the whole menu, from 0.5 to 1.15.

    part 12 · imaging
  30. What is read at each distance from the edge of a lit region. Three materials under a half-plane of light, with the boundary at the centre of the horizontal axis and the lit side on the right. The vertical axis is the radiance leaving the surface as a share of what it leaves far inside the lit region. On the unlit side the sample is emitting light while receiving none, so the ratio the model calls a reflectance has a zero denominator there. The distance over which the curve runs from a tenth to nine tenths is 0.21 millimetres on coated paper and 5.1 on pale marble — which is the width of the neighbourhood a point's colour is decided by.

    A pixel has an aperture too

    A camera photographing a translucent object has the same two discs a spectrophotometer has — one lit, one looked at — and gets them the other way round. Its illumination covers the whole scene, so the flat colour of a translucent surface comes out exactly right at any magnification, and the error moves entirely into the edges.

    part 12 · imaging
  31. A camera matrix refitted to minimise each unit, rather than solved in XYZ. Every camera profile here, and as far as can be told every camera profile anybody ships, is a linear least-squares solve in XYZ. That is an objective and it is on nobody's menu: it weights a difference by how large the tristimulus values are. Each row here refits the same 3×3 by direct search to minimise one of the six units instead. The upper bar is how much better the fit gets in that unit; the lower is how far the matrix itself moves, as a relative Frobenius norm. Both matter and they do not agree: CAM16-UCS moves the matrix least, at 0.34 per cent, for the largest improvement of the six, while ΔE*94 moves it 6.8 times as far for less. A score that changes is a report changing; a matrix that changes is the camera rendering different pixels.

    The objective nobody chose

    Every camera profile here, and as far as can be told everywhere, is a linear least-squares solve in tristimulus space. That is an objective and it is on nobody's menu — it weights an error by how bright the patch is. Refitting the same matrix to minimise a real colour-difference formula improves the fit in all six, and moves the matrix, which means different pixels rather than a different report.

    part 13 · imaging
  32. The collection's adaptation census, with its surfaces departed. Each row is one of the fourteen changes of light in this site's adaptation census, and the bar is what a von Kries gain leaves behind. The open marks are the published numbers; the filled ones are the same computation with every one of the hundred and twenty-five test surfaces replaced by what an instrument with an aperture, or a room with a direction in it, actually reports. Nothing moves by more than 9 per cent. A departure that does not depend on the light is very largely absorbed by the observer's own gain, because it changes the reflectance and the gain is applied afterwards. The fourth departure is not on this chart and cannot be: a fluorescent sample has a different curve under every light, so there is no set of reflectances to hand the census at all.

    The chart was measured, not photographed

    A camera profile is fitted so that the camera's response maps onto the chart's tristimulus values, and those values came out of a spectrophotometer. So the profile's target carries the instrument's departures and the camera does not — a mildly translucent chart read through a four-millimetre aperture supplies targets 2.55 ΔE₀₀ from the truth, which is twice the profile's own fitting error.

    part 13 · imaging
  33. Each departure over forty-two surfaces rather than one. The same six departures measured over a family of forty-two analytic reflectances — an absorption band of stated centre, width and depth — with the smallest, the median, the ninety-fifth percentile and the largest marked. Every one of them spans more than a factor of three, and the ranking between them is not stable across the family: what decides a departure's size is which sample it is asked about, because a departure is a pairing and the sample is one of the two factors. Quoting any single number for what an observer's age is worth is quoting a choice of example.

    The chart was measured by an observer too

    A camera profile is fitted so that the camera's numbers reproduce the chart's measured tristimulus values. Those values were computed through the 1931 observer, so the fit inherits every departure in this round — and the fit's own residual, at 0.19 ΔE₀₀ on the chart, is fifteen times smaller than the term it cannot see.

    part 14 · imaging
  34. The arguments a standard observer does not have. Seven choices inside a set of colour-matching functions, each with the shape it takes and what it is worth in ΔE₀₀ on a red pigment under a 6500 K radiator. Six are measurements: a field size, an age, a macular density, a cone optical density, three peak wavelengths and a rod contribution. The seventh is not — a change of basis is a change of curves and not a change of observer, and its entry is exactly zero because the space an experiment measures is what an observer is. Printing that zero beside the others is the clearest statement of what the other six are measurements of.

    A sensor has no lens

    A camera is a fourth observer and it is the only one with none of the six arguments this round measured. It does not age, it has no macular pigment, its response does not broaden with density and its peaks do not vary — so it is perfectly reproducible and is not any of the observers it is fitted to reproduce.

    part 15 · imaging
  35. Three exchanges, two of which move the colour. The documented pipeline is a white balance, a colour matrix, a tone curve and a clip. Each bar is what happens when two neighbours change places, over 30 surfaces the modelled sensor captures: the filled bar is the mean and the tick is the worst patch. Exchanging the balance and the matrix costs 9.2 colour differences at the mean and 13.2 at the worst. Exchanging the curve and the clip costs exactly nothing, and that is a theorem rather than a small number: a monotone curve onto the unit interval commutes with clamping to it.

    The order is not in the documentation

    A raw converter performs a white balance, a colour matrix, a tone curve and a clip, and every account of the process lists them in that order without saying the order decides anything. Exchanging the first two moves the picture by nine colour differences at the mean and thirteen at the worst patch. The twenty-four arrangements collapse into five outcomes running out to sixty-five, and nothing a converter ships says which of them it is.

    part 16 · imaging
  36. Where the mosaic is filled in, along one row through an edge. A Bayer row across a step from 0.9 to 0.08, in units of the sensor's own ceiling, reconstructed in linear light and reconstructed after the tone curve, with the second undone so the two are compared at the same point in the chain. Away from the edge they agree to 8.3e-14, because a constant interpolates to itself under any curve. At the edge they differ by 5.78 colour differences. Interpolating encoded values pulls an edge towards its dark side.

    One step has no choice

    Four of a raw converter's operations can be arranged twenty-four ways. The reconstruction cannot be arranged at all — a colour matrix needs three numbers and a mosaic site has one, so filling in the mosaic is forced to the front by arithmetic rather than by convention. What is not forced is whether it happens in linear light or after the curve, and that decision costs 5.8 colour differences at an ordinary edge and nothing at all four sites away from it.

    part 16 · imaging
  37. A hue circle through a per-channel curve. 28 colours on a circle of constant lightness 55 and chroma 38, each put through the tone curve one channel at a time and read back. The curve is a function of a single number and has no idea what hue is, and it rotates the circle by up to 4.4 degrees — largest at hue 260 — while raising chroma by a factor of 1.27 and lightness by about 1 units.

    A contrast control is three controls

    A tone curve is a function of one number at a time and knows nothing about hue. Applied to each channel separately it rotates a hue circle by up to seventeen degrees, raises chroma by a factor of 1.27 at ordinary strength, and lifts lightness — so a photographer who moves a contrast slider has moved three things and the interface names one of them. All three scale with the curve's strength, monotonically, and the hue rotation depends on which hue it is.

    part 17 · imaging
  38. A stop taken in raw, and the same lightness reached afterwards. Each row is a stop of exposure applied to the raw values, against a gain applied after the whole pipeline and solved so that an eighteen per cent grey comes out at the same lightness. The two are then the same brightness by construction and differ by 4.2 colour differences at the mean and 11.1 at the worst patch. A stop is a scalar in front of the curve and is not a scalar behind it.

    A stop is not a stop afterwards

    Doubling the light is exactly a factor of two in raw values and in tristimulus values, which is the one thing about exposure everybody is sure of. A stop taken after the tone curve is a factor of something else, and matching the two on an eighteen per cent grey leaves the rest of the frame between three and four colour differences apart at the mean and up to eleven at the worst patch. The gain that matches one stop is 2.47 rather than 2.

    part 17 · imaging
  39. The same highlight, clipped in two places. A ramp running from inside the sensor's range to 1.6 times over it, clipped at the sensor and clipped after the matrix. Below the ceiling the two are identical to the floating-point floor. Above it they part, reaching 21.0 colour differences and 78 degrees of hue. Clipping late keeps a highlight neutral and clipping early keeps its hue, and converters do both.

    Two converters and one highlight

    The clip is the only step in a raw pipeline that destroys information rather than moving it, and it is the step whose position varies most between converters. Below the sensor's ceiling its position changes nothing at all, exactly. Above it, clipping at the sensor and clipping after the matrix land twenty-one colour differences and seventy-eight degrees of hue apart, and which hues are affected is a property of the camera's own dyes.

    part 18 · imaging
  40. One infrared-cut filter, crossed at four angles. The transmittance of the same interference filter for light crossing it at the centre of a frame and at three steeper angles, from 560 to 760 nm. Its half-transmission edge is at 665 nm straight on and moves to 658, 646 and 630 nm, following the edge wavelength times the square root of one minus the squared sine of the angle over the square of the stack's effective index, 1.8. The deepest reds are what it takes away, and a lamp decides how much light there was in them.

    The corner of the frame has another filter

    A camera's infrared-cut filter is an interference stack, and light crossing it at an angle sees its edge moved towards the blue — from 665 nm at the centre of a frame to 646 at twenty-five degrees. The corner's red channel loses a tenth of its response under daylight and a sixth under tungsten. A grey-card gain map makes the corner exactly right under the lamp it was made under; under a tungsten lamp the same grey is 2.6 colour differences wrong, under a white LED 4.2, and even under its own lamp the coloured patches are not corrected, because a moved edge is not a gain.

    part 19 · imaging
  41. A black level slightly wrong, through the balance, under daylight. A grey ramp from half a per cent to seventy-two per cent reflectance, with a pedestal error of a tenth, three tenths and one per cent of white left in all three raw channels before the white balance, against the same ramp with none. The horizontal axis is the grey's reflectance, logarithmic. At a three-tenths error a two per cent grey is 2.4 colour differences off, most of it chroma, and a seventy-two per cent grey 0.21. An equal offset in the raw channels is not equal after three different gains.

    A black level is multiplied by the balance

    Every raw value carries a pedestal that is subtracted before anything else, and a white balance is then a different gain in each channel. Subtracting a constant and multiplying by one commute only when the constant is zero or the gains are equal. So a pedestal left three thousandths of white too high becomes 2.4 colour differences in a two per cent grey, most of it chroma, in the colour the lamp starves — and pushing that shadow four stops in editing makes it 8.9. An offset in proportion to the lamp's own white is the exception, and it is exactly grey.

    part 19 · imaging
  42. Noise clipped at zero, averaged over a shadow, under tungsten. A grey ramp from black to ten per cent reflectance under tungsten, captured at three illustrative noise levels, with every negative raw reading set to zero before the readings are averaged over an area. Each line is the colour difference between that average and the noiseless grey. At high gain a half per cent grey is 1.04 off and a black frame 0.79; at very high gain the worst is 2.95, at 1.0 per cent. The same readings averaged before any clip come back exactly, at every level. The tint is gone once every channel sits several deviations above zero.

    Clipped noise does not average away

    Noise on a raw reading is as likely to fall below the true value as above it, which is why averaging an area removes it. A converter that sets negative readings to zero keeps the upper half and throws the lower away, and the mean of what is left is the signal plus a pedestal. With no black level error anywhere, a half per cent grey under a tungsten lamp comes out 1.04 colour differences off at high gain, 8.98 after a four-stop push — and a blur that removes every trace of the noise leaves the tint where it was.

    part 20 · imaging
  43. Three corrections for the corner of a frame, each made under daylight. The mean colour difference over twenty-four coloured patches between the centre of a frame and its corner, against the angle light arrives at, after three corrections each fitted under daylight, D65 and used under it: a grey-card gain map, a correction confined to the red channel's row, and a full three-by-three matrix. All three leave the grey exact. At 25° the gain map leaves 1.86, the red row 0.93 and the matrix 0.90; at 35°, 3.81, 1.95 and 1.81. Six more numbers buy almost nothing, because the moved edge is in one channel.

    A corner is corrected by one row

    A grey-card gain map makes the corner of a frame exactly right on grey and leaves coloured patches 1.86 colour differences wrong at twenty-five degrees. A three-by-three matrix fitted at that position halves it — and six of its nine numbers do nothing, because the moved filter edge is in one channel. The three that matter rebuild the lost red from green and blue, they carry to another lamp better than a gain map in eleven cases of twelve, and in the twelfth, a row fitted under tungsten and used in daylight, they leave the grey 9.2 off.

    part 20 · imaging
  44. Two matrices blended by colour temperature, under fourteen lamps. For each lamp, with the neutral held exact as a converter holds it: the mean colour difference over twelve test surfaces with a matrix fitted under that lamp (the short bar) and with the tungsten and daylight matrices blended at the weight its correlated colour temperature gives (the long bar). Smooth lamps on or near the locus sit within 6 per cent of their own matrix. The lamps with lines or narrow bands in them sit a median of 2.2 times theirs, from 1.38 for a broadband tube to 5.2 for a three-emitter source.

    Two matrices do not reach a white LED

    A camera profile's two matrices, blended by the scene's colour temperature, are as good as a matrix fitted anywhere along daylight. Under a white LED or a fluorescent tube the same blend leaves colours twice as far off as a matrix fitted under that lamp, and no weight inside the profile's range repairs it. What decides it is not how far the lamp sits from the Planckian locus — a triphosphor tube sits nearly on it and fares worst — but whether its spectrum has lines in it, which a white balance reading cannot see.

    part 20 · imaging
  45. Four ways to fill in a clipped highlight: a glossy surface with a reflection of the lamp, under tungsten. Twenty-four chart surfaces under tungsten, as a glossy surface with a reflection of the lamp, taken up a ramp until their raw channels reach the sensor's ceiling. Each line is the mean colour difference, at equal lightness, between the true colour and what one response to the clipped reading makes of it: clipping to white, carrying the clipped values through, filling the clipped channel from the surface's own ratio, and filling it from the surface's colour plus the lamp's. At 0.4, where most surfaces have one channel clipped, the four leave 5.87, 4.37, 5.56, 0.00; at 2, 2.90, 26.97, 8.18, 8.18.

    Filling in a highlight is a claim about the surface

    A converter that rebuilds a clipped channel has to say what the highlight was. A matt surface over-exposed keeps its own colour, and filling the lost channel from that colour is exact. A glossy highlight is the surface's colour plus a reflection of the lamp, and the same fill leaves it 7.6 colour differences too colourful — while a fill that solves for surface and lamp is exact. Neither works once two channels are clipped, and a tungsten lamp keeps a highlight in the one-channel band more than twice as long as daylight does.

    part 20 · imaging
  46. The confusion matrix, and which corner the common lamps are in. Twelve fixtures sorted two ways. Down the page is what their spectra are; across is what flicker says. The two corners on the diagonal are 7 fixtures the classifier gets right. The 3 missed are structured lamps that do not flicker — a white LED and a warm LED on constant drivers, and a three-emitter fixture — and those are the lamps most modern interiors are lit by. The 2 false alarms are smooth lamps that do flicker: a halogen lamp on mains and a tinted radiator, both of which a photograph of a room is quite likely to contain.

    Flicker sorts lamps the wrong way

    A camera cannot see a spectral line in its own white, so the essay on the two-matrix profile named the classifiers a device might have instead, and the first of them was flicker. Flicker is measurable, and it measures the wrong thing. It sorts lamps by how their power is delivered while the matrix needs them sorted by how their spectrum is shaped, and the two are independent: a white LED on a constant driver is perfectly steady and strongly structured, and it is what most indoor photographs are lit by.

    part 21 · imaging
  47. The statistic a converter would read, under each model. The log ratio of the two channels that are still open, against how bright the surface is, under the two models of what a highlight is. A matt surface over-exposed keeps its own ratio exactly — the line is flat, and it must be, because scaling every channel by the same amount leaves a ratio alone. A glossy surface carries a reflection of the lamp on top of its body colour, so its ratio slides towards the lamp's as the reflection strengthens: -0.086 of a log unit between a quarter of full scale and nine tenths. That slide is the whole of the evidence a converter has for choosing between them.

    The converter can choose except where it matters

    A converter rebuilding a clipped highlight has to say whether the surface was matt and over-exposed or glossy and carrying a reflection, and the evidence is whether its raw chromaticity slides towards the lamp's on the way up. Read through the sensor's own noise, the slide is clear on most of the chart from the few tens of pixels a specular highlight holds — and on the surfaces where it takes half a frame, confusing the two models costs more than the median. A ratio cannot see a common scale, and an exposure supplies one.

    part 21 · imaging
  48. The four places a clamp could sit are two pipelines. Every pair of clamp positions, with the largest difference their delivered values reach over a grid of raw inputs that includes negative ones. Two of the six are exactly zero: a clamp at zero commutes with the white balance, which is a positive scale applied channel by channel, and with the tone curve, which is monotone and fixes zero. It does not commute with the colour matrix, which is the only step that mixes the channels — so the four positions collapse to two, before the matrix and after it, and no measurement of any scene can say more than which side a converter is on.

    Four places to clamp are two pipelines

    The essay on clipped noise ended on a procedure: a black frame and a dim grey card at a high amplification would place each raw converter's clamp. A procedure is a claim that a measurement identifies something, and this one identifies less than it looks. A clamp at zero commutes with the white balance and with the tone curve and not with the colour matrix, so the four positions are two pipelines — and the measurement separates them, on a card at half a per cent of white rather than on the black frame.

    part 21 · imaging
  49. Four ways to correct the corner, under each of four lamps, at 25°. The mean colour error left on the chart's coloured patches at the corner of the frame, under each lamp, after: the red row fitted under that lamp; one red row fitted on the chart under all four lamps with the grey held under daylight; a grey-card gain map calibrated under daylight; and the worst of the other lamps' rows used by mistake. daylight: 0.93, 1.33, 1.86, 4.91; tungsten: 0.99, 1.45, 1.87, 3.26; white LED: 0.36, 1.39, 3.28, 1.77; fluorescent: 0.37, 1.56, 3.09, 2.45. The pooled row holds every lamp between 1.33 and 1.56.

    One row for every lamp costs the lamps that lose least

    A corner correction fitted under one lamp is right under that lamp and can be badly wrong under another, so a converter unsure of its lamp was offered a single row fitted under several at once. Pooled over four lamps, one row holds every lamp's corner between 1.33 and 1.56 colour differences — no lamp worse than a grey-card map, and none near the 4.91 a wrong row can leave. The price falls on the white LED and the fluorescent tube, which it leaves four times worse than their own rows, because they lose the least red at the corner and the pooled row is built to repair the lamps that lose the most. Two rows, one per class of lamp, keep almost all of both.

    part 21 · imaging
  50. The same chart in two studios and in the room that holds both lamps. Each of the chart's twenty-four surfaces, with the pixels its slide needs at two standard deviations at high gain, on a logarithmic scale. Lit by a 3000 K radiator alone the worst surface needs 16,194; lit by daylight at 6500 K alone, 139,574. Lit by both, 50 and 50 per cent of the light, with a highlight of each lamp read together, the worst needs 10 and the median 6. The studios' hard surfaces sit at different places on the chart, and no surface is hard in both.

    Two lamps decide what one lamp could not

    Under one lamp a handful of surfaces cannot tell a glossy highlight from a matt over-exposure without most of a frame, because there the two differ by a scale a ratio cannot see. In a room lit evenly by a 3000 K lamp and daylight, every surface on the chart is decided from ten pixels. A body can sit at one lamp's white, not at two, and the rescue holds only while the second lamp carries a fifth of the light and its white sits far enough from the first.

    part 22 · imaging
  51. How far each lamp's sensor reading is from what the camera predicts, with RGB + clear. Fourteen lamps, six smooth and eight structured, each scored by how far an ambient-light sensor with red, green, blue and clear channels reads from what the camera's white predicts through a map fitted on smooth radiators and daylights. The smooth lamps score at most 0.057 and the structured at least 0.133; the dashed line is the threshold at the gap's geometric middle, 0.087. The lights the map was fitted on score at most 0.0113. Every lamp falls on its own side of the line.

    Two sensors disagree about deep red, not lines

    A phone's ambient-light sensor and its camera read the same lamp differently, and the difference sorts fourteen lamps into smooth and structured without a single mistake — where flicker made five. It is not reading their lines. Almost all of it comes from the sensor's clear channel collecting deep red the camera's infrared cut throws away, so daylight with its far red trimmed is called structured and a white LED with a far-red emitter is called smooth.

    part 22 · imaging
  52. The calibration error a narrow fourth channel survives, by where it is placed. For a red, green and blue ambient sensor with one more channel 10 nm wide, centred from 450 to 640 nm: the first calibration error at which some lamp of fourteen is misclassified. Dashed: the channel pooled into the whole residual, as the ambient sensor's disagreement was read; its best is ±1.50 per cent. Solid: the channel read on its own, as its departure from what the camera's white predicts for it; its best is ±4.0 per cent, at 450 nm. Crosses mark centres where the channel read alone does not separate the lamps at all. The two horizontal lines are the red, green and blue design (±1 per cent) and the design with a clear channel (±4 per cent).

    A narrow channel has to be read on its own

    An ambient sensor with a clear channel tells structured lamps from smooth ones by reading deep red, and one without it reads structure but breaks at one per cent of calibration error. A narrow fourth channel between the camera's peaks was proposed to have both. Pooled into the sensor's disagreement with the camera, it reads structure and breaks at one and a quarter per cent — no better than the design it was meant to rescue. Read on its own, as its departure from what the camera predicts for it, a channel at 450 nm holds to four per cent, the clear channel's figure, and far red does not move it.

    part 23 · imaging
  53. What the classifier misses, against what the camera gets wrong. Every lamp as the pair of channels reads it against the camera's mean colour error under it, with its two-matrix profile blended at the lamp's colour temperature. The band is the range of the six smooth census lamps, 1.14 to 1.62. Left of the line the classifier calls a lamp smooth; no lamp there is above the band. The violet-pumped LEDs it misses leave the camera at least as accurate as a smooth lamp does, two of them more so.

    The lamps two channels miss are smooth to the camera

    A narrow channel at 450 nm tells a phone which lamps are structured, and a white LED pumped in the violet might hide from it; a channel at 500 nm does the same job, and an LED with a cyan emitter should blind it. Reading both and calling a lamp structured if either departs was supposed to cover both families. It covers the cyan family only because the 450 nm channel already did, and half the violet-pumped LEDs escape both channels. Every one that escapes leaves the camera's colours as accurate as a smooth lamp does. What the classifier misses is what the camera does not need to be warned about.

    part 24 · imaging
  54. The camera's error, and the two-channel estimate of it. Each of the fifty-four lamps as the camera's true mean colour error against the estimate from the 450 and 500 nm channels, fitted with that lamp left out. The held-out error is ±0.14 ΔE00 against ±0.16 from the 450 nm channel alone and ±0.30 from the mean. The dashed lines at 1.5 mark the repair decision: points right of the vertical and below the horizontal are lamps that need a repair and are not given one.

    Two channels estimate what one can only sort

    A narrow sensor channel was fitted to call lamps smooth or structured, and the label turned out to be a proxy for the thing a camera cares about: its own colour error under the lamp. Scored against that error directly, the best channel is still the one at 450 nm — the band where camera and observer differ most comes close and no closer. Read as an estimate rather than a verdict, a second channel at 500 nm, useless as a vote, earns its place: together they predict the camera's error to within 0.14 ΔE00 over fifty-four lamps, and deciding when to repair from that estimate raises a quarter of the false alarms the label raises.

    part 25 · imaging
  55. What straightening the 570 nm channel buys an estimate of the camera's error. The root-mean-square and worst held-out errors of linear estimates of the camera's error, over fifty-four lamps with the three-emitter source kept in: from the 570 nm channel as read and through three transforms, from 450 nm alone, and from 450 nm with a log-transformed 570 nm channel or with 500 nm. Every transform rescues 570 nm from worse than the mean; none reaches 450 nm; and beside 450 nm it adds nothing, where 500 nm does.

    A straightened channel repeats the one beside it

    A phone's narrow sensor channel at 570 nm ranks a camera's colour error under a lamp almost as well as the one at 450, and estimates it worse than guessing the mean, because one lamp reads ten times higher than any other. Read through a logarithm, the channel is rescued: its estimate improves from ±0.57 to ±0.23. It still does not reach the 450 nm channel's ±0.16, and put beside that channel it adds nothing at all, where a 500 nm channel cuts the error to ±0.14. Straightened, 570 nm sorts the lamps as 450 nm already does; and the two lamps it reads highest have the most different errors, which no transform of one reading can tell apart.

    part 26 · imaging
  56. Which way each narrow channel departs from what the camera predicts. Each lamp's two narrow channels, their departures from the camera's prediction kept signed. 37 of the fifty-four lamps, every structured one among them, lie in the lower right: more light than predicted at 450 nm, less at 500 — a peak and a trough. 8 lie in the upper left, the opposite pattern, most of them violet-pumped LEDs whose pump misses 450 nm. In both the departure of the two readings' ratio is the sum of the two distances. The 7 in the upper right are the most heavily cyan-filled LEDs, whose fill puts light at 500 nm, and two daylights near the origin.

    One ratio reads a peak and a trough

    Two narrow sensor channels, at 450 and 500 nm, estimate a camera's colour error under a lamp to ±0.14 ΔE₀₀; the proposal was to read their ratio as one number instead. Taken as one channel's departure over the other's, the ratio is worthless — no better than the mean, because for smooth lamps both departures are nearly nothing. Taken as the departure of the two readings' ratio from what the camera predicts for it, one number estimates the error to ±0.141, as well as the two channels as two. The reason is a sign: under every structured lamp the channels depart in opposite directions, a peak at 450 and a trough at 500, and the ratio adds them; where a cyan fill lifts 500, it subtracts them, as the error falls. And no five per cent calibration error moves any of these estimates by a hundredth.

    part 27 · imaging
  57. Inside its family a 620 nm channel reads the tube's error; across the census it does not. The halophosphate tube with its main band at 558, 568, 578, 588 and 598 nm, joined in order: the camera's error under each falls from 2.55 to 1.48 as the band moves up, and the 620 nm channel's departure rises from -0.47 to 0.09 with it. The census's other fifty-three lamps, dots, lie nowhere near that line: the same departure means a different error for an LED.

    The tube a third channel misses has no family

    Two narrow sensor channels read as one ratio estimate a camera's colour error under fifty-four lamps to ±0.141 ΔE₀₀, and their worst miss is the halophosphate tube, whose trouble lies in its long-wave phosphor. A third narrow channel in the long-wave gap was predicted to halve that miss near 610 nm. No channel does, at any centre or width: the best buys under a tenth of the whole error and leaves the tube's miss above three quarters of what it was. At 610 nm the camera already predicts the tube's share almost exactly. The tube's error follows where its main phosphor band sits, and a 620 or 640 nm channel does read that — inside the tube's own family. The census has one halophosphate tube, and a lamp left out of a census that holds nothing like it is a lamp no channel can be fitted to.

    part 28 · imaging
  58. What each design buys each family of lamps. The camera's colour error under each lamp, estimated with the lamp left out, and each family's held-out error under four designs: the ratio of the 500 and 450 nm channels alone; one line on the ratio and a 640 nm channel for every lamp; two stages with each lamp's family given; and two stages with the family found by the nearest other lamp. The census's halophosphate tube is missed by 0.405 under the ratio and 0.011 under either two-stage design; the LEDs go from ±0.127 to ±0.111 with the family given and ±0.155 with it found.

    Two stages catch the tube and bill the lamps they misplace

    A narrow-channel estimate of a camera's colour error missed the halophosphate tube because the census held nothing like it, and a line that learned the tube's family from four siblings cost every other lamp. The proposed cure was two stages: recognise a lamp's family, then apply that family's own line. Given each lamp's family, it works as predicted and better — the tube missed by 0.011 ΔE₀₀, the fifty-four lamps estimated to ±0.133 against the ratio's ±0.141. Found by the nearest other lamp in the sensor's departures, the family is right for the tube and wrong for five lamps, and those five, missed by ±0.41, take the whole census back to ±0.162. The gain is real; the classifier is where it is lost.

    part 29 · imaging
  59. How many neighbours a lamp's family is read from, and what the estimate costs. The two-stage estimate's held-out error over the census's fifty-four lamps when a lamp's family is read from its one to six nearest neighbours, and used only if all of them agree (upper bars) or most of them do (lower), with the halophosphate tube's miss on each bar; otherwise the census-wide ratio line. The ratio alone is ±0.141 and the families given ±0.133. Blue bars catch the tube; orange ones lose it.

    A classifier that abstains gives up the tube

    Found by the nearest other lamp, a lamp's family cost a two-stage estimate of a camera's colour error more than it bought, because five lamps were placed confidently in the wrong family. The proposed repair was a classifier that abstains — falls back on the census-wide line — unless a lamp's three nearest neighbours agree. It abstains on the wrong lamps. The misplaced ones have three agreeing neighbours, all white LEDs; the lamp it gives up is the halophosphate tube the two stages were built to catch, whose third neighbour is a cyan LED, and its miss returns from 0.011 to 0.445. Two agreeing neighbours look better than knowing every family. Chosen without looking at the lamp being estimated, the rule is worth exactly what the ratio alone is worth.

    part 30 · imaging
  60. Three family lines through the departures, and whom they claim. Every lamp of the census and the halophosphate tube's four siblings by its 450 and 640 nm departures, coloured by family, with the principal line of each family that has three or more members — the radiators, the white LEDs and the halophosphate tubes — solid over the stretch its members span and dashed beyond. Circled are the 29 lamps whose nearest line is another family's. The radiators' short line runs along the LEDs' long one and, extended, through the violet-pumped LEDs.

    A family's line runs through its neighbours

    The halophosphate tubes differ from one another by one number — where their main phosphor band sits — and so lie along a line in the three departures an ambient-light sensor reads. The proposal was to classify a lamp by the family whose line passes nearest, which would keep the tube a vote of neighbours gives up. It keeps the tube, under every version that does not rescale the distances. It also places eighteen white LEDs on the radiators' line, because that line — fitted to six radiators close together — runs along the LEDs' own and, extended, straight through the violet-pumped ones; and the radiators' estimate, extrapolated to them, misses the triphosphor tube by 7.6. Clamped to the stretch each family spans, the lines still cost ±0.285; given to the halophosphate family alone, its line claims a cyan LED and costs ±0.179. The one line classifier that comes in under the ratio line's ±0.141 does so by two thousandths, having placed the tube with the LEDs.

    part 31 · imaging
  61. What treating radiators and LEDs as one family does to the estimate. Held-out error over the census's fifty-four lamps for the ratio line alone, for the two-stage estimate with the separate families found by the nearest lamp and given, and with radiators and LEDs merged into one family of smooth sources, found by the nearest lamp, with the halophosphate tube's miss. Merged, the estimate comes to ±0.127 — below the ratio's ±0.141 and below the separate families even when every lamp's family is given — and keeps the tube.

    Radiators and LEDs are one family to the sensor

    An ambient-light sensor's three narrow departures see the collection's six smooth radiators and forty-four white LEDs along one line: the radiators' own short line lies on the LEDs' long one. Estimating a camera's colour error family by family, the census had treated them as two, and every classifier that tried to tell them apart paid for it. Merged into one family of smooth broadband sources, found by the nearest other lamp as before, the two-stage estimate comes to ±0.127 over fifty-four lamps held out — below the ratio line's ±0.141, and below the ±0.133 the separate families managed when every lamp's family was simply given. The halophosphate tube is still caught. The radiators, which the prediction said the merge would cost a little, are estimated better inside it than inside their own family, because a three-coefficient line fitted over five radiators was worse for them than the census-wide ratio line.

    part 32 · imaging
  62. How far the merged design misses each lamp it never saw. For fourteen lamps outside the census — radiators and daylights, tinted and filtered lamps, white LEDs varied in their phosphors, and a three-band LED — the camera's colour error less the estimate the merged design makes from the ambient-light sensor's departures, fitted on the whole census. The dotted lines are the census's own held-out error, ±0.13. The radiators, daylights and tinted lamps fall inside or on it; 4 lamps fall outside, every one of them an LED.

    New LEDs miss the line their cousins drew

    An ambient-light sensor's three departures can estimate a camera's colour error under a lamp, and merging radiators and white LEDs into one smooth family brought that estimate to ±0.127 over fifty-four lamps, each left out in turn. Every one of those lamps had relatives in the pool. Fourteen lamps the census never saw test what the relatives were worth. The prediction was that new smooth lamps would land on the line and tinted incandescents fall off it by four tenths or more. The radiators and daylights land on it, within ±0.13 each. The tinted lamps do too — the pink-glass incandescent, placed among the LEDs by its nearest neighbour, misses by 0.12. The lamps that fall off are the new white LEDs: ±0.20, half again the census's error, two of them by a quarter. Their misses follow the sensor's 640 nm channel at a slope of −0.72, explaining four fifths of their scatter, because the line learned what that channel means from LEDs varied only in their blue pump. Adding the fourteen to the pool does not help.

    part 33 · imaging
  63. A phosphor grid's camera error is a V about the locus. Forty-eight white LEDs varied in pump, converter share and red phosphor (circles, shaded by red phosphor) and the census's forty-four (squares), placed by how far each white sits from the Planckian locus and by the camera's mean colour error under it. Across the grid the error rises away from the locus on both sides — correlated 0.68 with the distance on the green side and -0.64 on the pink — and is lowest near it. Every one of the census's LEDs sits on the green side, from 0.007 to 0.034.

    LEDs varied in their phosphors fall off every line

    The merged smooth family estimates a camera's colour error from an ambient-light sensor's departures to ±0.127, and five new white LEDs, varied in their phosphors where the census's forty-four vary their pump, missed by ±0.196 because the family's line had learned almost nothing about the sensor's 640 nm channel. Rebuilt on forty-eight LEDs varied in pump, converter and red phosphor, the line learns it: its 640 nm weight goes from −0.13 to −0.74, most of the way to the −0.85 the new LEDs implied. The prediction was that the new LEDs would then land within ±0.13. They miss by ±0.229, worse than before, crossing to the other side of the line, and the census's own held-out error more than doubles, to ±0.294. No pool of LEDs restores it, and no line in the sensor's departures reads the grid's own LEDs better than ±0.29. Across the grid the camera's error is a V about the Planckian locus, rising away from it on the green side and on the pink — and every one of the census's LEDs sat on the green side.

    part 34 · imaging
  64. Building on the locus does not make a line. Lines in the sensor's departures fitted to LEDs alone, each LED left out and estimated from the others: the free grid's forty-eight, whose whites fell either side of the locus, and the thirty built on it, all together and one pump at a time. Removing the V about the locus brings the merged row from ±0.291 to ±0.282 and the three departures from ±0.298 to ±0.248; only the LEDs pumped at 452 nm, taken alone, fall on a line.

    LEDs built on the locus still fall off the line

    A camera's colour error under a lamp can be estimated from three narrow channels of a small sensor, read as departures from a smooth lamp of the same colour, and the estimate held for the census's white LEDs, which varied only their blue pump. Rebuilt on LEDs varied freely in pump, converter and red phosphor, it failed: the error was a V about the Planckian locus, and no line in the departures read it. A maker does not let the white fall where it falls, so the proposal was to build the LEDs as a maker does — the converter tuned for each pump and red phosphor until the white sits on the locus — and the prediction was that the V would go and the line return, the census's held-out error to within ±0.15. Thirty of thirty-six such LEDs can be built. On the locus the V is gone and the line is not: the LEDs alone are missed by ±0.25 to ±0.28, the census's lamps by ±0.27. Taken one pump at a time, the departures read the LEDs pumped at 452 nm to ±0.05 and those at 440 and 465 nm no better than ±0.17. Within one pump the LEDs are readable, and across pumps they are not.

    part 35 · imaging
  65. A channel at its own pump reads the long pump better and the short one hardly at all. For the ten locus-built LEDs at each pump: the spread of the camera's colour error, and how far a line in one blue departure — at 440, 450 or 465 nm — with the 500 and 640 nm departures misses it, each LED left out. The 465 nm LEDs fall from ±0.264 with the 450 nm departure to ±0.135 with their own; the 440 nm LEDs from ±0.171 to ±0.149; the prediction was ±0.08.

    A channel at each pump cannot see the recipe

    Thirty white LEDs built onto the Planckian locus defeat a line in a small sensor's three departures, except within one pump: the 452 nm LEDs are read to ±0.047 by the 450 nm channel, the others no better than ±0.15. The proposal was a channel at each pump — 440 and 465 nm beside the 450 — and the prediction that each pump's LEDs would be read from their own channel within ±0.08. The 465 nm LEDs' own channel halves their miss, to ±0.135; the 440 nm LEDs' moves it from ±0.171 to ±0.149. No line in any three of the five departures reads either pump better than ±0.1. Yet the camera's error is simple: a line in what each LED is made of — its red phosphor, its colour temperature and their product — reads every pump within ±0.07, the 440 nm LEDs to ±0.043. The error is easy; the channels cannot see the recipe that sets it. Knowing each LED's pump halves the pooled miss, to ±0.119, and two blue channels can tell only one pump of three from the others.

    part 36 · imaging
  66. Two LEDs of one colour, one with a red phosphor. Two white LEDs pumped at 452 nm, both on the Planckian locus at 4,000 K: one with no red phosphor and its converter peaking at 579 nm, one with the full red phosphor and its converter pushed to 529 nm, drawn at equal total power. The red phosphor adds light past 620 nm and the shorter converter takes it away from 570 to 610, so a channel anywhere in the red sees the two changes together.

    The converter gives the red phosphor away

    A camera's error under white LEDs built onto the Planckian locus is simple in what each LED is made of — its red phosphor and its colour temperature — and a small sensor's narrow departures cannot read the red phosphor. The proposal was a channel at 610 nm, where a garnet converter falls and a red phosphor rises, and the prediction that it reads the red-phosphor strength within a tenth of its range. Within a pump it reads nothing: ±0.36 to ±0.43 at 440 and 452 nm against a spread of ±0.36, and no red channel from 600 to 680 nm does better than ±0.22. The reason is the locus. To keep the white's colour, each step of red phosphor pushes the converter's peak shorter, by 29 to 55 nanometres from none to the most, and in every red channel the two changes cancel. What survives is the converter: the 600 nm departure reads its peak to ±5 nm. Read across all thirty LEDs at once, the converter gives the red phosphor away — ±0.12 — and the error read through that estimated recipe comes within ±0.08 at every pump, the 440 nm LEDs at ±0.078, half their own channel's miss.

    part 37 · imaging
  67. Off the locus, the 600 nm line reads the red as well as on it. For white LEDs built on the Planckian locus and at a Duv of −0.003 and +0.003, the red-phosphor strength read from the 600 nm departure, the mireds and their product by the line learned on the thirty locus LEDs, less the true strength. On the locus, each left out, it misreads by ±0.120; below the locus by ±0.110 and above by ±0.117, reading too little below and too much above.

    Beside the locus the converter still gives the red away

    On the Planckian locus, a white LED's red phosphor pushes its converter to a shorter peak, so an ambient sensor's 600 nm departure, which reads the converter, reads the red phosphor too — within ±0.12 of a spread of ±0.36 — and through it the camera's colour error within ±0.074 ΔE₀₀. Real LEDs are binned a few thousandths off the locus, and the prediction was that a Duv of 0.003 moves the converter about as far as a fifth of the red phosphor does, so that the line learned on the locus misreads off-locus LEDs by a fifth of the range and their error falls back to ±0.12. The converter moves under two nanometres. The line reads the off-locus LEDs' red within ±0.11 and ±0.12, as well as it reads the locus's own held out — with a bias of about a twentieth that follows the Duv's sign. The error reads a third to a half worse, ±0.096 and ±0.107, and most of that is the camera's error itself moving off the locus with nothing in the recipe changed.

    part 38 · imaging
  68. Only a curve per temperature brings the bin back. The camera's colour error under eighty-nine white LEDs — thirty on the Planckian locus, fifty-nine at a Duv of ±0.003 — read through the red phosphor estimated from the 600 nm line and an error line within each pump, each LED left out, as the Duv enters the lines in turn: not at all, as one term, as a slope in mireds, as a slope for each temperature, and as a slope and a curve for each. Beside them the line learned on the locus alone. With a slope and curve per temperature: ±0.073 on the locus, ±0.056 below, ±0.048 above.

    Across a bin, the camera's error bends with the temperature

    White LEDs a Duv of 0.003 off the Planckian locus have their red phosphor read by an ambient sensor as well as LEDs on it, and their camera colour error read a third to a half worse, because the error itself moves with the Duv. The prediction was that one Duv term in the error's line, learned over all eighty-nine LEDs, brings those beside the locus back to the locus's ±0.074 ΔE₀₀ and costs the locus LEDs nothing. One term buys little: ±0.109 below the locus and ±0.085 above. The error turns across the locus one way at 2,700 K and the other at 4,000 and 6,500 K, and bends most where it is warmest, so the Duv has to enter as a slope and a curve for each temperature — ten numbers a pump, not five — before both sides come back, to ±0.056 and ±0.048. That line then reads the locus LEDs at ±0.073, worse than the ±0.062 a line with no Duv in it manages once it is learned across the bin.

    part 39 · imaging
  69. The curve holds inside the bin and fails outside it. Four error lines learned on eighty-nine white LEDs at a Duv of nought and ±0.003, each read at those three values with every LED left out and at ±0.0015 and ±0.006 on 119 LEDs none of them was fitted on. The slope and curve per temperature reads ±0.045 and ±0.043 inside the bin and ±0.153 and ±0.161 at twice its edge, where a slope per temperature alone reads ±0.093 and ±0.110.

    The bin's curve holds between its points and breaks beyond them

    A camera's colour error under a white LED was read from an ambient sensor across a manufacturing bin by a line with a slope and a curve in Duv for each colour temperature, fitted at three Duv values — on the locus and 0.003 either side — and reading the LEDs beside the locus within ±0.056 and ±0.048 ΔE₀₀. A curve through three points passes through them whatever happens between them. The prediction was that 119 new LEDs built at ±0.0015 are read within ±0.06, and those at ±0.006 worse than ±0.10. Both halves hold: ±0.045 and ±0.043 inside, ±0.153 and ±0.161 outside. But the error's own mean course stays on its parabola within 0.02 out to ±0.006. The line's bend is not the error's: it is the gap the line leaves between the locus LEDs and the bin's edges, and a gap spent as a curvature quadruples at twice the distance.

    part 40 · imaging
  70. With the level placed, the line bends as the error does. At each temperature, the curvature in Duv of the camera error's mean course through nought and ±0.003, beside the curvature each slope-and-curve line implies, averaged over the three pumps. At 2,700 K the course bends by +7,916, the line without a level by +2,803 and the line with one by +8,198; at 4,000 K the course bends by +2,196, the line without a level by +14,591 and the line with one by +2,195; at 6,500 K the course bends by +363, the line without a level by −13,349 and the line with one by +445.

    A level for each temperature lets the curve be the error's

    An error line with a slope and a curve in Duv for each colour temperature read white LEDs inside a manufacturing bin within ±0.045 ΔE₀₀ and LEDs at twice the bin's edge only within ±0.16, though the camera's own error stays on its parabola there. Its curve was borrowed: the line's shared terms could not place each temperature's level, and the square of the Duv absorbed the gap. The prediction was that one more number a pump, the square of the mireds, brings the locus LEDs within ±0.05 and those at ±0.006 within ±0.08. It brings the locus to ±0.025 — three times better than the locus-only line that started this run of essays — and the outer LEDs to ±0.049 and ±0.058. The curvature the line now implies at each temperature is the error's own within a fifth; what it leaves is the warm whites' scatter at the bin's edges.

    part 41 · imaging
  71. The red phosphor bends nothing and tilts the warm whites. The 2,700 K LEDs' residual at each Duv under the eleven-term line, with the square of the Duv times the estimated red phosphor added, and with the Duv times the estimated red added instead. The bend term leaves ±0.006 at ±0.068 and ±0.088, against ±0.069 and ±0.087; the slope term takes them to ±0.046 and ±0.067.

    The red phosphor tilts the warm whites and bends nothing

    An error line with a level, a slope and a curve in Duv for each colour temperature reads white LEDs at 4,000 and 6,500 K within ±0.04 ΔE₀₀ across and beyond a manufacturing bin, but warm whites at twice the bin's edge only within ±0.087. The prediction was that the red phosphor sets a warm white's bend, so that one term more a pump — the square of the Duv times the estimated red — brings them within ±0.05. It moves them by a thousandth. The red phosphor enters the slope instead: the Duv times the red takes them to ±0.046 below the locus and ±0.067 above. And the rest points upstream. The first stage reads a warm white's red phosphor squeezed toward the middle of its range, the warm misses follow that misreading times the Duv at r = 0.79, and given the red each LED was built with the warm whites come within ±0.05 — though the same substitution doubles the error at 4,000 K.

    part 42 · imaging
  72. The squeeze belongs to the temperature, not the Duv. For the 2,700 K LEDs at a Duv of ±0.003 and ±0.006, the first stage's mean estimate of the red phosphor against the red each was built with, by three first stages; the dashed line is a perfect reading. With one Duv term, no red and a full red are read at 0.13 and 0.80; with the Duv times the departure and the mireds at 0.14 and 0.80; with a level and a departure slope for each temperature at 0.02 and 1.01.

    The line had already undone the squeeze

    An ambient sensor's first stage reads a 2,700 K white LED's red phosphor squeezed about a third toward the middle of its range, and the camera-error line's warm misses outside the bin follow that misreading times the Duv. The prediction was that giving the first stage the Duv times its 600 nm departure and times the mireds would undo the squeeze. It changes nothing: the squeeze belongs to the temperature, and a level and a departure slope for each temperature read the warm red four times better, within ±0.035. But the eleven-term error line does not move — no warm LED by more than 0.006 — because at one temperature a squeeze is a rescaling its red and red-times-mireds terms had already undone. Only the red-slope line, whose one coefficient a pump spans three temperatures, gains: to ±0.034 below the locus, within 0.002 of the red known. And the cold whites pay for it.

    part 43 · imaging
  73. Split between two estimates, the line keeps both ends. The warm whites at ±0.006 and the cold whites at −0.003, read by the red-slope line on the squeezed red, on the un-squeezed red, and split — the eleven terms on the squeezed estimate, the red slope on the un-squeezed. The split line reads the warm whites at ±0.034 and ±0.057 and the cold at ±0.025; the squeezed line reads them at ±0.046, ±0.067 and ±0.021, the un-squeezed at ±0.034, ±0.057 and ±0.040.

    Two estimates of one red each read their own end

    Two first stages read a white LED's red phosphor from an ambient sensor: one squeezes the warm whites' red a third toward the middle, the other reads it four times better, and a camera-error line with a red slope prefers the first for cold whites and the second for warm. The prediction was that a line handed both — the eleven-term line on the squeezed estimate, the red slope on the faithful one — keeps each end's gain. It does, within 0.004 at the cold end. But the second estimate is not needed: the squeezed red alone, its red slope multiplied by the mireds, reads every LED within a ten-thousandth of the split line. And the two estimates' difference is worth a term of its own. Added to the line, it reads the cold whites within ±0.016 at every Duv and on the locus within a thousandth, and moves the warm whites and the middle by nothing.

    part 44 · imaging

All series