The collection

Every essay — page 47

Page 47 of 54, continuing through the fields in the same order.

What light is What the eye does Matching and measuring Difference and uniformity What the brain does What a scene does What a camera does Where the model breaks What it takes to deliver it

SeriesObserversNamed objectsRefutationsSearch

What a camera does

A camera is three functions of wavelength collapsing a spectrum onto three numbers, which is what an eye is — and they are different three functions. Everything a photograph can and cannot establish about colour follows from that, and from the fact that silicon sees three hundred nanometres past where anybody is looking.

Four ways to correct the corner, under each of four lamps, at 25°. The mean colour error left on the chart's coloured patches at the corner of the frame, under each lamp, after: the red row fitted under that lamp; one red row fitted on the chart under all four lamps with the grey held under daylight; a grey-card gain map calibrated under daylight; and the worst of the other lamps' rows used by mistake. daylight: 0.93, 1.33, 1.86, 4.91; tungsten: 0.99, 1.45, 1.87, 3.26; white LED: 0.36, 1.39, 3.28, 1.77; fluorescent: 0.37, 1.56, 3.09, 2.45. The pooled row holds every lamp between 1.33 and 1.56.

One row for every lamp costs the lamps that lose least

A corner correction fitted under one lamp is right under that lamp and can be badly wrong under another, so a converter unsure of its lamp was offered a single row fitted under several at once. Pooled over four lamps, one row holds every lamp's corner between 1.33 and 1.56 colour differences — no lamp worse than a grey-card map, and none near the 4.91 a wrong row can leave. The price falls on the white LED and the fluorescent tube, which it leaves four times worse than their own rows, because they lose the least red at the corner and the pooled row is built to repair the lamps that lose the most. Two rows, one per class of lamp, keep almost all of both.

7 figures
What the classifier misses, against what the camera gets wrong. Every lamp as the pair of channels reads it against the camera's mean colour error under it, with its two-matrix profile blended at the lamp's colour temperature. The band is the range of the six smooth census lamps, 1.14 to 1.62. Left of the line the classifier calls a lamp smooth; no lamp there is above the band. The violet-pumped LEDs it misses leave the camera at least as accurate as a smooth lamp does, two of them more so.

The lamps two channels miss are smooth to the camera

A narrow channel at 450 nm tells a phone which lamps are structured, and a white LED pumped in the violet might hide from it; a channel at 500 nm does the same job, and an LED with a cyan emitter should blind it. Reading both and calling a lamp structured if either departs was supposed to cover both families. It covers the cyan family only because the 450 nm channel already did, and half the violet-pumped LEDs escape both channels. Every one that escapes leaves the camera's colours as accurate as a smooth lamp does. What the classifier misses is what the camera does not need to be warned about.

6 figures
The camera's error, and the two-channel estimate of it. Each of the fifty-four lamps as the camera's true mean colour error against the estimate from the 450 and 500 nm channels, fitted with that lamp left out. The held-out error is ±0.14 ΔE00 against ±0.16 from the 450 nm channel alone and ±0.30 from the mean. The dashed lines at 1.5 mark the repair decision: points right of the vertical and below the horizontal are lamps that need a repair and are not given one.

Two channels estimate what one can only sort

A narrow sensor channel was fitted to call lamps smooth or structured, and the label turned out to be a proxy for the thing a camera cares about: its own colour error under the lamp. Scored against that error directly, the best channel is still the one at 450 nm — the band where camera and observer differ most comes close and no closer. Read as an estimate rather than a verdict, a second channel at 500 nm, useless as a vote, earns its place: together they predict the camera's error to within 0.14 ΔE00 over fifty-four lamps, and deciding when to repair from that estimate raises a quarter of the false alarms the label raises.

6 figures
What straightening the 570 nm channel buys an estimate of the camera's error. The root-mean-square and worst held-out errors of linear estimates of the camera's error, over fifty-four lamps with the three-emitter source kept in: from the 570 nm channel as read and through three transforms, from 450 nm alone, and from 450 nm with a log-transformed 570 nm channel or with 500 nm. Every transform rescues 570 nm from worse than the mean; none reaches 450 nm; and beside 450 nm it adds nothing, where 500 nm does.

A straightened channel repeats the one beside it

A phone's narrow sensor channel at 570 nm ranks a camera's colour error under a lamp almost as well as the one at 450, and estimates it worse than guessing the mean, because one lamp reads ten times higher than any other. Read through a logarithm, the channel is rescued: its estimate improves from ±0.57 to ±0.23. It still does not reach the 450 nm channel's ±0.16, and put beside that channel it adds nothing at all, where a 500 nm channel cuts the error to ±0.14. Straightened, 570 nm sorts the lamps as 450 nm already does; and the two lamps it reads highest have the most different errors, which no transform of one reading can tell apart.

6 figures
Which way each narrow channel departs from what the camera predicts. Each lamp's two narrow channels, their departures from the camera's prediction kept signed. 37 of the fifty-four lamps, every structured one among them, lie in the lower right: more light than predicted at 450 nm, less at 500 — a peak and a trough. 8 lie in the upper left, the opposite pattern, most of them violet-pumped LEDs whose pump misses 450 nm. In both the departure of the two readings' ratio is the sum of the two distances. The 7 in the upper right are the most heavily cyan-filled LEDs, whose fill puts light at 500 nm, and two daylights near the origin.

One ratio reads a peak and a trough

Two narrow sensor channels, at 450 and 500 nm, estimate a camera's colour error under a lamp to ±0.14 ΔE₀₀; the proposal was to read their ratio as one number instead. Taken as one channel's departure over the other's, the ratio is worthless — no better than the mean, because for smooth lamps both departures are nearly nothing. Taken as the departure of the two readings' ratio from what the camera predicts for it, one number estimates the error to ±0.141, as well as the two channels as two. The reason is a sign: under every structured lamp the channels depart in opposite directions, a peak at 450 and a trough at 500, and the ratio adds them; where a cyan fill lifts 500, it subtracts them, as the error falls. And no five per cent calibration error moves any of these estimates by a hundredth.

6 figures
Inside its family a 620 nm channel reads the tube's error; across the census it does not. The halophosphate tube with its main band at 558, 568, 578, 588 and 598 nm, joined in order: the camera's error under each falls from 2.55 to 1.48 as the band moves up, and the 620 nm channel's departure rises from -0.47 to 0.09 with it. The census's other fifty-three lamps, dots, lie nowhere near that line: the same departure means a different error for an LED.

The tube a third channel misses has no family

Two narrow sensor channels read as one ratio estimate a camera's colour error under fifty-four lamps to ±0.141 ΔE₀₀, and their worst miss is the halophosphate tube, whose trouble lies in its long-wave phosphor. A third narrow channel in the long-wave gap was predicted to halve that miss near 610 nm. No channel does, at any centre or width: the best buys under a tenth of the whole error and leaves the tube's miss above three quarters of what it was. At 610 nm the camera already predicts the tube's share almost exactly. The tube's error follows where its main phosphor band sits, and a 620 or 640 nm channel does read that — inside the tube's own family. The census has one halophosphate tube, and a lamp left out of a census that holds nothing like it is a lamp no channel can be fitted to.

6 figures
What each design buys each family of lamps. The camera's colour error under each lamp, estimated with the lamp left out, and each family's held-out error under four designs: the ratio of the 500 and 450 nm channels alone; one line on the ratio and a 640 nm channel for every lamp; two stages with each lamp's family given; and two stages with the family found by the nearest other lamp. The census's halophosphate tube is missed by 0.405 under the ratio and 0.011 under either two-stage design; the LEDs go from ±0.127 to ±0.111 with the family given and ±0.155 with it found.

Two stages catch the tube and bill the lamps they misplace

A narrow-channel estimate of a camera's colour error missed the halophosphate tube because the census held nothing like it, and a line that learned the tube's family from four siblings cost every other lamp. The proposed cure was two stages: recognise a lamp's family, then apply that family's own line. Given each lamp's family, it works as predicted and better — the tube missed by 0.011 ΔE₀₀, the fifty-four lamps estimated to ±0.133 against the ratio's ±0.141. Found by the nearest other lamp in the sensor's departures, the family is right for the tube and wrong for five lamps, and those five, missed by ±0.41, take the whole census back to ±0.162. The gain is real; the classifier is where it is lost.

5 figures
How many neighbours a lamp's family is read from, and what the estimate costs. The two-stage estimate's held-out error over the census's fifty-four lamps when a lamp's family is read from its one to six nearest neighbours, and used only if all of them agree (upper bars) or most of them do (lower), with the halophosphate tube's miss on each bar; otherwise the census-wide ratio line. The ratio alone is ±0.141 and the families given ±0.133. Blue bars catch the tube; orange ones lose it.

A classifier that abstains gives up the tube

Found by the nearest other lamp, a lamp's family cost a two-stage estimate of a camera's colour error more than it bought, because five lamps were placed confidently in the wrong family. The proposed repair was a classifier that abstains — falls back on the census-wide line — unless a lamp's three nearest neighbours agree. It abstains on the wrong lamps. The misplaced ones have three agreeing neighbours, all white LEDs; the lamp it gives up is the halophosphate tube the two stages were built to catch, whose third neighbour is a cyan LED, and its miss returns from 0.011 to 0.445. Two agreeing neighbours look better than knowing every family. Chosen without looking at the lamp being estimated, the rule is worth exactly what the ratio alone is worth.

5 figures
Three family lines through the departures, and whom they claim. Every lamp of the census and the halophosphate tube's four siblings by its 450 and 640 nm departures, coloured by family, with the principal line of each family that has three or more members — the radiators, the white LEDs and the halophosphate tubes — solid over the stretch its members span and dashed beyond. Circled are the 29 lamps whose nearest line is another family's. The radiators' short line runs along the LEDs' long one and, extended, through the violet-pumped LEDs.

A family's line runs through its neighbours

The halophosphate tubes differ from one another by one number — where their main phosphor band sits — and so lie along a line in the three departures an ambient-light sensor reads. The proposal was to classify a lamp by the family whose line passes nearest, which would keep the tube a vote of neighbours gives up. It keeps the tube, under every version that does not rescale the distances. It also places eighteen white LEDs on the radiators' line, because that line — fitted to six radiators close together — runs along the LEDs' own and, extended, straight through the violet-pumped ones; and the radiators' estimate, extrapolated to them, misses the triphosphor tube by 7.6. Clamped to the stretch each family spans, the lines still cost ±0.285; given to the halophosphate family alone, its line claims a cyan LED and costs ±0.179. The one line classifier that comes in under the ratio line's ±0.141 does so by two thousandths, having placed the tube with the LEDs.

5 figures
What treating radiators and LEDs as one family does to the estimate. Held-out error over the census's fifty-four lamps for the ratio line alone, for the two-stage estimate with the separate families found by the nearest lamp and given, and with radiators and LEDs merged into one family of smooth sources, found by the nearest lamp, with the halophosphate tube's miss. Merged, the estimate comes to ±0.127 — below the ratio's ±0.141 and below the separate families even when every lamp's family is given — and keeps the tube.

Radiators and LEDs are one family to the sensor

An ambient-light sensor's three narrow departures see the collection's six smooth radiators and forty-four white LEDs along one line: the radiators' own short line lies on the LEDs' long one. Estimating a camera's colour error family by family, the census had treated them as two, and every classifier that tried to tell them apart paid for it. Merged into one family of smooth broadband sources, found by the nearest other lamp as before, the two-stage estimate comes to ±0.127 over fifty-four lamps held out — below the ratio line's ±0.141, and below the ±0.133 the separate families managed when every lamp's family was simply given. The halophosphate tube is still caught. The radiators, which the prediction said the merge would cost a little, are estimated better inside it than inside their own family, because a three-coefficient line fitted over five radiators was worse for them than the census-wide ratio line.

5 figures
How far the merged design misses each lamp it never saw. For fourteen lamps outside the census — radiators and daylights, tinted and filtered lamps, white LEDs varied in their phosphors, and a three-band LED — the camera's colour error less the estimate the merged design makes from the ambient-light sensor's departures, fitted on the whole census. The dotted lines are the census's own held-out error, ±0.13. The radiators, daylights and tinted lamps fall inside or on it; 4 lamps fall outside, every one of them an LED.

New LEDs miss the line their cousins drew

An ambient-light sensor's three departures can estimate a camera's colour error under a lamp, and merging radiators and white LEDs into one smooth family brought that estimate to ±0.127 over fifty-four lamps, each left out in turn. Every one of those lamps had relatives in the pool. Fourteen lamps the census never saw test what the relatives were worth. The prediction was that new smooth lamps would land on the line and tinted incandescents fall off it by four tenths or more. The radiators and daylights land on it, within ±0.13 each. The tinted lamps do too — the pink-glass incandescent, placed among the LEDs by its nearest neighbour, misses by 0.12. The lamps that fall off are the new white LEDs: ±0.20, half again the census's error, two of them by a quarter. Their misses follow the sensor's 640 nm channel at a slope of −0.72, explaining four fifths of their scatter, because the line learned what that channel means from LEDs varied only in their blue pump. Adding the fourteen to the pool does not help.

6 figures
A phosphor grid's camera error is a V about the locus. Forty-eight white LEDs varied in pump, converter share and red phosphor (circles, shaded by red phosphor) and the census's forty-four (squares), placed by how far each white sits from the Planckian locus and by the camera's mean colour error under it. Across the grid the error rises away from the locus on both sides — correlated 0.68 with the distance on the green side and -0.64 on the pink — and is lowest near it. Every one of the census's LEDs sits on the green side, from 0.007 to 0.034.

LEDs varied in their phosphors fall off every line

The merged smooth family estimates a camera's colour error from an ambient-light sensor's departures to ±0.127, and five new white LEDs, varied in their phosphors where the census's forty-four vary their pump, missed by ±0.196 because the family's line had learned almost nothing about the sensor's 640 nm channel. Rebuilt on forty-eight LEDs varied in pump, converter and red phosphor, the line learns it: its 640 nm weight goes from −0.13 to −0.74, most of the way to the −0.85 the new LEDs implied. The prediction was that the new LEDs would then land within ±0.13. They miss by ±0.229, worse than before, crossing to the other side of the line, and the census's own held-out error more than doubles, to ±0.294. No pool of LEDs restores it, and no line in the sensor's departures reads the grid's own LEDs better than ±0.29. Across the grid the camera's error is a V about the Planckian locus, rising away from it on the green side and on the pink — and every one of the census's LEDs sat on the green side.

6 figures