Colour Science & Perception
what the eye settles, and what it cannot
Concept

Infrared — where it appears

Light longer than about 780 nanometres, where no observer responds and silicon responds strongly. It is the reason every colour camera has a cut filter and the reason a sensor's grid and an eye's are different grids.

Named by 10 essays across 2 fields — each of them below, with the objects they name alongside it.

The blue channel, as the three things multiplied to make it. Silicon's quantum efficiency, the colour-filter dye's transmittance, and their product. The dye is the only stage carrying any colour information and it is clear above about 800 nm — transmittance 0.92 at 900 nm against 0.06 at 550.

Silicon sees past the visible

A sensor's response ends at 1107 nanometres because that is the band gap, and the colour-filter dyes have stopped absorbing three hundred nanometres before it. So all three channels measure the same thing over the last third of the range, and every published sensitivity plot is drawn after the component that hides it.

imaging · Capture How much of what an unfiltered sensor records is invisible. The share of a camera's raw signal coming from beyond 780 nm, against the colour temperature of the lamp, for one surface with a near-infrared reflectance of 0.62. Without the filter it runs from 98 per cent at 2000 K to 51 at 9000; with it, under five per cent everywhere.

The filter that makes colour possible

An infrared-cut filter is not a refinement on a colour camera. Removing it collapses the separation between the three channels by a factor of nearly nine under tungsten, and the component that keeps colour photography working is the one nobody photographs.

imaging · Capture One reflectance, four different infrared tails, and what the camera makes of each. The same visible reflectance continued past 780 nm to four different near-infrared values. A spectrophotometer reports only the left-hand part; an unfiltered sensor integrates all of it. The channel spread falls from 0.14 at a tail of 0.05 to 0.02 at 0.85, with nothing about the visible half changed.

Most things are pale in the infrared

A spectrophotometer stops at 780 nanometres and a black cotton shirt reflecting five per cent of visible light reflects more than half the near infrared. The measurement everybody has and the quantity a camera integrates are different quantities, and nothing in the first says so.

imaging · Capture A camera's spectral sensitivities, with the filter removed. Silicon quantum efficiency times the colour-filter dye times nothing else, per channel, on a grid running to 1100 nm rather than to 780. With the filter removed, 68 per cent of the area under the three curves lies beyond the visible band, and all three curves are the same curve out there.

The grid outside every figure

Every figure here is computed on 380 to 780 nanometres, which is exactly right for an eye and insufficient for a sensor. This field met the first subject the grid cannot hold, and the decision was not to widen it — because widening it honestly is impossible.

imaging · Capture What each end of the 380–780 nanometre range costs, by light. Two bars per light, on a logarithmic axis: the upper is what extending the range down to 300 nanometres moves the answer, the lower what extending it up to 830 does. The asymmetry is the whole figure. A thermal source has about a fifth of its power outside this collection's range and almost all of it at the long end, where the observer is already zero; what costs money is the short end, where the observer is small but not zero and daylight is still strong. A light with no ultraviolet — an LED lamp, a laser — pays nothing at either end, which is the pairing again: a range only costs what the light puts in it.

Two ends and one is empty

Extending this collection's wavelength range down to 300 nanometres moves a red pigment under daylight by 0.502 ΔE₀₀. Extending it up to 830 moves the same colour by 0.00015. A fifth of a thermal source's power lies outside the range and almost none of its colour does, and confusing those two shares is how a range gets argued about instead of measured.

light · Light One infrared-cut filter, crossed at four angles. The transmittance of the same interference filter for light crossing it at the centre of a frame and at three steeper angles, from 560 to 760 nm. Its half-transmission edge is at 665 nm straight on and moves to 658, 646 and 630 nm, following the edge wavelength times the square root of one minus the squared sine of the angle over the square of the stack's effective index, 1.8. The deepest reds are what it takes away, and a lamp decides how much light there was in them.

The corner of the frame has another filter

A camera's infrared-cut filter is an interference stack, and light crossing it at an angle sees its edge moved towards the blue — from 665 nm at the centre of a frame to 646 at twenty-five degrees. The corner's red channel loses a tenth of its response under daylight and a sixth under tungsten. A grey-card gain map makes the corner exactly right under the lamp it was made under; under a tungsten lamp the same grey is 2.6 colour differences wrong, under a white LED 4.2, and even under its own lamp the coloured patches are not corrected, because a moved edge is not a gain.

imaging · Capture Three corrections for the corner of a frame, each made under daylight. The mean colour difference over twenty-four coloured patches between the centre of a frame and its corner, against the angle light arrives at, after three corrections each fitted under daylight, D65 and used under it: a grey-card gain map, a correction confined to the red channel's row, and a full three-by-three matrix. All three leave the grey exact. At 25° the gain map leaves 1.86, the red row 0.93 and the matrix 0.90; at 35°, 3.81, 1.95 and 1.81. Six more numbers buy almost nothing, because the moved edge is in one channel.

A corner is corrected by one row

A grey-card gain map makes the corner of a frame exactly right on grey and leaves coloured patches 1.86 colour differences wrong at twenty-five degrees. A three-by-three matrix fitted at that position halves it — and six of its nine numbers do nothing, because the moved filter edge is in one channel. The three that matter rebuild the lost red from green and blue, they carry to another lamp better than a gain map in eleven cases of twelve, and in the twelfth, a row fitted under tungsten and used in daylight, they leave the grey 9.2 off.

imaging · Capture How far each lamp's sensor reading is from what the camera predicts, with RGB + clear. Fourteen lamps, six smooth and eight structured, each scored by how far an ambient-light sensor with red, green, blue and clear channels reads from what the camera's white predicts through a map fitted on smooth radiators and daylights. The smooth lamps score at most 0.057 and the structured at least 0.133; the dashed line is the threshold at the gap's geometric middle, 0.087. The lights the map was fitted on score at most 0.0113. Every lamp falls on its own side of the line.

Two sensors disagree about deep red, not lines

A phone's ambient-light sensor and its camera read the same lamp differently, and the difference sorts fourteen lamps into smooth and structured without a single mistake — where flicker made five. It is not reading their lines. Almost all of it comes from the sensor's clear channel collecting deep red the camera's infrared cut throws away, so daylight with its far red trimmed is called structured and a white LED with a far-red emitter is called smooth.

imaging · Capture The calibration error a narrow fourth channel survives, by where it is placed. For a red, green and blue ambient sensor with one more channel 10 nm wide, centred from 450 to 640 nm: the first calibration error at which some lamp of fourteen is misclassified. Dashed: the channel pooled into the whole residual, as the ambient sensor's disagreement was read; its best is ±1.50 per cent. Solid: the channel read on its own, as its departure from what the camera's white predicts for it; its best is ±4.0 per cent, at 450 nm. Crosses mark centres where the channel read alone does not separate the lamps at all. The two horizontal lines are the red, green and blue design (±1 per cent) and the design with a clear channel (±4 per cent).

A narrow channel has to be read on its own

An ambient sensor with a clear channel tells structured lamps from smooth ones by reading deep red, and one without it reads structure but breaks at one per cent of calibration error. A narrow fourth channel between the camera's peaks was proposed to have both. Pooled into the sensor's disagreement with the camera, it reads structure and breaks at one and a quarter per cent — no better than the design it was meant to rescue. Read on its own, as its departure from what the camera predicts for it, a channel at 450 nm holds to four per cent, the clear channel's figure, and far red does not move it.

imaging · Capture Four ways to correct the corner, under each of four lamps, at 25°. The mean colour error left on the chart's coloured patches at the corner of the frame, under each lamp, after: the red row fitted under that lamp; one red row fitted on the chart under all four lamps with the grey held under daylight; a grey-card gain map calibrated under daylight; and the worst of the other lamps' rows used by mistake. daylight: 0.93, 1.33, 1.86, 4.91; tungsten: 0.99, 1.45, 1.87, 3.26; white LED: 0.36, 1.39, 3.28, 1.77; fluorescent: 0.37, 1.56, 3.09, 2.45. The pooled row holds every lamp between 1.33 and 1.56.

One row for every lamp costs the lamps that lose least

A corner correction fitted under one lamp is right under that lamp and can be badly wrong under another, so a converter unsure of its lamp was offered a single row fitted under several at once. Pooled over four lamps, one row holds every lamp's corner between 1.33 and 1.56 colour differences — no lamp worse than a grey-card map, and none near the 4.91 a wrong row can leave. The price falls on the white LED and the fluorescent tube, which it leaves four times worse than their own rows, because they lose the least red at the corner and the pooled row is built to repair the lamps that lose the most. Two rows, one per class of lamp, keep almost all of both.

imaging · Capture

Named alongside it

The objects these essays reach for when they reach for this one.

Spectral sensitivityCamera rawIlluminantCalibrationColour matrixSiliconColour filter arrayIdentifiabilityLED emissionPlanck's lawWhite balanceAbsorption

All concepts