Concept

Clipping — where it appears

Forcing a value back inside a range it has left, which produces a number that is legal and a colour that is wrong. It is the standard treatment of out-of-gamut colours and the reason a chromaticity diagram printed edge to edge is showing colours it is not labelling.

Named by 16 essays across 3 fields — each of them below, with the objects they name alongside it.

The CIE 1931 chromaticity diagram with its unreachable region marked. The spectral locus encloses every chromaticity a human eye can see. Cells inside the sRGB triangle are drawn in their own colour; the 85 per cent outside it are hatched, because no value this display accepts is the colour belonging there.

Most of this diagram cannot be shown

The chromaticity horseshoe is the canonical illustration of colour science, and nearly every printed copy is filled edge to edge with colours the page cannot produce. The honest version marks them, and the marking covers most of the picture.

matching · Gamut
A clipped channel turns the hue of what is left. CIELAB hue shift against exposure for one saturated stimulus, measured against the same stimulus rendered without clipping. Nothing moves until the first channel reaches the ceiling at 0.25 stops; after that the recorded hue rotates by as much as 67 degrees, with nothing in the scene having changed colour.

A blown highlight turns

An exposure that clips nothing changes no hue at all. Once one channel reaches the ceiling the recorded hue rotates by as much as sixty-seven degrees, with nothing in the scene having changed colour — and every response a converter can make to that is an invention.

imaging · Capture
Everything between the photons and the picture, and what each stage decides. The 8 stages of a camera pipeline. Only the second is physics; every one after it is a decision somebody made, and the reason two cameras pointed at the same scene disagree is that they made different ones.

A photograph is not a measurement

A photograph is a measurement made by an instrument whose kernel nobody published, under an illuminant nobody recorded, corrected by a matrix fitted to somebody else's surfaces, with two thirds of every pixel invented. It supports relative claims well and absolute ones badly, and it is used for the second.

imaging · Capture
What happens to a tone the destination cannot print. Source lightness along the bottom, destination lightness up the side, for a print whose black is L* = 8. Clipping is the flat segment on the left — 4 of 10 levels in the bottom twenty points of the scale arrive as the same number, and nothing downstream can recover them. Black point compensation is the straight line: all 10 levels survive as different numbers, and every tone in the picture has moved to pay for it.

A black that is not black

The deepest colour a four-colour press can make is L* 2.4, and against its own paper that is a contrast of about 320 to 1 — less than a cheap display manages in a dark room. Everything a printed picture does in the shadows is done inside that range, and the two ways of fitting a picture into it destroy different things.

applied · Delivery
A gradient of one hue, mapped into a press's gamut 2 ways. Chroma asked for along the bottom, chroma delivered up the side, for a ramp at lightness 55 and hue angle 25°. A colorimetric intent follows the diagonal until the press runs out and is flat afterwards — the flat part is a gradient arriving as a single colour. The perceptual intent is under the diagonal from the start, which is the price of never going flat.

No mapping preserves everything

More than half the sRGB solid is outside a press's gamut, so something has to be done with it, and there are two things that can be done. One leaves every reproducible colour exactly where it was and delivers a gradient as a flat area. The other keeps the gradient and moves every colour that needed no help by about three.

applied · Delivery
A gradient of one hue, mapped into a press's gamut 3 ways. Chroma asked for along the bottom, chroma delivered up the side, for a ramp at lightness 55 and hue angle 25°. A colorimetric intent follows the diagonal until the press runs out and is flat afterwards — the flat part is a gradient arriving as a single colour. The perceptual intent is under the diagonal from the start, which is the price of never going flat.

A budget drawn through one hue

The three-stage error budget this collection publishes for a colour-management chain is computed over twenty-four colours of a single hue at a single lightness. The quantity that actually varies with hue — how many distinguishable colours a rendering intent destroys — runs from nothing at all to more than a third, and the hue the budget uses is near the bottom of that range.

applied · Delivery
Three exchanges, two of which move the colour. The documented pipeline is a white balance, a colour matrix, a tone curve and a clip. Each bar is what happens when two neighbours change places, over 30 surfaces the modelled sensor captures: the filled bar is the mean and the tick is the worst patch. Exchanging the balance and the matrix costs 9.2 colour differences at the mean and 13.2 at the worst. Exchanging the curve and the clip costs exactly nothing, and that is a theorem rather than a small number: a monotone curve onto the unit interval commutes with clamping to it.

The order is not in the documentation

A raw converter performs a white balance, a colour matrix, a tone curve and a clip, and every account of the process lists them in that order without saying the order decides anything. Exchanging the first two moves the picture by nine colour differences at the mean and thirteen at the worst patch. The twenty-four arrangements collapse into five outcomes running out to sixty-five, and nothing a converter ships says which of them it is.

imaging · Capture
Where the mosaic is filled in, along one row through an edge. A Bayer row across a step from 0.9 to 0.08, in units of the sensor's own ceiling, reconstructed in linear light and reconstructed after the tone curve, with the second undone so the two are compared at the same point in the chain. Away from the edge they agree to 8.3e-14, because a constant interpolates to itself under any curve. At the edge they differ by 5.78 colour differences. Interpolating encoded values pulls an edge towards its dark side.

One step has no choice

Four of a raw converter's operations can be arranged twenty-four ways. The reconstruction cannot be arranged at all — a colour matrix needs three numbers and a mosaic site has one, so filling in the mosaic is forced to the front by arithmetic rather than by convention. What is not forced is whether it happens in linear light or after the curve, and that decision costs 5.8 colour differences at an ordinary edge and nothing at all four sites away from it.

imaging · Capture
A stop taken in raw, and the same lightness reached afterwards. Each row is a stop of exposure applied to the raw values, against a gain applied after the whole pipeline and solved so that an eighteen per cent grey comes out at the same lightness. The two are then the same brightness by construction and differ by 4.2 colour differences at the mean and 11.1 at the worst patch. A stop is a scalar in front of the curve and is not a scalar behind it.

A stop is not a stop afterwards

Doubling the light is exactly a factor of two in raw values and in tristimulus values, which is the one thing about exposure everybody is sure of. A stop taken after the tone curve is a factor of something else, and matching the two on an eighteen per cent grey leaves the rest of the frame between three and four colour differences apart at the mean and up to eleven at the worst patch. The gain that matches one stop is 2.47 rather than 2.

imaging · Capture
The same highlight, clipped in two places. A ramp running from inside the sensor's range to 1.6 times over it, clipped at the sensor and clipped after the matrix. Below the ceiling the two are identical to the floating-point floor. Above it they part, reaching 21.0 colour differences and 78 degrees of hue. Clipping late keeps a highlight neutral and clipping early keeps its hue, and converters do both.

Two converters and one highlight

The clip is the only step in a raw pipeline that destroys information rather than moving it, and it is the step whose position varies most between converters. Below the sensor's ceiling its position changes nothing at all, exactly. Above it, clipping at the sensor and clipping after the matrix land twenty-one colour differences and seventy-eight degrees of hue apart, and which hues are affected is a property of the camera's own dyes.

imaging · Capture
One edge magnified four times, three ways: text on a page. A step between the two colours of text on a page, magnified four times by linear interpolation, by bicubic and by a three-lobe Lanczos kernel, once on the stored values and once on the light. The curves are the stored-value result's lightness minus the light's, sample by sample across the edge; below the line the stored-value resize is darker. Linear interpolation is darker everywhere it differs. The two kernels with negative lobes swing above the line beside the edge, where their negative weights fall — bicubic by up to 1.8 colour differences and Lanczos by 3.7.

A resize with a negative weight in it

A blend taken on stored values is always darker than the blend of the light, because the encoding is concave and a convex combination of a concave function's values lies below the function of the combination. A bicubic or Lanczos resize is not a convex combination. Beside an edge its negative weights make the stored-value result lighter than the light's own — by up to 6.1 colour differences with bicubic and 12.2 with Lanczos on skin against its shadow — and on edges between full-scale values the clip hides the overshoot and the old guarantee appears to hold.

applied · Delivery
Noise clipped at zero, averaged over a shadow, under tungsten. A grey ramp from black to ten per cent reflectance under tungsten, captured at three illustrative noise levels, with every negative raw reading set to zero before the readings are averaged over an area. Each line is the colour difference between that average and the noiseless grey. At high gain a half per cent grey is 1.04 off and a black frame 0.79; at very high gain the worst is 2.95, at 1.0 per cent. The same readings averaged before any clip come back exactly, at every level. The tint is gone once every channel sits several deviations above zero.

Clipped noise does not average away

Noise on a raw reading is as likely to fall below the true value as above it, which is why averaging an area removes it. A converter that sets negative readings to zero keeps the upper half and throws the lower away, and the mean of what is left is the signal plus a pedestal. With no black level error anywhere, a half per cent grey under a tungsten lamp comes out 1.04 colour differences off at high gain, 8.98 after a four-stop push — and a blur that removes every trace of the noise leaves the tint where it was.

imaging · Capture
Four ways to fill in a clipped highlight: a glossy surface with a reflection of the lamp, under tungsten. Twenty-four chart surfaces under tungsten, as a glossy surface with a reflection of the lamp, taken up a ramp until their raw channels reach the sensor's ceiling. Each line is the mean colour difference, at equal lightness, between the true colour and what one response to the clipped reading makes of it: clipping to white, carrying the clipped values through, filling the clipped channel from the surface's own ratio, and filling it from the surface's colour plus the lamp's. At 0.4, where most surfaces have one channel clipped, the four leave 5.87, 4.37, 5.56, 0.00; at 2, 2.90, 26.97, 8.18, 8.18.

Filling in a highlight is a claim about the surface

A converter that rebuilds a clipped channel has to say what the highlight was. A matt surface over-exposed keeps its own colour, and filling the lost channel from that colour is exact. A glossy highlight is the surface's colour plus a reflection of the lamp, and the same fill leaves it 7.6 colour differences too colourful — while a fill that solves for surface and lamp is exact. Neither works once two channels are clipped, and a tungsten lamp keeps a highlight in the one-channel band more than twice as long as daylight does.

imaging · Capture
The corner of a patch of skin against its own shadow, magnified four times by Lanczos, three lobes. A map of the neighbourhood of one corner of a square patch — the patch fills the lower right, the field the rest — once it has been magnified four times by Lanczos, three lobes. Each cell is shaded by how much lighter (warm) or darker (cool) the stored-value result is than the light's, the deepest shade 18.2 units of lightness. Within three source pixels of the corner the stored-value result is up to 14.5 colour differences lighter, 14.5 outside the patch against 3.1 inside it, and up to 7.3 darker.

The corner of a resized patch is lighter than its edges

A resize taken on stored values is darker than the resize of the light wherever its weights are positive, and lighter beside an edge where a kernel's negative lobes fall. In two dimensions the kernel is a product, and just outside a patch's corner a Lanczos magnification of skin against its shadow comes out 14.5 colour differences lighter — more than along either edge. A reduction to a quarter is mostly an average and errs lighter by at most two. And an unsharp mask, whose negative weights are its whole purpose, is lighter on the stored values at every amount on every pair, and never darker.

applied · Delivery
The statistic a converter would read, under each model. The log ratio of the two channels that are still open, against how bright the surface is, under the two models of what a highlight is. A matt surface over-exposed keeps its own ratio exactly — the line is flat, and it must be, because scaling every channel by the same amount leaves a ratio alone. A glossy surface carries a reflection of the lamp on top of its body colour, so its ratio slides towards the lamp's as the reflection strengthens: -0.086 of a log unit between a quarter of full scale and nine tenths. That slide is the whole of the evidence a converter has for choosing between them.

The converter can choose except where it matters

A converter rebuilding a clipped highlight has to say whether the surface was matt and over-exposed or glossy and carrying a reflection, and the evidence is whether its raw chromaticity slides towards the lamp's on the way up. Read through the sensor's own noise, the slide is clear on most of the chart from the few tens of pixels a specular highlight holds — and on the surfaces where it takes half a frame, confusing the two models costs more than the median. A ratio cannot see a common scale, and an exposure supplies one.

imaging · Capture
The four places a clamp could sit are two pipelines. Every pair of clamp positions, with the largest difference their delivered values reach over a grid of raw inputs that includes negative ones. Two of the six are exactly zero: a clamp at zero commutes with the white balance, which is a positive scale applied channel by channel, and with the tone curve, which is monotone and fixes zero. It does not commute with the colour matrix, which is the only step that mixes the channels — so the four positions collapse to two, before the matrix and after it, and no measurement of any scene can say more than which side a converter is on.

Four places to clamp are two pipelines

The essay on clipped noise ended on a procedure: a black frame and a dim grey card at a high amplification would place each raw converter's clamp. A procedure is a claim that a measurement identifies something, and this one identifies less than it looks. A clamp at zero commutes with the white balance and with the tone curve and not with the colour matrix, so the four positions are two pipelines — and the measurement separates them, on a card at half a per cent of white rather than on the black frame.

imaging · Capture

Named alongside it

The objects these essays reach for when they reach for this one.

Colour managementSpecificationCamera rawDeclared inputDynamic rangeStructural choiceTransfer functionWhite balanceExposureGamutHighlight recoveryInterpolation

All concepts