Concept

Opponent processing — where it appears

The recombination of three cone signals into one achromatic and two chromatic channels, which is where colour vision's resolution and its unique hues come from. It explains why there is no reddish green and why fine detail is carried without colour.

Named by 19 essays across 4 fields — each of them below, with the objects they name alongside it.

One palette under normal vision and two dichromacies. The same 7 colours simulated by the Brettel–Viénot–Mollon construction at severity 1.0. protanopia and deuteranopia collapse the red-green distinctions. This shows which discriminations survive, not what anybody sees.

Three cones, two axes

The retina does not send three receptor signals down the optic nerve. It sends a sum and two differences, and the reason falls out of the statistics of natural light rather than out of anything the eye intended.

eye · Cones
The four unique hues, and the axes they are said to define. A constant-lightness, constant-chroma ring in CIECAM16, with the four unique hue anchors marked and CIELAB's a and b axes drawn through the same circle. If a* really were the red-green axis the anchors would fall on the crosshairs. Unique red sits 25° off, and the four are not 90° apart in any case. Hatched sectors are hues this display cannot reach at this chroma.

Why there are four unique hues

Observers agree that four hues are elementary and that no colour is reddish green. Nothing in the three receptors predicts either fact, and the axes of every standard colour space miss the four by tens of degrees.

brain · Appearance
An edge at 4:2:2, and the colour it arrives as. Above, the row as it was sent and as it arrives after the two chroma planes are averaged 2 samples at a time. Below, the colour difference at each sample. The worst is ΔE00 = 25.88, at a luma step of 0.058 across the edge — an edge of nearly equal luminance. Nothing is wrong with the codec: it discards the differences the eye resolves worst, and this edge is made of nothing else.

Colour thrown away on purpose

Every video format in use discards three quarters of its colour information and keeps all of its luminance, because the eye resolves fine colour detail badly. On an edge that carries luminance the loss is exactly zero. On an edge of nearly equal luminance it is a colour difference of forty-three, and the two edges are the same edge to the codec.

applied · Delivery
Contrast sensitivity, three channels, normalised to each channel's peak. Spatial frequency in cycles per degree against relative sensitivity. The luminance channel runs to 50 cycles per degree, red–green to 12 and blue–yellow to 8, each by the same criterion of 5 per cent of that channel's own peak. Only the luminance channel dips at low frequency; the two chromatic ones are low-pass, so a chromatic edge of any size at all is seen at its full contrast.

How fine a colour edge can be

The eye resolves a lightness pattern to about fifty cycles per degree and a red–green one to twelve. Every colour difference here is quoted as though a patch had no size, and the same difference is plainly visible at one scale and gone at another.

eye · Cones
One adapting colour, two answers. The left patch is what was stared at. The middle is the afterimage the cone-gain arithmetic predicts at 15 per cent adaptation; the right is the inverted code values. They are 22.1 ΔE00 apart. The gains that produced the middle patch are 0.95, 1.06, 1.69 on the long, medium and short cone classes — the reciprocal of what each class had been receiving, taken 15 per cent of the way.

An afterimage is an adaptation

The demonstration everybody gives is an inverted image, which is a statement about a file format. Running the receptoral arithmetic instead puts the afterimage of a saturated red sixty degrees of hue away from the inverse — and outside what any display can show.

brain · Appearance
A screen at 45°, 8 c/°, and where its energy sits. Left, the pattern. Right, its power in the frequency plane with the zero frequency at the centre and the edges at the sampling limit of 23 cycles per degree, on a logarithmic scale over five decades. The closed curves are the visual system's own sensitivity at 5, 25, 60 per cent of its peak; they are not circles, because sensitivity is lower on the diagonals than on the cardinal axes by a factor of 2.0 at high frequency. Energy inside a curve is seen; energy outside it is not, whatever its size.

A pattern has a direction

Every spatial claim here is a claim about a frequency, and a frequency has no direction in it. Turning a printed screen forty-five degrees makes it exactly twice as quiet with nothing else changed — and the same rotation does nothing at all to a chromatic one.

eye · Cones
Cone density, out from the centre of gaze. Quoted landmarks with logarithmic interpolation between them: 199,000 cones per square millimetre at the fovea, 9,500 at ten degrees — a factor of 21. The shaded bands are the two standard observers' fields. The 2° observer averages over a region whose density falls by 3.3× between its centre and its edge and the 10° observer by 12.4×, which is what "a 10° field" contains and is why the two sets of matching functions are different shapes rather than the same shape scaled.

Colour stops at the edge of sight

Cone density falls twenty-one-fold between the centre of gaze and ten degrees out, and the three channels give out at three different rates — so a colour difference in the periphery does not merely shrink, it turns. At the exact point of fixation there are no short-wavelength cones at all.

eye · Cones
Temporal sensitivity, and where each channel gives out. Modulation frequency in hertz against relative sensitivity. The luminance channel is band-pass, peaking at 8 hertz and running out at 60; an isoluminant modulation is low-pass and runs out at 15, which is 4.0 times sooner. Both cutoffs are at the same criterion of 5 per cent of that channel's own peak, so the ratio between them is a ratio between two measurements rather than between two conventions.

The eye has a shutter

An isoluminant flicker fuses at fifteen hertz and a luminance one at sixty, so a light whose colour changes forty times a second is a steady light of a colour it never emits. And the frequency at which flicker stops being visible is not a property of the eye — it moves twelve and a half hertz for every decade of light.

eye · Cones
One colour difference, at four places in the visual field. The same pair of colours — ΔE00 22.0 at the fovea — with each of its three components divided by that channel's own threshold scaling at the stated eccentricity. What is left at 20° is 4.4, and its hue has turned by 26 degrees, because the red–green part is divided by more than the blue–yellow part. The swatches are the predicted colours, drawn where a reader will look straight at them; the figure states a prediction it cannot stage.

A difference has no place

A colour difference formula answers a question about two patches somebody is looking straight at. Move the same pair ten degrees into the periphery and a third of it is left — and it has turned twenty-four degrees of hue, because the three channels give out at three different rates.

difference · Metric
An afterimage, as the local pool coming back to equilibrium. The local pool has adapted to the patch and the global pool has not, so the gain change is exactly the local share of a full von Kries change — which is why afterimage's free strength parameter is not free here. The dwell is 20 seconds. The swatches are the predicted appearance of the test surface at four moments. They are predictions of hue and direction; there is no response compression in this model, so the chroma is a ceiling rather than an estimate.

A gain has a time constant

An afterimage and the clock on chromatic adaptation were built in different files from what the last phase said was one mechanism. Joining them removes a free parameter, reproduces both, and predicts a third thing — that two people in one room, at one moment, looking at one patch, do not agree about its colour.

brain · Appearance
The eye's own drift, and what it does to every spatial frequency. A pattern of f cycles per degree, drifting across the retina at 0.5 degrees a second, arrives at each receptor at f × 0.5 hertz. The curve is the temporal sensitivity at that rate, against the pattern's spatial frequency. Every frequency the eye can resolve stays above a quarter of the temporal peak, and the band of drift speeds for which that holds is 0.02–0.71 degrees a second — with the measured drift inside it. Faster and the finest detail is carried past 60 hertz, where there is no sensitivity at all.

The eye is never still

A perfectly stabilised retinal image disappears within seconds. What keeps the world there is a drift of about half a degree a second between the microsaccades — fast enough to keep the finest detail modulating and slow enough not to carry it past fusion, in a band whose upper edge is at 0.71 degrees a second.

brain · Appearance
The drift window, asked about each channel in turn. Every spatial frequency a channel can resolve, drifting at v degrees a second, arrives at f × v hertz; the bar is the range of v over which all of them stay above a quarter of that channel's temporal peak. The luminance band is closed at both ends — 0.018 to 0.71 degrees a second — because its temporal sensitivity has a dip at zero to fall into. The chromatic bands have no slow edge at all, because chromatic temporal sensitivity is low-pass: a stationary chromatic pattern sits at the top of its own sensitivity. The mark is the measured drift, and it is inside all three.

The drift is a luminance mechanism

The eye's own drift was shown to sit inside a band of speeds that keeps every spatial frequency modulating, and the band was quoted as though it were about vision. Asked about colour, it has no slow edge at all — a stationary chromatic pattern needs no eye movement whatever. And a stabilised chromatic pattern is the first thing to fade.

eye · Cones
Where a pooled gain gives out, against where the eye does. The falling curve is how much of a pattern of each spatial frequency a local adaptation pool of 0.5° can see — and therefore how much of it a settled eye can cancel. It is half gone by 0.37 cycles per degree, which is a feature about 2.7° across. The three marks are the acuity limits of the luminance channel and the two chromatic ones. Every one of them is more than an order of magnitude finer than the pool, which is why a stabilised eye loses the fill of a picture and keeps its outline rather than losing the picture.

What a still eye stops seeing

A stabilised image is said to vanish, and nothing in a temporal filter predicts it — sensitivity at zero frequency is a quarter of the peak, not nothing. Give the adaptation gain a size and the answer falls out — fading is a high-pass filter that switches on over a minute, it takes the fill and leaves the outline, and a patch has to be about two degrees across before it goes at all.

eye · Cones
How fine a screen each channel can see. A halftone screen at 35 per cent coverage, 45 degrees, seen by each of the eye's three spatial channels. The bar is the ruling at which it drops below that channel's own threshold. The luminance channel is still seeing it at 55 cycles per degree; the two chromatic ones have lost it by 15 and 10. The dashed line is an ordinary press ruling at reading distance, and only one channel is above it. A halftone is a luminance object, which is why the ink whose dots are nearly the lightness of the paper is the one nobody worries about.

A halftone is a luminance object

The eye's three spatial channels resolve a screen at 55, 15 and 10 cycles per degree, so at any ruling a press actually runs only one of them can see it at all. The corollary corrects a guess already published here — rotating a screen matters more to the chromatic channels, not less — but only at rulings so coarse that nobody prints there.

difference · Metric
What is left of one colour difference when the two colours alternate. 23 pairs built at exactly ΔE₀₀ 1.000, alternated at a rate, with each part of the difference scaled by its own temporal channel and the formula then applied unchanged. At rest every pair is the flat line at one. By 7 hertz the median is 1.11 and the pairs run from 0.57 to 3.04 — a factor of 5.3 between pairs the formula calls identical. By sixty hertz the largest of them is 0.15.

A difference has no rate

A colour difference formula answers for two patches that are both there and stay. Alternate the same two colours and the difference is not scaled but taken apart: the colour half is gone by fifteen hertz and the lightness half is four times louder at eight, so twenty-three pairs the formula calls identical run over a factor of six at the rate the eye is best at, and are worth nothing at all above sixty.

difference · Metric
Three stored-value defects, before the eye and after it, a print at 40 cm. Each defect's largest colour difference between the version computed on stored values and the version computed on light, read twice: as a pixel carries it, and after both images have been through the visual system's three channels at 83 pixels a degree. The two rankings are not the same. The unsharp mask has the largest error per pixel — 16.62 — and keeps only 38 per cent of it; the corner has the smallest at 7.14 and comes out at 9.87. The filter is not a blur applied to a difference: it is applied to each image, and the difference is taken after.

The eye keeps the lightness errors

Four essays have priced what a resize taken on stored values costs, in colour differences between pixels. A reader does not see a pixel. Put the two versions of each image through the visual system's own three channels and the ranking reverses: the unsharp mask, the largest error per pixel at 16.6, is seen at 6.3 on a printed page, while the corner's 7.1 is seen at 9.9. What decides it is not the size of an error but how much of it is colour.

applied · Delivery
Where an unsharp mask errs, per pixel and as seen: print, 40 cm. The upper-left corner of a patch of skin against its shadow after an unsharp mask, as two maps of the colour difference between the result taken on stored values and taken on light. Left, pixel by pixel: the corner peaks at 16.8 and the middle of the edge at 16.6. Right, after the eye's three spatial channels at a print at 40 cm: the corner is seen at 17.1 and the edge at 7.1, a ratio of 2.40. Darker is larger, on one scale for both maps.

The eye counts a corner's error, not its peak

A Lanczos-magnified patch errs a fifth more at its corner than along its edges, pixel by pixel, and an unsharp mask errs almost exactly as much at its corner as along its edges. Filtered by the eye over the plane rather than along a line, the two swap: the magnified corner is seen exactly as its edge is, and on a printed page the sharpened corner is seen at 2.4 times its edge. What decides it is whether the error changes sign. Ringing averages away and a one-sided halo does not, and a corner is where two edges' halos land on the same patch of retina.

applied · Delivery
What the rods cost a match, by where their signal enters and under which lamp. For five lights, the median colour difference over forty-two surfaces between the reference observer and the same observer with a rod signal a tenth of each cone's peak added — into all three cone channels, into the long- and middle-wavelength channels only, or into the short-wavelength channel only. Under daylight the first two are 1.03 and 0.90: whether the rods reach the S pathway hardly matters. Under a phosphor white LED they are 1.24 and 0.45, a factor of 2.75, and the S-only route alone costs 0.96.

The rods' route is priced by the lamp

A rod signal in a dim room disturbs a colour match, and how much depends on which of the cone pathways it reaches — a weight the physiology leaves uncertain, especially for the blue–yellow pathway. Under daylight the uncertainty is nearly free: a rod signal that skips the S pathway costs 0.90 at the median surface against 1.03 for one that enters all three. Under a phosphor white LED it is worth a factor of 2.75, 0.45 against 1.24. What decides it is one number per lamp: how large the rod signal is compared with each cone class's own catch of the light.

eye · Cones
Where a sharpened E errs, per pixel and as seen: black type on paper, 10 point. The letter E at 10 point on a 300-dot-an-inch page, black type on paper, sharpened by an unsharp mask on stored values and on light; the two maps show the colour difference between the results, pixel by pixel on the left and after the eye's three spatial channels at 40 centimetres on the right, on one scale. The thin line is the letter's outline and the dashed circles mark two pixels round each corner — 8 outer corners and stroke ends, 4 inside angles. The circled zones are 31% of the outline and hold 28% of the per-pixel error and 25% of the seen error.

Sharpened type errs on its dark side

A sharpened square hides its halo along its edges and shows it at its corners, so a sharpened page of type was predicted to show its error at the corners of its letters, several times out of proportion to their length. Black type does the opposite: its outer corners and stroke ends hold between two thirds and nine tenths of their share. As the eye leaves it, the error lies on the dark side of every edge, and a corner holds as much of it as it has dark ground around it — a quarter of a disc where a black corner points out into paper, three quarters where black wraps round a pale one.

applied · Delivery

Named alongside it

The objects these essays reach for when they reach for this one.

Spatial frequencyContrast sensitivityThresholdViewing distanceAdaptationEccentricityIndividual variationLuminanceTemporal sensitivityViewing conditionAfterimageΔE

All concepts