Colour Science & Perception
what the eye settles, and what it cannot
Concept

Colour constancy — where it appears

A surface keeping its apparent colour as the light on it changes, which the eye manages approximately and no arithmetic manages exactly. The mechanisms behind it are a gain on three signals and an estimate of the illuminant, and both are approximations that this collection puts numbers to.

Named by 26 essays across 5 fields — each of them below, with the objects they name alongside it.

Two identical grey patches on different surrounds. Both inner squares are #818181. The one on the dark field looks lighter. The values are checked to be equal before the figure is drawn, so the claim is a fact about the drawing rather than a promise.

These two patches are identical

It is the most repeated and least checkable sentence in visual perception, because the whole point is that it does not look true. Every instance here is computed, and checked before the figure is drawn.

brain · Appearance One reflectance, two illuminants, two colours. A reflectance peaking near 580 nm, and the colours it produces under D65 and A. The object has not changed. The light has, and colour is a property of the pair.

Constancy is the default

A sheet of paper looks white in daylight and white under a tungsten lamp, although the light reaching the eye differs enormously. The visual system is solving one equation with two unknowns, and it solves it by assumption.

brain · Appearance One reflectance, two illuminants, two colours. A reflectance peaking near 610 nm, and the colours it produces under D65 and A. The object has not changed. The light has, and colour is a property of the pair.

The illuminant is half the answer

An object has a reflectance, not a colour. The colour appears when a specified light falls on it, which is why two surfaces can match in a shop and clash outside, and why every serious matching standard names the light.

light · Light five greens, no neutral, under D65 — four guesses at the illuminant. The scene's surfaces as they reach the eye, and each estimator's angular error in degrees against the illuminant that actually lit them. Grey-world 43.1°, Max-RGB 27.7°, Shades-of-grey (p = 6) 31.4°, Grey-edge 34.4°. The best here is Max-RGB, which is best because this scene happens to satisfy its assumption — something reflects fully in every band — and not because it is the better algorithm. Any hatched patch is a surface this display cannot show under this light.

The algorithms that guess the light

What reaches a sensor is an illuminant multiplied by a reflectance, and no arithmetic separates a product into its factors. Every white-balance algorithm therefore works by assuming something about the world — and the interesting content of each is not its formula but the assumption, because a scene can violate it.

brain · Appearance The two components of daylight, computed from one radiator and one scattering law. A 5800 K radiator through the atmosphere at air mass 1. The direct beam is the radiator times e^{−τm}; the sky is what that extinction removed, so the two are complements and neither needs its own model. The sky is steeply blue because τ ∝ λ⁻⁴, and a surface in shadow is lit by that component alone. Open ground and shadowed ground therefore sit under two illuminants differing by ΔE00 = 21.4 — which is why a photograph of snow has blue shadows and why no single white balance fixes both halves of it.

A shadow has its own illuminant

Outdoors there are two lights, not one. The direct beam is a radiator reddened by the atmosphere; the sky is precisely the power that reddening removed. A shadow is lit by the second alone, so shadowed ground and sunlit ground sit under illuminants 21 units of ΔE apart — before any surface, any eye or any opinion is involved.

scene · Scene A glossy surface returns two spectra, and only one of them is the paint. The dichromatic reflection model, computed rather than assumed. Light that enters a dielectric binder, scatters off pigment and comes back carries the reflectance — the body component, ΔE00 = 33.7 from the lamp. Light reflected at the interface never entered, so it carries the lamp's spectrum with only Fresnel's slight dispersion on it: ΔE00 = 1.06. The interface term is computed from Fresnel's equations on a Cauchy index at 55°, so its near-neutrality is a result here rather than an assumption. This is why a highlight is the one region of a photograph that tells a white balancer what the light was, and why removing highlights removes the evidence.

The highlight is the lamp

Light reflected at the surface of a glossy material never entered it, so it never met a pigment. Fresnel's reflectance varies by 5.5% across the visible band and the paint underneath varies by a factor of twenty — which makes a highlight the one region of a photograph that reports what the light was rather than what the object is.

scene · Scene One white balance across a scene lit by two lamps. A neutral surface of albedo 0.6 under 7 mixtures of A and D65, corrected by one diagonal transform chosen for the middle of the run — which is what a camera does when it estimates a single illuminant. The middle patch comes out neutral to ΔE00 = 0.00 and both ends do not: 19.8 at the A end and 16.9 at the D65 one. The failure is structural rather than a matter of a better estimator: white balance is one transform for the whole image, and a scene with two lamps in it has no single answer for that transform to be. Every patch here is the same surface.

A scene has no white point

White balance is one transform applied to a whole image, and a scene lit by two lamps has no single answer for that transform to be. The failure is structural rather than a matter of a better estimator — and every colour-managed workflow in existence takes exactly one white point as an input, with no field in which to say there were two.

scene · Scene The process inks as reflectance. Each ink is a sum of Gaussian absorbance bands with stated centres, widths and peak densities, and the reflectance shown is the substrate's times the square of the ink's transmittance, because light crosses the film going down and coming back. The first band of each ink is what it is for; the rest are what is wrong with it. Magenta's unwanted absorption in the blue-violet reaches an optical density of 0.46 against 0.95 for the band it exists to have — 48 per cent of its own strength, absorbing exactly where a saturated blue needs light to survive.

The paper is the white point

A printed colour is reported against the sheet it sits on rather than against the light in the room, and the choice is a switch in every colour engine. Flipped one way, the same separation on coated stock and on newsprint is a 3.04 colour difference; flipped the other, it is 0.13 — and the two answers are about different questions.

applied · Delivery Mixtures of 2700 K and 6500 K, on the diagram colour temperature is defined on. Both sources are Planckian radiators, so both sit exactly on the locus. Every mixture of them lies on the straight line between them, because mixing is addition and chromaticity is a projection of it — and the locus is curved, so the line is a chord. The equal mixture sits -0.0064 off the locus at a correlated colour temperature of 3953 K: a light that is measurably pink, specified by a number that says nothing about it.

Two lamps do not average

Light adds, band by band, and every number a lamp is sold by is a projection of the sum rather than a sum of the projections. Two radiators sitting exactly on the Planckian locus mix into a light that is measurably pink; two poor lamps mix into a better one than either.

light · Light One light, seven rooms. The same stimulus — fixed in XYZ, unchanged throughout — shown against whites from 12 to 800 candelas per square metre. Its lightness falls from 152 to 16 and its brightness rises, because one of those is a ratio to the white and the other is not. Brown is the low-lightness end: a colour that exists only when something brighter is present, which is why no lamp is brown and no star is.

There is no brown light

Brown is dark orange, dark is a ratio to a white, and a light in a dark room has no white to be dark against. The same stimulus, unchanged in XYZ, runs from lightness 152 to lightness 16 as the surround is raised — and only the bottom of that range has a name.

brain · Appearance How far a judgement is from the settled one, second by second. The light changed from one white to another at t = 0 and nothing else moved. The model has one degree of adaptation and no clock, so the distance plotted is what a clock adds: 3.6 CAM16-UCS units half a second in, still 1.3 after a minute, and 0.11 after five. Every appearance number on this site is the value at the right-hand end.

The model has no clock

An appearance model takes a stimulus and a situation and returns what it looks like. It does not take a time, and adaptation is not instantaneous — half a second after the light changes a judgement is three and a half CAM16-UCS units from the settled one, and a minute later it is still 1.3.

limits · Limits An afterimage, as the local pool coming back to equilibrium. The local pool has adapted to the patch and the global pool has not, so the gain change is exactly the local share of a full von Kries change — which is why afterimage's free strength parameter is not free here. The dwell is 20 seconds. The swatches are the predicted appearance of the test surface at four moments. They are predictions of hue and direction; there is no response compression in this model, so the chroma is a ceiling rather than an estimate.

A gain has a time constant

An afterimage and the clock on chromatic adaptation were built in different files from what the last phase said was one mechanism. Joining them removes a free parameter, reproduces both, and predicts a third thing — that two people in one room, at one moment, looking at one patch, do not agree about its colour.

brain · Appearance The eye's own drift, and what it does to every spatial frequency. A pattern of f cycles per degree, drifting across the retina at 0.5 degrees a second, arrives at each receptor at f × 0.5 hertz. The curve is the temporal sensitivity at that rate, against the pattern's spatial frequency. Every frequency the eye can resolve stays above a quarter of the temporal peak, and the band of drift speeds for which that holds is 0.02–0.71 degrees a second — with the measured drift inside it. Faster and the finest detail is carried past 60 hertz, where there is no sensitivity at all.

The eye is never still

A perfectly stabilised retinal image disappears within seconds. What keeps the world there is a drift of about half a degree a second between the microsaccades — fast enough to keep the finest detail modulating and slow enough not to carry it past fusion, in a band whose upper edge is at 0.71 degrees a second.

brain · Appearance The colour of a beam, against the angle it leaves at. A conformal converter — an even layer laid straight onto the die — makes light leaving at θ cross 1/cos θ times as much of it, so it is more completely converted and the beam is warmer at its edge. From the axis to 75° the correlated colour temperature falls by 556 K and the whole difference is ΔE00 16.4. The flat line is the same emitters under a dome, whose path length is the same in every direction by construction: no angular colour at all, exactly, which is what a remote converter is sold for.

A lamp has a direction

A white LED is a blue die under a converter, and light leaving at an angle has travelled further through the converter than light leaving straight up. So the mixture is different in every direction, the beam is bluer in the middle than at its edge, and the number on the box is one direction's worth of a device that has no single colour.

light · Light A surface in a room, from the moment the light goes on. How far a blue surface is from the colour it will settle at, second by second, for an observer who walked in from the snow as the lamp was switched on. It starts ΔE00 27 away, is still 6.1 away after a minute — the point at which the eye is conventionally said to have adapted — and does not fall under a unit until 295 seconds.

The room settles after the eye does

Four clocks run in a room and only three of them are in the observer. The slowest is the lamp, which takes four hundred seconds to reach nine tenths of its colour change — so a minute after the light goes on, when the eye is conventionally said to have settled, most of what is left is the lamp, and three quarters of that could not be adapted away by an observer of any speed.

light · Light The appearance model's three rooms, read as three moments. CIECAM16's degree of adaptation is a function of the surround and the adapting luminance and of nothing else — the model has no time in it. Solving for the moment at which an observer who will adapt completely has got that far turns each of the three tabulated surrounds into a reading on a clock. At 100 candelas per square metre they are 106, 49, 21 seconds. They are presented as three rooms. They are also one observer, in one room, at three times in the first two minutes.

A viewing condition is a moment

CIECAM16's degree of adaptation is a function of the surround and the adapting luminance and of nothing else, because the model has no time in it. Solving for when an observer who will adapt completely has got that far turns the standard's three surrounds into three clock readings — 107, 50 and 21 seconds — and the two readings are distinguishable by waiting.

brain · Appearance A corner moves the spectrum and the viewing condition at once. A coloured patch in a corner of coloured walls, against how enclosed the corner is. The top curve is what a colorimeter set up at the door reports: light that has bounced carries the surrounding reflectance again, so the patch is lit by something the room is not. The middle curve is what is left once the patch is read against the corner's own white — most of it goes, because a corner is a change of illuminant and that is what chromatic adaptation is for. The bottom curve is the other thing a corner is: a brighter place, 1.76 times the light, which moves the appearance through the Hunt effect with the white point held still and cannot be adapted away at all.

A corner moves both terms

The interreflection essays compute what a corner does to a spectrum, which is one of the two things a corner does. It is also a brighter place with a differently coloured background — a viewing condition, not a stimulus — and adaptation removes most of the first and none of the second. At an enclosure of six tenths that is 63 per cent of seven units gone and a further unit arriving from the extra light alone.

scene · Scene Every change of light this site models, and how much of it a gain removes. Each row is a change of illumination. The pale bar is how far it moves an ordinary surface for an observer who does not adapt; the solid bar at its left end is what is left after the observer has applied the one gain adaptation gives them, which is the ratio of the two whites in the CAT16 basis and is not fitted to anything. Sorted by the fraction left rather than by the size of the change, because the two orderings are different: the largest change here is removed almost entirely and the worst row is a change less than a third its size.

What no adaptation can remove

A change of light is exactly a 3×3 matrix on tristimulus values, and adaptation is a diagonal one. Putting every change of illumination this site models through that distinction sorts them by how much of themselves they leave behind, and the smallest residual in the census belongs to a filter inside the eye.

limits · Limits The same census, sorted by where the change of light came from. Each row is a change of illumination. The pale bar is how far it moves an ordinary surface for an observer who does not adapt; the solid bar at its left end is what is left after the observer has applied the one gain adaptation gives them, which is the ratio of the two whites in the CAT16 basis and is not fitted to anything. Sorted by where the change came from. The two kinds of light that existed before electricity sit at the top and leave the smallest share of themselves behind; the discharge lamps are worse, and the worst of them is d65 to a triphosphor tube at 33 per cent.

Which lamp changes are free

The changes of light that existed before electricity commute with one another to a couple of parts in a thousand, so one set of axes handles all of them. The lights the lighting industry invented do not, and the worst pair in the census is seventy-six times further from commuting than the best.

light · Light The same wall, applied once and applied twice. A room lit by light that has bounced off its own walls is a change of illumination like any other, and a corner is the same change applied twice. Squaring a reflectance sharpens it, a sharper change of light is further from being a gain, and the residual an adapted observer is left with therefore grows faster than the change does: the second bounce is 1.33 times the change and 1.96 times the residual. This is the adaptation half of what a corner does to a metameric match.

The same wall applied twice

A bounce off a painted wall is a change of illumination, and adaptation handles it about as well as it handles a change of colour temperature. A corner applies the same reflectance twice, which sharpens it — and leaves an adapted observer with 1.96 times as much for a change only 1.33 times as large.

scene · Scene How short of determining the light a photograph is, as the scene grows. Each cell is the number of unknowns left over after every equation the image supplies: three sensors, a three-dimensional illuminant, and reflectances confined to a linear model of the dimension on the left. At one and two dimensions more surfaces close the gap. At three the gap never closes, because each further surface adds three equations and three unknowns; at four it widens. The count is arithmetic and has no algorithm in it.

An image does not determine the light

A photograph of a scene under one illuminant gives three numbers per surface and asks for the illuminant plus three numbers per surface. The count closes only if reflectances lie in a two-dimensional model, and no number of surfaces helps — at three dimensions the alternative scenes can be written down, and they reproduce every sensor response exactly.

scene · Scene Every change of light in the census, under three bases. Fourteen changes of illumination, each drawn three times: the residual left by a gain in the basis built from the dichromat confusion points, in CAT16, and in the basis that minimises the average. The ordering between the three is the same on nearly every row, and — the part an average hides — the worst row is the same row for every basis nobody fitted, which is two bounces off the same wall. The difficulty belongs to the change rather than to the choice of axes — except for the fitted winner, whose worst row is D65 to a triphosphor tube instead. What a fit buys is not a uniform improvement; it is the abandonment of the one change everybody else is beaten by.

Which changes of light pay for it

A fitted adaptation basis beats the receptors by 0.68 units on average, and an average is a poor description of what it does. On six of fourteen changes of light it is worse, and the whole of its advantage comes from four — a tungsten lamp and three coloured walls.

light · Light Every change of light in the census, under three bases. Fourteen changes of illumination, each drawn three times: the residual left by a gain in the basis built from the dichromat confusion points, in CAT16, and in the basis that minimises the average. The ordering between the three is the same on nearly every row, and — the part an average hides — the worst row is the same row for every basis nobody fitted, which is two bounces off the same wall. The difficulty belongs to the change rather than to the choice of axes — except for the fitted winner, whose worst row is D65 to a triphosphor tube instead. What a fit buys is not a uniform improvement; it is the abandonment of the one change everybody else is beaten by.

Everyone is beaten by the same wall

Eight candidate adaptation bases, fourteen changes of light, and seven of the eight have their worst row in the same place — not a lamp, but a green wall reflecting twice. The one that does not is the one that was fitted, and what its fit bought was permission to give up on that row.

light · Light How far the answer for the average is from the average answer, over eight spreads. For each spread of inputs, the distance between the mean of the model's answers and its answer for the mean input, as a share of the spread of the answers. Over a population of observers it is 1.4 per cent. Over surfaces it is 21 on smooth natural reflectances, 27 on a banded family with lightness in it, and 9 on a set of pale surfaces. Over the light one room sees in a day it is 59.

The average surface does not look average

Over a population of observers the appearance model is so nearly linear that the mean of its answers is its answer for the mean, to 1.4 per cent of the spread. Over the surfaces in a scene it is not. On 240 smooth reflectances the gap is 21 per cent of the spread, and the mean surface looks 4.2 units lighter than the surfaces look on average. The grey that matches the average light is a 47 per cent reflectance; the grey that matches the average look is a 43 per cent one.

brain · Appearance A gloss finish's loss of colour, read by the light and by a viewer in the room. Four changes against the matt room as the coloured walls are made glossier, from roughness 0.8 to 0.15: the chroma of the room's reflected light as a colorimeter reads it; the mean chroma of the six faces as CIECAM16 sees them adapted to the lamp and adapted to the room's own average light; and how far the faces sit from that average in the model's uniform space. At roughness 0.2 the light loses 8.3 per cent, the faces 8.6 per cent to the lamp-adapted viewer and 13.9 to the room-adapted one, and the spread 11.0 per cent against 11.2 read against the lamp.

A gloss room looks less colourful than it measures

A gloss finish takes 8.3 per cent of the chroma out of a green room's reflected light, and a viewer adapted to the room should discount a loss that affects everything alike. The appearance model says the opposite. Adaptation removes the colour the whole room shares, leaves the colour that differs from face to face, and the finish takes as large a share of that as of anything — so to a viewer standing in the room the faces lose 13.9 per cent of their chroma, not 8.6.

scene · Scene What the choice of adopted white is worth, in a room lit by two lights. A room lit half by daylight and half by an incandescent lamp. The light on the surfaces is fixed; what varies is the white the model is told the observer has adapted to, running from the lamp on the left to the window on the right. The median of twelve surfaces moves 32.6 CAM16-UCS units if the lamp is adopted and 24.5 if the window is, against the room's own mixture in the middle. The model offers no way to choose, and its degree of adaptation is 0.94 at every point of the dial.

A room with two lights has no white

An appearance model takes one adapting white. A desk beside a window has two, and the mixture falling on the paper is not the same thing as the white the person reading it has adapted to. Mixing the lights is arithmetic. Choosing the white is not, and the choice is worth sixty units of appearance — most of which is a cast, and not all of which is.

brain · Appearance

Named alongside it

The objects these essays reach for when they reach for this one.

Chromatic adaptationIlluminantAdaptationReflectanceViewing conditionThe von Kries transformCIECAM16White pointAssertionSpectral power distributionCAT16Colour appearance

All concepts