The Art and Science of Depiction. Color. Fredo Durand MIT- Lab for Computer Science

Similar documents
CSE Data Visualization. Color. Jeffrey Heer University of Washington

Processing. Electrical Engineering, Department. IIT Kanpur. NPTEL Online - IIT Kanpur

Color in Information Visualization

[source unknown] Cornell CS465 Fall 2004 Lecture Steve Marschner 1

Fundamentals of Multimedia. Lecture 3 Color in Image & Video

Understanding Human Color Vision

Vannevar Bush: As We May Think

Television History. Date / Place E. Nemer - 1

Minimizing the Perception of Chromatic Noise in Digital Images

Murdoch redux. Colorimetry as Linear Algebra. Math of additive mixing. Approaching color mathematically. RGB colors add as vectors

!"#"$%& Some slides taken shamelessly from Prof. Yao Wang s lecture slides

Power saving in LCD panels

A Color Scientist Looks at Video

Visual Imaging and the Electronic Age Color Science

Visual Imaging and the Electronic Age Color Science

Essence of Image and Video

Television and video engineering

Introduction & Colour

Chapter 4 Color in Image and Video. 4.1 Color Science 4.2 Color Models in Images 4.3 Color Models in Video

Ch. 1: Audio/Image/Video Fundamentals Multimedia Systems. School of Electrical Engineering and Computer Science Oregon State University

Wide Color Gamut SET EXPO 2016

Recap of Last (Last) Week

ROY G BIV COLOR VISION EXPLORED

Color Reproduction Complex

Slides on color vision for ee299 lecture. Prof. M. R. Gupta January 2008

Improving Color Text Sharpness in Images with Reduced Chromatic Bandwidth

VISUAL MILL LAB. SECTION 1: Complete the following tests and fill out the appropriate sections on your Visual Mill Color Deficit Worksheet.

Automatic Testing of Color Blindness

High-resolution screens have become a mainstay on modern smartphones. Initial. Displays 3.1 LCD

The Perspectival Nature of Scientific Observation

TOOLS FOR A BETTER VIEW

Hue, Value and Intensity

LCD and Plasma display technologies are promising solutions for large-format

Image and video encoding: A big picture. Predictive. Predictive Coding. Post- Processing (Post-filtering) Lossy. Pre-

CSE Data Visualization. Graphical Perception. Jeffrey Heer University of Washington

Photoshop assignment. What is a Picture? Discussion. Reading. Visions of Light. Visions of Light

CHAPTER 9. Seeing Light

Color Illusion. Abstract. As standardly conceived, an illusion is an experience of an object o appearing

COLOR AND COLOR SPACES ABSTRACT

Company Software Manual version Issued Date Sony Corporation Projector Calibration Pro Version 0.04 Mar 3rd, 2017

Background Statement for SEMI Draft Document 4759A NEW STANDARD: TEST METHOD OF PERCEPTUAL ANGLE FOR OLED DISPLAYS

From light to color: how design choices make the difference

Escaping RGBland: Selecting Colors for Statistical Graphics

Multimedia Systems Video I (Basics of Analog and Digital Video) Mahdi Amiri April 2011 Sharif University of Technology

Superior Digital Video Images through Multi-Dimensional Color Tables

Colour Features in Adobe Creative Suite

ELEG5502 Video Coding Technology

Denotation system. Invention of linear perspective. Accidental/generic. Prototypes. Maximum size. Maximum size

The Art and Science of Depiction. Denotation system. Fredo Durand MIT- Lab for Computer Science

Computer and Machine Vision

Somewhere over the Rainbow How to Make Effective Use of Colors in Statistical Graphics

INTRODUCTION TO GRAPHICS. Color Vision Simulator Examples

2 Video Formation, Perception, and Representation Chapter 1 color value at any point in a video frame records the emitted or reflected light ata parti

Optical Electronics: RGB LED and the colours of the rainbow

Root6 Tech Breakfast July 2015 Phil Crawley

Erchives OCT COLOR CODING FOR A FACSIMILE SYSTEM ROBERT DAVID SOLOMON. B.S.E.E., Polytechnic Institute of Brooklyn (1967)

Color Reproduction Complex

The Color Reproduction Problem

OPTIMIZED LIGHT-EMITTING DIODE (LED) DEVICES THAT HAVE A HIGH COLOR RENDERING INDEX (CRI) FOR LIGHTING APPLICATIONS

CHAPTER 3 COLOR TELEVISION SYSTEMS

To show the Video Scopes, click on the down arrow next to View located in the upper- right corner of your playback panel.

Visualizing Social Networks

A Review of RGB Color Spaces

A Study on the Psychology of Color Perception In Color Palettes & Color Pickers

Using the VP300 to Adjust Video Display User Controls

THE ROLE OF COLOURS IN THE HEALTH AND WELLBEING OF THE BUILT ENVIRONMENT IN THE TROPICS ABSTRACT

Software Version V1.0 Manual Revision V1.2

Color: Direct experience and manipulation

The preferred display color temperature (Non-transparent vs. Transparent Display)

ADJUSTABLE RANGE OF PARAMETERS [End of the Book]

CHOICE OF WIDE COLOR GAMUTS IN CINEMA EOS C500 CAMERA

Organic Electronic Devices

Q1. Do LED lights burn out?

LED Light Achieves The Colour Rendering Of Sunlight. Hubert Ott Technical Marketing Director Lighting Avnet Silica

Calibrating the timecode signal input

A Comparative Study of Color and Contrast Enhancement for Still Images and Consumer Video Applications

Music 175: Pitch II. Tamara Smyth, Department of Music, University of California, San Diego (UCSD) June 2, 2015

Colour Matching Technology

Color Gamut Mapping based on Mahalanobis Distance for Color Reproduction of Electronic Endoscope Image under Different Illuminant

What is the lowest contrast spatial frequency you can see? High. x x x x. Contrast Sensitivity. x x x. x x. Low. Spatial Frequency (c/deg)

8K Resolution: Making Hyperrealism a Reality

User s Manual Color Vision Recorder version 4

The XYZ Colour Space. 26 January 2011 WHITE PAPER. IMAGE PROCESSING TECHNIQUES

Graphics Devices and Visual Perception. Human Vision. What is visual perception? Anatomy of the Eye. Spatial Resolution (Rods) Human Field of View

Using the NTSC color space to double the quantity of information in an image

2.4.1 Graphics. Graphics Principles: Example Screen Format IMAGE REPRESNTATION

Video Signals and Circuits Part 2

How to Manage Color in Telemedicine

KNOWLEDGE of the fundamentals of human color vision,

About our internship program

Preventing Illegal Colors

Graphical Perception. Graphical Perception. Graphical Perception. Which best encodes quantities? Jeffrey Heer Stanford University

An Introduction to TrueSource

ICC Color Symposium. Soft Proofing Revisit and Reborn. Chris Bai Senior Color Expert BenQ. 22/10/2018 Hong Kong. Organizers

LED Lighting 12 th Annual Building Codes Education Conference March Bozeman, MT Jaya Mukhopadhyay, Co-Director, Integrated Design Lab

EVERY COLOR, EVERY NUANCE AND EVERY SHADE WITH THE HIGHEST CRI

A Toolbox for Manipulating and Assessing Color Palettes for Statistical Graphics

Man-Machine-Interface (Video) Nataliya Nadtoka coach: Jens Bialkowski

Objectives. Explain perception Analyze color perception Analyze vision Relate perception with color models

BINOCULAR WHITE FROM RED AND GREEN, AND

Transcription:

The Art and Science of Depiction Color Fredo Durand MIT- Lab for Computer Science

Color Color Vision 2

Talks Abstract Issues Color Vision 3

Plan Color blindness Color Opponents, Hue-Saturation Value Perceptual color effects Color categories and culture Color Vision 4

Physical spectrum Color Vision 5

Summary Color Vision 6

Metamerism Different spectrum Same response Color Vision 7

Puzzles Why is violet close to red Primaries Cyan and magenta are not spontaneous primaries Color mixing Color Vision 8

Why color is complex 3 dimensional Difference spectrum-color Additive-subtractive LMS-opponents-Hue Saturation Value Color constancy Color appearance effects Cultural Preferred colors, memory Color Vision 9

Color synthesis Additive red, green, blue Subtractive cyan, magenta, yellow Color Vision 10

Color synthesis: a wrong example Additive red, green, blue Subtractive cyan, magenta, yellow WRONG RIGHT Color Vision 11

Plan Color blindness Color Opponents, Hue-Saturation Value Perceptual color effects Color categories and culture Color Vision 12

Color blindness Dalton 8% male, 0.6% female Genetic Dichromate (2% male) One type of cone missing L (protanope), M (deuteranope), S (tritanope) Anomalous trichromat Shifted sensitivity Color Vision 13

We are all color blind Center of retina No S (blue) We compensate via gaze movement Not well understood Color Vision 14

Color blindness test Color Vision 15

Color blindness test Maze in subtle intensity contrast Visible only to color blinds Color contrast overrides intensity otherwise Color Vision 16

Color blindness correction Filter On one eye Set of filters (case of electronics) Color Vision 17

Color blind impressions A normal scene B protanope L C deuteranope M D tritanope S Color Vision 18

Color blindness & Painting Restricted to blue-yellow Goethe after a color-blind Color Vision 19

Color blindness & Painting Restricted to blue-yellow Meryon, Le Vaisseau Fantôme Color Vision 20

Color blindness & Painting Restricted to blue-yellow J. J. Color Vision 21

Color blindness & Painting Image reproduction (after Gauguin) Different strategies Normal color vision Color blind (perceived) Color blind (confusion) Color Vision 22

Color vision variability Color blindness Mutations Gender, racial Cultural differences Color Vision 23

Preferred colors Caucasian skin More tanned Grass Greener Sky Bluer Color Vision 24

Plan Color blindness Color Opponents, Hue-Saturation Value Perceptual color effects Color categories and culture Color Vision 25

Color Opponents Hering A color can be blue-green, yellow-red, yellow-green, etc But never yellow-blue or red-green Suspected two opponents: Blue-yellow axis Red-Green axis Color Vision 26

Color reparameterization The input is LMS The output has a different parameterization: Light-dark Blue-yellow Red-green Color Vision 27

Color opponents wiring Sums for brightness Differences for color opponents + - + + + + - Color Vision 28

Double center surround opponents Center-surround Color opponents Color Vision 29

Opponents and image compression JPG, MPG Color opponents instead of RGB Compress color more than luminance Color Vision 30

Blue-yellow opponent and painting Often used to depict night (S cones share properties with rods ) Van Gogh Café at Night Color Vision 31

Red-green opponent and painting Jawlensky Color Vision 32

Opponent and painting Degas Color Vision 33

Color reparameterization The input is LMS The output has a different parameterization: Light-dark Blue-yellow Red-green A later stage may reparameterize: Brightness or Luminance or Value Hue Saturation Color Vision 34

Hue Saturation Value Color Vision 35

Hue Saturation Value One interpretation in spectrum space Not the only one because of metamerism Color Vision 36

Munsell book of colors Perceptually uniform Color Vision 37

History of color theories Aristotle & followers Scale from black to white Blue, red, yellow Position of green varies Nicolas Poussin Ecstasy of Saint Paul 1650 Color Vision 38

Plan Color blindness Color Opponents, Hue-Saturation Value Perceptual color effects Color categories and culture Color Vision 39

Color appearance effects Goethe, 19 th century Importance of subjective experience Chevreul, 19 th century Law of simultaneous contrast, optical mix Modern theories Measured effects Color Vision 40

Simultaneous contrast Chevreul In color opponent direction Color Vision 41

Crispening Increased sensitivity Color Vision 42

Simultaneous contrast In color opponent direction Center-surround Color Vision 43

Eugène Delacroix Color Vision 44

Eugène Delacroix Color Vision 45

Impressionism Claude Monet Color Vision 46

Post-Impressionism Van Gogh Color Vision 47

Post-Impressionism Van Gogh Color Vision 48

Land Retinex Color Vision 49

Haloing, local contrast Seurat, Bathers at Asnières, 1884 Color Vision 50

Edge burning Ansel Adams Color Vision 51

Spreading Optical mix when spatial frequency increases But before fusion frequency Additive mix! (opposed to pigment mix) Color Vision 52

Pointillism George Seurat, The Channel of Gravelines, Grand Fort-Philippe, 1890 Color Vision 53

Pointillism George Seurat, La Grande Jatte, 1886 Color Vision 54

Pointillism George Seurat, La Grande Jatte, 1886 Color Vision 55

Divisionism Paul Signac, The Mills at Overschie, 1905 Color Vision 56

Layered pointillism Chuck Close, Stanley, 1980-81 Color Vision 57

Photo-Mosaics Color Vision 58

Artistic Half toning Ostromoukhov 1999 Color Vision 59

Other effects Problems for color reproduction Problem in design and production Color Vision 60

Hunt and Stevens effect Stevens effect Contrast increases with luminance Bartleson-Breneman effect Image contrast changes with surround A dark surround decreases contrast (make the black of the image look less deep) Hunt effect Colorfulness increases with luminance Hence the need for gamma correction Color Vision 61

Bezold-Brücke Hue Shift Monochromatic stimulus Perceived hue changes when luminance varies Wavelength shift necessary to keep the same hue when luminance is decreased by a factor of 10 Color Vision 62

Abney Effect Hue changes with the addition of pure white Color Vision 63

Color appearance models Predict the appearance of a color depending on Objective stimulus Surrounding, context Color Vision 64

Plan Color blindness Color Opponents, Hue-Saturation Value Perceptual color effects Color categories and culture Color Vision 65

Color categories Prototypes Harder to classify colors at boundaries Color Vision 66

Color and culture Ancient Greeks Same term for blue-green-dark Berinmo Color Vision 67

Lexical study of basic color terms Berlin and Kay 1969-78 20+78 languages Monolexemic Not compound, e.g. not blue-green Primary chromatic reference Not material, e.g. not gold But allow orange General purpose No specific field, e.g. not blond, roan High frequency E.g. not mauve, taupe, puce Color Vision 68

Lexical study of basic color terms 20+78 languages 16 basic color terms 11 in English Red, green, blue, yellow, black, white, gray, orange, purple, brown, pink light-blue 4 that encompass more than one color Warm, cool, light-warm, dark-cool Color Vision 69

Lexical study of basic color terms Common pattern There are exceptions Color Vision 70

Visual Perception Very complex Different stages Different pathways for different elements Can explain some pictorial techniques/styles Can be helped of challenged Color Vision 71

Discussion Piranesi Color Vision 72

Discussion Perception and images Does it help the analysis Does it dazzle? Does it refrain creativity? Color Vision 73

Color terms (Fairchild 1998 Color Hue Brightness vs. lightness Colorfulness and Chroma Saturation Unrelated and related colors Color Vision 74

Color chromatic and achromatic content. This attribute can be described by chromatic color names such as yellow, orange, brown, red, pink, green, blue, purple, etc., or by achromatic color names such as white, gray, black, etc., and qualified by bright, dim, light, dark, etc., or by combinations of such names. Note: Perceived color depends on the spectral distribution of the color stimulus, on the size, shape, structure, and surround of the stimulus area, on the state of adaptation of the observer's visual system, and on the observer's experience of the prevailing and similar situations of observations. Color Vision 75

Related and Unrelated Colors Unrelated Color Color perceived to belong to an area or object seen in isolation from other colors. Related Color Color perceived to belong to an area or object seen in relation to other colors. Color Vision 76

Hue Hue Attribute of a visual sensation according to which an area appears be similar to one of the perceived colors: red, yellow, green, and blue, or to a combination of two of them. Achromatic Color Perceived color devoid of hue. Chromatic Color Perceived color possessing a hue. Color Vision 77

Brightness vs. Lightness Brightness Attribute of a visual sensation according to which an area appears to emit more or less light. Lightness: The brightness of an area judged relative to the brightness of a similarly illuminated area that appears to be white or highly transmitting. Color Vision 78

Colorfulness & Chroma Colorfulness Attribute of a visual sensation according to which the perceived color of an area appears to be more or less chromatic. Chroma: Colorfulness of an area judged as a proportion of the brightness of a similarly illuminated area that appears white or highly transmitting. Color Vision 79

Saturation Colorfulness of an area judged in proportion to its brightness. Color Vision 80