Display Blocks EE367/CS448I: Computational Imaging and Display stanford.edu du/class/ee367 Lecture 14 Robert Konrad Stanford University
Who am I?
Tupac & Snoop Dogg Live at Coachella 2012
Gorillaz & Madonna @ Grammy Awards 2006
John Henry Pepper, 1862 Pepper s Ghost
John Henry Pepper, 1862 Pepper s Ghost
http://www.redbubble.com/people/melek0197/works/9472644-childs-reflection-in-train-window
Pepper s Ghost wikipedia hidden room not directly visible! visible room beam splitter (green) viewing window (red)
wikipedia Pepper s Ghost - Lighting Same as all near-eye augmented reality displays!
Google Glass
Google Glass electroembedded.blogspot.com/2014/03/google-glass.html
Google Glass
Digital Displays - Overview displayblocks.org! spatial light modulators! projection displays! stereo displays! light field displays! of course: digital pepper s ghost & AR!
Spatial Light Modulators (SLMs)! some type of spatially-varying light modulation (amplitude or phase) Liquid Crystal Display (LCD) Liquid Crystal Display on Silicon (LCoS) Digital Micromirror Device (DMD) Light Emitting Diodes (LEDs) and OLEDs E Ink! mirasol! pixtronix! Ostendo! quantum dots
Light Emitting Diodes (LED) wikipedia
wikipedia Light Emitting Diodes (LED)
wikipedia White LEDs! either multiple dies (i.e. R+G+B dies)! or blue die + phosphor blue LED blue LED + phosphor (Ce:YAG)
LED Displays
Organic Light Emitting Diodes (OLEDs)! electroluminescent material is organic Samsung Galaxy Note Edge LG! can be printed, e.g. on flexible substrates
howstuffworks.com OLED Active vs Passive Matrix!"#$%& '"#$%&
Active vs Passive Matrix Addressing Scheme active matrix! more complex electronics (1 capacitor & 1 transistor per pixel)! pixel can store information, e.g. while scanning over the rest of the screen! similar to phosphor lifetime in CRT passive matrix! simpler electronics! dead time between pixel updates can lead to flicker (slow response)! imprecise voltage control! Higher power consumption
https://www.youtube.com/watch?v=mnh3lt8rnuk Active vs Passive Matrix Addressing Scheme
Liquid Crystal Displays! most common displays for monitors and TVs
LCDs - Twisted Nematic (TN)
!"#$#%&'$()'*+'+,&-."*(/0./#()*1-"(2*"#)*+/*+/$0+3 LCDs - Twisted Nematic (TN) relaxed (twisted), crystalline state
LCDs - Twisted Nematic (TN)!"#$#%&'$()'*+'+,&-."*(/0./#()*1-"(2*"#)*+/*+/$0+3 voltage applied: un-twisting liquid state
LCDs In-plane Switching (IPS) wikipedia! Polarizers same direction! electrodes on same side! in-plane LC alignment! pro: more consistent across viewing angles, don t change color when touched! con: more power, slower, more expensive than TN
wikipedia
LCD Subpixels IPS wikipedia S-IPS IPS TN subpixels
LCD Subpixels - Pentile Pixels! exotic subpixel layouts with different advantages and disadvantages
LCD Backlight wikipedia extremetech.com
LCD Backlight CCFL vs LED used to be: cold-cathode fluorescent lamps now mostly LEDs: last longer, brighter, thinner, lower power, but a bit more expensive
extremetech.com LCD Backlight at the end, you have a light box backlight enhancing films Cornelissen, SPIE 2008
Fattal et al. 2013 Directional Backlight - Leia
Quantum Dots (QD)! semiconductor nanocrystal! extremely narrow, tunable emission spectrum (visible+ir)! band gap (which determines emitted wavelength) is inversely proportional to dot size! quantum dot displays used in LCD backlight (we ll get back to that a but later) by QD Vision
wikipedia Quantum Dots
http://www.ravepubs.com/ quantum-dots-the-end-of-white-leds-in-backlights/ Quantum Dot Backlight QD Vision
Liquid Crystal on Silicon (LCoS)! basically a reflective LCD! standard component in projectors and head mounted displays! used e.g. in google glass! without 2 nd polarizer: phase modulation!
Electronic Ink (E Ink)! reflective display no active lighting!! high contrast, low power! bistable! invented by Joe Jacobsen
Mirasol (Qualcomm)! interferometric modulator display (IMOD)! color from gap size (changed via MEMS)! Low refresh rate! Low power consumption
Digital Micromirror Device (DMD)! developed by Texas Instruments! MEMS device! binary states (e.g. +/- 10 degrees)! gray-level through pulse width modulation (PWM) Texas Instruments
Digital Micromirror Device (DMD)! when used in projector, usually called digital light processing device (DLP)
Digital Displays - Overview displayblocks.org! spatial light modulators! projection displays! stereo displays! light field displays! of course: digital pepper s ghost & AR!
Digital Light Processing (DLP) Projectors! color multiplexed in time (field sequential color)! for example using color wheel in DPL projectors
Anatomy of a Projector (without the light) 2-33$1+/4,(++. )("*+,'-"./0+.1 5-+6+(!"#$%&'"(
LCD Projectors! 3 separate optical paths (1 opticsbalzers.com/en/237/lcd-projector.htm per color channel)! splitting via dichroic mirrors! separate modulation via transmissive LCDs! combination via x-cube prism! projection lens
LCD Projectors light source http://wordpress.mrreid.org/ (dichroic) mi LCDs x-cube prism projection lens
Scanned Laser Pico Projectors! biaxial MEMS scanner! 43.2 by 24.3 at 60 Hz 1 mm Microvision, Freeman et al. 2009
Microvision, Freeman et al. 2009 Scanned Laser Pico Projectors
Holographic Laser Projectors! developed by light blue optics! coherent light phase modulation in Fourier plane
Laser/LCD Projector announced by Sony! phosphor+blue laser = white (same as white LED)
Scanning Fiber Projector! Schowengerdt et al., University of Washington! now at Magic Leap
Questions?
Stereoscopic and 3D / Light Field Displays many slides from Douglas Lanman (thanks)
Some Depth Cues of the HVS binocular disparity convergence motion parallax accommodation/blur current glasses-based (stereoscopic) displays near-term: compressive light field displays longer-term: holographic displays
Taxonomy of Direct 3D Displays: Glasses-bound vs. Unencumbered Designs!"#$$%$&'()*+,-%.%($/(01/ 2%#+&3()*-%+ (#<#;&#,#1+)=#,0&'#.63/."&,$+/&%;*6<7 4)"-10"%5%+6 (%0#$#+.;6&$.2&09.%6"#./&%;*6<.%:$56,#7!""#$%&'# ()*+,-%./&$#,01'&34.+5.$#6*.2+$*/7 8##109$+:49 (%:;#$&";+%#%.%<309#0&,.&"64#%.+30+.$#6*.2+$*/7 8;60&6**<1":*0&;*#>#/.(5&#*/1,+3,:$$#307 (,+*+$.5&*0#$%?.;+*6$&@#$%?.6:0+%0#$#+4$6"%?.#0,A7 B#";+$6**<1":*0&;*#>#/.(5&#*/1%#C:#30&6*7 (DEF.%9:00#$.4*6%%#%7 7*%*/)3'%.%+ 8)-(3)"-1$/(01/ / 9#.#""#5&'#$%+ (GF./&%;*6<.2&09.*&4901/&$#,0&34.#*#"#30%7 :(")3%-.1/ (/&$#,0*<.&**:"&360#.;+&30%.2&09&3.6.'+*:"#7 H6$6**6>.I6$$&#$% (:3&5+$".6$$6<.+5.JF.%*&0%.+$.GF.;&39+*#.6$$6<%7!30#4$6*.!"64&34 (*#30&,:*6$.%9##0%.+$.5*<K%.#<#.*#3%*#0.6$$6<%7 L:*0&1;*636$ (0&"#1%#C:#30&6*.;$+=#,0&+3.+30+.%2#;0.%:$56,#%7 B$63%;6$#30.8:)%0$60#% (&30#$%#,0&34.*6%#$.)#6"%?.5+4.*6<#$%?.#0,A7 B6>+3+"<.6/6;0#/.5$+".M+34.M:6 2("(;.#0<1/ ($#,+3%0$:,0%.26'#5$+30.:%&34.GF.#*#"#307 8060&, (9+*+4$6;9&,.5&*"%7. F<36"&, (9+*+'&/#+7.
Taxonomy of 3D Displays: Immersive Head-mounted Displays (HMDs) 2%#+&3()*-%+ (#8#9&#,#1+):#,0&'#.63/."&,$+/&%9*687!""#$%&'# ()*+,-%./&$#,01'&34.+5.$#6*.2+$*/7!"#$$%$&'()*+,-%.%($/(01/ 4)"-10"%5%+6 (%0#$#+.96&$.2&0;.%6"#./&%9*68.%<$56,#7
Taxonomy of 3D Displays: See-through Head-mounted Displays (HMDs)!"#$$%$&'()*+,-%.%($/(01/ 2%#+&3()*-%+ (#<#;&#,#1+)=#,0&'#.63/."&,$+/&%;*6<7 4)"-10"%5%+6 (%0#$#+.;6&$.2&09.%6"#./&%;*6<.%:$56,#7!""#$%&'# ()*+,-%./&$#,01'&34.+5.$#6*.2+$*/7 8##109$+:49 (%:;#$&";+%#%.%<309#0&,.&"64#%.+30+.$#6*.2+$*/7
Taxonomy of 3D Displays: Spatial Multiplexing (e.g., Anaglyphs)!"#$$%$&'()*+,-%.%($/(01/ 2%#+&3()*-%+ (#<#;&#,#1+)=#,0&'#.63/."&,$+/&%;*6<7 4)"-10"%5%+6 (%0#$#+.;6&$.2&09.%6"#./&%;*6<.%:$56,#7!""#$%&'# ()*+,-%./&$#,01'&34.+5.$#6*.2+$*/7 8##109$+:49 (%:;#$&";+%#%.%<309#0&,.&"64#%.+30+.$#6*.2+$*/7 8;60&6**<1":*0&;*#>#/.(5&#*/1,+3,:$$#307 (,+*+$.5&*0#$%?.;+*6$&@#$%?.#0,A7
Taxonomy of 3D Displays: Temporal Multiplexing (e.g., Shutter Glasses)!"#$$%$&'()*+,-%.%($/(01/ 2%#+&3()*-%+ (#<#;&#,#1+)=#,0&'#.63/."&,$+/&%;*6<7 4)"-10"%5%+6 (%0#$#+.;6&$.2&09.%6"#./&%;*6<.%:$56,#7!""#$%&'# ()*+,-%./&$#,01'&34.+5.$#6*.2+$*/7 8##109$+:49 (%:;#$&";+%#%.%<309#0&,.&"64#%.+30+.$#6*.2+$*/7 8;60&6**<1":*0&;*#>#/.(5&#*/1,+3,:$$#307 (,+*+$.5&*0#$%?.;+*6$&@#$%?.6:0+%0#$#+4$6"%?.#0,A7 B#";+$6**<1":*0&;*#>#/.(5&#*/1%#C:#30&6*7 (DEF.%9:00#$.4*6%%#%7
Perceptual Issues of Stereo Displays!"#$%&'("#)*+,*-. 3)-221 A))*++*<%."*1 B,*)%&':&%12C (2:.9!2-821)2 4562).':2-)2";2<'"1'=( )2";2<'"1'=(!"2@"18'<"#)*+,*-. /*+,*-.'0*12 4562).'"1'-"89.'272 >"?2&'<"#:%-".7 4562).'"1'&2,.'272!"#$%&$#'()*"+,-$*.,% -/0#)%/'12"!"##$%&'()*++(,-./01 23(4567
Perceptual Issues of Stereo Displays!"#$%&'("#)*+,*-. /*+,*-.'0*12 6)212'+%1"7$&%."*1!"23"14'5"#)*+,*-.!"23"14')*+,*-.!"#$%&$#'()*"+,-$*.,% -/0#)%/'12"!"##$%&'()*++(,-./01 23(4567
Perceptual Issues of Stereo Displays!"#$%&"'()*+,%$$"-. /0&*1&(%2 3145%21)" 2()%2'()1&' 6&)20378(#902(#314)02)10&4 :;(2( );(" :1**!(#*(44 5(28(1<(3!"#$%&$'()*+&,-()&./*0(--&$1*2#)*3.')'#,4#-&4*5+6*!"#$%&'#()#%*+#,-.-
Perceptual Issues of Stereo Displays!"#$%&"'()*+,%$$"-. /012%*#34567)%&8(!%1(9 6& 1%*0(&8"!"#$%&$'()*+&,-()&./*0(--&$1*2#)*3.')'#,4#-&4*5+6*!"#$%&'#()#%*+#,-.-
Taxonomy of Direct 3D Displays: Parallax Barriers 12(2--234'2/#)!"#$%&'()*+$,&-.$)&/.-0%&123-&4/$2)2524-'6 9#:;.78+<=54>?*@A<>?BB!>?"@<>@A@B$><A$9&2,'6 ;*1*))*<$=*11&21'!74&:815$*11*+$8:$>#$')&-'$81$"#$(&4.8)2$*11*+'6!"#"$%&'#(#) *%+,&%-+./$,0.$ $ 5,-%&#+(.$!%&123-)+$&))75&4*-2$(8&4-'$,&-.&4$*$98)7526 6,-,7(208.$!12384'-173-'$,*92:184-$7'&4/$"#$2)2524-6
Parallax Barriers Ives 1903 barrier 2D display! low resolution & very dim
Taxonomy of Direct 3D Displays: Integral Imaging 12(2--234'2/#)!"#$%&'()*+$,&-.$)&/.-0%&123-&4/$2)2524-'6 *-.,/$,09:;<6<:=>??!>A"B<>"BBC$><D$9&2,'6 ;*1*))*<$=*11&21'!74&:815$*11*+$8:$>#$')&-'$81$"#$(&4.8)2$*11*+'6?4-2/1*)$?5*/&4/!)24-&37)*1$'.22-'$81$:)+@'$2+2$)24')2-$*11*+'6!"#"$%&'#(#) *%+,&%-+./$,0.$ $ 5,-%&#+(.$!%&123-)+$&))75&4*-2$(8&4-'$,&-.&4$*$98)7526 6,-,7(208.$!12384'-173-'$,*92:184-$7'&4/$"#$2)2524-6
Integral Imaging Lippmann 1908 lenslets 2D display! low-res, but brighter than parallax barriers
Integral Imaging Light Field
Integral Imaging Interlaced Light Field # Display Pixels Y # Display Pixels X
Integral Imaging Observed Central View # Display Pixels Y / # Views Y # Display Pixels X / # Views X
Directional Backlighting Nelson and Brott, 2010 US Patent 7,847,869 Currently promoted by 3M Requires a high-speed (120 Hz) LCD panel, an additional double-sided prism film, and a pair of LEDs Allows multi-view display, but requires higher-speed LCD and additional light sources for each view
Taxonomy of Direct 3D Displays: Multi-planar Volumetric Displays 12(2--234'2/#)!"#$%&'()*+$,&-.$)&/.-0%&123-&4/$2)2524-'6 ;*1*))*<$=*11&21'!74&:815$*11*+$8:$>#$')&-'$81$"#$(&4.8)2$*11*+'6?4-2/1*)$?5*/&4/!)24-&37)*1$'.22-'$81$:)+@'$2+2$)24')2-$*11*+'6!"#"$%&'#(#) *%+,&%-+./$,0.$ $ 5,-%&#+(.$!%&123-)+$&))75&4*-2$(8&4-'$,&-.&4$*$98)7526 A7)-&0()*4*1!-&520'2B724-&*)$(18C23-&84$84-8$',2(-$'71:*32'6 6,-,7(208.$!12384'-173-'$,*92:184-$7'&4/$"#$2)2524-6
Taxonomy of Direct 3D Displays: Transparent-substrate Volumetric Displays 12(2--234'2/#)!"#$%&'()*+$,&-.$)&/.-0%&123-&4/$2)2524-'6 ;*1*))*<$=*11&21'!74&:815$*11*+$8:$>#$')&-'$81$"#$(&4.8)2$*11*+'6?4-2/1*)$?5*/&4/!)24-&37)*1$'.22-'$81$:)+@'$2+2$)24')2-$*11*+'6!"#"$%&'#(#) *%+,&%-+./$,0.$ $ 5,-%&#+(.$!%&123-)+$&))75&4*-2$(8&4-'$,&-.&4$*$98)7526 A7)-&0()*4*1!-&520'2B724-&*)$(18C23-&84$84-8$',2(-$'71:*32'6 D1*4'(*124-$E7F'-1*-2'!&4-21'23-&4/$)*'21$F2*5'G$:8/$)*+21'G$2-3H6 6,-,7(208.$!12384'-173-'$,*92:184-$7'&4/$"#$2)2524-6
Taxonomy of Direct 3D Displays: Static Holograms $20+%(# (#$,"/+(%$+.," 12(2--234'2/#)!"#$%&'()*+$,&-.$)&/.-0%&123-&4/$2)2524-'6 ;*1*))*<$=*11&21'!74&:815$*11*+$8:$>#$')&-'$81$"#$(&4.8)2$*11*+'6?4-2/1*)$?5*/&4/!)24-&37)*1$'.22-'$81$:)+@'$2+2$)24')2-$*11*+'6!"#"$%&'#(#) *%+,&%-+./$,0.$ $ 5,-%&#+(.$!%&123-)+$&))75&4*-2$(8&4-'$,&-.&4$*$98)7526 6,-,7(208.$!12384'-173-'$,*92:184-$7'&4/$"#$2)2524-6 A7)-&0()*4*1!-&520'2B724-&*)$(18C23-&84$84-8$',2(-$'71:*32'6 D1*4'(*124-$E7F'-1*-2'!&4-21'23-&4/$)*'21$F2*5'G$:8/$)*+21'G$2-3H6 E-*-&3!.8)8/1*(.&3$:&)5'6$
Taxonomy of Direct 3D Displays: Dynamic Holograms (Holovideo) 92:;#+;2-<; IJ*-712G$"KKLM 12(2--234'2/#)!"#$%&'()*+$,&-.$)&/.-0%&123-&4/$2)2524-'6 =>9;=#).2;?2';@02+.2-;>&27."7;A(,%0 IN8)89&%28G$>OLO$P (12'24-M ;*1*))*<$=*11&21'!74&:815$*11*+$8:$>#$')&-'$81$"#$(&4.8)2$*11*+'6?4-2/1*)$?5*/&4/!)24-&37)*1$'.22-'$81$:)+@'$2+2$)24')2-$*11*+'6!"#"$%&'#(#) *%+,&%-+./$,0.$ $ 5,-%&#+(.$!%&123-)+$&))75&4*-2$(8&4-'$,&-.&4$*$98)7526 6,-,7(208.$!12384'-173-'$,*92:184-$7'&4/$"#$2)2524-6 A7)-&0()*4*1!-&520'2B724-&*)$(18C23-&84$84-8$',2(-$'71:*32'6 D1*4'(*124-$E7F'-1*-2'!&4-21'23-&4/$)*'21$F2*5'G$:8/$)*+21'G$2-3H6 E-*-&3!.8)8/1*(.&3$:&)5'6$ #+4*5&3!.8)89&%286$
Glasses-free 3D Theaters Seymon Palovich Ivanov, Russia, 1935 Cyclostereoscope, France, 1940-50s Inventors & Filmmakers, 1950s
Multi-projector Glasses-free 3D!"#$%#&$' "%(()*+,$-./0$1&234,565789:;<9
Anatomy of a Projector 2-33$1+/4,(++. )("*+,'-"./0+.1 5-+6+(!"#$%&'"(
!"#$%&'()* Building a 3D Projector
Building a 3D Projector!"#$%&"$' &$()"*+,-./,0%1"2234$(
Next: Computational Displays! HDR displays! projection displays! volumetric and other 3D displays! vision-correcting displays Jones et al. 2009 Favalora et al. Huang et al. 2014
References and Further Reading many more details on LCDs: http://www.personal.kent.edu/~mgu/lcd/index.htm good article for LCDs: http://en.wikipedia.org/wiki/lcd_television (better than the wikipedia LCD article) Freeman, Champion, Madhaven Scanned Laser Pico-projectors, Microvision, 2009 Fattal, Peng, Tran, Vo, Fiorentino, Brug, Beausoleil, A Multi-directional backlight for a wide-angle, glasses-free three-dimensional display, Nature 2013 Jones, McDowall, Yamada, Bolas, Debevec Rendering for an Interactive 360 Light Field Display, SIGGRPH 2007 Favalora, Napoli, Hall, Dorval, Dorval, Giovinco, Richmond, Chun 100-million-voxel volumetric display, SPIE 4712, 2002