Basics of Video Yao Wang Polytechnic University, Brooklyn, NY11201 yao@vision.poly.edu
Outline Color perception and specification Video capture and display Analog raster video Analog TV systems Digital video Yao Wang, 2004 Video Basics
Color Perception and Specification Light -> color perception Human perception of color Type of light sources Trichromatic color mixing theory Specification of color Tristimulus representation Luminance/Chrominance representation Color coordinate conversion Yao Wang, 2004 Video Basics 3
Light is part of the EM wave from [Gonzalez02] Yao Wang, 2004 Video Basics 4
Illuminating and Reflecting Light Illuminating sources: emit light (e.g. the sun, light bulb, TV monitors) perceived color depends on the emitted freq. follows additive rule R+G+B=White Reflecting sources: reflect an incoming light (e.g. the color dye, matte surface, cloth) perceived color depends on reflected freq (=emitted freqabsorbed freq.) follows subtractive rule R+G+B=Black Yao Wang, 2004 Video Basics 5
Eye Anatomy From http://www.stlukeseye.com/anatomy.asp Yao Wang, 2004 Video Basics 6
Eye vs. Camera Camera components Lens Shutter Film Cable to transfer images Eye components Lens, cornea Iris, pupil Retina Optic nerve send the info to the brain Yao Wang, 2004 Video Basics 7
Human Perception of Color Retina contains photo receptors Cones: day vision, can perceive color tone Red, green, and blue cones Different cones have different frequency responses Tri-receptor theory of color vision [Young1802] Rods: night vision, perceive brightness only Color sensation is characterized by Luminance (brightness) Chrominance Hue (color tone) Saturation (color purity) From http://www.macula.org/anatomy /retinaframe.html Yao Wang, 2004 Video Basics 8
Frequency Responses of Cones from [Gonzalez02] Ci = C( λ) ai ( λ) dλ, i = r, g, b, y Yao Wang, 2004 Video Basics 9
Frequency Responses of Cones and the Luminous Efficiency Function Relative sensitivity 100 80 60 40 Blue 20 Luminosity function Red Green 20 0 400 500 600 700 Wavelength Ci = C( λ) ai ( λ) dλ, i = r, g, b, y Yao Wang, 2004 Video Basics 10
Color Hue Specification Yao Wang, 2004 Video Basics 11
Trichromatic Color Mixing Trichromatic color mixing theory Any color can be obtained by mixing three primary colors with a right proportion C = T C, T : Tristimulus values k k= 1,2,3 k k Primary colors for illuminating sources: Red, Green, Blue (RGB) Color monitor works by exciting red, green, blue phosphors using separate electronic guns Primary colors for reflecting sources (also known as secondary colors): Cyan, Magenta, Yellow (CMY) Color printer works by using cyan, magenta, yellow and black (CMYK) dyes Yao Wang, 2004 Video Basics 12
RGB vs CMY Yao Wang, 2004 Video Basics 13
red Green Blue Yao Wang, 2004 Video Basics 14
Color Representation Models Specify the tristimulus values associated with the three primary colors RGB CMY Specify the luminance and chrominance HSI (Hue, saturation, intensity) YIQ (used in NTSC color TV) YCbCr (used in digital color TV) Amplitude specification: 8 bits for each color component, or 24 bits total for each pixel Total of 16 million colors A true RGB color display of size 1Kx1K requires a display buffer memory size of 3 MB Yao Wang, 2004 Video Basics 15
Color Coordinate Conversion Conversion between different primary sets are linear (3x3 matrix) Conversion between primary and XYZ/YIQ/YUV are also linear Conversion to LSI/Lab are nonlinear LSI and Lab coordinates coordinate Euclidean distance proportional to actual color difference Conversion formulae between many color coordinates can be found in [Gonzalez92] Yao Wang, 2004 Video Basics 16
Video Capture and Display Light reflection physics Imaging operator Color capture Color display Component vs. composite video Yao Wang, 2004 Video Basics 17
Video Capture For natural images we need a light source? (λ: wavelength of the source). E(x, y, z, λ): incident light on a point (x, y, z world coordinates of the point) Each point in the scene has a reflectivity function. r(x, y, z, λ): reflectivity function Light reflects from a point and the reflected light is captured by an imaging device. c(x, y, z, λ) =E(x, y, z, λ) r(x, y, z, λ): reflected light. Courtesy of Onur Guleryuz Yao Wang, 2004 Video Basics 18
More on Video Capture Reflected light to camera Camera absorption function ψ ( X, t) = C( X, t, λ) ac ( λ) dλ Projection from 3-D to 2-D X x P ψ ( P( X), t) = ψ ( X, t) or ψ ( x, t) = ψ ( P 1 ( x), t) The projection operator is non-linear Perspective projection Othographic projection Yao Wang, 2004 Video Basics 19
Perspective Projection Model Y X Y X 3-D point Z X Z x Image plane y x y x 2-D image F C Camera center X x = F, y = Z Y F Z The image of an object is reversed from its 3-D position. The object appears smaller when it is farther away. Yao Wang, 2004 Video Basics 20
How to Capture Color Need three types of sensors Complicated digital processing is incorporated in advanced cameras ( f s,1 ) CCDs f s,1 f s,1 Image 2fs,1 Rate enhancer conv. 2f /f s,1 s,2 Digital CN output Lens R B G Analog process A/D Pre-process Interpolation Color corrector Nonlinear processing Matrix & encoder 2f s,1 13.5 MHz D/A D/A Analog CN & CS output Viewfinder output Figure 1.2 Schematic block diagram of a professional color video camera. Reprinted from Y. Hashimoto, M. Yamamoto, and T. Asaida, Cameras and display systems, IEEE (July 1995), 83(7):1032 43. Copyright 1995 IEEE. Yao Wang, 2004 Video Basics 21
Video Display CRT vs LCD Need three light sources projecting red, green, blue components respectively Yao Wang, 2004 Video Basics 22
Analog Video Video raster Progressive vs. interlaced raster Analog TV systems Yao Wang, 2004 Video Basics 23
Raster Scan Real-world scene is a continuous 3-D signal (temporal, horizontal, vertical) Analog video is stored in the raster format Sampling in time: consecutive sets of frames To render motion properly, >=30 frame/s is needed Sampling in vertical direction: a frame is represented by a set of scan lines Number of lines depends on maximum vertical frequency and viewing distance, 525 lines in the NTSC system Video-raster = 1-D signal consisting of scan lines from successive frames Yao Wang, 2004 Video Basics 24
Progressive and Interlaced Scans Horizontal retrace Progressive Frame Interlaced Frame Field 1 Field 2 Vertical retrace Interlaced scan is developed to provide a trade-off between temporal and vertical resolution, for a given, fixed data rate (number of line/sec). Yao Wang, 2004 Video Basics 25
Waveform and Spectrum of an Interlaced Raster Horizontal retrace for first field Vertical retrace from first to second field Vertical retrace from second to third field Blanking level Black level T h White level T l t 2 T T t (a) ( f ) 0 f l 2f l 3f l f max f (b) Yao Wang, 2004 Video Basics 26
Color TV Broadcasting and Receiving RGB ---> YC1C2 Luminance, Chrominance, Audio Multiplexing Modulation YC1C2 ---> RGB De- Multiplexing De- Modulation Yao Wang, 2004 Video Basics 27
Why not using RGB directly? R,G,B components are correlated Transmitting R,G,B components separately is redundant More efficient use of bandwidth is desired RGB->YC1C2 transformation Decorrelating: Y,C1,C2 are uncorrelated C1 and C2 require lower bandwidth Y (luminance) component can be received by B/W TV sets YIQ in NTSC I: orange-to-cyan Q: green-to-purple (human eye is less sensitive) Q can be further bandlimited than I Phase=Arctan(Q/I) = hue, Magnitude=sqrt (I^2+Q^2) = saturation Hue is better retained than saturation Yao Wang, 2004 Video Basics 28
Color Image Y image I image (orange-cyan) Q image (green-purple)
I and Q on the color circle Q: green-purple I: orange-cyan Yao Wang, 2004 Video Basics 30
Conversion between RGB and YIQ RGB -> YIQ Y = 0.299 R + 0.587 G + 0.114 B I = 0.596 R -0.275 G -0.321 B Q = 0.212 R -0.523 G + 0.311 B YIQ -> RGB R =1.0 Y + 0.956 I + 0.620 Q, G = 1.0 Y - 0.272 I -0.647 Q, B =1.0 Y -1.108 I + 1.700 Q. Yao Wang, 2004 Video Basics 31
TV signal bandwidth Luminance Maximum vertical frequency (cycles/picture-height)= black and white lines interlacing f = Kf / 2 Maximum horizontal frequency (cycles/picture-width) Corresponding temporal frequency (cycles/second or Hz) f = f T ' = IAR Kf ' /2T ' For NTSC, Chrominance v, max ' s, y f h f, max = v,max max IAR h,max / l s, y f max = 4.2 MHz Can be bandlimited significantly I: 1.5 MHz, Q: 0.5 MHz. l Yao Wang, 2004 Video Basics 32
Bandwidth of Chrominance Signals Theoretically, for the same line rate, the chromiance signal can have as high frequency as the luminance signal However, with real video signals, the chrominance component typically changes much slower than luminance Furthermore, the human eye is less sensitive to changes in chrominance than to changes in luminance The eye is more sensitive to the orange-cyan range (I) (the color of face!) than to green-purple range (Q) The above factors lead to I: bandlimitted to 1.5 MHz Q: bandlimitted to 0.5 MHz Yao Wang, 2004 Video Basics 33
Multiplexing of Luminance and Chrominance Chrominance signal can be bandlimited it usually has a narrower frequency span than the luminance and the human eye is less sensitive to high frequencies in chrominance The two chrominance components (I and Q) are multiplexed onto the same sub-carrier using QAM The upper band of I is limited to 0.5 MHz to avoid interference with audio Position the bandlimited chrominance at the high end spectrum of the luminance, where the luminance is weak, but still sufficiently lower than the audio (at 4.5 MHz=286 f l ) The actual position should be such that the peaks of chrominance spectrum interlace with those of the luminance f c 455 f / 2 ( = 3.58 = l Hz for NTSC) Yao Wang, 2004 Video Basics 34
Spectrum Illustration (f ) Luminance Chrominance 0 f l 2f l 3f l 225f l 226f l 227f l 228f l 229f l 230f l f f c (Color subcarrier) Yao Wang, 2004 Video Basics 35
Multiplexing of luminance, chrominance and audio (Composite Video Spectrum) 1.25 MHz 6.0 MHz 4.5 MHz 4.2 MHz 3.58 MHz Luminance I I and Q Audio f p f c f a f Picture carrier Color subcarrier Audio subcarrier (b) Yao Wang, 2004 Video Basics 36
Quadrature Amplitude Modulation (QAM) A method to modulate two signals onto the same carrier frequency, but with 90 o phase shift cos( 2 πf 1 t ) cos( 2 πf 1 t ) s 1( t ) m (t ) m (t ) LPF s 1 ( t ) s 2 ( t ) sin( 2πf1t ) sin( 2πf1t ) LPF s 2 ( t ) QAM modulator QAM demodulator Yao Wang, 2004 Video Basics 37
Adding Color Bursts for Synchronization For accurate regeneration of the color sub-carrier signal at the receiver, a color burst signal is added during the horizontal retrace period Figure from From Grob, Basic Color Television Principles and Servicing, McGraw Hill, 1975 http://www.ee.washington.edu/conselec/ce/kuhn/ntsc/95x417.gif Yao Wang, 2004 Video Basics 38
Multiplexing of Luminance and Chrominance Y(t) LPF 0-4.2MHz I(t) LPF 0-1.5MHz Q(t) LPF 0-0.5MHz -π/2 Σ BPF 2-4.2MHz Σ Composite video Acos(2πf c t) Gate Color burst signal Yao Wang, 2004 Video Basics 39
DeMultiplexing of Luminance and Chrominance Composite video Comb Filter 0-4.2MHz Y(t) _ + Σ LPF 0-1.5MHz I(t) Horizontal sync signal Gate 2Acos(2πf c t) -π/2 LPF 0-0.5MHz Q(t) Phase comparator Voltage controlled oscillator Yao Wang, 2004 Video Basics 40
Luminance/Chrominance Separation In low-end TV receivers, a low pass filter with cut-off frequency at 3MHz is typically used to separate the luminance and chrominance signal. The high frequency part of the I component (2 to 3 Mhz) is still retained in the luminance signal. The extracted chrominance components can contain significant luminance signal in a scene with very high frequency (luminance energy is not negligible near f c ) These can lead to color bleeding artifacts For better quality, a comb filter can be used, which will filter out harmonic peaks correspond to chrominance signals. Show example of comb filter on board Yao Wang, 2004 Video Basics 41
What will a Monochrome TV see? The monochrome TV receiver uses a LPT with cut-off at 4.2 MHz, and thus will get the composite video (baseband luminance plus the I and Q signal modulated to f c =3.58 MHz) Because the modulated chrominance signal is at very high frequency (227.5 cycles per line), the eye smoothes it out mostly, but there can be artifacts The LPF in Practical TV receivers have wide transition bands, and the response is already quite low at f c. Yao Wang, 2004 Video Basics 42
Color TV Broadcasting and Receiving RGB ---> YC1C2 Luminance, Chrominance, Audio Multiplexing Modulation YC1C2 ---> RGB De- Multiplexing De- Modulation Yao Wang, 2004 Video Basics 43
Transmitter in More Details Audio FM modulator 4.5MHz R(t) G(t) B(t) RGB to YIQ conversion Y(t) I(t) Q(t) LPF 0-4.2MHz LPF 0-1.5MHz LPF 0-0.5MHz Acos(2πf c t) -π/2 Σ Gate BPF 2-4.2MHz Color burst signal Σ VSB To transmit antenna Yao Wang, 2004 Video Basics 44
Receiver in More Details BPF, 4.4-4.6MHz Composite video BPF, 0-4.2 MHz VSB Demodulator From antenna Gate Comb Filter 0-4.2MHz 2Acos(2πf c t) Phase comparator Horizontal sync signal FM demodulator + _ Σ Voltage controlled oscillator LPF 0-1.5MHz Yao Wang, 2004 Video Basics 45 -π/2 LPF 0-0.5MHz Y(t) I(t) Q(t) YIQ to RGB conversion Audio R(t) G(t) B(t) To speaker To CRT
Matlab Simulation of Mux/Demux We will show the multiplexing/demultiplexing of YIQ process for a real sequence ( mobile calendar ) Original Y,I, Q frames Converted Y,I, Q raster signals and their respective spectrums QAM of I and Q: choice of f c, waveform and spectrum Multiplexing of Y and QAM(I+Q): waveform and spectrum What wil a B/W TV receiver see: W/o filtering vs. with filtering What will a color TV receiver see: Original and recovered Y,I, Q Original and recovered color image Spectrum and waveforms Yao Wang, 2004 Video Basics 46
Spectrum of Y, I, Q 10 6 Y S pectrum 10 6 I S pe c trum 10 6 Q Spectrum 10 5 10 5 10 5 10 4 10 4 10 4 10 3 10 3 10 3 10 2 10 2 10 2 10 1 10 1 10 1 10 0 10 0 10 0 10-1 0 5 10 x 10 5 10-1 0 5 10 x 10 5 10-1 0 5 10 x 10 5 Spectrum of Y, I, and Q components, computed from first two progressive frames of mobilcal, 352x240/frame Maximum possible frequency is 352x240x30/2=1.26 MHz. Notice bandwidths of Y, I, Q components are 0.8,0.2,0.15 MHz, respectively, if we consider 10^3 as the cut-off magnitude. Yao Wang, 2004 Video Basics 47
QAM of I and Q: Waveform 80 I Wa ve form 80 Q Waveform 80 QAM multiplexed I & Q 60 60 60 40 40 40 20 20 20 Gray Level 0 Gray Level 0 Gray Level 0-20 -20-20 -40-40 -40-60 -60-60 -80 0 0.5 1 1.5 Time x 10-4 -80 0 0.5 1 1.5 Time x 10-4 -80 0 0.5 1 1.5 Time x 10-4 Line rate f l =30*240; Luminance f max =30*240*352/2*0.7=.89 MHz, The color subcarrier f c =225*f l /2=0.81MHz. M(t)=I(t)*cos(2πf c t)+q(t)*sin (2πf c t) Yao Wang, 2004 Video Basics 48
QAM of I and Q: Spectrum 10 6 I S pe c trum 10 6 Q Spectrum 10 6 QAM I+Q Spectrum 10 5 10 5 10 5 10 4 10 4 10 4 10 3 10 3 10 3 10 2 10 2 10 2 10 1 10 1 10 1 10 0 10 0 10 0 10-1 0 5 10 x 10 5 10-1 0 5 10 x 10 5 10-1 0 5 10 x 10 5 Spectrum of I, Q, and QAM multiplexed I+Q, fc=225*fl/2=0.81 MHz Yao Wang, 2004 Video Basics 49
Composite Video: Waveform 250 Y Waveform 250 Composite Waveform 200 200 150 150 Gray Level 100 Gray Level 100 50 50 0 0 0 0.5 1 1.5 0 0.5 1 1.5 Time x 10-4 Time x 10-4 Waveform of the Y signal Y(t) and the composite signal V(t)=Y(t)+M(t). 1 line Yao Wang, 2004 Video Basics 50
Composite Video: Spectrum 10 6 Y S pectrum 10 6 Composite Video Spectrum 10 5 10 5 10 4 10 4 10 3 10 3 10 2 0 2 4 6 8 10 12 x 10 5 10 2 0 2 4 6 8 10 12 x 10 5 Yao Wang, 2004 Video Basics 51
Blown-up View of Spectrum 10 6 Composite Spectrum (beginning) Luminance peaks 10 6 Composite Spectrum (near f c ) Chrominance peaks 10 5 10 5 10 4 10 4 10 3 10 3 Luminance peaks 10 2 0 5 10 15 x 10 4 10 2 7.5 8 8.5 9 x 10 5 Notice the harmonic peaks of Y and M interleaves near fc Yao Wang, 2004 Video Basics 52
Composite Video Viewed as a Monochrome Image w/o filtering Original Y Composite Signal as Y On the right is what a B/W receiver will see if no filtering is applied to the baseband video signal Yao Wang, 2004 Video Basics 53
Low-Pass Filter for Recovering Y Frequency response Impulse response (filter coefficients) Magnitude (db) 50 0-50 -100 0.6 0.5 0.4-150 0 2 4 6 Frequency (Hz) 8 10 12 x 10 5 0 0.3 0.2 Phase (degrees) -500-1000 -1500 0 2 4 6 Frequency (Hz) 8 10 12 x 10 5 0.1 0-0.1 0 5 10 15 20 25 f_lpf=30*240/2*150=0.54mhz; fir_length=20; LPF=fir1(fir_length,f_LPF/(Fs/2)); Yao Wang, 2004 Video Basics 54
Recovered Y with Filtering Original Y Recovered Y On the right is what a B/W receiver will see if a lowpass filter with cutoff frequency at about 0.75 MHz is applied to the baseband video signal. This is also the recovered Y component by a color receiver if the same filter is used to separate Y and QAM signal. Y (t)=conv(v(t),lpf(t)) Yao Wang, 2004 Video Basics 55
Y Waveform Comparison 250 Y Waveform 250 Composite Waveform 250 Y from Composite using LPF 200 200 200 Gray Level 150 100 Gray Level 150 100 Gray Level 150 100 50 50 50 0 0 0.5 1 1.5 Time x 10-4 0 0 0.5 1 1.5 Time x 10-4 0 0 0.5 1 1.5 Time x 10-4 Yao Wang, 2004 Video Basics 56
Demux Y and QAM(I,Q) 80 QAM Waveform 80 Demultiplexed QAM 60 60 40 40 20 20 Gray Level 0 Gray Level 0-20 -20-40 -40-60 -60-80 0 0.5 1 1.5-80 0 0.5 1 1.5 Time x 10-4 Time x 10-4 M (t)=v(t)-y (t) Yao Wang, 2004 Video Basics 57
QMA Modulation and Demodulation Modulated signal: M(t)=I(t)*cos(2πf c t)+q(t)*sin (2πf c t) Demodulated signal: I (t)=2*m(t)*cos(2πf c t), Q (t)=2*m(t)*sin(2πf c t) I (t) contains I(t) at baseband, as well as I(t) at 2f c and Q(t) at 4f c A LPF is required to extract I(t) cos( 2πf1t ) cos( 2 πf 1 t ) s 1( t ) m (t ) m (t ) LPF s 1( t ) s 2 ( t ) sin( 2πf1t ) sin( 2πf1t ) LPF s 2 ( t ) QAM modulator QAM demodulator Yao Wang, 2004 Video Basics 58
Lowpass filter for Extracting QAM(I+Q) Frequency response Impulse response Magnitude (db) Phase (degrees) 50 0-50 -100 0 2 4 6 8 10 12 Frequency (Hz) x 10 5 0-200 -400-600 -800 0 2 4 6 8 10 12 Frequency (Hz) x 10 5 0.16 0.14 0.12 0.1 0.08 0.06 0.04 0.02 0-0.02 0 5 10 15 20 25 f_lpf=0.2mhz; fir_length=20; LPF=fir1(fir_length,f_LPF/(Fs/2)); Yao Wang, 2004 Video Basics 59
QAM Demodulation: Waveform 80 Original I 80 Demodulated I 80 Demodulation+LPF I 60 60 60 40 40 40 20 20 20 Gray Level 0-20 Gray Level 0-20 Gray Level 0-20 -40-40 -40-60 -60-60 -80 0 0.5 1 1.5 Time x 10-4 -80 0 0.5 1 1.5 Time x 10-4 -80 0 0.5 1 1.5 Time x 10-4 I (t)=2*m(t)*cos(2πf c t) I (t)=conv(i (t),lpf(t)) Yao Wang, 2004 Video Basics 60
QAM Demodultion: Spectrum 10 6 I S pe c trum 10 6 Extracted I Spectrum w/o LPF 10 6 Extracted I Spectrum after LPF 10 5 10 5 10 5 10 4 10 4 10 4 10 3 10 3 10 3 10 2 0 5 10 x 10 5 10 2 0 5 10 x 10 5 10 2 0 5 10 x 10 5 Yao Wang, 2004 Video Basics 61
original I original Q 50 100 150 200 50 100 150 200 100 200 300 Recovered I 100 200 300 Recovered Q 50 100 150 200 50 100 150 200 100 200 300 100 200 300 Yao Wang, 2004 Video Basics 62
Original color frame Recovered color frame Yao Wang, 2004 Video Basics 63
Different Color TV Systems Parameters NTSC PAL SECAM Field Rate (Hz) 59.95 (60) 50 50 Line Number/Frame 525 625 625 Line Rate (Line/s) 15,750 15,625 15,625 Color Coordinate YIQ YUV YDbDr Luminance Bandwidth (MHz) 4.2 5.0/5.5 6.0 Chrominance Bandwidth (MHz) 1.5(I)/0.5(Q) 1.3(U,V) 1.0 (U,V) Color Subcarrier (MHz) 3.58 4.43 4.25(Db),4.41(Dr) Color Modulation QAM QAM FM Audio Subcarrier 4.5 5.5/6.0 6.5 Total Bandwidth (MHz) 6.0 7.0/8.0 8.0 Yao Wang, 2004 Video Basics 64
Who uses what? From http://www.stjarnhimlen.se/tv/tv.html#worldwide_0 Yao Wang, 2004 Video Basics 65
Digital Video Digital video by sampling/quantizing analog video raster BT.601 video Other digital video formats and their applications Yao Wang, 2004 Video Basics 66
Digitizing A Raster Video Sample the raster waveform = Sample along the horizontal direction Sampling rate must be chosen properly For the samples to be aligned vertically, the sampling rate should be multiples of the line rate Horizontal sampling interval = vertical sampling interval Total sampling rate equal among different systems f s = l l 858 f (NTSC) = 864 f (PAL/SECAM) = 13.5 MHz Yao Wang, 2004 Video Basics 67
BT.601* Video Format 858 pels 864 pels 720 pels 720 pels 525 lines 480 lines Active Area 625 lines 576 lines Active Area 122 pel 16 pel 132 pel 12 pel 525/60: 60 field/s 625/50: 50 field/s * BT.601 is formerly known as CCIR601 Yao Wang, 2004 Video Basics 68
RGB <--> YCbCr Y_d = 0.257 R_d + 0.504 G_d + 0.098 B_d + 16, C_b = -0.148 R_d - 0.291 G_d + 0.439 B_d + 128, C_r = 0.439 R_d -0.368 G_d - 0.071 B_d + 128, R_d = 1.164 Y_d + 0.0 C_b + 1.596 C_r, G_d = 1.164 Y_d - 0.392 C_b -0.813 C_r, B_d = 1.164 Y_d + 2.017 C_b + 0.0 C_r, Y_d =Y_d -16, C_b =C_b-128, C_r =C_r-128 Yao Wang, 2004 Video Basics 69
Chrominance Subsampling Formats 4:4:4 For every 2x2 Y Pixels 4 Cb & 4 Cr Pixel (No subsampling) 4:2:2 For every 2x2 Y Pixels 2 Cb & 2 Cr Pixel (Subsampling by 2:1 horizontally only) 4:1:1 For every 4x1 Y Pixels 1Cb & 1 CrPixel (Subsampling by 4:1 horizontally only) 4:2:0 For every 2x2 Y Pixels 1Cb&1CrPixel (Subsampling by 2:1 both horizontally and vertically) Y Pixel Cb and Cr Pixel Yao Wang, 2004 Video Basics 70
Digital Video Formats Video Format Y Size Color Sampling Frame Rate (Hz) Raw Data Rate (Mbps) HDTV Over air. cable, satellite, MPEG2 video, 20-45 Mbps SMPTE296M 1280x720 4:2:0 24P/30P/60P 265/332/664 SMPTE295M 1920x1080 4:2:0 24P/30P/60I 597/746/746 Video production, MPEG2, 15-50 Mbps BT.601 720x480/576 4:4:4 60I/50I 249 BT.601 720x480/576 4:2:2 60I/50I 166 High quality video distribution (DVD, SDTV), MPEG2, 4-10 Mbps BT.601 720x480/576 4:2:0 60I/50I 124 Intermediate quality video distribution (VCD, WWW), MPEG1, 1.5 Mbps SIF 352x240/288 4:2:0 30P/25P 30 Video conferencing over ISDN/Internet, H.261/H.263, 128-384 Kbps CIF 352x288 4:2:0 30P 37 Video telephony over wired/wireless modem, H.263, 20-64 Kbps QCIF 176x144 4:2:0 30P 9.1 Yao Wang, 2004 Video Basics 71
Video Terminology Component video Three color components stored/transmitted separately Use either RGB or YIQ (YUV) coordinate New digital video format (YCrCb) Betacam (professional tape recorder) use this format Composite video Convert RGB to YIQ (YUV) Multiplexing YIQ into a single signal Used in most consumer analog video devices S-video Y and C (QAM of I and Q) are stored separately Used in high end consumer video devices High end monitors can take input from all three Yao Wang, 2004 Video Basics 72
Homework Reading assignment: Chap. 1. Problems: Prob. 1.5. Prob. 1.6. Prob. 1.7. Prob. 1.8. Prob. 1.9. Prob. 1.10 Prob. 1.11 Prove mux/demux with QAM will get back the original two signals Yao Wang, 2004 Video Basics 73