Basics on Video Communications and Other Video Coding Approaches/Standards
|
|
- Lesley Tucker
- 5 years ago
- Views:
Transcription
1 UMCP ENEE631 Slides (created by M.Wu 2004) Basics on Video Communications and Other Video Coding Approaches/Standards Spring 06 Instructor: K. J. Ray Liu ECE Department, Univ. of Maryland, College Park UMCP ENEE631 Slides (created by M.Wu 2004) Quick Review A Few Basics on Video Acquisition, Display, Analog & Digital Formats ENEE631 Digital Image Processing (Spring'06) ENEE631 Digital Image Processing (Spring'06) Lec20 Video Coding (3) [2] Video Camera Video Display Frame-by-frame capturing CCD sensors (Charge-Coupled Devices) 2-D array of solid-state sensors Each sensor corresponding to a pixel Store in a buffer and sequentially read out Widely used small and light CMOS sensors Each sensor is a transitor ENEE631 Digital Image Processing (Spring'06) Lec20 Video Coding (3) [3] CRT (Cathode Ray Tube) Large dynamic range Bulky for large display CRT physical depth has to be similar to screen width LCD Flat-panel display Use electrical field to change the optical properties hence the brightness/color of liquid crystal Generating the electrical field by an array of transistors: active-matrix thin-film transistors by plasma Active-matrix display (also known as TFT) has a transistor located at each pixel, allowing display be switched more frequently and less current to control pixel luminance. Passive matrix LCD has a grid of conductors with pixels located at the grid intersections ENEE631 Digital Image Processing (Spring'06) Lec20 Video Coding (3) [4] 1
2 Composite vs. Component Video Component video Three separate signals for tristimulus color representation or luminancechrominance representation Pro: higher quality Con: need high bandwidth and synchronization Composite video Multiplex into a single signal Historical reason for transmitting color TV through monochrome channel Pro: save bandwidth Con: cross talk S-video: luminance sig. + single multiplexed chrominance sig. Analog Video Raster Line-by-line Raster Scan Represent line-by-line image frame with 1-D analog waveform Synchronization signal for horizontal and vertical retrace ENEE631 Digital Image Processing (Spring'06) Lec20 Video Coding (3) [5] ENEE631 Digital Image Processing (Spring'06) Lec20 Video Coding (3) [6] Forming Picture on TV Tube (Monochrome) How Many TV Lines? From B.Liu EE330 S 01 Princeton From B.Liu EE330 S 01 Princeton Determined by spatial freq. response of HVS dot dot Cannot resolve if distance > 2000 x separation (~ 0.03 degree viewing angle) How many lines? N = 500 for D=4H ENEE631 Digital Image Processing (Spring'06) Lec20 Video Coding (3) [7] ENEE631 Digital Image Processing (Spring'06) Lec20 Video Coding (3) [8] 2
3 Review: Progressive vs. Interlaced scan From B.Liu EE330 S 01 Princeton Analog Color TV Systems Historical notes Color TV system had to be compatible with earlier monochrome TV system 3 formats NTSC ~ North American + Japan/Taiwan PAL ~ Western Europe + Asia(China) + Middle East SECAM ~ Eastern Europe + France What format in your home country? From Wang s Preprint Fig.1.5 ENEE631 Digital Image Processing (Spring'06) Lec20 Video Coding (3) [9] ENEE631 Digital Image Processing (Spring'06) Lec20 Video Coding (3) [10] Comparison of Three Analog TV Systems Spatial and temporal resolution Color coordinate Signal bandwidth Multiplexing of luminance, chrominance, and audio (From Wang s Preprint) NTSC 4:3 aspect ratio (width:height) 525 lines/frame, 2:1 interlace at field rate 59.94Hz 483 active lines per frame; vertical retrace takes time of 9 lines rest for broadcaster s info. like closed caption YIQ color coordinate for transmission RGB primary slightly different from PAL Orthogonal chrominance I ~ orange-to-cyan; Q ~ green-to-purple (need less bandwidth) Multiplexing over 6M Hz total bandwidth Artifacts due to cross talk between luminance and chrominance ENEE631 Digital Image Processing (Spring'06) Lec20 Video Coding (3) [11] ENEE631 Digital Image Processing (Spring'06) Lec20 Video Coding (3) [12] 3
4 NTSC 6MHz Bandwidth From Wang s Preprint Fig.1.6(b) Analog Video Recording From Wang s Preprint Table 1.2 Comparison of common formats ENEE631 Digital Image Processing (Spring'06) Lec20 Video Coding (3) [13] ENEE631 Digital Image Processing (Spring'06) Lec20 Video Coding (3) [14] Digital Video Formats ITU-R BT.601 recommendation Downsampled chrominance Y Cb Cr coordinate and four subsampling formats Inter. Telecomm. Union Radio sector Wang s Preprint Fig.1.8 ENEE631 Digital Image Processing (Spring'06) Lec20 Video Coding (3) [15] From Wang s Preprint Table 1.3 ENEE631 Digital Image Processing (Spring'06) Lec20 Video Coding (3) [16] 4
5 From R.Liu Seminar Course UMCP Generations of Video Coding UMCP ENEE631 Slides (created by M.Wu 2004) Resource Background and Motivation on Multimedia Coding / Communications ENEE631 Digital Image Processing (Spring'06) Lec20 Video Coding (3) [17] ENEE631 Digital Image Processing (Spring'06) Lec20 Video Coding (3) [18] Channel Bandwidth From R.Liu Seminar Course UMCP Storage Capacity From R.Liu Seminar Course UMCP ENEE631 Digital Image Processing (Spring'06) Lec20 Video Coding (3) [19] ENEE631 Digital Image Processing (Spring'06) Lec20 Video Coding (3) [20] 5
6 From R.Liu Seminar Course UMCP From R.Liu Seminar Course UMCP Source Video Formats Application Requirements ENEE631 Digital Image Processing (Spring'06) Lec20 Video Coding (3) [21] ENEE631 Digital Image Processing (Spring'06) Lec20 Video Coding (3) [22] Performance Tradeoff for Video Coding UMCP ENEE631 Slides (created by M.Wu 2004) Other Standard and Considerations for Digital Video Coding From R.Liu s Handbook Fig.1.2: mos ~ 5-pt mean opinion scale of bad, poor, fair, good, excellent ENEE631 Digital Image Processing (Spring'06) Lec20 Video Coding (3) [23] ENEE631 Digital Image Processing (Spring'06) Lec20 Video Coding (3) [24] 6
7 H.26x for Video Telephony Remote face-to-face communication: A dream for years H.26x Video coding targeted low bit rate Through ISDN or regular analog telephone line ~ on the order of 64kbps Need roughly symmetric complexity on encoder and decoder H.261 (early 1990s) Similar to simplified MPEG-1 ~ block-based DCT/MC hybrid coder Integer-pel motion compensation with I/P frame only ~ no B frames Restricted picture size/fps format and M.V. range H.263 (mid 1990s) and H.263+/H (late 1990s) Support half-pel motion compensation & many options for improvement H.264 (latest, 2001-): also known as H.26L / JVT / MPEG4 part10 Hybrid coding framework with many advanced techniques Focusing on greatly improving compression ratio at a cost of complexity MPEG-2 Extend from MPEG-1 Target at high-resolution high-bit-rate applications Digital video broadcasting, HDTV, Also used for DVD Support scalability Support interlaced video Frame pictures vs. Field pictures New prediction modes for motion compensation related to interlaced video Use previously encoded fields to do M.E.-M.C. ENEE631 Digital Image Processing (Spring'06) Lec20 Video Coding (3) [25] ENEE631 Digital Image Processing (Spring'06) Lec20 Video Coding (3) [26] Scalability in Video Codecs Scalability: provide different quality in a single stream Stack up more bits on base layer to provide improved quality Possible ways for achieving scalabilities SNR Scalability ~ Multiple quality video services Basic vs. premium quality Spatial Scalability ~ Multiple-dimension displays Display on PDA vs. PC vs. Super-resolution display Temporal Scalability ~ Multiple frame rates Layered coding concept facilitates: Unequal error protection Efficient use of resources Different needs from customers Multiple services ENEE631 Digital Image Processing (Spring'06) Lec20 Video Coding (3) [27] SNR Scalability Two layers with same spatio-temporal resolution but different qualities Video in + - base-layer encoder base-layer decoder enhancement-layer encoder Base-layer Enhancement-layer ENEE631 Digital Image Processing (Spring'06) Lec20 Video Coding (3) [28] multiplexer Output From R.Liu Seminar UMCP 7
8 Spatial Scalability Two layers with different spatial resolution Temporal Scalability From R.Liu Seminar UMCP Enhancement layer carries additional frames at same spatial resolution Video in Down-sampler Up-sampler + - base-layer encoder base-layer decoder enhancement-layer encoder Base-layer Enhancement-layer multiplexer Output From R.Liu Seminar UMCP Base-layer video in Base-layer decoded video out Enhancement-layer video in Temporal demux base-layer encoder base-layer decoder enhancement-layer encoder Base-layer Enhancement-layer Base-layer Enhancement-layer multiplexer Output ENEE631 Digital Image Processing (Spring'06) Lec20 Video Coding (3) [29] ENEE631 Digital Image Processing (Spring'06) Lec20 Video Coding (3) [30] MPEG-4 Many functionalities targeting a variety of applications Introduced object-based coding strategy For better support of interactive applications & graphics/animation video Require encoder to perform object segmentation difficult for general applications Introduced error resilient coding techniques Streaming video profile for wireless multimedia applications Part-10 is converged into H.264 Focused on improving compression ratio and error resilience Stick with Hybrid coding framework Object-based based Coding in MPEG-4 Interactive functionalities Higher compression efficiency by separately handling Moving objects Unchanged background New regions M.C.-failure regions => Sprite encoding Object segmentation needed (not easy ) Based on color, motion, edge, texture, etc. Possible for targeted applications Revised from R.Liu Seminar UMCP ENEE631 Digital Image Processing (Spring'06) Lec20 Video Coding (3) [31] ENEE631 Digital Image Processing (Spring'06) Lec20 Video Coding (3) [32] 8
9 Object-based based Coding in MPEG-4 4 (cont d) Model-Based Video Coding From Wang s book preprint Fig ENEE631 Digital Image Processing (Spring'06) Lec20 Video Coding (3) [33] From R.Liu Seminar UMCP ENEE631 Digital Image Processing (Spring'06) Lec20 Video Coding (3) [34] Analysis-Synthesis Coding Some Coding Models From R.Liu Seminar UMCP ENEE631 Digital Image Processing (Spring'06) Lec20 Video Coding (3) [35] From R.Liu Seminar UMCP ENEE631 Digital Image Processing (Spring'06) Lec20 Video Coding (3) [36] 9
10 MPEG-7 Multimedia Content Description Interface Figure from MPEG-7 Document N4031 (March 2001) Not a video coding/compression standard like previous MPEG Emphasize on how to describe the video content for efficient indexing, search, and retrieval Standardize the description mechanism of content Descriptor, Description Scheme, Description Definition Languages Example of MPEG-7 visual descriptor: Color, Texture, Shape, Summary Scalable coding Standards evolved from or similar to MPEG-1 MPEG-2, H.26x Brief intro. on model-based coding Object-based video coding & MPEG-4 Additional MPEG-4 activities Error resilience Intellectual property management/protection What is after MPEG-4? MPEG-7 for facilitating image/video search and indexing ENEE631 Digital Image Processing (Spring'06) Lec20 Video Coding (3) [37] ENEE631 Digital Image Processing (Spring'06) Lec20 Video Coding (3) [38] UMCP ENEE408G Slides (created by M.Wu 2002) Reading Assignment Readings Wang s book Chapt.13, Sec.11.1, Sec.10.5 [Electronic Handout] R.Liu s Handbook Chapt.1-3 Chapter 7 Data Compression (handout) Sec. 7.6 => H.261 & H.263 Sec & => MPEG-4 & MPEG-7 Tutorial on MPEG Video Coding (handout) IEEE Signal Processing Magazine, Sept Video Content Analysis ENEE631 Digital Image Processing (Spring'06) Lec20 Video Coding (3) [39] ENEE631 Digital Image Processing (Spring'06) Lec20 Video Coding (3) [40] 10
11 Introduction to Video Content Analysis Teach computer to understand video content Define features that computer can learn to measure and compare color (RGB values or other color coordinates) motion (magnitude and directions) shape (contours) texture and patterns Give example correspondences so that computer can learn build connections between feature & higher-level semantics/concepts statistical classification and recognition techniques Video understanding Break a video sequence into chunks, each with consistent content ~ shot Group similar shot into scenes that represent certain events Describe connections among scenes via story boards or scene graphs Associate shot/scene with representative feature/semantics for future query Video Understanding (step-1) From Yeung-Yeo-Liu: STG (Princeton) Break a video sequence into chunks, each with consistent content ~ shot ENEE631 Digital Image Processing (Spring'06) Lec20 Video Coding (3) [41] ENEE631 Digital Image Processing (Spring'06) Lec20 Video Coding (3) [42] Video Understanding (step-2) Group similar shot into scenes From Yeung-Yeo-Liu: STG (Princeton) Video Understanding (step-3) From Yeung-Yeo-Liu: STG (Princeton) Describe connections among scenes via story boards or scene graphs ENEE631 Digital Image Processing (Spring'06) Lec20 Video Coding (3) [43] ENEE631 Digital Image Processing (Spring'06) Lec20 Video Coding (3) [44] 11
12 Video Temporal Segmentation A first step toward video content understanding Two types of transitions Cut ~ abrupt transition Gradual transition Fade out and Fade in; Dissolve; Wipe Detecting transitions Detecting cut is relatively easier ~ check frame-wise difference Detecting dissolve and fade by checking linearity f 0 (1 t/t) + f 1 * t/t Detecting wipe ~ more difficult via projection, edge pattern, or linearity of color histogram Types of Transitions [above] Transition types offered by Adobe Premiere See also transition demos provided by PowerPoint From talks by Joyce-Liu (Princeton) Video transition collection (Rob Joyce) ENEE631 Digital Image Processing (Spring'06) Lec20 Video Coding (3) [45] ENEE631 Digital Image Processing (Spring'06) Lec20 Video Coding (3) [46] Examples of Wipes Compressed-Domain Processing UMCP ENEE408G Slides (created by M.Wu 2002) Use I & P frames only to reduce computation and to enhance robustness in scene change detection I b b P b b P b b P b b I b b P Working in compressed domain Process video by only doing partial decoding (inverse VLC, etc.) without a full decoding (IDCT) to save computation Low resolution version already provide enough information for transition detection DC-image ENEE631 Digital Image Processing (Spring'06) Lec20 Video Coding (3) [47] ENEE631 Digital Image Processing (Spring'06) Lec20 Video Coding (3) [48] 12
13 DC Image Put DC of each block together Already contain most information of the video DC Frame Example From Joyce-Liu (Princeton) UMCP ENEE408G Slides (created by M.Wu 2002) Fast Extraction of DC Image From MPEG-1 I frame Take DC coeff. from each block and put together P/B frame Fast approximation of reference block s DC Adding DC of the motion compensation residue recall DCT is a linear transform 1 2 R 3 4 C 4 hw i i [ DCT( Pref )] [ DCT ( P i )] i= 1 [ DCT( P )] [ DCT( P )] + [ DCT( P )] cur 00 ref 00 diff 00 ENEE631 Digital Image Processing (Spring'06) Lec20 Video Coding (3) [49] ENEE631 Digital Image Processing (Spring'06) Lec20 Video Coding (3) [50] UMCP ENEE408G Slides (created by M.Wu 2002) Compressed-Domain Scene Change Detection Compare nearby frames Take pixel-wise difference of nearby DC-frames Or take pixel-wise difference of every N frames to accumulate more changes => useful for detect gradual transitions Observe the pixel-wise difference for different frame pairs cuts, and gradual transitions Figure from Yeo-Liu CSVT 95 paper UMCP ENEE408G Slides (created by M.Wu 2002) Scene Change Detection (cont d) Figure from Yeo-Liu CSVT 95 paper ENEE631 Digital Image Processing (Spring'06) Lec20 Video Coding (3) [51] ENEE631 Digital Image Processing (Spring'06) Lec20 Video Coding (3) [52] 13
14 Dissolve: DC Frame Space g k Pixel 3 Dissolve: a linear combination of g and h Detect straight lines in DC frame space correlation detection on triplets m Pixel 2 n dissolve Pixel 1 h k From talks by Joyce-Liu (Princeton) UMCP ENEE408G Slides (created by M.Wu 2002) Wipe Detection Convert the 2-D problem to 1-D by projection Perform horizon, vertical, diagonal projection to detect diverse wipe types ENEE631 Digital Image Processing (Spring'06) Lec20 Video Coding (3) [53] ENEE631 Digital Image Processing (Spring'06) Lec20 Video Coding (3) [54] Color Histogram What is color histogram? Count the # of pixels with the same color Plot color-value vs. corresponding pixel# Similarly for luminance histogram Give idea of the dominate color and color distribution Ignore the exact spatial location of each color value Useful in image and video analysis Color histogram can be used to: Detect gradual shot transition esp. for fancy wipes Measure content similarity between images / video shots Wipe Detection (cont d) More diverse and fancy wipes Linear change in color histogram G k m Bin 2 wipe Bin 1 H k From talks by Joyce-Liu (Princeton) Bin 3 n ENEE631 Digital Image Processing (Spring'06) Lec20 Video Coding (3) [55] ENEE631 Digital Image Processing (Spring'06) Lec20 Video Coding (3) [56] 14
Midterm Review. Yao Wang Polytechnic University, Brooklyn, NY11201
Midterm Review Yao Wang Polytechnic University, Brooklyn, NY11201 yao@vision.poly.edu Yao Wang, 2003 EE4414: Midterm Review 2 Analog Video Representation (Raster) What is a video raster? A video is represented
More informationLecture 2 Video Formation and Representation
2013 Spring Term 1 Lecture 2 Video Formation and Representation Wen-Hsiao Peng ( 彭文孝 ) Multimedia Architecture and Processing Lab (MAPL) Department of Computer Science National Chiao Tung University 1
More informationAudio and Video II. Video signal +Color systems Motion estimation Video compression standards +H.261 +MPEG-1, MPEG-2, MPEG-4, MPEG- 7, and MPEG-21
Audio and Video II Video signal +Color systems Motion estimation Video compression standards +H.261 +MPEG-1, MPEG-2, MPEG-4, MPEG- 7, and MPEG-21 1 Video signal Video camera scans the image by following
More informationAn Overview of Video Coding Algorithms
An Overview of Video Coding Algorithms Prof. Ja-Ling Wu Department of Computer Science and Information Engineering National Taiwan University Video coding can be viewed as image compression with a temporal
More informationModule 8 VIDEO CODING STANDARDS. Version 2 ECE IIT, Kharagpur
Module 8 VIDEO CODING STANDARDS Lesson 27 H.264 standard Lesson Objectives At the end of this lesson, the students should be able to: 1. State the broad objectives of the H.264 standard. 2. List the improved
More informationChapter 3 Fundamental Concepts in Video. 3.1 Types of Video Signals 3.2 Analog Video 3.3 Digital Video
Chapter 3 Fundamental Concepts in Video 3.1 Types of Video Signals 3.2 Analog Video 3.3 Digital Video 1 3.1 TYPES OF VIDEO SIGNALS 2 Types of Video Signals Video standards for managing analog output: A.
More informationVideo coding standards
Video coding standards Video signals represent sequences of images or frames which can be transmitted with a rate from 5 to 60 frames per second (fps), that provides the illusion of motion in the displayed
More informationAdvanced Computer Networks
Advanced Computer Networks Video Basics Jianping Pan Spring 2017 3/10/17 csc466/579 1 Video is a sequence of images Recorded/displayed at a certain rate Types of video signals component video separate
More informationLecture 2 Video Formation and Representation
Wen-Hsiao Peng, Ph.D. Multimedia Architecture and Processing Laboratory (MAPL) Department of Computer Science, National Chiao Tung University March 2013 Wen-Hsiao Peng, Ph.D. (NCTU CS) MAPL March 2013
More informationOverview: Video Coding Standards
Overview: Video Coding Standards Video coding standards: applications and common structure ITU-T Rec. H.261 ISO/IEC MPEG-1 ISO/IEC MPEG-2 State-of-the-art: H.264/AVC Video Coding Standards no. 1 Applications
More informationMultimedia Communications. Image and Video compression
Multimedia Communications Image and Video compression JPEG2000 JPEG2000: is based on wavelet decomposition two types of wavelet filters one similar to what discussed in Chapter 14 and the other one generates
More informationEssence of Image and Video
1 Essence of Image and Video Wei-Ta Chu 2009/9/24 Outline 2 Image Digital Image Fundamentals Representation of Images Video Representation of Videos 3 Essence of Image Wei-Ta Chu 2009/9/24 Chapters 2 and
More informationMultimedia Communications. Video compression
Multimedia Communications Video compression Video compression Of all the different sources of data, video produces the largest amount of data There are some differences in our perception with regard to
More informationCOMP 249 Advanced Distributed Systems Multimedia Networking. Video Compression Standards
COMP 9 Advanced Distributed Systems Multimedia Networking Video Compression Standards Kevin Jeffay Department of Computer Science University of North Carolina at Chapel Hill jeffay@cs.unc.edu September,
More informationModule 1: Digital Video Signal Processing Lecture 5: Color coordinates and chromonance subsampling. The Lecture Contains:
The Lecture Contains: ITU-R BT.601 Digital Video Standard Chrominance (Chroma) Subsampling Video Quality Measures file:///d /...rse%20(ganesh%20rana)/my%20course_ganesh%20rana/prof.%20sumana%20gupta/final%20dvsp/lecture5/5_1.htm[12/30/2015
More informationModule 8 VIDEO CODING STANDARDS. Version 2 ECE IIT, Kharagpur
Module 8 VIDEO CODING STANDARDS Lesson 24 MPEG-2 Standards Lesson Objectives At the end of this lesson, the students should be able to: 1. State the basic objectives of MPEG-2 standard. 2. Enlist the profiles
More informationVideo 1 Video October 16, 2001
Video Video October 6, Video Event-based programs read() is blocking server only works with single socket audio, network input need I/O multiplexing event-based programming also need to handle time-outs,
More informationChapter 2 Introduction to
Chapter 2 Introduction to H.264/AVC H.264/AVC [1] is the newest video coding standard of the ITU-T Video Coding Experts Group (VCEG) and the ISO/IEC Moving Picture Experts Group (MPEG). The main improvements
More informationVideo compression principles. Color Space Conversion. Sub-sampling of Chrominance Information. Video: moving pictures and the terms frame and
Video compression principles Video: moving pictures and the terms frame and picture. one approach to compressing a video source is to apply the JPEG algorithm to each frame independently. This approach
More informationMultimedia Systems Video I (Basics of Analog and Digital Video) Mahdi Amiri April 2011 Sharif University of Technology
Course Presentation Multimedia Systems Video I (Basics of Analog and Digital Video) Mahdi Amiri April 2011 Sharif University of Technology Video Visual Effect of Motion The visual effect of motion is due
More informationResearch Topic. Error Concealment Techniques in H.264/AVC for Wireless Video Transmission in Mobile Networks
Research Topic Error Concealment Techniques in H.264/AVC for Wireless Video Transmission in Mobile Networks July 22 nd 2008 Vineeth Shetty Kolkeri EE Graduate,UTA 1 Outline 2. Introduction 3. Error control
More informationTo discuss. Types of video signals Analog Video Digital Video. Multimedia Computing (CSIT 410) 2
Video Lecture-5 To discuss Types of video signals Analog Video Digital Video (CSIT 410) 2 Types of Video Signals Video Signals can be classified as 1. Composite Video 2. S-Video 3. Component Video (CSIT
More informationUnderstanding Multimedia - Basics
Understanding Multimedia - Basics Joemon Jose Web page: http://www.dcs.gla.ac.uk/~jj/teaching/demms4 Wednesday, 9 th January 2008 Design and Evaluation of Multimedia Systems Lectures video as a medium
More informationLecture 1: Introduction & Image and Video Coding Techniques (I)
Lecture 1: Introduction & Image and Video Coding Techniques (I) Dr. Reji Mathew Reji@unsw.edu.au School of EE&T UNSW A/Prof. Jian Zhang NICTA & CSE UNSW jzhang@cse.unsw.edu.au COMP9519 Multimedia Systems
More informationMPEG-2. ISO/IEC (or ITU-T H.262)
1 ISO/IEC 13818-2 (or ITU-T H.262) High quality encoding of interlaced video at 4-15 Mbps for digital video broadcast TV and digital storage media Applications Broadcast TV, Satellite TV, CATV, HDTV, video
More informationDan Schuster Arusha Technical College March 4, 2010
Television Theory Of Operation Dan Schuster Arusha Technical College March 4, 2010 My TV Background 34 years in Automation and Image Electronics MS in Electrical and Computer Engineering Designed Television
More informationMULTIMEDIA TECHNOLOGIES
MULTIMEDIA TECHNOLOGIES LECTURE 08 VIDEO IMRAN IHSAN ASSISTANT PROFESSOR VIDEO Video streams are made up of a series of still images (frames) played one after another at high speed This fools the eye into
More informationChapter 10 Basic Video Compression Techniques
Chapter 10 Basic Video Compression Techniques 10.1 Introduction to Video compression 10.2 Video Compression with Motion Compensation 10.3 Video compression standard H.261 10.4 Video compression standard
More informationColour Reproduction Performance of JPEG and JPEG2000 Codecs
Colour Reproduction Performance of JPEG and JPEG000 Codecs A. Punchihewa, D. G. Bailey, and R. M. Hodgson Institute of Information Sciences & Technology, Massey University, Palmerston North, New Zealand
More informationdecodes it along with the normal intensity signal, to determine how to modulate the three colour beams.
Television Television as we know it today has hardly changed much since the 1950 s. Of course there have been improvements in stereo sound and closed captioning and better receivers for example but compared
More informationIntroduction to Video Compression Techniques. Slides courtesy of Tay Vaughan Making Multimedia Work
Introduction to Video Compression Techniques Slides courtesy of Tay Vaughan Making Multimedia Work Agenda Video Compression Overview Motivation for creating standards What do the standards specify Brief
More informationVIDEO 101: INTRODUCTION:
W h i t e P a p e r VIDEO 101: INTRODUCTION: Understanding how the PC can be used to receive TV signals, record video and playback video content is a complicated process, and unfortunately most documentation
More informationTelevision History. Date / Place E. Nemer - 1
Television History Television to see from a distance Earlier Selenium photosensitive cells were used for converting light from pictures into electrical signals Real breakthrough invention of CRT AT&T Bell
More informationLecture 2 Video Formation and Representation
Wen-Hsiao Peng, Ph.D Multimedia Architecture and Processing Laboratory (MAPL) Department of Computer Science, National Chiao Tung University February 2008 Wen-Hsiao Peng, Ph.D (NCTU CS) MAPL February 2008
More informationMan-Machine-Interface (Video) Nataliya Nadtoka coach: Jens Bialkowski
Seminar Digitale Signalverarbeitung in Multimedia-Geräten SS 2003 Man-Machine-Interface (Video) Computation Engineering Student Nataliya Nadtoka coach: Jens Bialkowski Outline 1. Processing Scheme 2. Human
More informationCh. 1: Audio/Image/Video Fundamentals Multimedia Systems. School of Electrical Engineering and Computer Science Oregon State University
Ch. 1: Audio/Image/Video Fundamentals Multimedia Systems Prof. Ben Lee School of Electrical Engineering and Computer Science Oregon State University Outline Computer Representation of Audio Quantization
More informationA video signal consists of a time sequence of images. Typical frame rates are 24, 25, 30, 50 and 60 images per seconds.
Video coding Concepts and notations. A video signal consists of a time sequence of images. Typical frame rates are 24, 25, 30, 50 and 60 images per seconds. Each image is either sent progressively (the
More informationSampling Issues in Image and Video
Sampling Issues in Image and Video Spring 06 Instructor: K. J. Ray Liu ECE Department, Univ. of Maryland, College Park Overview and Logistics Last Time: Motion analysis Geometric relations and manipulations
More informationMotion Video Compression
7 Motion Video Compression 7.1 Motion video Motion video contains massive amounts of redundant information. This is because each image has redundant information and also because there are very few changes
More informationMultimedia. Course Code (Fall 2017) Fundamental Concepts in Video
Course Code 005636 (Fall 2017) Multimedia Fundamental Concepts in Video Prof. S. M. Riazul Islam, Dept. of Computer Engineering, Sejong University, Korea E-mail: riaz@sejong.ac.kr Outline Types of Video
More informationPresented by: Amany Mohamed Yara Naguib May Mohamed Sara Mahmoud Maha Ali. Supervised by: Dr.Mohamed Abd El Ghany
Presented by: Amany Mohamed Yara Naguib May Mohamed Sara Mahmoud Maha Ali Supervised by: Dr.Mohamed Abd El Ghany Analogue Terrestrial TV. No satellite Transmission Digital Satellite TV. Uses satellite
More informationModule 1: Digital Video Signal Processing Lecture 3: Characterisation of Video raster, Parameters of Analog TV systems, Signal bandwidth
The Lecture Contains: Analog Video Raster Interlaced Scan Characterization of a video Raster Analog Color TV systems Signal Bandwidth Digital Video Parameters of a digital video Pixel Aspect Ratio file:///d
More information1. Broadcast television
VIDEO REPRESNTATION 1. Broadcast television A color picture/image is produced from three primary colors red, green and blue (RGB). The screen of the picture tube is coated with a set of three different
More informationMPEG has been established as an international standard
1100 IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. 9, NO. 7, OCTOBER 1999 Fast Extraction of Spatially Reduced Image Sequences from MPEG-2 Compressed Video Junehwa Song, Member,
More informationH.261: A Standard for VideoConferencing Applications. Nimrod Peleg Update: Nov. 2003
H.261: A Standard for VideoConferencing Applications Nimrod Peleg Update: Nov. 2003 ITU - Rec. H.261 Target (1990)... A Video compression standard developed to facilitate videoconferencing (and videophone)
More informationEECS150 - Digital Design Lecture 12 Project Description, Part 2
EECS150 - Digital Design Lecture 12 Project Description, Part 2 February 27, 2003 John Wawrzynek/Sandro Pintz Spring 2003 EECS150 lec12-proj2 Page 1 Linux Command Server network VidFX Video Effects Processor
More information5.1 Types of Video Signals. Chapter 5 Fundamental Concepts in Video. Component video
Chapter 5 Fundamental Concepts in Video 5.1 Types of Video Signals 5.2 Analog Video 5.3 Digital Video 5.4 Further Exploration 1 Li & Drew c Prentice Hall 2003 5.1 Types of Video Signals Component video
More information!"#"$%& Some slides taken shamelessly from Prof. Yao Wang s lecture slides
http://ekclothing.com/blog/wp-content/uploads/2010/02/spring-colors.jpg Some slides taken shamelessly from Prof. Yao Wang s lecture slides $& Definition of An Image! Think an image as a function, f! f
More informationCOMP 9519: Tutorial 1
COMP 9519: Tutorial 1 1. An RGB image is converted to YUV 4:2:2 format. The YUV 4:2:2 version of the image is of lower quality than the RGB version of the image. Is this statement TRUE or FALSE? Give reasons
More informationELEG5502 Video Coding Technology
ELEG5502 Video Coding Technology Ngan King Ngi 顏慶義 Room 309, Ho Sin Hang Engineering Building Department of Electronic Engineering, CUHK Email: knngan@ee.cuhk.edu.hk Objectives After completing this course,
More informationRec. ITU-R BT RECOMMENDATION ITU-R BT PARAMETER VALUES FOR THE HDTV STANDARDS FOR PRODUCTION AND INTERNATIONAL PROGRAMME EXCHANGE
Rec. ITU-R BT.79-4 1 RECOMMENDATION ITU-R BT.79-4 PARAMETER VALUES FOR THE HDTV STANDARDS FOR PRODUCTION AND INTERNATIONAL PROGRAMME EXCHANGE (Question ITU-R 27/11) (199-1994-1995-1998-2) Rec. ITU-R BT.79-4
More informationSERIES H: AUDIOVISUAL AND MULTIMEDIA SYSTEMS Infrastructure of audiovisual services Coding of moving video
International Telecommunication Union ITU-T H.272 TELECOMMUNICATION STANDARDIZATION SECTOR OF ITU (01/2007) SERIES H: AUDIOVISUAL AND MULTIMEDIA SYSTEMS Infrastructure of audiovisual services Coding of
More informationThe H.26L Video Coding Project
The H.26L Video Coding Project New ITU-T Q.6/SG16 (VCEG - Video Coding Experts Group) standardization activity for video compression August 1999: 1 st test model (TML-1) December 2001: 10 th test model
More informationDigital Media. Daniel Fuller ITEC 2110
Digital Media Daniel Fuller ITEC 2110 Daily Question: Video How does interlaced scan display video? Email answer to DFullerDailyQuestion@gmail.com Subject Line: ITEC2110-26 Housekeeping Project 4 is assigned
More informationSHOT DETECTION METHOD FOR LOW BIT-RATE VIDEO CODING
SHOT DETECTION METHOD FOR LOW BIT-RATE VIDEO CODING J. Sastre*, G. Castelló, V. Naranjo Communications Department Polytechnic Univ. of Valencia Valencia, Spain email: Jorsasma@dcom.upv.es J.M. López, A.
More informationVIDEO Muhammad AminulAkbar
VIDEO Muhammad Aminul Akbar Analog Video Analog Video Up until last decade, most TV programs were sent and received as an analog signal Progressive scanning traces through a complete picture (a frame)
More informationCommunication Theory and Engineering
Communication Theory and Engineering Master's Degree in Electronic Engineering Sapienza University of Rome A.A. 2018-2019 Practice work 14 Image signals Example 1 Calculate the aspect ratio for an image
More informationPrinciples of Video Compression
Principles of Video Compression Topics today Introduction Temporal Redundancy Reduction Coding for Video Conferencing (H.261, H.263) (CSIT 410) 2 Introduction Reduce video bit rates while maintaining an
More informationChapter 6 & Chapter 7 Digital Video CS3570
Chapter 6 & Chapter 7 Digital Video CS3570 Video, Film, and Television Compared Movie : a story told with moving images and sound The word motion picture and movie are the same thing The word film seems
More informationVideo Transmission. Thomas Wiegand: Digital Image Communication Video Transmission 1. Transmission of Hybrid Coded Video. Channel Encoder.
Video Transmission Transmission of Hybrid Coded Video Error Control Channel Motion-compensated Video Coding Error Mitigation Scalable Approaches Intra Coding Distortion-Distortion Functions Feedback-based
More informationNAPIER. University School of Engineering. Advanced Communication Systems Module: SE Television Broadcast Signal.
NAPIER. University School of Engineering Television Broadcast Signal. luminance colour channel channel distance sound signal By Klaus Jørgensen Napier No. 04007824 Teacher Ian Mackenzie Abstract Klaus
More informationSo far. Chapter 4 Color spaces Chapter 3 image representations. Bitmap grayscale. 1/21/09 CSE 40373/60373: Multimedia Systems
So far. Chapter 4 Color spaces Chapter 3 image representations Bitmap grayscale page 1 8-bit color image Can show up to 256 colors Use color lookup table to map 256 of the 24-bit color (rather than choosing
More informationThe Development of a Synthetic Colour Test Image for Subjective and Objective Quality Assessment of Digital Codecs
2005 Asia-Pacific Conference on Communications, Perth, Western Australia, 3-5 October 2005. The Development of a Synthetic Colour Test Image for Subjective and Objective Quality Assessment of Digital Codecs
More informationVideo Compression. Representations. Multimedia Systems and Applications. Analog Video Representations. Digitizing. Digital Video Block Structure
Representations Multimedia Systems and Applications Video Compression Composite NTSC - 6MHz (4.2MHz video), 29.97 frames/second PAL - 6-8MHz (4.2-6MHz video), 50 frames/second Component Separation video
More informationHardcopy. Prerequisites. An understanding of the nature of color and visual communication, and an appreciation of what makes an effective image.
Hardcopy Prerequisites An understanding of the nature of color and visual communication, and an appreciation of what makes an effective image. Introduction You have worked hard to analyze a problem and
More informationVisual Communication at Limited Colour Display Capability
Visual Communication at Limited Colour Display Capability Yan Lu, Wen Gao and Feng Wu Abstract: A novel scheme for visual communication by means of mobile devices with limited colour display capability
More informationRECOMMENDATION ITU-R BT.1201 * Extremely high resolution imagery
Rec. ITU-R BT.1201 1 RECOMMENDATION ITU-R BT.1201 * Extremely high resolution imagery (Question ITU-R 226/11) (1995) The ITU Radiocommunication Assembly, considering a) that extremely high resolution imagery
More informationA Big Umbrella. Content Creation: produce the media, compress it to a format that is portable/ deliverable
A Big Umbrella Content Creation: produce the media, compress it to a format that is portable/ deliverable Distribution: how the message arrives is often as important as what the message is Search: finding
More informationANTENNAS, WAVE PROPAGATION &TV ENGG. Lecture : TV working
ANTENNAS, WAVE PROPAGATION &TV ENGG Lecture : TV working Topics to be covered Television working How Television Works? A Simplified Viewpoint?? From Studio to Viewer Television content is developed in
More informationPart 1: Introduction to Computer Graphics
Part 1: Introduction to Computer Graphics 1. Define computer graphics? The branch of science and technology concerned with methods and techniques for converting data to or from visual presentation using
More informationMPEGTool: An X Window Based MPEG Encoder and Statistics Tool 1
MPEGTool: An X Window Based MPEG Encoder and Statistics Tool 1 Toshiyuki Urabe Hassan Afzal Grace Ho Pramod Pancha Magda El Zarki Department of Electrical Engineering University of Pennsylvania Philadelphia,
More informationINTERNATIONAL TELECOMMUNICATION UNION. SERIES H: AUDIOVISUAL AND MULTIMEDIA SYSTEMS Coding of moving video
INTERNATIONAL TELECOMMUNICATION UNION CCITT H.261 THE INTERNATIONAL TELEGRAPH AND TELEPHONE CONSULTATIVE COMMITTEE (11/1988) SERIES H: AUDIOVISUAL AND MULTIMEDIA SYSTEMS Coding of moving video CODEC FOR
More information06 Video. Multimedia Systems. Video Standards, Compression, Post Production
Multimedia Systems 06 Video Video Standards, Compression, Post Production Imran Ihsan Assistant Professor, Department of Computer Science Air University, Islamabad, Pakistan www.imranihsan.com Lectures
More informationContent storage architectures
Content storage architectures DAS: Directly Attached Store SAN: Storage Area Network allocates storage resources only to the computer it is attached to network storage provides a common pool of storage
More informationPAL uncompressed. 768x576 pixels per frame. 31 MB per second 1.85 GB per minute. x 3 bytes per pixel (24 bit colour) x 25 frames per second
191 192 PAL uncompressed 768x576 pixels per frame x 3 bytes per pixel (24 bit colour) x 25 frames per second 31 MB per second 1.85 GB per minute 191 192 NTSC uncompressed 640x480 pixels per frame x 3 bytes
More informationModule 3: Video Sampling Lecture 16: Sampling of video in two dimensions: Progressive vs Interlaced scans. The Lecture Contains:
The Lecture Contains: Sampling of Video Signals Choice of sampling rates Sampling a Video in Two Dimensions: Progressive vs. Interlaced Scans file:///d /...e%20(ganesh%20rana)/my%20course_ganesh%20rana/prof.%20sumana%20gupta/final%20dvsp/lecture16/16_1.htm[12/31/2015
More informationHDTV compression for storage and transmission over Internet
Proceedings of the 5th WSEAS Int. Conf. on DATA NETWORKS, COMMUNICATIONS & COMPUTERS, Bucharest, Romania, October 16-17, 26 57 HDTV compression for storage and transmission over Internet 1 JAIME LLORET
More informationContents. xv xxi xxiii xxiv. 1 Introduction 1 References 4
Contents List of figures List of tables Preface Acknowledgements xv xxi xxiii xxiv 1 Introduction 1 References 4 2 Digital video 5 2.1 Introduction 5 2.2 Analogue television 5 2.3 Interlace 7 2.4 Picture
More informationRECOMMENDATION ITU-R BT.1203 *
Rec. TU-R BT.1203 1 RECOMMENDATON TU-R BT.1203 * User requirements for generic bit-rate reduction coding of digital TV signals (, and ) for an end-to-end television system (1995) The TU Radiocommunication
More informationMPEG-2. Lecture Special Topics in Signal Processing. Multimedia Communications: Coding, Systems, and Networking
1-99 Special Topics in Signal Processing Multimedia Communications: Coding, Systems, and Networking Prof. Tsuhan Chen tsuhan@ece.cmu.edu Lecture 7 MPEG-2 1 Outline Applications and history Requirements
More informationElements of a Television System
1 Elements of a Television System 1 Elements of a Television System The fundamental aim of a television system is to extend the sense of sight beyond its natural limits, along with the sound associated
More informationThe H.263+ Video Coding Standard: Complexity and Performance
The H.263+ Video Coding Standard: Complexity and Performance Berna Erol (bernae@ee.ubc.ca), Michael Gallant (mikeg@ee.ubc.ca), Guy C t (guyc@ee.ubc.ca), and Faouzi Kossentini (faouzi@ee.ubc.ca) Department
More informationARTEFACTS. Dr Amal Punchihewa Distinguished Lecturer of IEEE Broadcast Technology Society
1 QoE and COMPRESSION ARTEFACTS Dr AMAL Punchihewa Director of Technology & Innovation, ABU Asia-Pacific Broadcasting Union A Vice-Chair of World Broadcasting Union Technical Committee (WBU-TC) Distinguished
More informationModule 3: Video Sampling Lecture 17: Sampling of raster scan pattern: BT.601 format, Color video signal sampling formats
The Lecture Contains: Sampling a Raster scan: BT 601 Format Revisited: Filtering Operation in Camera and display devices: Effect of Camera Apertures: file:///d /...e%20(ganesh%20rana)/my%20course_ganesh%20rana/prof.%20sumana%20gupta/final%20dvsp/lecture17/17_1.htm[12/31/2015
More informationMonitor and Display Adapters UNIT 4
Monitor and Display Adapters UNIT 4 TOPIC TO BE COVERED: 4.1: video Basics(CRT Parameters) 4.2: VGA monitors 4.3: Digital Display Technology- Thin Film Displays, Liquid Crystal Displays, Plasma Displays
More informationHigh Quality Digital Video Processing: Technology and Methods
High Quality Digital Video Processing: Technology and Methods IEEE Computer Society Invited Presentation Dr. Jorge E. Caviedes Principal Engineer Digital Home Group Intel Corporation LEGAL INFORMATION
More informationMahdi Amiri. April Sharif University of Technology
Course Presentation Multimedia Systems Video I (Basics of Analog and Digital Video) Mahdi Amiri April 2014 Sharif University of Technology Video Visual Effect of Motion The visual effect of motion is due
More informationVideo Signals and Circuits Part 2
Video Signals and Circuits Part 2 Bill Sheets K2MQJ Rudy Graf KA2CWL In the first part of this article the basic signal structure of a TV signal was discussed, and how a color video signal is structured.
More informationAnalog TV Systems: Monochrome TV. Yao Wang Polytechnic University, Brooklyn, NY11201
Analog TV Systems: Monochrome TV Yao Wang Polytechnic University, Brooklyn, NY11201 yao@vision.poly.edu Outline Overview of TV systems development Video representation by raster scan: Human vision system
More informationImages and Formats. Dave Bancroft. Philips Broadcast Film Imaging
1 Images and Formats Dave Bancroft Philips Broadcast Film Imaging 2 Objectives Survey what is happening with image representation as the broadcast television and movie industries converge Examine the impact
More informationWelcome Back to Fundamentals of Multimedia (MR412) Fall, ZHU Yongxin, Winson
Welcome Back to Fundamentals of Multimedia (MR412) Fall, 2012 ZHU Yongxin, Winson zhuyongxin@sjtu.edu.cn Shanghai Jiao Tong University Chapter 5 Fundamental Concepts in Video 5.1 Types of Video Signals
More informationIntra-frame JPEG-2000 vs. Inter-frame Compression Comparison: The benefits and trade-offs for very high quality, high resolution sequences
Intra-frame JPEG-2000 vs. Inter-frame Compression Comparison: The benefits and trade-offs for very high quality, high resolution sequences Michael Smith and John Villasenor For the past several decades,
More informationITU-T Video Coding Standards
An Overview of H.263 and H.263+ Thanks that Some slides come from Sharp Labs of America, Dr. Shawmin Lei January 1999 1 ITU-T Video Coding Standards H.261: for ISDN H.263: for PSTN (very low bit rate video)
More informationIn MPEG, two-dimensional spatial frequency analysis is performed using the Discrete Cosine Transform
MPEG Encoding Basics PEG I-frame encoding MPEG long GOP ncoding MPEG basics MPEG I-frame ncoding MPEG long GOP encoding MPEG asics MPEG I-frame encoding MPEG long OP encoding MPEG basics MPEG I-frame MPEG
More informationAgilent Technologies 54522A
Agilent Technologies 54522A Data Sheet Product Specifications General Specifications Maximum Sample Rate 54522A 2 GSa/s Number of Channels (all are simultaneous acquisition) 54522A: 2 Record Length 32,768
More informationVideo Over Mobile Networks
Video Over Mobile Networks Professor Mohammed Ghanbari Department of Electronic systems Engineering University of Essex United Kingdom June 2005, Zadar, Croatia (Slides prepared by M. Mahdi Ghandi) INTRODUCTION
More informationVideo Coding IPR Issues
Video Coding IPR Issues Developing China s standard for HDTV and HD-DVD Cliff Reader, Ph.D. www.reader.com Agenda Which technology is patented? What is the value of the patents? Licensing status today.
More informationEssence of Image and Video
1 Essence of Image and Video Wei-Ta Chu 2010/9/23 2 Essence of Image Wei-Ta Chu 2010/9/23 Chapters 2 and 6 of Digital Image Procesing by R.C. Gonzalez and R.E. Woods, Prentice Hall, 2 nd edition, 2001
More informationComputer and Machine Vision
Computer and Machine Vision Introduction to Continuous Camera Capture, Sampling, Encoding, Decoding and Transport January 22, 2014 Sam Siewert Video Camera Fundamentals Overview Introduction to Codecs
More informationAn Efficient Low Bit-Rate Video-Coding Algorithm Focusing on Moving Regions
1128 IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. 11, NO. 10, OCTOBER 2001 An Efficient Low Bit-Rate Video-Coding Algorithm Focusing on Moving Regions Kwok-Wai Wong, Kin-Man Lam,
More information