Improving Quality of Video Networking Mohammad Ghanbari LFIEEE School of Computer Science and Electronic Engineering University of Essex, UK https://www.essex.ac.uk/people/ghanb44808/mohammed-ghanbari December 17-19, 2018
Improving video networking quality Improving Video Compression Techniques Improving Channel Rate Allocation Improving Video Resolution Improving Video Generation and Display tools
Standard codecs ITU-T Standard H.261 (Version 1) H.261 (Version 2) H.263 H.263+ H.263++ Joint ITU-T/MPEG Standards H.262/MPEG-2 H.264/MPEG-4 AVC H.264/SVC H.265/HEVC MPEG Standard MPEG-1 MPEG-4 (Version 1) MPEG-4 (Version 2) AV1 - VVC 1988 1990 1992 1994 1996 1998 2000 2002 2004 2006 2008 2010 2012 2014 2016 2018
Early video codecs H.261 (1989) Network: Circuit switch, Channel rate: 1-30 Telephone channels (64-2 Mbit/s) Video resolution: CIF (360 pixels x 288 lines x 30 Frame/s) H.263 (1993) Wireless (3G) Channel rate: 20 Kbit/s Video resolution: QSIF (180 pixels x 144 lines x 10 Frames/s) H.263+, H.263++: advanced versions with more error resiliency
MPEG-1 (1991) Media: Storage on CD Roms (680 Mbytes) Data rate: 1 Mbit/s Video resolution: SIF (320 pixels x 288 lines x 25 frames/s) MPEG-2/H.262 (1993) Network: Broadcast: Digital terrestrial (DTT), Satellite (DVBs), as well as ATM network Channel rate: 2-3 Mbit/s The first codec in digital video transmission Video resolution: SD (720 pixels x 576 lines x 25 frames/s) H.262-SVC: includes scalable coding (Temporal, Spatial, SNR) for Error resiliency over ATM networks
Advanced video coding H.264/AVC (2003) Network: All (4G, DTT, DVBs, IP) Data rate: 20 Kbit/s (QSIF video) to 3-5 Mbit/s for HD Video Resolution: QSIF (180 x 90 x 10) (1920x1080x25) Compression efficiency: twice better than MPEG-2/H.262 Replacing MPEG-2 in broadcast Replacing H.263 in Video over Wireless Highly error resilient H.264/SVC: scalable coding (temporal, Spatial, SNR) The main tool in video streaming today
New Generation of codecs H.265/HEVC (2013) Network: soon to replace H.264/AVC Data rate:2-30 Mbit/s Compression efficiency : 40% better than H.264/AVC Video resolution: HD to UHD (3960 x 2160 x50)= 4Kvideo AV1 (2016) Open source advanced video coding to replace H.265/HEVC 20% more efficient than H.265/HEVC VVC (2017) Versatile video coding Network: All kind, mainly for video streaming
A Typical Video Over IP For better quality of video over IP sufficient channel rate should be allocated
TCP-Friendly Rate Control (TFRC) Existing solutions, including the standard TCP-Friendly Rate Control (TFRC) equation-based congestion controller, are prone to fluctuations in their sending rate and may respond only when packet loss has already occurred. This is a major problem, because both fluctuations and packet loss affect the end-user s perception of the delivered video.
Use of Fuzzy for congestion control
Type-II = A series of Type-I
Fuzzy Type-I / TCP (TFRC)
FLC2/FLC1
FLC2/FLC1 (Quality)
Video Quality with Fuzzy-I Flow Control
Video Quality with Fuzzy-II Flow control
Evolving Digital Media: Need for High Bit Rates 1-24 Gbps 500 Mbps - 15.2 Gbps 250 Mbs - 6 Gbps 250 Mbps - 7.6 Gbps 200 Mbps - 3 Gbps 20 Mbps - 1.5 Gbps 5-25 Mbps More 8K 4K 2 SHD 4K 2K 2 2K HD 2 HDTV HDV UHDTV Stereo 4K (future) SHD (Quad HD) Digital Cinema Stereo HD HDTV Consumer HD
2160 4320 1080 Why More Resolution is Better? More resolution allows closer viewing of larger images Closer viewing of larger image increases viewing angle Increased viewing angle produces stronger emotional response UHDTV(8K) 7680 HDTV (2K) 1920 3.0 Picture Height 30º 3840 SHD (4K) 0.75 Picture Height 100º 60º 1.5 Picture Height
How to improve video quality further? So far we have improved video delivery through: More efficient video compression technique Better bandwidth allocation Higher picture resolution How can we improve it further? In fact efficient compression means, more video channels, OR better quality for the same number of channels Statistics indicate Higher resolution video only has 20% added value on satisfaction But look at the next pictures!
How does a normal TV in a stadium look like?
We like to see it like this! ( What is added value for this picture?)
Display parameters defining video quality Luminance Contrast Colour In CRT 0.1 < Lum <100 nits In LCD 0.001 < Lum < 1000 nits HSV But Colour remains the same as BT. 709 standard
Luminance range of CRT vs LCD
Scene of objects with various light intensity
Opto-Electric/Eletro-Optic Transfer functions in Normal TV At display: Electro- Optic Transfer Function: EOTF At the camera: Opto- Electric Transfer Function: OETF System Transfer Function= Opto-Optic Transfer Function= OOTF
Comparison between BT.709 /BT.2020
Human Visual Colour (HSV) Response IDEAL LCD CRT
Colour Gamut in BT.709 & BT 2020+HDR
Opto-Optical Transfer Function (OOTF) = Systems transfer function System transfer function for CRT OOTF SDR = OETF 709 EOTF 709 System transfer function for LCD OOTF SDR = OETF 709 EOTF 1880 System transfer function for HDR OOTF HDR = OETF PQ EOTF PQ
Perceptual Quantizer
Metadata
O/E Transfer functions Display mapping
Hybrid Log-Gamma (HLG)
Comparison between OETF of PQ/HLG
Dolby vision HDR ITU-R BT.2020 colour diagram 12 bit Perceptual Quantizer (PQ) Adaptive (frame by frame) metadata (can also be static) Is not free Applications: UHD-HDR on Blue-Ray & Streaming With 12 bits it can produce 10,000 nits, but in practice is about 4,000 nits Supporters: 4k-HDR manufacturers; LG, TCL, Vizio
Hybrid Logarithmic Gamma HDR Hybrid Logarithmic Gamma (HLG) quantizer ITU-BT 2020 Colour diagram 10 bit resolution BBC and NHK Joint work Compatible to SDR (EOTF is similar to SDR up to 100 nits) (note: new LCDs also use BT.2020 colour, specially UHD-TV) No metadata
Other standards HDR10 ITU-R BT.2020 10 bit colour PQ Fixed Metadata Supported by: Dell LG Samsung Sharp Sony و Vizio, Microsoft and Sony HDR10+ ITU-R BT.2020 Could be more than 10 bits PQ Metadata change fr/fr Supported by Samsung and Amazon (free)
Single Layer Directly Standard Dynamic Range = SL-HDR1 Also called advanced HDR It sends SDR + supplement Enhancement Information for HDR (supported by H.264 and H.265) Easy compatibility with SDR Also supported by ETSI in 2016 Supporters: STMicroelectronics, Philips, CableLabs & Technicolour research Centre (France)
Transmission of Quality Scalable HDR
Transmission of SL-HDR1
4K-HDR Trial via Satellite 10 bit 4k-video HOTBIRD (13 East) Frequency: 12015 MHz Horizontal polarization Symbol rate: 30000 DVB-S2, 8PSK, FEC 5/6 HEVC encoding at 30 Mbit/s 2 Samsung receivers with 1000 nits (HDR and SDR)
Added Value Expected satisfaction from one TV format to another? Black & White to Colour TV (High) SD to HD (medium) HD to UHD (medium) HD to HD-HDR is higher than HD to UHD HD to UHD-HDR (high)
Which HDR format? All 4 formats are under study by the standard groups Dolby vision: Will be most used in Blue-rays HDR10 HLG Most likely to be used in North America Most likely to be used in Europe and Asia SL-HDR1 Most likely to be used as format convertors
Images @ Sunset
The End