COMPLEXITY REDUCTION FOR HEVC INTRAFRAME LUMA MODE DECISION USING IMAGE STATISTICS AND NEURAL NETWORKS.
|
|
- Monica Robbins
- 6 years ago
- Views:
Transcription
1 COMPLEXITY REDUCTION FOR HEVC INTRAFRAME LUMA MODE DECISION USING IMAGE STATISTICS AND NEURAL NETWORKS. DILIP PRASANNA KUMAR UNDER GUIDANCE OF DR. RAO UNIVERSITY OF TEXAS AT ARLINGTON. DEPT. OF ELECTRICAL ENGINEERING
2 1. INTRODUCTION HEVC or the High Efficiency Video Coding standard is a new standard being developed as a joint project by ITU-T VCEG and ISO/IEC MPEG, working together in a partnership known as the Joint Collaborative Team on Video Coding (JCT-VC) [1]. It has been designed to address all existing applications of H.264/MPEG-4 AVC and to particularly focus on two key issues: increased video resolution and increased use of parallel processing architecture [2]. HEVC aims to achieve 50% compression over H.264 while maintaining a similar visual quality [2]. The compression is achieved at the cost of increased encoder complexity. It supports visually lossless compression and lossless compression, pictures from QVGA (320x240) to ultrahd (8k x 4k). It allows random access, fast channel switching, trick modes and also intra only coding modes. HEVC employs a traditional hybrid coding model employing temporal and spatial predictions, spatial transforms, quantization, entropy coding and in loop filtering. The block diagram for a typical HEVC encoder is shown in figure 1. Figure 1: HEVC encoder block diagram. [1]
3 Figure 2: HEVC decoder block diagram. [12] HEVC encoder is functionally similar to the older video coding standards such as H.264 and AVC. The notable differences are the new coding tree unit instead of the macroblock, new in loop filtering techniques and a single entropy coding method- Context Adaptive Binary Arithmetic Coding (CABAC). However, modifications have been made to almost all aspects of the encoder and these differences contribute to the increased compression achieved by HEVC [1]. 2. CODING TREE UNIT IN HEVC The significant change is the new coding tree unit instead of a macroblock. In principle, the quadtree coding structure in HEVC is described by means of blocks and units. A block defines an array of samples and sizes thereof whereas a unit encapsulates one luma and corresponding chroma blocks together with syntax needed to code these. Consequently, a Coding Tree Unit (CTU) includes coding tree blocks (CTB) and syntax specifying coding data and further subdivision. This subdivision results in coding unit (CU) leaves with coding blocks (CB). Each CU incorporates more entities for the purpose of prediction, so called prediction units (PU), and of transform, so called transform units (TU). Similarly, each CB is split into prediction blocks (PB) and transform blocks (TB) [3]. Figure 2 shows the coding units for a frame from the sequence Traffic.
4 Figure 3: Detail of 4kx2k sequence Traffic showing the coding block (white) and nested transform block (red) structure resulting from recursive quadtree structure. [3]. The coding units are traversed in a Z-scan order as shown in figure 4. The sizes of the luma CTB can be chosen as 16x16, 32x32 or 64x64 samples [2]. The larger sizes typically enable better compression [4]. Figure 4: HEVC Z-scan order for traversing the coding units. Figure adapted from the documentation accompanying the HM 8.0 source code [1][2].
5 3. INTRA PREDICTION IN HEVC FOR LUMA SAMPLES HEVC introduces 33 directional modes and a planar and a DC mode for intra prediction for luma samples [Fig 5]. The angles are intentionally designed to provide denser coverage for near-horizontal and near-vertical angles and coarser coverage for near-diagonal angles [1]. The angles are ± 0, ± 2, ± 5, ± 9, ± 17, ± 21, ± 26 and ± 32 in degrees, from the horizontal and vertical directions. In addition to this, HEVC supports two alternative prediction methods, planar and DC, to target regions which have strong directional edges. Figure 5: Luma modes for intra prediction in HEVC. Mode 0 is planar mode and Mode 1 is DC mode. [1] The prediction process of the Intra_Angular modes can involve extrapolating samples from the projected reference sample location according to a given directionality. To remove sample-by-sample switching between the reference row and column buffers, all extrapolations in a PB refer to a single reference row or column depending on the mode number [1]. The reference samples used for intra prediction are sometimes filtered by a 3 tap smoothing filter [1 2 1]/4 smoothing filter, in a manner similar to what was used for 8 8 intra prediction in H.264/MPEG-4 AVC. However, HEVC applies this smoothing operation more adaptively according to the directionality and the block size. As in H.264/MPEG-4 AVC [2], the smoothing filter is not applied for 4 4 blocks. For 8 8 blocks, only the diagonal directions 2, 18, or 34, use the reference sample smoothing. For blocks, the reference samples are filtered for most directions except the nearhorizontal and near-vertical directions, (directions in the range of 9 to 11 and 25 to 27). For blocks, all directions except the exactly-horizontal and exactly-vertical directions use the smoothing filter.
6 The Intra Planar mode also uses the smoothing filter when the block size is equal or greater than 8 8, and the smoothing is not used (or useful) for the Intra DC case. HEVC applies this smoothing operation adaptively according to the directionality and block size. [2]. Figure 6: Reference samples used with mode 29. [1]
7 4. PROBLEM STATEMNT Intra prediction in HEVC is incredibly complex because of the large number of possible modes. This is further complicated by the quad tree structure: the encoder must decide both the quad tree depth and the prediction direction for each coding unit. A brute force search for the best intra mode will consist of evaluating 735 modes per LCU 1. Figure 7: The recursive coding tree search employed by the HM encoder. [2]. Evaluating each mode consists of generating a prediction, subtracting the prediction from the original image and obtaining the residual. This is then used to compute the cost for rate distortion optimization. The reference software HM8.0 employs this brute force method, and it has been shown that in the all intra mode, a quarter of the total time is spent on rate-distortion optimization and an additional 16% for intra prediction [3]. The problem being considered is to evaluate a method to reduce the number of modes that need to be evaluated for each coding unit and generate data regarding its performance. It is hoped that similar attempts by other researchers will generate sufficient data so that the best method can eventually be determined by comparing such results of all proposed methods modes + ( 4 * (35 modes + (4 * 35 modes) ) = 735 modes
8 5. HYPOTHESIS The hypothesis is that the optimum coding unit size, and hence the quad tree depth, can be determined as a function of the variance of the pixel values within a coding unit and the correlation to the reference pixels. Also, the statistics of the most frequently used tree depth around the neighboring CUs can be helpful in determining the order in which the possible modes can be tested. Further, once the coding tree depth has been determined by analyzing the statistics of the image, the intra mode direction within each prediction unit can be viewed as classification based on image features. Thus an artificial neural network classifier can be trained to identify the most probable intra mode direction. [13] 6. PROPOSD WORK To verify the hypothesis, the following work is proposed: 1. Obtain a large set of sample pixels and corresponding intra mode decisions by modifying the HM 8.0 software [1][2], to log the relevant data and then compressing the test sequences using the modified encoder. 2. Develop a method to interpret the logged data to determine the image statistics. Use this to obtain the statistics for the data samples. 3. Search for a relation between the image statistics and the code tree depth. Specifically, determine if the variance within an image, and the correlation to the reference pixels can be used to obtain the quad tree depth. 4. Develop a MATLAB code to determine the quad tree depth using the developed method using variance and correlation and use it to determine quad tree depths with reference samples. Compare the results with the results of brute force search employed by HM Train a neural network to identify the most possible intra mode direction. Collect the training data required from the modified HM 8.0 encoder. 6. Develop a MATLAB code to use the neural network to identify the intra mode for reference samples. Compare these with the results of HM 8.0 encoder. 7. Study the implementation complexity and verify that the proposed method is less complex than the brute force method. Also, compare the results with other complexity reduction techniques [6][7][8]. 8. Implement the above model in HM 8.0 and measure the gain in encoding time. Also, measure the increase in BD-bitrate and BD-PSNR [15][16][17]. Compare the results with the results achieved by other techniques [6][7][8]. 9. Use the data to conclude if the proposed solution is a feasible solution to the complexity of the HEVC encoder. Determine the limitations and possible improvements to the proposed solution.
9 REFERENCES 1. B. Bross, W. J. Han, J. R Ohm and T Wiegand, High efficiency video coding (HEVC) text specification draft 8, ITU-T/ISO/IEC Joint Collaborative Team on Video Coding (JCT- VC) document JCTVC-J1003, July G. J. Sullivan, J.-R. Ohm, W.-J. Han, and T. Wiegand, "Overview of the high efficiency video coding (HEVC) Standard," IEEE Transactions on Circuits and Systems for Video Technology, vol 22, pp., December F. Bossen, B. Bross, K. Sühring, and D. Flynn, "HEVC Complexity and Implementation analysis," IEEE Transactions on Circuits and Systems for Video Technology, vol 22, pp., December G. J. Sullivan and R.L Baker Efficient quadtree coding of images and video, IEEE Transactions on Image Processing, vol 3. No 3. pp , Jan Y. Tan, C. Yeo, H. Tan, and Z. Li, On residual quad-tree coding in HEVC" in IEEE International Workshop on Multimedia Signal Processing (MMSP), pp. 1 4, October S.-W. Teng, H.-M. Hang, and Y.-F. Chen, Fast mode decision algorithm for residual quadtree coding in HEVC" in The Visual Communications and Image Processing (VCIP) Conference, pp. 1-4, November K. Choi and E. Jang, Fast coding unit decision method based on coding tree pruning for high effciency video coding," Opt. Eng.0001; 51(3) : doi: / 1.OE , March L. Zhao, L. Zhang, S. Ma, and D. Zhao, Fast mode decision algorithm for intra prediction in HEVC" in The Visual Communications and Image Processing (VCIP) Conference, pp. 1-4, November W. Jiang, H. Ma, and Y. Chen, Gradient based fast mode decision algorithm for intra prediction in HEVC," in International Conference on Consumer Electronics, Communications and Networks (CECNet), pp , April X. Shen, L. Yu, and J. Chen, Fast coding unit size selection for hevc based on Bayesian decision rule" in Picture Coding Symposium (PCS), pp , May G. Tian and S. Goto, Content based hierarchical fast coding unit decision algorithm for HEVC" in Picture Coding Symposium (PCS), vol 1, pp , May C. Fogg, Suggested figures for the HEVC specification, ITU-T/ISO/IEC Joint Collaborative Team on Video Coding (JCT-VC) document JCTVC- J0292r1, July C. H Lampert, Machine Learning for Video Compression: Macroblock Mode Decision, in 18 th International Conference on Pattern Recognition, 2006 (ICPR 2006). Vol 1, pp Dr. Gary J. Sullivan, HEVC: The Next Generation in Video Compression, Keynote speech at VCIP 2012, Nov 29th 2012.
10 15. G. Bjontegaard, Calculation of average PSNR differences between RD-Curves, ITU-T SG16, Doc. VCEG-M33, 13th VCEG meeting, Austin, TX, April G. Bjontegaard, Improvements of the BD-PSNR model, ITU-T SG16 Q.6, Doc. VCEG- AI11, Berlin, Germany, July K. Anderson, R. Sjobetg and A. Norkin, BD measurements based on MOS, (online), ITU- T Q6/SG16, document VCEG-AL23, Geneva, Switzerland, July Available at J. Lainema et al, Intra coding of the HEVC standard, IEEE Trans. Circuits and Systems for Video Technology, vol 22, pp., Dec G. Correa et al, Performance and computational complexity assessment of high efficiency video encoders, IEEE Trans. Circuits and Systems for Video Technology, vol 22, pp.,dec M. Zhou et al, HEVC lossless coding and improvements, IEEE Trans. Circuits and Systems for Video Technology, vol. 22, pp., Dec 2012.
International Journal for Research in Applied Science & Engineering Technology (IJRASET) Motion Compensation Techniques Adopted In HEVC
Motion Compensation Techniques Adopted In HEVC S.Mahesh 1, K.Balavani 2 M.Tech student in Bapatla Engineering College, Bapatla, Andahra Pradesh Assistant professor in Bapatla Engineering College, Bapatla,
More informationProject Proposal Time Optimization of HEVC Encoder over X86 Processors using SIMD. Spring 2013 Multimedia Processing EE5359
Project Proposal Time Optimization of HEVC Encoder over X86 Processors using SIMD Spring 2013 Multimedia Processing Advisor: Dr. K. R. Rao Department of Electrical Engineering University of Texas, Arlington
More informationInterim Report Time Optimization of HEVC Encoder over X86 Processors using SIMD. Spring 2013 Multimedia Processing EE5359
Interim Report Time Optimization of HEVC Encoder over X86 Processors using SIMD Spring 2013 Multimedia Processing Advisor: Dr. K. R. Rao Department of Electrical Engineering University of Texas, Arlington
More informationMauricio Álvarez-Mesa ; Chi Ching Chi ; Ben Juurlink ; Valeri George ; Thomas Schierl Parallel video decoding in the emerging HEVC standard
Mauricio Álvarez-Mesa ; Chi Ching Chi ; Ben Juurlink ; Valeri George ; Thomas Schierl Parallel video decoding in the emerging HEVC standard Conference object, Postprint version This version is available
More informationHEVC Subjective Video Quality Test Results
HEVC Subjective Video Quality Test Results T. K. Tan M. Mrak R. Weerakkody N. Ramzan V. Baroncini G. J. Sullivan J.-R. Ohm K. D. McCann NTT DOCOMO, Japan BBC, UK BBC, UK University of West of Scotland,
More informationChapter 2 Introduction to
Chapter 2 Introduction to H.264/AVC H.264/AVC [1] is the newest video coding standard of the ITU-T Video Coding Experts Group (VCEG) and the ISO/IEC Moving Picture Experts Group (MPEG). The main improvements
More informationConference object, Postprint version This version is available at
Benjamin Bross, Valeri George, Mauricio Alvarez-Mesay, Tobias Mayer, Chi Ching Chi, Jens Brandenburg, Thomas Schierl, Detlev Marpe, Ben Juurlink HEVC performance and complexity for K video Conference object,
More informationSignal Processing: Image Communication
Signal Processing: Image Communication 29 (2014) 935 944 Contents lists available at ScienceDirect Signal Processing: Image Communication journal homepage: www.elsevier.com/locate/image Fast intra-encoding
More informationTHE High Efficiency Video Coding (HEVC) standard is
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. 22, NO. 12, DECEMBER 2012 1649 Overview of the High Efficiency Video Coding (HEVC) Standard Gary J. Sullivan, Fellow, IEEE, Jens-Rainer
More informationMULTI-CORE SOFTWARE ARCHITECTURE FOR THE SCALABLE HEVC DECODER. Wassim Hamidouche, Mickael Raulet and Olivier Déforges
2014 IEEE International Conference on Acoustic, Speech and Signal Processing (ICASSP) MULTI-CORE SOFTWARE ARCHITECTURE FOR THE SCALABLE HEVC DECODER Wassim Hamidouche, Mickael Raulet and Olivier Déforges
More informationModule 8 VIDEO CODING STANDARDS. Version 2 ECE IIT, Kharagpur
Module 8 VIDEO CODING STANDARDS Lesson 27 H.264 standard Lesson Objectives At the end of this lesson, the students should be able to: 1. State the broad objectives of the H.264 standard. 2. List the improved
More informationFinal Report Time Optimization of HEVC Encoder over X86 Processors using SIMD. Spring 2013 Multimedia Processing EE5359
Final Report Time Optimization of HEVC Encoder over X86 Processors using SIMD Spring 2013 Multimedia Processing Advisor: Dr. K. R. Rao Department of Electrical Engineering University of Texas, Arlington
More informationWITH the rapid development of high-fidelity video services
896 IEEE SIGNAL PROCESSING LETTERS, VOL. 22, NO. 7, JULY 2015 An Efficient Frame-Content Based Intra Frame Rate Control for High Efficiency Video Coding Miaohui Wang, Student Member, IEEE, KingNgiNgan,
More informationProject Interim Report
Project Interim Report Coding Efficiency and Computational Complexity of Video Coding Standards-Including High Efficiency Video Coding (HEVC) Spring 2014 Multimedia Processing EE 5359 Advisor: Dr. K. R.
More informationFAST SPATIAL AND TEMPORAL CORRELATION-BASED REFERENCE PICTURE SELECTION
FAST SPATIAL AND TEMPORAL CORRELATION-BASED REFERENCE PICTURE SELECTION 1 YONGTAE KIM, 2 JAE-GON KIM, and 3 HAECHUL CHOI 1, 3 Hanbat National University, Department of Multimedia Engineering 2 Korea Aerospace
More informationAuthors: Glenn Van Wallendael, Sebastiaan Van Leuven, Jan De Cock, Peter Lambert, Joeri Barbarien, Adrian Munteanu, and Rik Van de Walle
biblio.ugent.be The UGent Institutional Repository is the electronic archiving and dissemination platform for all UGent research publications. Ghent University has implemented a mandate stipulating that
More informationQuarter-Pixel Accuracy Motion Estimation (ME) - A Novel ME Technique in HEVC
International Transaction of Electrical and Computer Engineers System, 2014, Vol. 2, No. 3, 107-113 Available online at http://pubs.sciepub.com/iteces/2/3/5 Science and Education Publishing DOI:10.12691/iteces-2-3-5
More informationOverview: Video Coding Standards
Overview: Video Coding Standards Video coding standards: applications and common structure ITU-T Rec. H.261 ISO/IEC MPEG-1 ISO/IEC MPEG-2 State-of-the-art: H.264/AVC Video Coding Standards no. 1 Applications
More informationA parallel HEVC encoder scheme based on Multi-core platform Shu Jun1,2,3,a, Hu Dong1,2,3,b
4th National Conference on Electrical, Electronics and Computer Engineering (NCEECE 2015) A parallel HEVC encoder scheme based on Multi-core platform Shu Jun1,2,3,a, Hu Dong1,2,3,b 1 Education Ministry
More informationTHE TWO prominent international organizations specifying
1792 IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. 22, NO. 12, DECEMBER 2012 Intra Coding of the HEVC Standard Jani Lainema, Frank Bossen, Member, IEEE, Woo-Jin Han, Member, IEEE,
More informationStandardized Extensions of High Efficiency Video Coding (HEVC)
MITSUBISHI ELECTRIC RESEARCH LABORATORIES http://www.merl.com Standardized Extensions of High Efficiency Video Coding (HEVC) Sullivan, G.J.; Boyce, J.M.; Chen, Y.; Ohm, J-R.; Segall, C.A.: Vetro, A. TR2013-105
More informationIMAGE SEGMENTATION APPROACH FOR REALIZING ZOOMABLE STREAMING HEVC VIDEO ZARNA PATEL. Presented to the Faculty of the Graduate School of
IMAGE SEGMENTATION APPROACH FOR REALIZING ZOOMABLE STREAMING HEVC VIDEO by ZARNA PATEL Presented to the Faculty of the Graduate School of The University of Texas at Arlington in Partial Fulfillment of
More informationSelective Intra Prediction Mode Decision for H.264/AVC Encoders
Selective Intra Prediction Mode Decision for H.264/AVC Encoders Jun Sung Park, and Hyo Jung Song Abstract H.264/AVC offers a considerably higher improvement in coding efficiency compared to other compression
More informationAnalysis of the Intra Predictions in H.265/HEVC
Applied Mathematical Sciences, vol. 8, 2014, no. 148, 7389-7408 HIKARI Ltd, www.m-hikari.com http://dx.doi.org/10.12988/ams.2014.49750 Analysis of the Intra Predictions in H.265/HEVC Roman I. Chernyak
More informationNO-REFERENCE QUALITY ASSESSMENT OF HEVC VIDEOS IN LOSS-PRONE NETWORKS. Mohammed A. Aabed and Ghassan AlRegib
214 IEEE International Conference on Acoustic, Speech and Signal Processing (ICASSP) NO-REFERENCE QUALITY ASSESSMENT OF HEVC VIDEOS IN LOSS-PRONE NETWORKS Mohammed A. Aabed and Ghassan AlRegib School of
More informationA video signal consists of a time sequence of images. Typical frame rates are 24, 25, 30, 50 and 60 images per seconds.
Video coding Concepts and notations. A video signal consists of a time sequence of images. Typical frame rates are 24, 25, 30, 50 and 60 images per seconds. Each image is either sent progressively (the
More informationFast Mode Decision Algorithm for Intra prediction in H.264/AVC Video Coding
356 IJCSNS International Journal of Computer Science and Network Security, VOL.7 No.1, January 27 Fast Mode Decision Algorithm for Intra prediction in H.264/AVC Video Coding Abderrahmane Elyousfi 12, Ahmed
More informationProject Proposal: Sub pixel motion estimation for side information generation in Wyner- Ziv decoder.
EE 5359 MULTIMEDIA PROCESSING Subrahmanya Maira Venkatrav 1000615952 Project Proposal: Sub pixel motion estimation for side information generation in Wyner- Ziv decoder. Wyner-Ziv(WZ) encoder is a low
More informationImage Segmentation Approach for Realizing Zoomable Streaming HEVC Video
Thesis Proposal Image Segmentation Approach for Realizing Zoomable Streaming HEVC Video Under the guidance of DR. K. R. RAO DEPARTMENT OF ELECTRICAL ENGINEERING UNIVERSITY OF TEXAS AT ARLINGTON Submitted
More informationWHITE PAPER. Perspectives and Challenges for HEVC Encoding Solutions. Xavier DUCLOUX, December >>
Perspectives and Challenges for HEVC Encoding Solutions Xavier DUCLOUX, December 2013 >> www.thomson-networks.com 1. INTRODUCTION... 3 2. HEVC STATUS... 3 2.1 HEVC STANDARDIZATION... 3 2.2 HEVC TOOL-BOX...
More informationError concealment techniques in H.264 video transmission over wireless networks
Error concealment techniques in H.264 video transmission over wireless networks M U L T I M E D I A P R O C E S S I N G ( E E 5 3 5 9 ) S P R I N G 2 0 1 1 D R. K. R. R A O F I N A L R E P O R T Murtaza
More informationHEVC Real-time Decoding
HEVC Real-time Decoding Benjamin Bross a, Mauricio Alvarez-Mesa a,b, Valeri George a, Chi-Ching Chi a,b, Tobias Mayer a, Ben Juurlink b, and Thomas Schierl a a Image Processing Department, Fraunhofer Institute
More informationComparative Study of JPEG2000 and H.264/AVC FRExt I Frame Coding on High-Definition Video Sequences
Comparative Study of and H.264/AVC FRExt I Frame Coding on High-Definition Video Sequences Pankaj Topiwala 1 FastVDO, LLC, Columbia, MD 210 ABSTRACT This paper reports the rate-distortion performance comparison
More informationFast MBAFF/PAFF Motion Estimation and Mode Decision Scheme for H.264
Fast MBAFF/PAFF Motion Estimation and Mode Decision Scheme for H.264 Ju-Heon Seo, Sang-Mi Kim, Jong-Ki Han, Nonmember Abstract-- In the H.264, MBAFF (Macroblock adaptive frame/field) and PAFF (Picture
More informationThe H.26L Video Coding Project
The H.26L Video Coding Project New ITU-T Q.6/SG16 (VCEG - Video Coding Experts Group) standardization activity for video compression August 1999: 1 st test model (TML-1) December 2001: 10 th test model
More informationVersatile Video Coding The Next-Generation Video Standard of the Joint Video Experts Team
Versatile Video Coding The Next-Generation Video Standard of the Joint Video Experts Team Mile High Video Workshop, Denver July 31, 2018 Gary J. Sullivan, JVET co-chair Acknowledgement: Presentation prepared
More informationSubband Decomposition for High-Resolution Color in HEVC and AVC 4:2:0 Video Coding Systems
Microsoft Research Tech Report MSR-TR-2014-31 Subband Decomposition for High-Resolution Color in HEVC and AVC 4:2:0 Video Coding Systems Srinath Reddy, Sandeep Kanumuri, Yongjun Wu, Shyam Sadhwani, Gary
More informationVisual Communication at Limited Colour Display Capability
Visual Communication at Limited Colour Display Capability Yan Lu, Wen Gao and Feng Wu Abstract: A novel scheme for visual communication by means of mobile devices with limited colour display capability
More informationHIGH Efficiency Video Coding (HEVC) version 1 was
1 An HEVC-based Screen Content Coding Scheme Bin Li and Jizheng Xu Abstract This document presents an efficient screen content coding scheme based on HEVC framework. The major techniques in the scheme
More informationan organization for standardization in the
International Standardization of Next Generation Video Coding Scheme Realizing High-quality, High-efficiency Video Transmission and Outline of Technologies Proposed by NTT DOCOMO Video Transmission Video
More informationEfficient encoding and delivery of personalized views extracted from panoramic video content
Efficient encoding and delivery of personalized views extracted from panoramic video content Pieter Duchi Supervisors: Prof. dr. Peter Lambert, Dr. ir. Glenn Van Wallendael Counsellors: Ir. Johan De Praeter,
More informationA Novel Macroblock-Level Filtering Upsampling Architecture for H.264/AVC Scalable Extension
05-Silva-AF:05-Silva-AF 8/19/11 6:18 AM Page 43 A Novel Macroblock-Level Filtering Upsampling Architecture for H.264/AVC Scalable Extension T. L. da Silva 1, L. A. S. Cruz 2, and L. V. Agostini 3 1 Telecommunications
More informationERROR CONCEALMENT TECHNIQUES IN H.264 VIDEO TRANSMISSION OVER WIRELESS NETWORKS
Multimedia Processing Term project on ERROR CONCEALMENT TECHNIQUES IN H.264 VIDEO TRANSMISSION OVER WIRELESS NETWORKS Interim Report Spring 2016 Under Dr. K. R. Rao by Moiz Mustafa Zaveri (1001115920)
More informationHighly Efficient Video Codec for Entertainment-Quality
Highly Efficient Video Codec for Entertainment-Quality Seyoon Jeong, Sung-Chang Lim, Hahyun Lee, Jongho Kim, Jin Soo Choi, and Haechul Choi We present a novel video codec for supporting entertainment-quality
More informationarxiv: v2 [cs.mm] 17 Jan 2018
Predicting Chroma from Luma in AV1 arxiv:1711.03951v2 [cs.mm] 17 Jan 2018 Luc N. Trudeau, Nathan E. Egge, and David Barr Mozilla Xiph.Org Foundation 331 E Evelyn Ave 21 College Hill Road Mountain View,
More informationTunneling High-Resolution Color Content through 4:2:0 HEVC and AVC Video Coding Systems
Tunneling High-Resolution Color Content through :2:0 HEVC and AVC Video Coding Systems Yongjun Wu, Sandeep Kanumuri, Yifu Zhang, Shyam Sadhwani, Gary J. Sullivan, and Henrique S. Malvar Microsoft Corporation
More informationThe H.263+ Video Coding Standard: Complexity and Performance
The H.263+ Video Coding Standard: Complexity and Performance Berna Erol (bernae@ee.ubc.ca), Michael Gallant (mikeg@ee.ubc.ca), Guy C t (guyc@ee.ubc.ca), and Faouzi Kossentini (faouzi@ee.ubc.ca) Department
More informationA High Performance VLSI Architecture with Half Pel and Quarter Pel Interpolation for A Single Frame
I J C T A, 9(34) 2016, pp. 673-680 International Science Press A High Performance VLSI Architecture with Half Pel and Quarter Pel Interpolation for A Single Frame K. Priyadarshini 1 and D. Jackuline Moni
More informationSCALABLE video coding (SVC) is currently being developed
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. 16, NO. 7, JULY 2006 889 Fast Mode Decision Algorithm for Inter-Frame Coding in Fully Scalable Video Coding He Li, Z. G. Li, Senior
More informationA Low Energy HEVC Inverse Transform Hardware
754 IEEE Transactions on Consumer Electronics, Vol. 60, No. 4, November 2014 A Low Energy HEVC Inverse Transform Hardware Ercan Kalali, Erdem Ozcan, Ozgun Mert Yalcinkaya, Ilker Hamzaoglu, Senior Member,
More informationReal-time SHVC Software Decoding with Multi-threaded Parallel Processing
Real-time SHVC Software Decoding with Multi-threaded Parallel Processing Srinivas Gudumasu a, Yuwen He b, Yan Ye b, Yong He b, Eun-Seok Ryu c, Jie Dong b, Xiaoyu Xiu b a Aricent Technologies, Okkiyam Thuraipakkam,
More informationFast Simultaneous Video Encoder for Adaptive Streaming
Fast Simultaneous Video Encoder for Adaptive Streaming Johan De Praeter #1, Antonio Jesús Díaz-Honrubia 2, Niels Van Kets 1 Glenn Van Wallendael 1, Jan De Cock 1, Peter Lambert 1, Rik Van de Walle 1 1
More informationISSN Vol.06,Issue.22 June-2017, Pages:
ISSN 2319-8885 Vol.06,Issue.22 June-2017, Pages:4291-4296 www.ijsetr.com High-Throughput Power-Efficient VLSI Architecture of Fractional Motion Estimation for Ultra-HD HEVC Video Encoding VANAM BABU RAO
More informationROBUST ADAPTIVE INTRA REFRESH FOR MULTIVIEW VIDEO
ROBUST ADAPTIVE INTRA REFRESH FOR MULTIVIEW VIDEO Sagir Lawan1 and Abdul H. Sadka2 1and 2 Department of Electronic and Computer Engineering, Brunel University, London, UK ABSTRACT Transmission error propagation
More informationVariable Block-Size Transforms for H.264/AVC
604 IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. 13, NO. 7, JULY 2003 Variable Block-Size Transforms for H.264/AVC Mathias Wien, Member, IEEE Abstract A concept for variable block-size
More informationPERCEPTUAL QUALITY OF H.264/AVC DEBLOCKING FILTER
PERCEPTUAL QUALITY OF H./AVC DEBLOCKING FILTER Y. Zhong, I. Richardson, A. Miller and Y. Zhao School of Enginnering, The Robert Gordon University, Schoolhill, Aberdeen, AB1 1FR, UK Phone: + 1, Fax: + 1,
More informationUniversity of Bristol - Explore Bristol Research. Peer reviewed version. Link to published version (if available): /ICASSP.2016.
Hosking, B., Agrafiotis, D., Bull, D., & Easton, N. (2016). An adaptive resolution rate control method for intra coding in HEVC. In 2016 IEEE International Conference on Acoustics, Speech and Signal Processing
More informationCODING EFFICIENCY IMPROVEMENT FOR SVC BROADCAST IN THE CONTEXT OF THE EMERGING DVB STANDARDIZATION
17th European Signal Processing Conference (EUSIPCO 2009) Glasgow, Scotland, August 24-28, 2009 CODING EFFICIENCY IMPROVEMENT FOR SVC BROADCAST IN THE CONTEXT OF THE EMERGING DVB STANDARDIZATION Heiko
More informationResearch Topic. Error Concealment Techniques in H.264/AVC for Wireless Video Transmission in Mobile Networks
Research Topic Error Concealment Techniques in H.264/AVC for Wireless Video Transmission in Mobile Networks July 22 nd 2008 Vineeth Shetty Kolkeri EE Graduate,UTA 1 Outline 2. Introduction 3. Error control
More informationAdvanced Video Processing for Future Multimedia Communication Systems
Advanced Video Processing for Future Multimedia Communication Systems André Kaup Friedrich-Alexander University Erlangen-Nürnberg Future Multimedia Communication Systems Trend in video to make communication
More informationParallel SHVC decoder: Implementation and analysis
Parallel SHVC decoder: Implementation and analysis Wassim Hamidouche, Mickaël Raulet, Olivier Deforges To cite this version: Wassim Hamidouche, Mickaël Raulet, Olivier Deforges. Parallel SHVC decoder:
More informationMULTI-STATE VIDEO CODING WITH SIDE INFORMATION. Sila Ekmekci Flierl, Thomas Sikora
MULTI-STATE VIDEO CODING WITH SIDE INFORMATION Sila Ekmekci Flierl, Thomas Sikora Technical University Berlin Institute for Telecommunications D-10587 Berlin / Germany ABSTRACT Multi-State Video Coding
More informationAn Efficient Low Bit-Rate Video-Coding Algorithm Focusing on Moving Regions
1128 IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. 11, NO. 10, OCTOBER 2001 An Efficient Low Bit-Rate Video-Coding Algorithm Focusing on Moving Regions Kwok-Wai Wong, Kin-Man Lam,
More informationConstant Bit Rate for Video Streaming Over Packet Switching Networks
International OPEN ACCESS Journal Of Modern Engineering Research (IJMER) Constant Bit Rate for Video Streaming Over Packet Switching Networks Mr. S. P.V Subba rao 1, Y. Renuka Devi 2 Associate professor
More informationOverview of the Emerging HEVC Screen Content Coding Extension
MITSUBISHI ELECTRIC RESEARCH LABORATORIES http://www.merl.com Overview of the Emerging HEVC Screen Content Coding Extension Xu, J.; Joshi, R.; Cohen, R.A. TR25-26 September 25 Abstract A Screen Content
More informationAdvanced Screen Content Coding Using Color Table and Index Map
1 Advanced Screen Content Coding Using Color Table and Index Map Zhan Ma, Wei Wang, Meng Xu, Haoping Yu Abstract This paper presents an advanced screen content coding solution using Color Table and Index
More informationH.265/HEVC decoder optimization
H.265/HEVC decoder optimization Submitted by Antonios Kalkanof Advisor Prof. Ioannis Katsavounidis University of Thessaly Volos, Greece February 2014 1 Acknowledgements I am grateful to my family and friends
More informationTHE NEWEST international video coding standard is
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. 15, NO. 7, JULY 2005 813 Fast Mode Decision Algorithm for Intraprediction in H.264/AVC Video Coding Feng Pan, Xiao Lin, Susanto Rahardja,
More informationA High Performance Deblocking Filter Hardware for High Efficiency Video Coding
714 IEEE Transactions on Consumer Electronics, Vol. 59, No. 3, August 2013 A High Performance Deblocking Filter Hardware for High Efficiency Video Coding Erdem Ozcan, Yusuf Adibelli, Ilker Hamzaoglu, Senior
More informationVideo Compression - From Concepts to the H.264/AVC Standard
PROC. OF THE IEEE, DEC. 2004 1 Video Compression - From Concepts to the H.264/AVC Standard GARY J. SULLIVAN, SENIOR MEMBER, IEEE, AND THOMAS WIEGAND Invited Paper Abstract Over the last one and a half
More informationHEVC: Future Video Encoding Landscape
HEVC: Future Video Encoding Landscape By Dr. Paul Haskell, Vice President R&D at Harmonic nc. 1 ABSTRACT This paper looks at the HEVC video coding standard: possible applications, video compression performance
More informationADAPTIVE QUANTISATION IN HEVC FOR CONTOURING ARTEFACTS REMOVAL IN UHD CONTENT
ADAPTIVE QUANTISATION IN HEVC FOR CONTOURING ARTEFACTS REMOVAL IN UHD CONTENT Nicolò Casali,2, Matteo Naccari, Marta Mrak and Riccardo Leonardi 2 British Broadcasting Corporation - Research and Development,
More informationDesign of a Fast Multi-Reference Frame Integer Motion Estimator for H.264/AVC
http://dx.doi.org/10.5573/jsts.2013.13.5.430 JOURNAL OF SEMICONDUCTOR TECHNOLOGY AND SCIENCE, VOL.13, NO.5, OCTOBER, 2013 Design of a Fast Multi-Reference Frame Integer Motion Estimator for H.264/AVC Juwon
More informationROI ENCRYPTION FOR THE HEVC CODED VIDEO CONTENTS. Mousa Farajallah, Wassim Hamidouche, Olivier Déforges and Safwan El Assad
ROI ENCRYPTION FOR THE HEVC CODED VIDEO CONTENTS Mousa Farajallah, Wassim Hamidouche, Olivier Déforges and Safwan El Assad IETR Lab CNRS 6164, France ABSTRACT In this paper we investigate privacy protection
More informationRobust 3-D Video System Based on Modified Prediction Coding and Adaptive Selection Mode Error Concealment Algorithm
International Journal of Signal Processing Systems Vol. 2, No. 2, December 2014 Robust 3-D Video System Based on Modified Prediction Coding and Adaptive Selection Mode Error Concealment Algorithm Walid
More informationA robust video encoding scheme to enhance error concealment of intra frames
Loughborough University Institutional Repository A robust video encoding scheme to enhance error concealment of intra frames This item was submitted to Loughborough University's Institutional Repository
More informationContents. xv xxi xxiii xxiv. 1 Introduction 1 References 4
Contents List of figures List of tables Preface Acknowledgements xv xxi xxiii xxiv 1 Introduction 1 References 4 2 Digital video 5 2.1 Introduction 5 2.2 Analogue television 5 2.3 Interlace 7 2.4 Picture
More informationVideo coding standards
Video coding standards Video signals represent sequences of images or frames which can be transmitted with a rate from 5 to 60 frames per second (fps), that provides the illusion of motion in the displayed
More informationPerformance Evaluation of Error Resilience Techniques in H.264/AVC Standard
Performance Evaluation of Error Resilience Techniques in H.264/AVC Standard Ram Narayan Dubey Masters in Communication Systems Dept of ECE, IIT-R, India Varun Gunnala Masters in Communication Systems Dept
More informationSUMMIT LAW GROUP PLLC 315 FIFTH AVENUE SOUTH, SUITE 1000 SEATTLE, WASHINGTON Telephone: (206) Fax: (206)
Case 2:10-cv-01823-JLR Document 154 Filed 01/06/12 Page 1 of 153 1 The Honorable James L. Robart 2 3 4 5 6 7 UNITED STATES DISTRICT COURT FOR THE WESTERN DISTRICT OF WASHINGTON AT SEATTLE 8 9 10 11 12
More informationUniversity of Bristol - Explore Bristol Research. Peer reviewed version. Link to published version (if available): /ISCAS.2005.
Wang, D., Canagarajah, CN., & Bull, DR. (2005). S frame design for multiple description video coding. In IEEE International Symposium on Circuits and Systems (ISCAS) Kobe, Japan (Vol. 3, pp. 19 - ). Institute
More informationOverview of the H.264/AVC Video Coding Standard
560 IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. 13, NO. 7, JULY 2003 Overview of the H.264/AVC Video Coding Standard Thomas Wiegand, Gary J. Sullivan, Senior Member, IEEE, Gisle
More informationIntra-frame JPEG-2000 vs. Inter-frame Compression Comparison: The benefits and trade-offs for very high quality, high resolution sequences
Intra-frame JPEG-2000 vs. Inter-frame Compression Comparison: The benefits and trade-offs for very high quality, high resolution sequences Michael Smith and John Villasenor For the past several decades,
More informationColor space adaptation for video coding
Color Space Adaptation for Video Coding Adrià Arrufat 1 Color space adaptation for video coding Adrià Arrufat Universitat Politècnica de Catalunya tutor: Josep Ramon Casas Technicolor tutors: Philippe
More informationCHROMA CODING IN DISTRIBUTED VIDEO CODING
International Journal of Computer Science and Communication Vol. 3, No. 1, January-June 2012, pp. 67-72 CHROMA CODING IN DISTRIBUTED VIDEO CODING Vijay Kumar Kodavalla 1 and P. G. Krishna Mohan 2 1 Semiconductor
More informationEFFICIENT HEVC LOSS LESS CODING USING SAMPLE BASED ANGULAR INTRA PREDICTION (SAP) PAVAN GAJJALA. Presented to the Faculty of the Graduate School of
EFFICIENT HEVC LOSS LESS CODING USING SAMPLE BASED ANGULAR INTRA PREDICTION (SAP) by PAVAN GAJJALA Presented to the Faculty of the Graduate School of The University of Texas at Arlington in Partial Fulfillment
More informationRegion of Interest Coding for Aerial Surveillance Video Using AVC & HEVC
Region of Interest Coding for Aerial Surveillance Video Using AVC & HEVC Holger Meuel, Florian Kluger and Jörn Ostermann Institut für Informationsverarbeitung Gottfried Wilhelm Leibniz Universität Hannover,
More informationInto the Depths: The Technical Details Behind AV1. Nathan Egge Mile High Video Workshop 2018 July 31, 2018
Into the Depths: The Technical Details Behind AV1 Nathan Egge Mile High Video Workshop 2018 July 31, 2018 North America Internet Traffic 82% of Internet traffic by 2021 Cisco Study
More informationPrinciples of Video Compression
Principles of Video Compression Topics today Introduction Temporal Redundancy Reduction Coding for Video Conferencing (H.261, H.263) (CSIT 410) 2 Introduction Reduce video bit rates while maintaining an
More informationCOMP 249 Advanced Distributed Systems Multimedia Networking. Video Compression Standards
COMP 9 Advanced Distributed Systems Multimedia Networking Video Compression Standards Kevin Jeffay Department of Computer Science University of North Carolina at Chapel Hill jeffay@cs.unc.edu September,
More informationReduced complexity MPEG2 video post-processing for HD display
Downloaded from orbit.dtu.dk on: Dec 17, 2017 Reduced complexity MPEG2 video post-processing for HD display Virk, Kamran; Li, Huiying; Forchhammer, Søren Published in: IEEE International Conference on
More informationABSTRACT ERROR CONCEALMENT TECHNIQUES IN H.264/AVC, FOR VIDEO TRANSMISSION OVER WIRELESS NETWORK. Vineeth Shetty Kolkeri, M.S.
ABSTRACT ERROR CONCEALMENT TECHNIQUES IN H.264/AVC, FOR VIDEO TRANSMISSION OVER WIRELESS NETWORK Vineeth Shetty Kolkeri, M.S. The University of Texas at Arlington, 2008 Supervising Professor: Dr. K. R.
More informationAn Overview of Video Coding Algorithms
An Overview of Video Coding Algorithms Prof. Ja-Ling Wu Department of Computer Science and Information Engineering National Taiwan University Video coding can be viewed as image compression with a temporal
More informationJoint Algorithm-Architecture Optimization of CABAC
Noname manuscript No. (will be inserted by the editor) Joint Algorithm-Architecture Optimization of CABAC Vivienne Sze Anantha P. Chandrakasan Received: date / Accepted: date Abstract This paper uses joint
More informationH.264/AVC Baseline Profile Decoder Complexity Analysis
704 IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. 13, NO. 7, JULY 2003 H.264/AVC Baseline Profile Decoder Complexity Analysis Michael Horowitz, Anthony Joch, Faouzi Kossentini, Senior
More informationWITH the demand of higher video quality, lower bit
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. 16, NO. 8, AUGUST 2006 917 A High-Definition H.264/AVC Intra-Frame Codec IP for Digital Video and Still Camera Applications Chun-Wei
More informationMotion Re-estimation for MPEG-2 to MPEG-4 Simple Profile Transcoding. Abstract. I. Introduction
Motion Re-estimation for MPEG-2 to MPEG-4 Simple Profile Transcoding Jun Xin, Ming-Ting Sun*, and Kangwook Chun** *Department of Electrical Engineering, University of Washington **Samsung Electronics Co.
More informationChapter 10 Basic Video Compression Techniques
Chapter 10 Basic Video Compression Techniques 10.1 Introduction to Video compression 10.2 Video Compression with Motion Compensation 10.3 Video compression standard H.261 10.4 Video compression standard
More informationA Highly Parallel and Scalable CABAC Decoder for Next Generation Video Coding
8 IEEE JOURNAL OF SOLID-STATE CIRCUITS, VOL. 47, NO. 1, JANUARY 2012 A Highly Parallel and Scalable CABAC Decoder for Next Generation Video Coding Vivienne Sze, Member, IEEE, and Anantha P. Chandrakasan,
More informationIntroduction to Video Compression Techniques. Slides courtesy of Tay Vaughan Making Multimedia Work
Introduction to Video Compression Techniques Slides courtesy of Tay Vaughan Making Multimedia Work Agenda Video Compression Overview Motivation for creating standards What do the standards specify Brief
More information