Efficient Implementation of Neural Network Deinterlacing
|
|
- Kerry Bryan
- 5 years ago
- Views:
Transcription
1 Efficient Implementation of Neural Network Deinterlacing Guiwon Seo, Hyunsoo Choi and Chulhee Lee Dept. Electrical and Electronic Engineering, Yonsei University 34 Shinchon-dong Seodeamun-gu, Seoul -749, Korea Rep. ABSTRACT Interlaced scanning has been widely used in most broadcasting systems. However, there are some undesirable artifacts such as jagged patterns, flickering, and line twitters. Moreover, most recent TV monitors utilize flat panel display technologies such as LCD or PDP monitors and these monitors require progressive formats. Consequently, the conversion of interlaced video into progressive video is required in many applications and a number of deinterlacing methods have been proposed. Recently deinterlacing methods based on neural network have been proposed with good results. On the other hand, with high resolution video contents such as HDTV, the amount of video data to be processed is very large. As a result, the processing time and hardware complexity become an important issue. In this paper, we propose an efficient implementation of neural network deinterlacing using polynomial approximation of the sigmoid function. Experimental results show that these approximations provide equivalent performance with a considerable reduction of complexity. This implementation of neural network deinterlacing can be efficiently incorporated in HW implementation. Keywords: neural networks, deinterlacing, HW implementation, polynomial approximation. INTRODUCTION Most broadcasting systems have employed an interlaced scanning, which makes it possible to reduce bandwidth while doubling the frame rate []. However, interlaced scanning causes undesirable artifacts such as jagged patterns, flickering, and line twitters [9]. These artifacts may degrade video quality. Furthermore, most recent TV monitors utilize flat panel technologies such as LCD or PDP monitors. Consequently, conversions between interlaced and progressive video sequences are required in many applications. Due to its importance, a number of deinterlacing methods have been proposed [-6]. These techniques can be roughly classified into two categories: intra-field methods and inter-field methods. Intra-field deinterlacing methods use only the pixel values of the current frame. Although their performance might not be optimal, they have been widely used since their requirements for memory and computing power are manageable. In order to process large video data in real time, this is a very important problem. The inter-field deinterlacing algorithms utilize the information from adjacent fields to fill in missing lines. Although they provide improved performance than intra-field deinterlacing, they require high computational complexity. Moreover, in motion-compensated deinterlacing methods, inaccurate motion estimation may cause artifacts which degrade perceptual video quality, though overall PSNR is good. Recently, several neural network deinterlacing methods have been proposed with promising results [3-6]. If a neural network deinterlacing method uses a number of fields as input, it can be classified as inter-field deinterlacing. However, since motion-compensated deinterlacing methods are computationally expensive, the neural network deinterlacing method emerges as a promising solution. With the advancement of display and transmission technologies, high resolution video programs such as HDTV become widely available. With such high resolution video contents, the amount of video data to be processed in real time is very large. Consequently, the processing time and HW complexity are important issues when deinterlacing is performed at display monitors. A problem with neural network deinterlacing methods is that they require sigmoid functions which are expensive to implement. In this paper, we propose an efficient implementation of neural network deinterlacing methods using polynomial approximation of the sigmoid function. We tested a number of polynomial functions and analyzed their performance. Experimental results show that these approximations provide equivalent performance with a considerable reduction of complexity. This implementation of neural network deinterlacing can be efficiently incorporated in HW implementation. Image Processing: Algorithms and Systems VII, edited by Jaakko T. Astola, Karen O. Egiazarian Nasser M. Nasrabadi, Syed A. Rizvi, Proc. of SPIE-IS&T Electronic Imaging, SPIE Vol. 745, SPIE-IS&T CCC code: X/9/$8 doi:.7/.857 SPIE-IS&T/ Vol
2 . NEURAL NETWORKS Figure shows a diagram of multilayer neural network algorithm. Although there is one hidden layer in Figure, there can be multiple hidden layers. At each node, we compute the following summation: net j = d i= x w i ji + w = d x w = w t j x j i ji () i= y = f net ) () j ( j where x r is an input vector and y i is an output of the node. As can be seen in equation (), to compute y i, we have to compute the activation function f (x). A different type of activation function can be used. On the other hand, there are some constraint on the activation function. First, the activation function must be nonlinear. If the activation function is linear, the neural network would be a linear function. Second, the activation function should have a saturation property. In other words, it has maximum and minimum output values. Third, the activation function needs to be continuous and smooth. It is desirable that the activation function and its derivatives are must have continuous. The following sigmoid function is widely used as an activation function. The sigmoid function satisfies all the properties. f ( x) = (3) x + e output layer hidden layer input layer Fig.. Diagram of multilayer neural networks. Back-propagation algorithm The back-propagation algorithm is most widely used in training neural networks [7]. The back-propagation algorithm is used to find optimal weight vectors for a given data set. In the back-propagation algorithm, we first compute the error between target values and output values as follows: E = k ( t k o k ) where t k is a target value and ok is an output value. A weight vector is modified so that the error is reduced as follows: (4) SPIE-IS&T/ Vol
3 E Δwij = η (5) w ij where η is a learning rate.. Sigmoid Approximation In the previous session, we explained the activation function and the sigmoid function. However, the sigmoid function includes an exponential function. When an algorithm is implemented in hardware, the exponential function is an expensive operation. In this paper, we aim to approximate the sigmoid function with a polynomial function. In particular, we approximate the sigmoid function with a quadratic function. The quadratic function can be expressed as follows: y a + = (6) + ax ax To obtain the optimal coefficients, we try to find the polynomial coefficients that maximize the correlation coefficient between the sigmoid function and the quadratic function. We uniformly sampled an interval (-4) and generated, points ( x values). Using the generated data points, we constructed two vectors: x, x. Since constant terms can t affect the correlation, we can ignore the constant coefficient a in maximizing the correlation. Then, we compute the output values of the quadratic function and constructed an output vector: y '. T T [ w w ] [ x x ] = W D y' = w x + w x = (7) We also computed the corresponding output values of the sigmoid function and constructed another vector: y sgm. Finally, we try to maximize the correlation between y sgm and y '. Using the optimization method in [8], we can formulate the optimal weight vector which maximizes the correlation coefficient as follows: Σ Σ = ρ W (8) D Q W where Q = E( y D), Σ = QQ and sgm minimize MSE as follows: Q T Σ D = DD T. After finding the optimal weight vector, we apply linear fitting to y + = a + k y' = a + kw x kw x (9) where a = kw and a = kw. Using linear fitting we can find a and k. Since the quadratic function can t provide the saturation property of the sigmoid function, we approximate the sigmoid function with a linear function when x is larger than a threshold (Fig. ). The coefficients of the linear function were selected so that the overall function will be continuous and differentiable. The approximation function for x> is given by a + ax + ax for x < xth y = () b + b x for x xth SPIE-IS&T/ Vol
4 Fig.. Threshold of quadratic functions and its substituting linear function For x<, we can take advantages of the sigmoid function which has an anti-symmetry property. The final form of the proposed function is follows: b + b x a + ax + ax y = a + ax ax b + b x for for for for x x x < x x th th x < x x < It is noted that a >, a < and a =. 5. The sigmoid and the proposed function are shown Figure 3. As can be seen, the sigmoid and approximation functions are very similar and the error between two functions is very small. th th () Sigmoid Approximation x Error Fig. 3. Sigmoid function, proposed function and error between two functions SPIE-IS&T/ Vol
5 3. NEURAL NETWORK DEINTERLACING Deinterlacing is a process of filling in mission lines of interlaced video sequences. Due to it importance, a number of deinterlacing methods have been proposed by many researchers. In particular, there are several deinterlacing methods based on neural networks [3-6]. In neural network deinterlacing methods, input neurons are obtained from field pixels and the outputs of the neural network are desired values. There are two categories in neural network deinterlacing methods: intra-field methods and inter-field methods. In intra methods we use only the pixels of the current field while the inter-field deinterlacing method may use pixels from several fields including the current, previous and next fields. In [3], Plaziac proposed an intra-field deinterlacing algorithm using neural networks. The inputs and outputs of the methods are shown in Figure 4. As can be seen in Figure 4, it computes 3 output neurons using 3 input neurons. The method used a 3 layer neural network with 6 hidden neurons. Input of neural network Output of neural network Fig. 4. Deinterlacing method using single field Previous frame Current frame Next frame Input of neural network Output of neural network Fig. 5. Deinterlacing method using previous and next field SPIE-IS&T/ Vol
6 In [5], Choi proposed an inter-field deinterlacing method. The inputs and outputs of the methods are shown in Figure 5. The inputs are extracted from the previous, current and next fields. From the previous and next fields, 5 reference pixels are taken. From the current field, it takes pixels. The network has three layers with 6 hidden neurons. The input and output neuron can be expressed using vectors as follows: T [ a a,, a ] B = [ b] A =,, L () where A is the input vector and B is the output vector. It is reported that inter-field deinterlacing methods show better performance than intra-field deinterlacing methods [5]. Thus, in this paper, we selected the inter-field deinterlacing method [5] to verify the proposed activation function that is used instead of the sigmoid function. 4. EXPERIMENTAL RESULTS Experiments were performed to test the proposed function. In the experiments, we implemented the neural network deinterlacing method in [5]. Along with the proposed activation function, we tested the sigmoid function (3) and the hyperbolic tangent function, which are frequently as activation functions. These functions satisfy the non-linearity and saturation properties. These functions have been widely used in many applications and their performance has been satisfactory. We tested the neural network deinterlacing algorithm using nine QCIF video sequences. To evaluate the performance of the activation functions, we first converted the progressive video sequences to interlaced video sequences. After we applied the neural network deinterlacing algorithm, we computed PSNRs with the original progressive video sequences. Table shows performance comparison. Table. Average result PSNRs (db) Format Video Sigmoid Hyperbolic Tangent Proposed Coastguard Container Foreman Hall & Monitor QCIF Mobile Mother & Daughter Silent Stefan Table Average Table is obtained by averaging trials with different initial weights. We used the first frames of four video sequences (Coastguard, Foreman, Mobile and Hall & Monitor). The experimental results show that the proposed function provides performance comparable to the other activation functions. SPIE-IS&T/ Vol
7 Table shows the average processing time of the three activation functions (Core Quad CPU.4 GHz). It is noted that the processing time was measured for test only. We excluded the training time. It can be seen that the proposed algorithm is fastest among the three activation functions. The proposed algorithm consumes 73% of the processing time with the sigmoid function and 53% of that with the hyperbolic tangent function. It is noted that the processing time of the proposed activation can be further reduced when it is implemented in hardware. Table. Average computation time of deinterlacing test Sigmoid Hyperbolic Tangent Proposed Computation Time(sec) Figure 6 shows that frame PSNR comparison of the sigmoid and proposed activation functions for the coastguard video sequence. It shows that the proposed activation function provides almost the identical performance compared to the sigmoid function. PSNR(dB) Sigmoid Proposed Frame number Fig. 6. Frame by frame comparison for coastguard sequence ( frames) 5. CONCLUSIONS In this paper, we proposed a new activation function for neural networks. Although presenting activation functions assure the performance of neural networks, it is time consuming process because it is used every iteration. Our proposed function is implemented by quadratic polynomial functions and linear functions. It has piecewise continuous and smoothness. This function is adapted to neural network deinterlacing. Experiments results show that the proposed function perform in shorter time with similar quality. It seems very useful to replace activation function to proposed polynomial function in hardware implementation. SPIE-IS&T/ Vol
8 ACKNOWLEDGEMENT This research was supported by the MKE (Ministry of Knowledge Economy) under the ITRC (Information Technology Research Center) support program supervised by the IITA (Institute of Information Technology Assessment) (IITA- 8-(C9-8-)), Korea REFERENCES [] [] [3] [4] [5] [6] [7] [8] [9] Renxiang Li, Bing Zeng and Ming L. Liou, Reliable motion detection/compensation for interlaced sequences and its applications to deinterlacing, IEEE Trans. Circuits and System for Video Technology, (), 3-9 (). Taeuk Jeong, Younghie Kim, Kwanghoon Sohn and Chulhee Lee, Deinterlacing with selective motion compensation, Optical Engineering, 45(7), 77, (6). Nathalie Plaziac, Image interpolation using neural networks, IEEE Trans. Image Processing, 8(), (999). Xianglin Wang and Yeong Taeg Kim, An edge direction based neural network interpolator for video deinterlacing, IEEE Int. Conf. Neural Networks & Signal Processing, 5-8 (3). Hyunsoo Choi, Eunjae Lee and Chulhee Lee, Neural Network Deinterlacing Using Multiple Fields, LNCIS, 345, (6). Hyunsoo Choi and Chulhee Lee, Neural Network Deinterlacing Using Multiple Fields and Field-MESs, IJCNN 7, International Joint Conference on, (7). Richard O. Duda, Peter E. Hart and David G. Stork, [Pattern Classification Second Edition], Wiley Interscience, pp (). Document 6Q/4: A new method for objective measure of video quality using wavelet transform, ITU-R/SG 6/WP 6Q, Republic of Korea (Sep. 3, ). Ohjae Kwon, Kwanghoon Sohn and Chulhee Lee, Deinterlacing using directional interpolation and motion compensation, IEEE Trans. Consumer Electronics, 49(), 98-3(3). SPIE-IS&T/ Vol
Using enhancement data to deinterlace 1080i HDTV
Using enhancement data to deinterlace 1080i HDTV The MIT Faculty has made this article openly available. Please share how this access benefits you. Your story matters. Citation As Published Publisher Andy
More informationFRAME RATE CONVERSION OF INTERLACED VIDEO
FRAME RATE CONVERSION OF INTERLACED VIDEO Zhi Zhou, Yeong Taeg Kim Samsung Information Systems America Digital Media Solution Lab 3345 Michelson Dr., Irvine CA, 92612 Gonzalo R. Arce University of Delaware
More informationFAST SPATIAL AND TEMPORAL CORRELATION-BASED REFERENCE PICTURE SELECTION
FAST SPATIAL AND TEMPORAL CORRELATION-BASED REFERENCE PICTURE SELECTION 1 YONGTAE KIM, 2 JAE-GON KIM, and 3 HAECHUL CHOI 1, 3 Hanbat National University, Department of Multimedia Engineering 2 Korea Aerospace
More informationTemporal Error Concealment Algorithm Using Adaptive Multi- Side Boundary Matching Principle
184 IJCSNS International Journal of Computer Science and Network Security, VOL.8 No.12, December 2008 Temporal Error Concealment Algorithm Using Adaptive Multi- Side Boundary Matching Principle Seung-Soo
More informationResearch Article. ISSN (Print) *Corresponding author Shireen Fathima
Scholars Journal of Engineering and Technology (SJET) Sch. J. Eng. Tech., 2014; 2(4C):613-620 Scholars Academic and Scientific Publisher (An International Publisher for Academic and Scientific Resources)
More informationResearch Topic. Error Concealment Techniques in H.264/AVC for Wireless Video Transmission in Mobile Networks
Research Topic Error Concealment Techniques in H.264/AVC for Wireless Video Transmission in Mobile Networks July 22 nd 2008 Vineeth Shetty Kolkeri EE Graduate,UTA 1 Outline 2. Introduction 3. Error control
More informationSkip Length and Inter-Starvation Distance as a Combined Metric to Assess the Quality of Transmitted Video
Skip Length and Inter-Starvation Distance as a Combined Metric to Assess the Quality of Transmitted Video Mohamed Hassan, Taha Landolsi, Husameldin Mukhtar, and Tamer Shanableh College of Engineering American
More informationFast MBAFF/PAFF Motion Estimation and Mode Decision Scheme for H.264
Fast MBAFF/PAFF Motion Estimation and Mode Decision Scheme for H.264 Ju-Heon Seo, Sang-Mi Kim, Jong-Ki Han, Nonmember Abstract-- In the H.264, MBAFF (Macroblock adaptive frame/field) and PAFF (Picture
More informationSelective Intra Prediction Mode Decision for H.264/AVC Encoders
Selective Intra Prediction Mode Decision for H.264/AVC Encoders Jun Sung Park, and Hyo Jung Song Abstract H.264/AVC offers a considerably higher improvement in coding efficiency compared to other compression
More information1. INTRODUCTION. Index Terms Video Transcoding, Video Streaming, Frame skipping, Interpolation frame, Decoder, Encoder.
Video Streaming Based on Frame Skipping and Interpolation Techniques Fadlallah Ali Fadlallah Department of Computer Science Sudan University of Science and Technology Khartoum-SUDAN fadali@sustech.edu
More informationAdaptive Key Frame Selection for Efficient Video Coding
Adaptive Key Frame Selection for Efficient Video Coding Jaebum Jun, Sunyoung Lee, Zanming He, Myungjung Lee, and Euee S. Jang Digital Media Lab., Hanyang University 17 Haengdang-dong, Seongdong-gu, Seoul,
More informationExpress Letters. A Novel Four-Step Search Algorithm for Fast Block Motion Estimation
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. 6, NO. 3, JUNE 1996 313 Express Letters A Novel Four-Step Search Algorithm for Fast Block Motion Estimation Lai-Man Po and Wing-Chung
More informationUnderstanding PQR, DMOS, and PSNR Measurements
Understanding PQR, DMOS, and PSNR Measurements Introduction Compression systems and other video processing devices impact picture quality in various ways. Consumers quality expectations continue to rise
More informationInterleaved Source Coding (ISC) for Predictive Video Coded Frames over the Internet
Interleaved Source Coding (ISC) for Predictive Video Coded Frames over the Internet Jin Young Lee 1,2 1 Broadband Convergence Networking Division ETRI Daejeon, 35-35 Korea jinlee@etri.re.kr Abstract Unreliable
More informationAn Efficient Low Bit-Rate Video-Coding Algorithm Focusing on Moving Regions
1128 IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. 11, NO. 10, OCTOBER 2001 An Efficient Low Bit-Rate Video-Coding Algorithm Focusing on Moving Regions Kwok-Wai Wong, Kin-Man Lam,
More informationAnalysis of Packet Loss for Compressed Video: Does Burst-Length Matter?
Analysis of Packet Loss for Compressed Video: Does Burst-Length Matter? Yi J. Liang 1, John G. Apostolopoulos, Bernd Girod 1 Mobile and Media Systems Laboratory HP Laboratories Palo Alto HPL-22-331 November
More informationRegion Adaptive Unsharp Masking based DCT Interpolation for Efficient Video Intra Frame Up-sampling
International Conference on Electronic Design and Signal Processing (ICEDSP) 0 Region Adaptive Unsharp Masking based DCT Interpolation for Efficient Video Intra Frame Up-sampling Aditya Acharya Dept. of
More informationMULTI-STATE VIDEO CODING WITH SIDE INFORMATION. Sila Ekmekci Flierl, Thomas Sikora
MULTI-STATE VIDEO CODING WITH SIDE INFORMATION Sila Ekmekci Flierl, Thomas Sikora Technical University Berlin Institute for Telecommunications D-10587 Berlin / Germany ABSTRACT Multi-State Video Coding
More informationImpact of scan conversion methods on the performance of scalable. video coding. E. Dubois, N. Baaziz and M. Matta. INRS-Telecommunications
Impact of scan conversion methods on the performance of scalable video coding E. Dubois, N. Baaziz and M. Matta INRS-Telecommunications 16 Place du Commerce, Verdun, Quebec, Canada H3E 1H6 ABSTRACT The
More informationAutomatic Commercial Monitoring for TV Broadcasting Using Audio Fingerprinting
Automatic Commercial Monitoring for TV Broadcasting Using Audio Fingerprinting Dalwon Jang 1, Seungjae Lee 2, Jun Seok Lee 2, Minho Jin 1, Jin S. Seo 2, Sunil Lee 1 and Chang D. Yoo 1 1 Korea Advanced
More informationUniversity of Bristol - Explore Bristol Research. Peer reviewed version. Link to published version (if available): /ISCAS.2005.
Wang, D., Canagarajah, CN., & Bull, DR. (2005). S frame design for multiple description video coding. In IEEE International Symposium on Circuits and Systems (ISCAS) Kobe, Japan (Vol. 3, pp. 19 - ). Institute
More informationReduced complexity MPEG2 video post-processing for HD display
Downloaded from orbit.dtu.dk on: Dec 17, 2017 Reduced complexity MPEG2 video post-processing for HD display Virk, Kamran; Li, Huiying; Forchhammer, Søren Published in: IEEE International Conference on
More informationMotion Re-estimation for MPEG-2 to MPEG-4 Simple Profile Transcoding. Abstract. I. Introduction
Motion Re-estimation for MPEG-2 to MPEG-4 Simple Profile Transcoding Jun Xin, Ming-Ting Sun*, and Kangwook Chun** *Department of Electrical Engineering, University of Washington **Samsung Electronics Co.
More informationDesign of a Fast Multi-Reference Frame Integer Motion Estimator for H.264/AVC
http://dx.doi.org/10.5573/jsts.2013.13.5.430 JOURNAL OF SEMICONDUCTOR TECHNOLOGY AND SCIENCE, VOL.13, NO.5, OCTOBER, 2013 Design of a Fast Multi-Reference Frame Integer Motion Estimator for H.264/AVC Juwon
More informationTHE CAPABILITY of real-time transmission of video over
1124 IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. 15, NO. 9, SEPTEMBER 2005 Efficient Bandwidth Resource Allocation for Low-Delay Multiuser Video Streaming Guan-Ming Su, Student
More informationWE CONSIDER an enhancement technique for degraded
1140 IEEE SIGNAL PROCESSING LETTERS, VOL. 21, NO. 9, SEPTEMBER 2014 Example-based Enhancement of Degraded Video Edson M. Hung, Member, IEEE, Diogo C. Garcia, Member, IEEE, and Ricardo L. de Queiroz, Senior
More informationReconstruction of Ca 2+ dynamics from low frame rate Ca 2+ imaging data CS229 final project. Submitted by: Limor Bursztyn
Reconstruction of Ca 2+ dynamics from low frame rate Ca 2+ imaging data CS229 final project. Submitted by: Limor Bursztyn Introduction Active neurons communicate by action potential firing (spikes), accompanied
More informationFast thumbnail generation for MPEG video by using a multiple-symbol lookup table
48 3, 376 March 29 Fast thumbnail generation for MPEG video by using a multiple-symbol lookup table Myounghoon Kim Hoonjae Lee Ja-Cheon Yoon Korea University Department of Electronics and Computer Engineering,
More informationA Study of Encoding and Decoding Techniques for Syndrome-Based Video Coding
MITSUBISHI ELECTRIC RESEARCH LABORATORIES http://www.merl.com A Study of Encoding and Decoding Techniques for Syndrome-Based Video Coding Min Wu, Anthony Vetro, Jonathan Yedidia, Huifang Sun, Chang Wen
More informationWITH the rapid development of high-fidelity video services
896 IEEE SIGNAL PROCESSING LETTERS, VOL. 22, NO. 7, JULY 2015 An Efficient Frame-Content Based Intra Frame Rate Control for High Efficiency Video Coding Miaohui Wang, Student Member, IEEE, KingNgiNgan,
More informationLCD Motion Blur Reduced Using Subgradient Projection Algorithm
IOSR Journal of Electronics and Communication Engineering (IOSR-JECE) e-issn: 2278-2834,p-ISSN: 2278-8735 PP 05-11 www.iosrjournals.org LCD Motion Blur Reduced Using Subgradient Projection Algorithm Corresponding
More informationSCALABLE video coding (SVC) is currently being developed
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. 16, NO. 7, JULY 2006 889 Fast Mode Decision Algorithm for Inter-Frame Coding in Fully Scalable Video Coding He Li, Z. G. Li, Senior
More informationProject Proposal: Sub pixel motion estimation for side information generation in Wyner- Ziv decoder.
EE 5359 MULTIMEDIA PROCESSING Subrahmanya Maira Venkatrav 1000615952 Project Proposal: Sub pixel motion estimation for side information generation in Wyner- Ziv decoder. Wyner-Ziv(WZ) encoder is a low
More informationSpatial Error Concealment Technique for Losslessly Compressed Images Using Data Hiding in Error-Prone Channels
168 JOURNAL OF COMMUNICATIONS AND NETWORKS, VOL. 12, NO. 2, APRIL 2010 Spatial Error Concealment Technique for Losslessly Compressed Images Using Data Hiding in Error-Prone Channels Kyung-Su Kim, Hae-Yeoun
More informationN T I. Introduction. II. Proposed Adaptive CTI Algorithm. III. Experimental Results. IV. Conclusion. Seo Jeong-Hoon
An Adaptive Color Transient Improvement Algorithm IEEE Transactions on Consumer Electronics Vol. 49, No. 4, November 2003 Peng Lin, Yeong-Taeg Kim jhseo@dms.sejong.ac.kr 0811136 Seo Jeong-Hoon CONTENTS
More information1022 IEEE TRANSACTIONS ON IMAGE PROCESSING, VOL. 19, NO. 4, APRIL 2010
1022 IEEE TRANSACTIONS ON IMAGE PROCESSING, VOL. 19, NO. 4, APRIL 2010 Delay Constrained Multiplexing of Video Streams Using Dual-Frame Video Coding Mayank Tiwari, Student Member, IEEE, Theodore Groves,
More informationError Concealment for SNR Scalable Video Coding
Error Concealment for SNR Scalable Video Coding M. M. Ghandi and M. Ghanbari University of Essex, Wivenhoe Park, Colchester, UK, CO4 3SQ. Emails: (mahdi,ghan)@essex.ac.uk Abstract This paper proposes an
More informationMUSICAL INSTRUMENT RECOGNITION WITH WAVELET ENVELOPES
MUSICAL INSTRUMENT RECOGNITION WITH WAVELET ENVELOPES PACS: 43.60.Lq Hacihabiboglu, Huseyin 1,2 ; Canagarajah C. Nishan 2 1 Sonic Arts Research Centre (SARC) School of Computer Science Queen s University
More informationAUDIOVISUAL COMMUNICATION
AUDIOVISUAL COMMUNICATION Laboratory Session: Recommendation ITU-T H.261 Fernando Pereira The objective of this lab session about Recommendation ITU-T H.261 is to get the students familiar with many aspects
More informationRobust Transmission of H.264/AVC Video using 64-QAM and unequal error protection
Robust Transmission of H.264/AVC Video using 64-QAM and unequal error protection Ahmed B. Abdurrhman 1, Michael E. Woodward 1 and Vasileios Theodorakopoulos 2 1 School of Informatics, Department of Computing,
More informationColor Image Compression Using Colorization Based On Coding Technique
Color Image Compression Using Colorization Based On Coding Technique D.P.Kawade 1, Prof. S.N.Rawat 2 1,2 Department of Electronics and Telecommunication, Bhivarabai Sawant Institute of Technology and Research
More informationOptimized Color Based Compression
Optimized Color Based Compression 1 K.P.SONIA FENCY, 2 C.FELSY 1 PG Student, Department Of Computer Science Ponjesly College Of Engineering Nagercoil,Tamilnadu, India 2 Asst. Professor, Department Of Computer
More informationUsing Motion-Compensated Frame-Rate Conversion for the Correction of 3 : 2 Pulldown Artifacts in Video Sequences
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. 10, NO. 6, SEPTEMBER 2000 869 Using Motion-Compensated Frame-Rate Conversion for the Correction of 3 : 2 Pulldown Artifacts in Video
More informationLecture 2 Video Formation and Representation
2013 Spring Term 1 Lecture 2 Video Formation and Representation Wen-Hsiao Peng ( 彭文孝 ) Multimedia Architecture and Processing Lab (MAPL) Department of Computer Science National Chiao Tung University 1
More informationInternational Journal for Research in Applied Science & Engineering Technology (IJRASET) Motion Compensation Techniques Adopted In HEVC
Motion Compensation Techniques Adopted In HEVC S.Mahesh 1, K.Balavani 2 M.Tech student in Bapatla Engineering College, Bapatla, Andahra Pradesh Assistant professor in Bapatla Engineering College, Bapatla,
More informationError Resilience for Compressed Sensing with Multiple-Channel Transmission
Journal of Information Hiding and Multimedia Signal Processing c 2015 ISSN 2073-4212 Ubiquitous International Volume 6, Number 5, September 2015 Error Resilience for Compressed Sensing with Multiple-Channel
More informationRobust 3-D Video System Based on Modified Prediction Coding and Adaptive Selection Mode Error Concealment Algorithm
International Journal of Signal Processing Systems Vol. 2, No. 2, December 2014 Robust 3-D Video System Based on Modified Prediction Coding and Adaptive Selection Mode Error Concealment Algorithm Walid
More informationSpeeding up Dirac s Entropy Coder
Speeding up Dirac s Entropy Coder HENDRIK EECKHAUT BENJAMIN SCHRAUWEN MARK CHRISTIAENS JAN VAN CAMPENHOUT Parallel Information Systems (PARIS) Electronics and Information Systems (ELIS) Ghent University
More informationAN IMPROVED ERROR CONCEALMENT STRATEGY DRIVEN BY SCENE MOTION PROPERTIES FOR H.264/AVC DECODERS
AN IMPROVED ERROR CONCEALMENT STRATEGY DRIVEN BY SCENE MOTION PROPERTIES FOR H.264/AVC DECODERS Susanna Spinsante, Ennio Gambi, Franco Chiaraluce Dipartimento di Elettronica, Intelligenza artificiale e
More informationError Resilient Video Coding Using Unequally Protected Key Pictures
Error Resilient Video Coding Using Unequally Protected Key Pictures Ye-Kui Wang 1, Miska M. Hannuksela 2, and Moncef Gabbouj 3 1 Nokia Mobile Software, Tampere, Finland 2 Nokia Research Center, Tampere,
More informationComparative Study of JPEG2000 and H.264/AVC FRExt I Frame Coding on High-Definition Video Sequences
Comparative Study of and H.264/AVC FRExt I Frame Coding on High-Definition Video Sequences Pankaj Topiwala 1 FastVDO, LLC, Columbia, MD 210 ABSTRACT This paper reports the rate-distortion performance comparison
More informationPERCEPTUAL QUALITY OF H.264/AVC DEBLOCKING FILTER
PERCEPTUAL QUALITY OF H./AVC DEBLOCKING FILTER Y. Zhong, I. Richardson, A. Miller and Y. Zhao School of Enginnering, The Robert Gordon University, Schoolhill, Aberdeen, AB1 1FR, UK Phone: + 1, Fax: + 1,
More informationAn FPGA Implementation of Shift Register Using Pulsed Latches
An FPGA Implementation of Shift Register Using Pulsed Latches Shiny Panimalar.S, T.Nisha Priscilla, Associate Professor, Department of ECE, MAMCET, Tiruchirappalli, India PG Scholar, Department of ECE,
More informationNo Reference, Fuzzy Weighted Unsharp Masking Based DCT Interpolation for Better 2-D Up-sampling
No Reference, Fuzzy Weighted Unsharp Masking Based DCT Interpolation for Better 2-D Up-sampling Aditya Acharya Dept. of Electronics and Communication Engineering National Institute of Technology Rourkela-769008,
More informationMPEG has been established as an international standard
1100 IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. 9, NO. 7, OCTOBER 1999 Fast Extraction of Spatially Reduced Image Sequences from MPEG-2 Compressed Video Junehwa Song, Member,
More informationLine-Adaptive Color Transforms for Lossless Frame Memory Compression
Line-Adaptive Color Transforms for Lossless Frame Memory Compression Joungeun Bae 1 and Hoon Yoo 2 * 1 Department of Computer Science, SangMyung University, Jongno-gu, Seoul, South Korea. 2 Full Professor,
More informationUNIVERSAL SPATIAL UP-SCALER WITH NONLINEAR EDGE ENHANCEMENT
UNIVERSAL SPATIAL UP-SCALER WITH NONLINEAR EDGE ENHANCEMENT Stefan Schiemenz, Christian Hentschel Brandenburg University of Technology, Cottbus, Germany ABSTRACT Spatial image resizing is an important
More informationDELTA MODULATION AND DPCM CODING OF COLOR SIGNALS
DELTA MODULATION AND DPCM CODING OF COLOR SIGNALS Item Type text; Proceedings Authors Habibi, A. Publisher International Foundation for Telemetering Journal International Telemetering Conference Proceedings
More informationA SVD BASED SCHEME FOR POST PROCESSING OF DCT CODED IMAGES
Electronic Letters on Computer Vision and Image Analysis 8(3): 1-14, 2009 A SVD BASED SCHEME FOR POST PROCESSING OF DCT CODED IMAGES Vinay Kumar Srivastava Assistant Professor, Department of Electronics
More informationOptimizing Fuzzy Flip-Flop Based Neural Networks by Bacterial Memetic Algorithm
Optimizing Fuzzy Flip-Flop Based Neural Networks by Bacterial Memetic Algorithm Rita Lovassy 1,2 László T. Kóczy 1,3 László Gál 1,4 1 Faculty of Engineering Sciences, Széchenyi István University Gyr, Hungary
More informationCERIAS Tech Report Preprocessing and Postprocessing Techniques for Encoding Predictive Error Frames in Rate Scalable Video Codecs by E
CERIAS Tech Report 2001-118 Preprocessing and Postprocessing Techniques for Encoding Predictive Error Frames in Rate Scalable Video Codecs by E Asbun, P Salama, E Delp Center for Education and Research
More informationPlanning Tool of Point to Poin Optical Communication Links
Planning Tool of Point to Poin Optical Communication Links João Neto Cordeiro (1) (1) IST-Universidade de Lisboa, Av. Rovisco Pais, 1049-001 Lisboa e-mail: joao.neto.cordeiro@ist.utl.pt; Abstract The use
More informationAbstract 1. INTRODUCTION. Cheekati Sirisha, IJECS Volume 05 Issue 10 Oct., 2016 Page No Page 18532
www.ijecs.in International Journal Of Engineering And Computer Science ISSN: 2319-7242 Volume 5 Issue 10 Oct. 2016, Page No. 18532-18540 Pulsed Latches Methodology to Attain Reduced Power and Area Based
More informationRATE-REDUCTION TRANSCODING DESIGN FOR WIRELESS VIDEO STREAMING
RATE-REDUCTION TRANSCODING DESIGN FOR WIRELESS VIDEO STREAMING Anthony Vetro y Jianfei Cai z and Chang Wen Chen Λ y MERL - Mitsubishi Electric Research Laboratories, 558 Central Ave., Murray Hill, NJ 07974
More informationJoint Optimization of Source-Channel Video Coding Using the H.264/AVC encoder and FEC Codes. Digital Signal and Image Processing Lab
Joint Optimization of Source-Channel Video Coding Using the H.264/AVC encoder and FEC Codes Digital Signal and Image Processing Lab Simone Milani Ph.D. student simone.milani@dei.unipd.it, Summer School
More informationA Luminance Adjusting Algorithm for High Resolution and High Image Quality AMOLED Displays of Mobile Phone Applications
H.-J. In et al.: A uminance Adjusting Algorithm for High Resolution and High Image Quality AMOED Displays of Mobile Phone Applications A uminance Adjusting Algorithm for High Resolution and High Image
More informationDrift Compensation for Reduced Spatial Resolution Transcoding
MERL A MITSUBISHI ELECTRIC RESEARCH LABORATORY http://www.merl.com Drift Compensation for Reduced Spatial Resolution Transcoding Peng Yin Anthony Vetro Bede Liu Huifang Sun TR-2002-47 August 2002 Abstract
More informationDICOM medical image watermarking of ECG signals using EZW algorithm. A. Kannammal* and S. Subha Rani
126 Int. J. Medical Engineering and Informatics, Vol. 5, No. 2, 2013 DICOM medical image watermarking of ECG signals using EZW algorithm A. Kannammal* and S. Subha Rani ECE Department, PSG College of Technology,
More informationOn the Characterization of Distributed Virtual Environment Systems
On the Characterization of Distributed Virtual Environment Systems P. Morillo, J. M. Orduña, M. Fernández and J. Duato Departamento de Informática. Universidad de Valencia. SPAIN DISCA. Universidad Politécnica
More informationDesign of Fault Coverage Test Pattern Generator Using LFSR
Design of Fault Coverage Test Pattern Generator Using LFSR B.Saritha M.Tech Student, Department of ECE, Dhruva Institue of Engineering & Technology. Abstract: A new fault coverage test pattern generator
More informationInSync White Paper : Achieving optimal conversions in UHDTV workflows April 2015
InSync White Paper : Achieving optimal conversions in UHDTV workflows April 2015 Abstract - UHDTV 120Hz workflows require careful management of content at existing formats and frame rates, into and out
More informationINTRA-FRAME WAVELET VIDEO CODING
INTRA-FRAME WAVELET VIDEO CODING Dr. T. Morris, Mr. D. Britch Department of Computation, UMIST, P. O. Box 88, Manchester, M60 1QD, United Kingdom E-mail: t.morris@co.umist.ac.uk dbritch@co.umist.ac.uk
More informationRegion Based Laplacian Post-processing for Better 2-D Up-sampling
Region Based Laplacian Post-processing for Better 2-D Up-sampling Aditya Acharya Dept. of Electronics and Communication Engg. National Institute of Technology Rourkela Rourkela-769008, India aditya.acharya20@gmail.com
More informationError concealment techniques in H.264 video transmission over wireless networks
Error concealment techniques in H.264 video transmission over wireless networks M U L T I M E D I A P R O C E S S I N G ( E E 5 3 5 9 ) S P R I N G 2 0 1 1 D R. K. R. R A O F I N A L R E P O R T Murtaza
More informationDeep Neural Networks Scanning for patterns (aka convolutional networks) Bhiksha Raj
Deep Neural Networks Scanning for patterns (aka convolutional networks) Bhiksha Raj 1 Story so far MLPs are universal function approximators Boolean functions, classifiers, and regressions MLPs can be
More informationAn Lut Adaptive Filter Using DA
An Lut Adaptive Filter Using DA ISSN: 2321-9939 An Lut Adaptive Filter Using DA 1 k.krishna reddy, 2 ch k prathap kumar m 1 M.Tech Student, 2 Assistant Professor 1 CVSR College of Engineering, Department
More informationWeighted Random and Transition Density Patterns For Scan-BIST
Weighted Random and Transition Density Patterns For Scan-BIST Farhana Rashid Intel Corporation 1501 S. Mo-Pac Expressway, Suite 400 Austin, TX 78746 USA Email: farhana.rashid@intel.com Vishwani Agrawal
More informationNew-Generation Scalable Motion Processing from Mobile to 4K and Beyond
Mobile to 4K and Beyond White Paper Today s broadcast video content is being viewed on the widest range of display devices ever known, from small phone screens and legacy SD TV sets to enormous 4K and
More informationIN OBJECT-BASED video coding, such as MPEG-4 [1], an. A Robust and Adaptive Rate Control Algorithm for Object-Based Video Coding
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. 14, NO. 10, OCTOBER 2004 1167 A Robust and Adaptive Rate Control Algorithm for Object-Based Video Coding Yu Sun, Student Member, IEEE,
More informationA parallel HEVC encoder scheme based on Multi-core platform Shu Jun1,2,3,a, Hu Dong1,2,3,b
4th National Conference on Electrical, Electronics and Computer Engineering (NCEECE 2015) A parallel HEVC encoder scheme based on Multi-core platform Shu Jun1,2,3,a, Hu Dong1,2,3,b 1 Education Ministry
More informationFeasibility Study of Stochastic Streaming with 4K UHD Video Traces
Feasibility Study of Stochastic Streaming with 4K UHD Video Traces Joongheon Kim and Eun-Seok Ryu Platform Engineering Group, Intel Corporation, Santa Clara, California, USA Department of Computer Engineering,
More informationUnderstanding Compression Technologies for HD and Megapixel Surveillance
When the security industry began the transition from using VHS tapes to hard disks for video surveillance storage, the question of how to compress and store video became a top consideration for video surveillance
More informationVideo Processing Applications Image and Video Processing Dr. Anil Kokaram
Video Processing Applications Image and Video Processing Dr. Anil Kokaram anil.kokaram@tcd.ie This section covers applications of video processing as follows Motion Adaptive video processing for noise
More informationPower Reduction via Macroblock Prioritization for Power Aware H.264 Video Applications
Power Reduction via Macroblock Prioritization for Power Aware H.264 Video Applications Michael A. Baker, Viswesh Parameswaran, Karam S. Chatha, and Baoxin Li Department of Computer Science and Engineering
More informationModule 8 VIDEO CODING STANDARDS. Version 2 ECE IIT, Kharagpur
Module 8 VIDEO CODING STANDARDS Lesson 27 H.264 standard Lesson Objectives At the end of this lesson, the students should be able to: 1. State the broad objectives of the H.264 standard. 2. List the improved
More informationA Novel Approach towards Video Compression for Mobile Internet using Transform Domain Technique
A Novel Approach towards Video Compression for Mobile Internet using Transform Domain Technique Dhaval R. Bhojani Research Scholar, Shri JJT University, Jhunjunu, Rajasthan, India Ved Vyas Dwivedi, PhD.
More informationRobust Transmission of H.264/AVC Video Using 64-QAM and Unequal Error Protection
Robust Transmission of H.264/AVC Video Using 64-QAM and Unequal Error Protection Ahmed B. Abdurrhman, Michael E. Woodward, and Vasileios Theodorakopoulos School of Informatics, Department of Computing,
More informationScalable Foveated Visual Information Coding and Communications
Scalable Foveated Visual Information Coding and Communications Ligang Lu,1 Zhou Wang 2 and Alan C. Bovik 2 1 Multimedia Technologies, IBM T. J. Watson Research Center, Yorktown Heights, NY 10598, USA 2
More informationPower Problems in VLSI Circuit Testing
Power Problems in VLSI Circuit Testing Farhana Rashid and Vishwani D. Agrawal Auburn University Department of Electrical and Computer Engineering 200 Broun Hall, Auburn, AL 36849 USA fzr0001@tigermail.auburn.edu,
More informationINTERNATIONAL JOURNAL OF ELECTRONICS AND COMMUNICATION ENGINEERING & TECHNOLOGY (IJECET)
INTERNATIONAL JOURNAL OF ELECTRONICS AND COMMUNICATION ENGINEERING & TECHNOLOGY (IJECET) International Journal of Electronics and Communication Engineering & Technology (IJECET), ISSN 0976 ISSN 0976 6464(Print)
More informationTERRESTRIAL broadcasting of digital television (DTV)
IEEE TRANSACTIONS ON BROADCASTING, VOL 51, NO 1, MARCH 2005 133 Fast Initialization of Equalizers for VSB-Based DTV Transceivers in Multipath Channel Jong-Moon Kim and Yong-Hwan Lee Abstract This paper
More informationReconfigurable Neural Net Chip with 32K Connections
Reconfigurable Neural Net Chip with 32K Connections H.P. Graf, R. Janow, D. Henderson, and R. Lee AT&T Bell Laboratories, Room 4G320, Holmdel, NJ 07733 Abstract We describe a CMOS neural net chip with
More informationLow-Power and Area-Efficient Shift Register Using Pulsed Latches
Low-Power and Area-Efficient Shift Register Using Pulsed Latches G.Sunitha M.Tech, TKR CET. P.Venkatlavanya, M.Tech Associate Professor, TKR CET. Abstract: This paper proposes a low-power and area-efficient
More informationOverview of All Pixel Circuits for Active Matrix Organic Light Emitting Diode (AMOLED)
Chapter 2 Overview of All Pixel Circuits for Active Matrix Organic Light Emitting Diode (AMOLED) ---------------------------------------------------------------------------------------------------------------
More informationAchieve Accurate Critical Display Performance With Professional and Consumer Level Displays
Achieve Accurate Critical Display Performance With Professional and Consumer Level Displays Display Accuracy to Industry Standards Reference quality monitors are able to very accurately reproduce video,
More informationA 5-Gb/s Half-rate Clock Recovery Circuit in 0.25-μm CMOS Technology
A 5-Gb/s Half-rate Clock Recovery Circuit in 0.25-μm CMOS Technology Pyung-Su Han Dept. of Electrical and Electronic Engineering Yonsei University Seoul, Korea ps@tera.yonsei.ac.kr Woo-Young Choi Dept.
More informationAnalysis of Video Transmission over Lossy Channels
1012 IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, VOL. 18, NO. 6, JUNE 2000 Analysis of Video Transmission over Lossy Channels Klaus Stuhlmüller, Niko Färber, Member, IEEE, Michael Link, and Bernd
More informationAn Efficient Reduction of Area in Multistandard Transform Core
An Efficient Reduction of Area in Multistandard Transform Core A. Shanmuga Priya 1, Dr. T. K. Shanthi 2 1 PG scholar, Applied Electronics, Department of ECE, 2 Assosiate Professor, Department of ECE Thanthai
More informationROBUST ADAPTIVE INTRA REFRESH FOR MULTIVIEW VIDEO
ROBUST ADAPTIVE INTRA REFRESH FOR MULTIVIEW VIDEO Sagir Lawan1 and Abdul H. Sadka2 1and 2 Department of Electronic and Computer Engineering, Brunel University, London, UK ABSTRACT Transmission error propagation
More informationDISPLAY AWARENESS IN SUBJECTIVE AND OBJECTIVE VIDEO QUALITY EVALUATION
DISPLAY AWARENESS IN SUBJECTIVE AND OBJECTIVE VIDEO QUALITY EVALUATION Sylvain Tourancheau 1, Patrick Le Callet 1, Kjell Brunnström 2 and Dominique Barba 1 (1) Université de Nantes, IRCCyN laboratory rue
More information