Scalable multiple description coding of video sequences

Size: px
Start display at page:

Download "Scalable multiple description coding of video sequences"

Transcription

1 Scalable multiple description coding of video sequences Marco Folli, and Lorenzo Favalli Electronics Department University of Pavia, Via Ferrata 1, 100 Pavia, Italy Abstract In this paper, we address the problem of robust transmission of compressed visual information and propose two transmission schemes based on Multiple Description Scalable Coding (MDSC). In both schemes, we generate four spatial subsequences from the original video stream, by subsampling in both horizontal and vertical directions. Then, each description is encoded using two subsequences using the H.4/SVC video coder, thus generating two scalable descriptors. In the first scheme, we predict one subsequence from the other one using the inter layer prediction tools. In the second scheme, we exploit the redundancy between the subsequence with the hierarchical dyadic B frame prediction algorithm. These schemes provide better performances with respect to the most used spatial multiple description coded solution, called Polyphase Spatial Subsampling multiple description (PSS-MD), at the cost of a very low additional system complexity. KEYWORDS H.4/SVC, Multiple Description Coding, scalability, hierarchical B pictures, inter layer prediction I. INTRODUCTION Video communications are becoming increasingly popular and more and more important for the global information infrastructure thanks to the increasing available bandwidth and to more and more efficient video compression techniques. Despite these advances, the bandwidth requirements force a trade off between quality guarantee and resources utilization. Scalability has always been seen as a possible way to cope with this problem and, more recently, in the literature a new approach has emerged in which the coder generates multiple data streams called descriptions or descriptors. While scalability techniques produce multiple streams of which only one (the base-layer is independently decodable, all the descriptions are independently decodable To achieve this, it is necessary to introduce in each descriptor some amount of redundancy. Then, the descriptors can be transmitted using different physical channels or on the same channel but with different error protection or rate (same physical channel, different logical channel). At the receiver, if all the descriptions are received, ideally it s possible to recover the quality of the original stream. Otherwise, if only some descriptions are available, the original sequence is still decodable, but at a lower quality. A comprehensive overview of various MDC techniques is provided by Goyal [1]. A simple and efficient scheme for multiple descriptions video coding consists in splitting the even and odd pictures of a video sequence into two separate descriptions, which can be encoded using a certain coding scheme such as H.4. Such multiple description algorithm was developed in [2]. Subsequently, Wang [3] improved this scheme by adding some motion compensation between the descriptors. Another efficient and simple approach to generate multiple description streams was proposed by Vitali et al. [4], using spatial subsampling in both horizontal and vertical directions, thus obtaining four descriptions. This kind of algorithm is called polyphase spatial subsampling multiple description (PSS-MD) coding. In their work, they show that in error prone networks such a scheme provides better or equal robustness with respect to other solutions such as forward error correction (FEC), but with a lower system complexity. A possible improvement of this scheme is proposed in [5], where the original sequence is first oversampled via DCT transform and zero padding, then the descriptors are obtained by subsampling this oversampled sequence. These schemes are only aimed at increasing the robustness of the video stream, without taking into consideration any other transmission challenges, such as bandwidth variations or device heterogeneity, where a scalable approach is required. Recently, some multiple description scalable coding (MDSC) schemes have been proposed as efficient hybrid solutions. A very simple extension of the method proposed in [2] is the algorithm described in [6], in which two descriptions are obtained by temporal subsampling, and the Fig. 1. Example of polyphase downsampling system GTTI 08 - Sessione elaborazione dei segnali 1

2 2 scalability is simply achieved by hierarchical B prediction. For the PSS scheme, several interesting scalable approaches have been proposed. In [7], a combination of motion compensation and spatial subsampling is implemented; in [8], some spatial correlation of the scheme is exploited by predicting two of the four subsequences from their neighboring ones, then the residuals are coded using the discrete cosine transform and variable length coding. Finally, in [9] we developped a further improvement of the previous scheme, by adding a sign bit to the predicted subsequences and then coding them using a standard coder (H.4/SVC). Given the fact that the original subsequences are obtained by simple subsampling, their correlation is very high and consequently coding efficiency is low. The starting point of this paper is to develop some PSS schemes capable to remove some of this redundancy and at the same time introduce some form of scalability. In order to be compatible with a standard H.4/SVC coder, all MDC operations are performed as pre- and post- processing so that the different descriptions can be implemented using some of the scalable coding tools implemented in H.4/SVC. The first method, called Inter Layer Prediction Spatial Multiple Description Scalable Coding (ILPS-MDSC), takes advantage of the inter layer prediction method to generate spatial or coarse grain streams. The second one, called Hierarchical B Frame prediction Spatial Multiple Description Coding (HBFPS-MDSC), uses the dyadic B frame prediction scheme, needed for temporal scalability, to predict one of the subsequences from another one. The proposed algorithms are presented in detail in section III, after some description of scalable coding tools implemented in H.4/SVC, in section II. A description of their implementation on top of the H.4/SVC coder and simulation results are provided in section IV. II. DESCRIPTION OF SCALABLE CODING TOOLS H.4/AVC [10] is one of the latest international video coding standard. It uses a state-of-the-art coding tools and provides enhanced coding efficiency for a wide range of applications, including video telephony, video conferencing and video streaming. It outperforms the MPEG2 standard at least doubling its performances while keeping the cost acceptable. The scalable extension of H.4/AVC, named H.4/SVC, uses a layered approach to provide spatial, temporal and SNR scalability. These options may be used at the same time so that a set of spatio-temporal-snr streams can be generated and decoded from a global scalable video stream, according to the selected encoder configuration. The scalable extension of H.4/AVC extends the hybrid coding approach of this coder toward motion compensated temporal filtering. However, the algorithm that performs the prediction and update steps is similar to the motion compensation techniques already used in the generalized B frame approach used in H.4/AVC, in order to guarantee the backward compatibility. Further detail of H.4/SVC can be found in [11]. A. Hierarchical B Frame Prediction Structure The temporal prediction structure is changed relatively to H.4/AVC. In this coder, low pass pictures, resulting from the update step, are generated in a different way than high pass pictures which follow the prediction step, as in H.4/AVC. Basically, a group of pictures (GOP) is generated and this group is partitioned in two sets of pictures. The decomposition is then performed such that the high pass pictures are aligned with one of the partitions, and the low pass pictures are aligned with the other one. However, when the GOP size is greater than 2, it s advantageous to hierarchically iterate the partition of the GOP in order to obtain only a single low pass picture. The most common way to do it is to do a temporal dyadic prediction, as seen in fig. 2. The delay introduced by this algorithm is coupled with the use of reference pictures that are displayed later than the predicted or updated pictures. Therefore, if the reference pictures are in the past relatively to the predicted pictures and the update step is omitted, then no additional delay is introduced. When the GOP size is very large, it is then possible to control the maximum delay of the prediction structure (for real time applications) by perfoming the update step only in a subpartition of the GOP in order to meet the delay constraints. It is easy to see that this scheme guarantees temporal scalability, since it is possible to remove those parts of the bit-stream that are not used as reference pictures for the remaining pictures, and correspond to the highest hierarchical prediction layer of the prediction/update structure. B. Inter-layer Prediction Spatial scalability in the H.4/SVC is performed only considering oversampling factors which are powers of 2 in Fig. 2. Dyadic temporal decomposition of a group of 16 pictures Fig. 3. Hierarchical prediction structure applied to our method

3 3.5.5 Fig. 4. Coder structure needed to perform ILPS-MDSC with inter layer prediction structure highlighted both horizontal and vertical resolution. Then, the video signal is represented using an oversampled pyramid and as a first interpretation every spatial resolution, e.g. spatial layer, can be coded independently from the others. However, it is clear that a higher resolution layers (e.g. the 4CIF layer) can be somehow affected by the presence of lower resolution layers. Consequently, it is possible to improve the performances of the scalable coding algorithm by exploiting the redundancy between the neighbors layers. Plus, increased efficiency is obtained by allowing the encoder to freely choose which dependencies between spatial resolution layers have to be exploited through a switchable prediction mechanism. In ous work we have developed two different techniques that provide good performance gains and are described in the next section. prediction of macroblocks using up-sampled lower resolution signals prediction of motion vectors using up-sampled lower resolution motion vectors prediction of residual signals using up-sampled residual signals of the lower resolution layer The same techniques can also be applied when the base layer has the same spatial resolution as the current layer (e.g coarse grain scalability). In this case, the up-sampling operations are simply discarded. III. PROPOSED SCHEMES We have developed two different schemes to generate multiple description, both of them based on prediction algorithms of the scalable extension of H.4/AVC. In order to preserve the standard coder, a pre- and post- processing scheme is HBFPS MDSC, by rows, desc. 1 BL HBFPS MDSC, by rows, desc. 2 BL ILPS MDSC, by rows, desc. 1 BL ILPS MDSC, by rows, desc. 2 BL PSS MD, one desc. Fig. 6. Rate distortion, performance when receiving only one subsequence, HBFPS MDSC, quincunx, desc. 1 BL HBFPS MDSC, quincunx, desc. 2 BL ILPS MDSC, quincunx, desc. 1 BL ILPS MDSC, quincunx, desc. 2 BL PSS MD, one desc. Fig. 7. Rate distortion, performance when receiving only one subsequence, implemented. In the pre-processing part, we down sample the original sequence by rows and columns thus generating four different sub-frames, similarly to what is done in PSS- MD. An overall view of the process can be seen in fig. 1. Then, descriptions are formed by coupling two different subsequences and sending them to the same standard scalable coder, thus obtaining two scalable descriptors that can be transmitted independently. In the post-processing part, the original sequence is obtained by merging the descriptions. In case of lost description or discarded enhancement layers, the missing pixels are reconstructed by interpolation from the received ones. Fig. 5. Image subsampling patterns. a:by rows, b:quincunx A. Hierarchical B Frame Prediction Spatial - Multiple Description Scalable Coding After obtaining the four subsequences, as in PSS-MD, we take two of them and generate a new video sequence by temporal interleaving, taking a picture from the first subsequence and one from the other alternatively, so that the sequence now has a frame rate twice the original. Then, the same scheme is applied also to the two remaining subsequences,

4 4 35 HBFPS MDSC, by rows, desc. 1 HBFPS MDSC, by rows, desc. 2 HBFPS MDSC, by rows, desc. 1 BL 2 BL ILPS MDSC, by rows, desc. 1 BL ILPS MDSC, by rows, desc. 2 BL ILPS MDSC, by rows, desc. 1 BL 2 BL PSS MD, two desc. HBFPS MDSC, by rows, desc. 1 2 BL HBFPS MDSC, by rows, desc. 1 BL 2 ILPS MDSC, by rows, desc. 1 2 BL ILPS MDSC, by rows, desc. 1 BL 2 PSS MD, three desc. Fig. 8. Rate distortion, performance when receiving two subsequences, Fig. 10. Rate distortion, performance when receiving three subsequences, HBFPS MDSC, quincunx, desc. 1 HBFPS MDSC, quincunx, desc. 2 HBFPS MDSC, quincunx, desc. 1 BL 2 BL ILPS MDSC, quincunx, desc. 1 BL ILPS MDSC, quincunx, desc. 2 BL ILPS MDSC, quincunx, desc. 1 BL 2 BL PSS MD, two desc. HBFPS MDSC, quincunx, desc. 1 2 BL HBFPS MDSC, quincunx, desc. 1 BL 2 ILPS MDSC, quincunx, desc. 1 2 BL ILPS MDSC, quincunx, desc. 1 BL 2 PSS MD, three desc. Fig. 9. Rate distortion, performance when receiving two subsequences, Fig. 11. Rate distortion, performance when receiving three subsequences, so that at the end we only get two different new streams that will form the descriptors. At this point, we code each of them using a hierarchical dyadic B frame prediction, discussed in section II-A, in order to fully predict one of them from the other one. By doing so, the redundancy is reduced to a minimum and, also, scalability is achieved since discarding the predicted subsequence, leaves the description still decodable. The structure of the interlaced sequence and an example of prediction of a GOP is depicted in fig. 3. We underline that this method is very simple and virtually is compatible with every coder that support dyadic B prediction. B. Inter Layer Prediction Spatial - Multiple Description Scalable Coding As in the previous scheme, we group the four subsequences obtained in the pre-processing part in two groups of two subsequences each, that will form the descriptions. In this method, the inter layer layer prediction algorithm of the scalable extension of H.4/AVC, described in II-B is used instead of the hierarchical B frame prediction. In particular, we configure the coder to generate a coarse grain scalable (CGS) stream with only one enhancement layer. Instead of sending the same subsequence for the base and the enhancement layer (whch is a requirement for CGS), we use the inter layer prediction algorithm to remove the redundancy between the subsequences by assigning one of them to the base layer, and the other one to the enhancement layer, with the coder structure represented in figure 4. By doing this, most of the correlation is eliminated. Scalability now is simply obtained by discarding the enhancement layer, with both descriptors still decodable. At the decoder, we reconstruct the original subsequence that forms the description by first decoding the full stream (base plus enhancement layer), obtaining the predicted subsequence, then the other subsequence is given by simply decoding the base layer only. IV. RESULTS The software used in our experiments is H.4/SVC version 8.1. The different options provided by the coder have been set as follows 1/4 pixel accuracy for motion estimation a single reference frame

5 5 GOP size 8 I frame only at the beginning 16x16, 16x8, 8x16, 8x8 inter-prediction blocks with SAD metric CABAC CIF sequence with fps Results are reported using the sequences foreman (video calling environment) and football (high motion sequence). For the sake of comparison, our approaches are compared with PSS-MD. We choose two different methods to couple the subsequences generated in the pre-processing part. The first scheme, called by rows, consist in coupling the subsequences that form the rows of the original video sequence, so one description contains the pixels of the odd rows, when the other contains those belonging to the even rows. The second scheme, called quincunx, groups the subsequences so that the pixels form a quincunx lattice. Figure 5 shows how the subsequence in coupled to form the description. In fig. 5.a we can see the by rows scheme, where subsequences one and two form the first description, while subsequences three and four form the second one. Instead, in fig. 5.b the quincunx method is shown, with the subsequence one and four generating the first description, and the subsequences two and three generating the other. Before showing the results, we make a consideration about the interpolation schemes needed at the receiver when not all substreams are received. We use different interpolation algorithms accordingly to the number and type of subsequences received: if we receive only one subsequence (i.e. only the base layer ofone of the two descriptors), we recover the missing information computing the mean of the nearest pixels; if two subsequences are recived, if they are in a row fashion, then we recover the missing information considering the mean of the two nearest pixels; otherwise, if we received two subsequences in quincunx fashion, the missed information is recovered as the mean of the four nearest pixels; if three of the four subsequence is received, the missing information is obtained by interpolation of the eight nearest pixels. We have made two different experiments in our simulations, in the first experiment, we have evaluated the performance of both methods compared to the PSS-MD method via some empirical rate distortion curves. In the second experiment, we have found the optimal value of the ILPS-MDSC method, by varying the ratio between the base layer and the full description rate. Results are reported respectively in subsection IV-A and IV-B. A. RATE DISTORTION CURVE The results are shown as a rate distortion (RD) curve, from 100 kbit/s to 1900 kbit/s with a rate span of 200 kbit/s. The total bitrate is evenly divided in the ILPS-MDSC approach among the subsequences that form the base layer and the other one transmitted as an enhancement layer. In the Fig. 12. Fig HBFPS MDSC, by rows, both desc. HBFPS MDSC, by rows, both desc. ILPS MDSC, quincunx, both desc. ILPS MDSC, quincunx, both desc. PSS MD, all desc. Rate distortion, performance when receiving all the subsequences ILPS MDSC, by rows, desc ILPS MDSC, quincunx, desc ILPS MDSC, by rows, desc ILPS MDSC, quincunx, desc ILPS MDSC, by rows, desc ILPS MDSC, quincunx, desc Optimal ratio, performance when receiving only one subsequence HBFPS-MDSC algorithm, the available bitrate is the target bitrate of the interlaced sequence, so we don t apply any rate subdivision among the subsequences that form a description and let the coder perform its best. In this subsection, all the results are reported using the foreman sequence, without loss of generality. Figures 6 and 7 show the performances when only one subsequence is received. As we can see, both methods outperform the simple PSS-MD algorithm and, in particular, we can note that the quincunx scheme gives very similar performances independently of the method used or which descriptor is received. Also, it is possible to see that the proposed schemes reach very quickly the asymptotic value given by the reconstruction algorithm. Figures 8 and 9 show the performances when receiving two subsequences, either a full description or the base layer of both descriptions. Two considerations can be made: first, when receiving one full description, the performances of the HBFPS-MDSC are always better with respect of PSS-MD, while the ILPS-MDSC scheme has more stable performances. Second, when we receive the base layer of both descriptions, the performances of the two methods are very different and mutual from the by rows and the quincunx scheme: in this cases, the performance of the by rows scheme, when receiving both base layer of

6 6 ILPS MDSC, by rows, desc. 500 ILPS MDSC, by rows, desc. 1 BL ILPS MDSC, by rows, desc ILPS MDSC, by rows, desc. 1 BL ILPS MDSC, by rows, desc ILPS MDSC, by rows, desc. 1 BL ILPS MDSC, by rows, desc ILPS MDSC, by rows, desc. 1 BL 500 ILPS MDSC, by rows, desc ILPS MDSC, by rows, desc. 1 BL 1000 ILPS MDSC, by rows, desc ILPS MDSC, by rows, desc. 1 BL Fig. 14. Optimal ratio, performance when receiving two subsequences, Fig. 16. Optimal ratio, performance when receiving three subsequences, ILPS MDSC, quincunx, desc. 500 ILPS MDSC, quincunx, desc. 1 BL ILPS MDSC, quincunx, desc ILPS MDSC, quincunx, desc. 1 BL ILPS MDSC, quincunx, desc ILPS MDSC, quincunx, desc. 1 BL Fig. 15. Optimal ratio, performance when receiving two subsequences, the descriptors, outperforms any other combination of two subsequences. This is due to the particular features of the original sequence, that promote with better performances a quincunx scheme instead of a by rows scheme and can be computed calculating the asymptotic performance of the reconstruction algorithm by coding the description at infinite bitrate. These are shown in table I for some very common video sequences: foreman, football, mobile and tempete. In particular, the quincunx method seems to give similar and better performance for both description in every considerated video sequence. A possible interpretation of this result can be made by taking Desc. 1, Desc. 2, Desc. 1, Desc. 2, by rows by rows quincux quincux Foreman Football Tempete.9.5 Mobile TABLE I ASYMPTOTIC PERFORMANCE OF INTERPOLATION METHODS into account the larger distance between the pixels of the subsequences in a quincunx scheme, so the description itself carries more information with respect of the by rows scheme. However, this advantage is lost in case both descriptions are received since more information implies lesser redundancy that can be exploited by the scalable tools of H.4/SVC, giving lower coding efficiency. Figures 10 and 11 show the performances for the case when three received subsequences, meaning a full description plus the base layer of the other one. Now, both methods seem to perform better than the standard PSS-MD algorithm and have almost the same performances, which partially confirms the previous considerations. We can also note that the HBFPS- MDSC performs a little better than the ILPS-MDSC scheme with the by rows scheme than with the quincunx scheme. The reason for this feature seems to be in the scalable coding tool used in HBFPS-MDSC scheme. In fact, the hierarchical prediction structure needs that adjacent video pictures are strongly correlated in order to exploit well all the redundancy, so it best suited to a by rows rather than to a quincunx scheme. Finally, in figure 12, we report the performances when both description are fully received. In this case, we observe that HBFPS-MDSC performs really well with the by rows scheme, but its performances drop with the quincunx method (its performance is lower than PSS-MD), for the same reasons derived from the above consideration. Instead, the ILPS-MDSC gives the best overall performances. B. OPTIMAL RATIO FOR ILPS-MDSC In these simulations, we report the results as the average of the sequence at different base layer to full description ratios, starting from 10 to 90 percent. For each description, the total bitrate is chosen to be respectively 500, 1000, and 1500 kbit/s in order to exploit the optimal value at different rates. All the results of this subsequences are provided using football subsequences for space reasons but the same considerations also hold for all the other videos used in our tests. Figure 13 shows the performances when only one subsequence is received. Obviously, as we decode only the base

7 7 ILPS MDSC, quincunx, desc ILPS MDSC, quincunx, desc. 1 BL 500 ILPS MDSC, quincunx, desc ILPS MDSC, quincunx, desc. 1 BL 1000 ILPS MDSC, quincunx, desc ILPS MDSC, quincunx, desc. 1 BL Fig. 17. Optimal ratio, performance when receiving three subsequences, Fig ILPS MDSC, by rows, both 500 ILPS MDSC, quincunx, both 500 ILPS MDSC, by rows, both 1000 ILPS MDSC, quincunx, both 1000 ILPS MDSC, by rows, both 1500 ILPS MDSC, quincunx, both Optimal ratio, performance when receiving all the subsequences layer of one description, the quality of the reconstructed sequence improves as far as we increase the ratio. However, with a ratio more than 60%, the improvement becomes very little as we reach the asympotic value of the reconstruction algorithm. Figures 14 and 15 show the performances when receiving two subsequences, either a full description or the base layer of both descriptions. In those figures, we can see two different behaviors: when a full description in received, the maximum value seems to be achieved at a ratio between 50 and 60 percent. This indicates that it s better to generate balanced descriptors by assigning the available bitrate in an almost fair way. Note that since the proposed approach exploits the redundancy between base and enhancement layers, this indeed means that the enhancement layer gets a rather large amount of bits. On the other hand, if we reconstruct the sequence starting from the base layers of both descriptors, the trends seem to be more similar to the one subsequence figure. However, above 70% the gain is very low compared with the loss in case of receiving, otherwise, one description. Figures 16 and 17 show the performance for three received subsequences. Now, we always have one full description plus the base layer of the other one, so we have at the same time the two different behaviors of the case when receiving two subsequences. As we can see, the performance seems to be more influenced by the rate of the enhancement layer than by the gain of having another base layer, so the maximum performance can be achieved with a ratio of about 60-70%. Finally, figure 18 shows the performance when both descriptors are fully received. As we can see, we reach the maximun performance with a ratio of 60%, thus confirming all the above given considerations. V. CONCLUSIONS In this paper we introduced some possible novel algorithms to generate multiple description in a H.4/SVC coder and have shown their performances compared to single description coding. Also, the second set of experiments shows that the better overall performance can be obtained by using a ratio of about 60-70% in almost every considerated sequences. Work is in progress to improve these algorithms and to introduce them in real network scenarios to exploit their adaptability and robustness features. Plus, future works will be related to introduce Fine Granular Scalability in each layer in order to be more flexible at variable bitrate and to find some rate distortion analytic functions that fits well the rate distortion curve obtained. REFERENCES [1] V.K. Goyal, Multiple Description Coding: Compression meets the network, International Conference on Image Processing (ICIP), vol. 18, no. 5, pp , Sept [2] J.G. Apostolopoulos, Error-resilient video compression through the use of multiple states, Proc. IEEE ICIP 00, Vancover, Canada, vol. 3, pp , [3] Y. Wang and S. Lin, Error resilient video coding using multiple description motion compensation, IEEE Transaction Circuits and Systems for Video Technology, vol. 12, no. 6, pp , June [4] A. Vitali, F. Rovati, R. Rinaldo, R. Bernardini and M. Durigon, Low- Complexity Standard-Compatible Robust and Scalable Video Streaming over Lossy/Variable Bandwidth Networks, IEEE International Conference on Consumer Electronics, Jan. 2005, Las Vegas, USA, pp [5] S. Shirani, M. Gallant, and F. Kossentini, Multiple description image coding using pre- and post-processing, IEEE Proceedings of the International Conference on Information Technology: Coding and Computing, Las Vegas, USA, pp , April [6] M. Liu, Ce Zhu, Multiple description video coding using hierarchical B pictures, IEEE International Conference on Multimedia and Expo, Beijing, China, pp , July [7] N. Franchi, M. Fumagalli, R. Lancini, and S. Tubaro, Multiple Description Video Coding for Scalable and Robust Transmission Over IP, IEEE Transactions on Circuits and Systems for Video Technology, vol. 15, no. 3, pp. 1-3, March [8] Zhe Wei, Canhui Cai, and Kai-Kuang Ma, A Novel H.4-based Multiple Description Video Coding Via Polyphase Transform and Partial Prediction, International Symposium on Intelligent Signal Processing and Communications, Yonago, Japan, pp , December [9] M. Folli, L. Favalli, Multiple Description Coding algorithms for H.4 coder, Mobimedia 07, Nafpaktos, Greece, August [10] H. Schwarz, T. Hinz, H. Kirchhoffer, D. Marpe, and T. Wiegand, Technical description of the HHI proposal for SVC CE1, ISO/IEC JTC1/SC/WG11, Doc. m114, Palma de Mallorca, Spain, Oct [11] R. Schafer, H. Schwarz, D. Marpe, and T. Wiegand, MCTF and Scalability Extension of H.4/AVC and its applications to video transmission, storage and surveillance, Visual Communications and Image Processing, July 2005.

Parameters optimization for a scalable multiple description coding scheme based on spatial subsampling

Parameters optimization for a scalable multiple description coding scheme based on spatial subsampling Parameters optimization for a scalable multiple description coding scheme based on spatial subsampling ABSTRACT Marco Folli and Lorenzo Favalli Universitá degli studi di Pavia Via Ferrata 1 100 Pavia,

More information

MULTI-STATE VIDEO CODING WITH SIDE INFORMATION. Sila Ekmekci Flierl, Thomas Sikora

MULTI-STATE VIDEO CODING WITH SIDE INFORMATION. Sila Ekmekci Flierl, Thomas Sikora MULTI-STATE VIDEO CODING WITH SIDE INFORMATION Sila Ekmekci Flierl, Thomas Sikora Technical University Berlin Institute for Telecommunications D-10587 Berlin / Germany ABSTRACT Multi-State Video Coding

More information

Research Topic. Error Concealment Techniques in H.264/AVC for Wireless Video Transmission in Mobile Networks

Research Topic. Error Concealment Techniques in H.264/AVC for Wireless Video Transmission in Mobile Networks Research Topic Error Concealment Techniques in H.264/AVC for Wireless Video Transmission in Mobile Networks July 22 nd 2008 Vineeth Shetty Kolkeri EE Graduate,UTA 1 Outline 2. Introduction 3. Error control

More information

University of Bristol - Explore Bristol Research. Peer reviewed version. Link to published version (if available): /ISCAS.2005.

University of Bristol - Explore Bristol Research. Peer reviewed version. Link to published version (if available): /ISCAS.2005. Wang, D., Canagarajah, CN., & Bull, DR. (2005). S frame design for multiple description video coding. In IEEE International Symposium on Circuits and Systems (ISCAS) Kobe, Japan (Vol. 3, pp. 19 - ). Institute

More information

Research Article Spatial Multiple Description Coding for Scalable Video Streams

Research Article Spatial Multiple Description Coding for Scalable Video Streams Digital Multimedia Broadcasting, Article ID 132621, 8 pages http://dx.doi.org/10.1155/2014/132621 Research Article Spatial Multiple Description Coding for Scalable Video Streams Roya Choupani, 1 Stephan

More information

Joint Optimization of Source-Channel Video Coding Using the H.264/AVC encoder and FEC Codes. Digital Signal and Image Processing Lab

Joint Optimization of Source-Channel Video Coding Using the H.264/AVC encoder and FEC Codes. Digital Signal and Image Processing Lab Joint Optimization of Source-Channel Video Coding Using the H.264/AVC encoder and FEC Codes Digital Signal and Image Processing Lab Simone Milani Ph.D. student simone.milani@dei.unipd.it, Summer School

More information

Coding. Multiple Description. Packet networks [1][2] a new technology for video streaming over the Internet. Andrea Vitali STMicroelectronics

Coding. Multiple Description. Packet networks [1][2] a new technology for video streaming over the Internet. Andrea Vitali STMicroelectronics Coding Multiple Description a new technology for video streaming over the Internet Andrea Vitali STMicroelectronics The Internet is growing quickly as a network of heterogeneous communication networks.

More information

Video coding standards

Video coding standards Video coding standards Video signals represent sequences of images or frames which can be transmitted with a rate from 5 to 60 frames per second (fps), that provides the illusion of motion in the displayed

More information

Module 8 VIDEO CODING STANDARDS. Version 2 ECE IIT, Kharagpur

Module 8 VIDEO CODING STANDARDS. Version 2 ECE IIT, Kharagpur Module 8 VIDEO CODING STANDARDS Lesson 24 MPEG-2 Standards Lesson Objectives At the end of this lesson, the students should be able to: 1. State the basic objectives of MPEG-2 standard. 2. Enlist the profiles

More information

A Novel Macroblock-Level Filtering Upsampling Architecture for H.264/AVC Scalable Extension

A Novel Macroblock-Level Filtering Upsampling Architecture for H.264/AVC Scalable Extension 05-Silva-AF:05-Silva-AF 8/19/11 6:18 AM Page 43 A Novel Macroblock-Level Filtering Upsampling Architecture for H.264/AVC Scalable Extension T. L. da Silva 1, L. A. S. Cruz 2, and L. V. Agostini 3 1 Telecommunications

More information

SCALABLE video coding (SVC) is currently being developed

SCALABLE video coding (SVC) is currently being developed IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. 16, NO. 7, JULY 2006 889 Fast Mode Decision Algorithm for Inter-Frame Coding in Fully Scalable Video Coding He Li, Z. G. Li, Senior

More information

ARTICLE IN PRESS. Signal Processing: Image Communication

ARTICLE IN PRESS. Signal Processing: Image Communication Signal Processing: Image Communication 23 (2008) 677 691 Contents lists available at ScienceDirect Signal Processing: Image Communication journal homepage: www.elsevier.com/locate/image H.264/AVC-based

More information

Chapter 2 Introduction to

Chapter 2 Introduction to Chapter 2 Introduction to H.264/AVC H.264/AVC [1] is the newest video coding standard of the ITU-T Video Coding Experts Group (VCEG) and the ISO/IEC Moving Picture Experts Group (MPEG). The main improvements

More information

Hierarchical SNR Scalable Video Coding with Adaptive Quantization for Reduced Drift Error

Hierarchical SNR Scalable Video Coding with Adaptive Quantization for Reduced Drift Error Hierarchical SNR Scalable Video Coding with Adaptive Quantization for Reduced Drift Error Roya Choupani 12, Stephan Wong 1 and Mehmet Tolun 3 1 Computer Engineering Department, Delft University of Technology,

More information

Motion Re-estimation for MPEG-2 to MPEG-4 Simple Profile Transcoding. Abstract. I. Introduction

Motion Re-estimation for MPEG-2 to MPEG-4 Simple Profile Transcoding. Abstract. I. Introduction Motion Re-estimation for MPEG-2 to MPEG-4 Simple Profile Transcoding Jun Xin, Ming-Ting Sun*, and Kangwook Chun** *Department of Electrical Engineering, University of Washington **Samsung Electronics Co.

More information

Error Concealment for SNR Scalable Video Coding

Error Concealment for SNR Scalable Video Coding Error Concealment for SNR Scalable Video Coding M. M. Ghandi and M. Ghanbari University of Essex, Wivenhoe Park, Colchester, UK, CO4 3SQ. Emails: (mahdi,ghan)@essex.ac.uk Abstract This paper proposes an

More information

CODING EFFICIENCY IMPROVEMENT FOR SVC BROADCAST IN THE CONTEXT OF THE EMERGING DVB STANDARDIZATION

CODING EFFICIENCY IMPROVEMENT FOR SVC BROADCAST IN THE CONTEXT OF THE EMERGING DVB STANDARDIZATION 17th European Signal Processing Conference (EUSIPCO 2009) Glasgow, Scotland, August 24-28, 2009 CODING EFFICIENCY IMPROVEMENT FOR SVC BROADCAST IN THE CONTEXT OF THE EMERGING DVB STANDARDIZATION Heiko

More information

Overview: Video Coding Standards

Overview: Video Coding Standards Overview: Video Coding Standards Video coding standards: applications and common structure ITU-T Rec. H.261 ISO/IEC MPEG-1 ISO/IEC MPEG-2 State-of-the-art: H.264/AVC Video Coding Standards no. 1 Applications

More information

Fast MBAFF/PAFF Motion Estimation and Mode Decision Scheme for H.264

Fast MBAFF/PAFF Motion Estimation and Mode Decision Scheme for H.264 Fast MBAFF/PAFF Motion Estimation and Mode Decision Scheme for H.264 Ju-Heon Seo, Sang-Mi Kim, Jong-Ki Han, Nonmember Abstract-- In the H.264, MBAFF (Macroblock adaptive frame/field) and PAFF (Picture

More information

ROBUST ADAPTIVE INTRA REFRESH FOR MULTIVIEW VIDEO

ROBUST ADAPTIVE INTRA REFRESH FOR MULTIVIEW VIDEO ROBUST ADAPTIVE INTRA REFRESH FOR MULTIVIEW VIDEO Sagir Lawan1 and Abdul H. Sadka2 1and 2 Department of Electronic and Computer Engineering, Brunel University, London, UK ABSTRACT Transmission error propagation

More information

Module 8 VIDEO CODING STANDARDS. Version 2 ECE IIT, Kharagpur

Module 8 VIDEO CODING STANDARDS. Version 2 ECE IIT, Kharagpur Module 8 VIDEO CODING STANDARDS Lesson 27 H.264 standard Lesson Objectives At the end of this lesson, the students should be able to: 1. State the broad objectives of the H.264 standard. 2. List the improved

More information

INFORMATION THEORY INSPIRED VIDEO CODING METHODS : TRUTH IS SOMETIMES BETTER THAN FICTION

INFORMATION THEORY INSPIRED VIDEO CODING METHODS : TRUTH IS SOMETIMES BETTER THAN FICTION INFORMATION THEORY INSPIRED VIDEO CODING METHODS : TRUTH IS SOMETIMES BETTER THAN FICTION Nitin Khanna, Fengqing Zhu, Marc Bosch, Meilin Yang, Mary Comer and Edward J. Delp Video and Image Processing Lab

More information

MPEG has been established as an international standard

MPEG has been established as an international standard 1100 IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. 9, NO. 7, OCTOBER 1999 Fast Extraction of Spatially Reduced Image Sequences from MPEG-2 Compressed Video Junehwa Song, Member,

More information

Robust 3-D Video System Based on Modified Prediction Coding and Adaptive Selection Mode Error Concealment Algorithm

Robust 3-D Video System Based on Modified Prediction Coding and Adaptive Selection Mode Error Concealment Algorithm International Journal of Signal Processing Systems Vol. 2, No. 2, December 2014 Robust 3-D Video System Based on Modified Prediction Coding and Adaptive Selection Mode Error Concealment Algorithm Walid

More information

COMP 249 Advanced Distributed Systems Multimedia Networking. Video Compression Standards

COMP 249 Advanced Distributed Systems Multimedia Networking. Video Compression Standards COMP 9 Advanced Distributed Systems Multimedia Networking Video Compression Standards Kevin Jeffay Department of Computer Science University of North Carolina at Chapel Hill jeffay@cs.unc.edu September,

More information

Concealment of Whole-Picture Loss in Hierarchical B-Picture Scalable Video Coding Xiangyang Ji, Debin Zhao, and Wen Gao, Senior Member, IEEE

Concealment of Whole-Picture Loss in Hierarchical B-Picture Scalable Video Coding Xiangyang Ji, Debin Zhao, and Wen Gao, Senior Member, IEEE IEEE TRANSACTIONS ON MULTIMEDIA, VOL. 11, NO. 1, JANUARY 2009 11 Concealment of Whole-Picture Loss in Hierarchical B-Picture Scalable Video Coding Xiangyang Ji, Debin Zhao, and Wen Gao, Senior Member,

More information

Interleaved Source Coding (ISC) for Predictive Video Coded Frames over the Internet

Interleaved Source Coding (ISC) for Predictive Video Coded Frames over the Internet Interleaved Source Coding (ISC) for Predictive Video Coded Frames over the Internet Jin Young Lee 1,2 1 Broadband Convergence Networking Division ETRI Daejeon, 35-35 Korea jinlee@etri.re.kr Abstract Unreliable

More information

The H.263+ Video Coding Standard: Complexity and Performance

The H.263+ Video Coding Standard: Complexity and Performance The H.263+ Video Coding Standard: Complexity and Performance Berna Erol (bernae@ee.ubc.ca), Michael Gallant (mikeg@ee.ubc.ca), Guy C t (guyc@ee.ubc.ca), and Faouzi Kossentini (faouzi@ee.ubc.ca) Department

More information

Video compression principles. Color Space Conversion. Sub-sampling of Chrominance Information. Video: moving pictures and the terms frame and

Video compression principles. Color Space Conversion. Sub-sampling of Chrominance Information. Video: moving pictures and the terms frame and Video compression principles Video: moving pictures and the terms frame and picture. one approach to compressing a video source is to apply the JPEG algorithm to each frame independently. This approach

More information

Project Proposal: Sub pixel motion estimation for side information generation in Wyner- Ziv decoder.

Project Proposal: Sub pixel motion estimation for side information generation in Wyner- Ziv decoder. EE 5359 MULTIMEDIA PROCESSING Subrahmanya Maira Venkatrav 1000615952 Project Proposal: Sub pixel motion estimation for side information generation in Wyner- Ziv decoder. Wyner-Ziv(WZ) encoder is a low

More information

An Overview of Video Coding Algorithms

An Overview of Video Coding Algorithms An Overview of Video Coding Algorithms Prof. Ja-Ling Wu Department of Computer Science and Information Engineering National Taiwan University Video coding can be viewed as image compression with a temporal

More information

Error-Resilience Video Transcoding for Wireless Communications

Error-Resilience Video Transcoding for Wireless Communications MITSUBISHI ELECTRIC RESEARCH LABORATORIES http://www.merl.com Error-Resilience Video Transcoding for Wireless Communications Anthony Vetro, Jun Xin, Huifang Sun TR2005-102 August 2005 Abstract Video communication

More information

Video Transmission. Thomas Wiegand: Digital Image Communication Video Transmission 1. Transmission of Hybrid Coded Video. Channel Encoder.

Video Transmission. Thomas Wiegand: Digital Image Communication Video Transmission 1. Transmission of Hybrid Coded Video. Channel Encoder. Video Transmission Transmission of Hybrid Coded Video Error Control Channel Motion-compensated Video Coding Error Mitigation Scalable Approaches Intra Coding Distortion-Distortion Functions Feedback-based

More information

Video Over Mobile Networks

Video Over Mobile Networks Video Over Mobile Networks Professor Mohammed Ghanbari Department of Electronic systems Engineering University of Essex United Kingdom June 2005, Zadar, Croatia (Slides prepared by M. Mahdi Ghandi) INTRODUCTION

More information

Introduction to Video Compression Techniques. Slides courtesy of Tay Vaughan Making Multimedia Work

Introduction to Video Compression Techniques. Slides courtesy of Tay Vaughan Making Multimedia Work Introduction to Video Compression Techniques Slides courtesy of Tay Vaughan Making Multimedia Work Agenda Video Compression Overview Motivation for creating standards What do the standards specify Brief

More information

International Journal for Research in Applied Science & Engineering Technology (IJRASET) Motion Compensation Techniques Adopted In HEVC

International Journal for Research in Applied Science & Engineering Technology (IJRASET) Motion Compensation Techniques Adopted In HEVC Motion Compensation Techniques Adopted In HEVC S.Mahesh 1, K.Balavani 2 M.Tech student in Bapatla Engineering College, Bapatla, Andahra Pradesh Assistant professor in Bapatla Engineering College, Bapatla,

More information

Principles of Video Compression

Principles of Video Compression Principles of Video Compression Topics today Introduction Temporal Redundancy Reduction Coding for Video Conferencing (H.261, H.263) (CSIT 410) 2 Introduction Reduce video bit rates while maintaining an

More information

Robust Transmission of H.264/AVC Video using 64-QAM and unequal error protection

Robust Transmission of H.264/AVC Video using 64-QAM and unequal error protection Robust Transmission of H.264/AVC Video using 64-QAM and unequal error protection Ahmed B. Abdurrhman 1, Michael E. Woodward 1 and Vasileios Theodorakopoulos 2 1 School of Informatics, Department of Computing,

More information

An Efficient Low Bit-Rate Video-Coding Algorithm Focusing on Moving Regions

An Efficient Low Bit-Rate Video-Coding Algorithm Focusing on Moving Regions 1128 IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. 11, NO. 10, OCTOBER 2001 An Efficient Low Bit-Rate Video-Coding Algorithm Focusing on Moving Regions Kwok-Wai Wong, Kin-Man Lam,

More information

Error Resilient Video Coding Using Unequally Protected Key Pictures

Error Resilient Video Coding Using Unequally Protected Key Pictures Error Resilient Video Coding Using Unequally Protected Key Pictures Ye-Kui Wang 1, Miska M. Hannuksela 2, and Moncef Gabbouj 3 1 Nokia Mobile Software, Tampere, Finland 2 Nokia Research Center, Tampere,

More information

Robust Transmission of H.264/AVC Video Using 64-QAM and Unequal Error Protection

Robust Transmission of H.264/AVC Video Using 64-QAM and Unequal Error Protection Robust Transmission of H.264/AVC Video Using 64-QAM and Unequal Error Protection Ahmed B. Abdurrhman, Michael E. Woodward, and Vasileios Theodorakopoulos School of Informatics, Department of Computing,

More information

Selective Intra Prediction Mode Decision for H.264/AVC Encoders

Selective Intra Prediction Mode Decision for H.264/AVC Encoders Selective Intra Prediction Mode Decision for H.264/AVC Encoders Jun Sung Park, and Hyo Jung Song Abstract H.264/AVC offers a considerably higher improvement in coding efficiency compared to other compression

More information

Multiple Description H.264 Video Coding with Redundant Pictures

Multiple Description H.264 Video Coding with Redundant Pictures Multiple Description H.4 Video Coding with Redundant Pictures Ivana Radulovic Ecole Polytechnique Fédérale de Lausanne (EPFL) CH-1015 Lausanne, Switzerland ivana.radulovic@epfl.ch Ye-Kui Wang, Stephan

More information

Systematic Lossy Error Protection of Video based on H.264/AVC Redundant Slices

Systematic Lossy Error Protection of Video based on H.264/AVC Redundant Slices Systematic Lossy Error Protection of based on H.264/AVC Redundant Slices Shantanu Rane and Bernd Girod Information Systems Laboratory Stanford University, Stanford, CA 94305. {srane,bgirod}@stanford.edu

More information

Joint source-channel video coding for H.264 using FEC

Joint source-channel video coding for H.264 using FEC Department of Information Engineering (DEI) University of Padova Italy Joint source-channel video coding for H.264 using FEC Simone Milani simone.milani@dei.unipd.it DEI-University of Padova Gian Antonio

More information

Performance Evaluation of Error Resilience Techniques in H.264/AVC Standard

Performance Evaluation of Error Resilience Techniques in H.264/AVC Standard Performance Evaluation of Error Resilience Techniques in H.264/AVC Standard Ram Narayan Dubey Masters in Communication Systems Dept of ECE, IIT-R, India Varun Gunnala Masters in Communication Systems Dept

More information

ABSTRACT ERROR CONCEALMENT TECHNIQUES IN H.264/AVC, FOR VIDEO TRANSMISSION OVER WIRELESS NETWORK. Vineeth Shetty Kolkeri, M.S.

ABSTRACT ERROR CONCEALMENT TECHNIQUES IN H.264/AVC, FOR VIDEO TRANSMISSION OVER WIRELESS NETWORK. Vineeth Shetty Kolkeri, M.S. ABSTRACT ERROR CONCEALMENT TECHNIQUES IN H.264/AVC, FOR VIDEO TRANSMISSION OVER WIRELESS NETWORK Vineeth Shetty Kolkeri, M.S. The University of Texas at Arlington, 2008 Supervising Professor: Dr. K. R.

More information

A Novel Approach towards Video Compression for Mobile Internet using Transform Domain Technique

A Novel Approach towards Video Compression for Mobile Internet using Transform Domain Technique A Novel Approach towards Video Compression for Mobile Internet using Transform Domain Technique Dhaval R. Bhojani Research Scholar, Shri JJT University, Jhunjunu, Rajasthan, India Ved Vyas Dwivedi, PhD.

More information

AN IMPROVED ERROR CONCEALMENT STRATEGY DRIVEN BY SCENE MOTION PROPERTIES FOR H.264/AVC DECODERS

AN IMPROVED ERROR CONCEALMENT STRATEGY DRIVEN BY SCENE MOTION PROPERTIES FOR H.264/AVC DECODERS AN IMPROVED ERROR CONCEALMENT STRATEGY DRIVEN BY SCENE MOTION PROPERTIES FOR H.264/AVC DECODERS Susanna Spinsante, Ennio Gambi, Franco Chiaraluce Dipartimento di Elettronica, Intelligenza artificiale e

More information

INTERNATIONAL JOURNAL OF ELECTRONICS AND COMMUNICATION ENGINEERING & TECHNOLOGY (IJECET)

INTERNATIONAL JOURNAL OF ELECTRONICS AND COMMUNICATION ENGINEERING & TECHNOLOGY (IJECET) INTERNATIONAL JOURNAL OF ELECTRONICS AND COMMUNICATION ENGINEERING & TECHNOLOGY (IJECET) International Journal of Electronics and Communication Engineering & Technology (IJECET), ISSN 0976 ISSN 0976 6464(Print)

More information

Chapter 10 Basic Video Compression Techniques

Chapter 10 Basic Video Compression Techniques Chapter 10 Basic Video Compression Techniques 10.1 Introduction to Video compression 10.2 Video Compression with Motion Compensation 10.3 Video compression standard H.261 10.4 Video compression standard

More information

Region Adaptive Unsharp Masking based DCT Interpolation for Efficient Video Intra Frame Up-sampling

Region Adaptive Unsharp Masking based DCT Interpolation for Efficient Video Intra Frame Up-sampling International Conference on Electronic Design and Signal Processing (ICEDSP) 0 Region Adaptive Unsharp Masking based DCT Interpolation for Efficient Video Intra Frame Up-sampling Aditya Acharya Dept. of

More information

Multimedia Communications. Video compression

Multimedia Communications. Video compression Multimedia Communications Video compression Video compression Of all the different sources of data, video produces the largest amount of data There are some differences in our perception with regard to

More information

VIDEO compression is mainly based on block-based motion

VIDEO compression is mainly based on block-based motion IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. 18, NO. 1, JANUARY 2008 59 Redundant Slice Optimal Allocation for H.264 Multiple Description Coding Tammam Tillo, Member, IEEE, Marco

More information

A Study of Encoding and Decoding Techniques for Syndrome-Based Video Coding

A Study of Encoding and Decoding Techniques for Syndrome-Based Video Coding MITSUBISHI ELECTRIC RESEARCH LABORATORIES http://www.merl.com A Study of Encoding and Decoding Techniques for Syndrome-Based Video Coding Min Wu, Anthony Vetro, Jonathan Yedidia, Huifang Sun, Chang Wen

More information

Comparative Study of JPEG2000 and H.264/AVC FRExt I Frame Coding on High-Definition Video Sequences

Comparative Study of JPEG2000 and H.264/AVC FRExt I Frame Coding on High-Definition Video Sequences Comparative Study of and H.264/AVC FRExt I Frame Coding on High-Definition Video Sequences Pankaj Topiwala 1 FastVDO, LLC, Columbia, MD 210 ABSTRACT This paper reports the rate-distortion performance comparison

More information

Free Viewpoint Switching in Multi-view Video Streaming Using. Wyner-Ziv Video Coding

Free Viewpoint Switching in Multi-view Video Streaming Using. Wyner-Ziv Video Coding Free Viewpoint Switching in Multi-view Video Streaming Using Wyner-Ziv Video Coding Xun Guo 1,, Yan Lu 2, Feng Wu 2, Wen Gao 1, 3, Shipeng Li 2 1 School of Computer Sciences, Harbin Institute of Technology,

More information

PERCEPTUAL QUALITY COMPARISON BETWEEN SINGLE-LAYER AND SCALABLE VIDEOS AT THE SAME SPATIAL, TEMPORAL AND AMPLITUDE RESOLUTIONS. Yuanyi Xue, Yao Wang

PERCEPTUAL QUALITY COMPARISON BETWEEN SINGLE-LAYER AND SCALABLE VIDEOS AT THE SAME SPATIAL, TEMPORAL AND AMPLITUDE RESOLUTIONS. Yuanyi Xue, Yao Wang PERCEPTUAL QUALITY COMPARISON BETWEEN SINGLE-LAYER AND SCALABLE VIDEOS AT THE SAME SPATIAL, TEMPORAL AND AMPLITUDE RESOLUTIONS Yuanyi Xue, Yao Wang Department of Electrical and Computer Engineering Polytechnic

More information

UNBALANCED QUANTIZED MULTI-STATE VIDEO CODING

UNBALANCED QUANTIZED MULTI-STATE VIDEO CODING UNBALANCED QUANTIZED MULTI-STATE VIDEO CODING Sila Ekmekci Flierl, Thomas Sikora +, Pascal Frossard Ecole Polytechnique Fédérale de Lausanne (EPFL) Technical University Berlin + Signal Processing Institute

More information

Dual Frame Video Encoding with Feedback

Dual Frame Video Encoding with Feedback Video Encoding with Feedback Athanasios Leontaris and Pamela C. Cosman Department of Electrical and Computer Engineering University of California, San Diego, La Jolla, CA 92093-0407 Email: pcosman,aleontar

More information

Motion Video Compression

Motion Video Compression 7 Motion Video Compression 7.1 Motion video Motion video contains massive amounts of redundant information. This is because each image has redundant information and also because there are very few changes

More information

Modeling and Optimization of a Systematic Lossy Error Protection System based on H.264/AVC Redundant Slices

Modeling and Optimization of a Systematic Lossy Error Protection System based on H.264/AVC Redundant Slices Modeling and Optimization of a Systematic Lossy Error Protection System based on H.264/AVC Redundant Slices Shantanu Rane, Pierpaolo Baccichet and Bernd Girod Information Systems Laboratory, Department

More information

Interleaved Source Coding (ISC) for Predictive Video over ERASURE-Channels

Interleaved Source Coding (ISC) for Predictive Video over ERASURE-Channels Interleaved Source Coding (ISC) for Predictive Video over ERASURE-Channels Jin Young Lee, Member, IEEE and Hayder Radha, Senior Member, IEEE Abstract Packet losses over unreliable networks have a severe

More information

Analysis of MPEG-2 Video Streams

Analysis of MPEG-2 Video Streams Analysis of MPEG-2 Video Streams Damir Isović and Gerhard Fohler Department of Computer Engineering Mälardalen University, Sweden damir.isovic, gerhard.fohler @mdh.se Abstract MPEG-2 is widely used as

More information

Rate-distortion optimized mode selection method for multiple description video coding

Rate-distortion optimized mode selection method for multiple description video coding Multimed Tools Appl (2014) 72:1411 14 DOI 10.1007/s11042-013-14-8 Rate-distortion optimized mode selection method for multiple description video coding Yu-Chen Sun & Wen-Jiin Tsai Published online: 19

More information

Error concealment techniques in H.264 video transmission over wireless networks

Error concealment techniques in H.264 video transmission over wireless networks Error concealment techniques in H.264 video transmission over wireless networks M U L T I M E D I A P R O C E S S I N G ( E E 5 3 5 9 ) S P R I N G 2 0 1 1 D R. K. R. R A O F I N A L R E P O R T Murtaza

More information

WYNER-ZIV VIDEO CODING WITH LOW ENCODER COMPLEXITY

WYNER-ZIV VIDEO CODING WITH LOW ENCODER COMPLEXITY WYNER-ZIV VIDEO CODING WITH LOW ENCODER COMPLEXITY (Invited Paper) Anne Aaron and Bernd Girod Information Systems Laboratory Stanford University, Stanford, CA 94305 {amaaron,bgirod}@stanford.edu Abstract

More information

Contents. xv xxi xxiii xxiv. 1 Introduction 1 References 4

Contents. xv xxi xxiii xxiv. 1 Introduction 1 References 4 Contents List of figures List of tables Preface Acknowledgements xv xxi xxiii xxiv 1 Introduction 1 References 4 2 Digital video 5 2.1 Introduction 5 2.2 Analogue television 5 2.3 Interlace 7 2.4 Picture

More information

Multimedia Communications. Image and Video compression

Multimedia Communications. Image and Video compression Multimedia Communications Image and Video compression JPEG2000 JPEG2000: is based on wavelet decomposition two types of wavelet filters one similar to what discussed in Chapter 14 and the other one generates

More information

MPEG-1 and MPEG-2 Digital Video Coding Standards

MPEG-1 and MPEG-2 Digital Video Coding Standards Heinrich-Hertz-Intitut Berlin - Image Processing Department, Thomas Sikora Please note that the page has been produced based on text and image material from a book in [sik] and may be subject to copyright

More information

Systematic Lossy Forward Error Protection for Error-Resilient Digital Video Broadcasting

Systematic Lossy Forward Error Protection for Error-Resilient Digital Video Broadcasting Systematic Lossy Forward Error Protection for Error-Resilient Digital Broadcasting Shantanu Rane, Anne Aaron and Bernd Girod Information Systems Laboratory, Stanford University, Stanford, CA 94305 {srane,amaaron,bgirod}@stanford.edu

More information

SCENE CHANGE ADAPTATION FOR SCALABLE VIDEO CODING

SCENE CHANGE ADAPTATION FOR SCALABLE VIDEO CODING 17th European Signal Processing Conference (EUSIPCO 2009) Glasgow, Scotland, August 24-28, 2009 SCENE CHANGE ADAPTATION FOR SCALABLE VIDEO CODING Tea Anselmo, Daniele Alfonso Advanced System Technology

More information

The H.26L Video Coding Project

The H.26L Video Coding Project The H.26L Video Coding Project New ITU-T Q.6/SG16 (VCEG - Video Coding Experts Group) standardization activity for video compression August 1999: 1 st test model (TML-1) December 2001: 10 th test model

More information

Skip Length and Inter-Starvation Distance as a Combined Metric to Assess the Quality of Transmitted Video

Skip Length and Inter-Starvation Distance as a Combined Metric to Assess the Quality of Transmitted Video Skip Length and Inter-Starvation Distance as a Combined Metric to Assess the Quality of Transmitted Video Mohamed Hassan, Taha Landolsi, Husameldin Mukhtar, and Tamer Shanableh College of Engineering American

More information

Minimax Disappointment Video Broadcasting

Minimax Disappointment Video Broadcasting Minimax Disappointment Video Broadcasting DSP Seminar Spring 2001 Leiming R. Qian and Douglas L. Jones http://www.ifp.uiuc.edu/ lqian Seminar Outline 1. Motivation and Introduction 2. Background Knowledge

More information

FAST SPATIAL AND TEMPORAL CORRELATION-BASED REFERENCE PICTURE SELECTION

FAST SPATIAL AND TEMPORAL CORRELATION-BASED REFERENCE PICTURE SELECTION FAST SPATIAL AND TEMPORAL CORRELATION-BASED REFERENCE PICTURE SELECTION 1 YONGTAE KIM, 2 JAE-GON KIM, and 3 HAECHUL CHOI 1, 3 Hanbat National University, Department of Multimedia Engineering 2 Korea Aerospace

More information

A robust video encoding scheme to enhance error concealment of intra frames

A robust video encoding scheme to enhance error concealment of intra frames Loughborough University Institutional Repository A robust video encoding scheme to enhance error concealment of intra frames This item was submitted to Loughborough University's Institutional Repository

More information

PACKET-SWITCHED networks have become ubiquitous

PACKET-SWITCHED networks have become ubiquitous IEEE TRANSACTIONS ON IMAGE PROCESSING, VOL. 13, NO. 7, JULY 2004 885 Video Compression for Lossy Packet Networks With Mode Switching and a Dual-Frame Buffer Athanasios Leontaris, Student Member, IEEE,

More information

MPEG-2. ISO/IEC (or ITU-T H.262)

MPEG-2. ISO/IEC (or ITU-T H.262) 1 ISO/IEC 13818-2 (or ITU-T H.262) High quality encoding of interlaced video at 4-15 Mbps for digital video broadcast TV and digital storage media Applications Broadcast TV, Satellite TV, CATV, HDTV, video

More information

Analysis of Video Transmission over Lossy Channels

Analysis of Video Transmission over Lossy Channels 1012 IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, VOL. 18, NO. 6, JUNE 2000 Analysis of Video Transmission over Lossy Channels Klaus Stuhlmüller, Niko Färber, Member, IEEE, Michael Link, and Bernd

More information

1. INTRODUCTION. Index Terms Video Transcoding, Video Streaming, Frame skipping, Interpolation frame, Decoder, Encoder.

1. INTRODUCTION. Index Terms Video Transcoding, Video Streaming, Frame skipping, Interpolation frame, Decoder, Encoder. Video Streaming Based on Frame Skipping and Interpolation Techniques Fadlallah Ali Fadlallah Department of Computer Science Sudan University of Science and Technology Khartoum-SUDAN fadali@sustech.edu

More information

Modeling and Evaluating Feedback-Based Error Control for Video Transfer

Modeling and Evaluating Feedback-Based Error Control for Video Transfer Modeling and Evaluating Feedback-Based Error Control for Video Transfer by Yubing Wang A Dissertation Submitted to the Faculty of the WORCESTER POLYTECHNIC INSTITUTE In partial fulfillment of the Requirements

More information

Implementation of an MPEG Codec on the Tilera TM 64 Processor

Implementation of an MPEG Codec on the Tilera TM 64 Processor 1 Implementation of an MPEG Codec on the Tilera TM 64 Processor Whitney Flohr Supervisor: Mark Franklin, Ed Richter Department of Electrical and Systems Engineering Washington University in St. Louis Fall

More information

CONSTRAINING delay is critical for real-time communication

CONSTRAINING delay is critical for real-time communication 1726 IEEE TRANSACTIONS ON IMAGE PROCESSING, VOL. 16, NO. 7, JULY 2007 Compression Efficiency and Delay Tradeoffs for Hierarchical B-Pictures and Pulsed-Quality Frames Athanasios Leontaris, Member, IEEE,

More information

ENCODING OF PREDICTIVE ERROR FRAMES IN RATE SCALABLE VIDEO CODECS USING WAVELET SHRINKAGE. Eduardo Asbun, Paul Salama, and Edward J.

ENCODING OF PREDICTIVE ERROR FRAMES IN RATE SCALABLE VIDEO CODECS USING WAVELET SHRINKAGE. Eduardo Asbun, Paul Salama, and Edward J. ENCODING OF PREDICTIVE ERROR FRAMES IN RATE SCALABLE VIDEO CODECS USING WAVELET SHRINKAGE Eduardo Asbun, Paul Salama, and Edward J. Delp Video and Image Processing Laboratory (VIPER) School of Electrical

More information

Constant Bit Rate for Video Streaming Over Packet Switching Networks

Constant Bit Rate for Video Streaming Over Packet Switching Networks International OPEN ACCESS Journal Of Modern Engineering Research (IJMER) Constant Bit Rate for Video Streaming Over Packet Switching Networks Mr. S. P.V Subba rao 1, Y. Renuka Devi 2 Associate professor

More information

Impact of scan conversion methods on the performance of scalable. video coding. E. Dubois, N. Baaziz and M. Matta. INRS-Telecommunications

Impact of scan conversion methods on the performance of scalable. video coding. E. Dubois, N. Baaziz and M. Matta. INRS-Telecommunications Impact of scan conversion methods on the performance of scalable video coding E. Dubois, N. Baaziz and M. Matta INRS-Telecommunications 16 Place du Commerce, Verdun, Quebec, Canada H3E 1H6 ABSTRACT The

More information

The Multistandard Full Hd Video-Codec Engine On Low Power Devices

The Multistandard Full Hd Video-Codec Engine On Low Power Devices The Multistandard Full Hd Video-Codec Engine On Low Power Devices B.Susma (M. Tech). Embedded Systems. Aurora s Technological & Research Institute. Hyderabad. B.Srinivas Asst. professor. ECE, Aurora s

More information

AUDIOVISUAL COMMUNICATION

AUDIOVISUAL COMMUNICATION AUDIOVISUAL COMMUNICATION Laboratory Session: Recommendation ITU-T H.261 Fernando Pereira The objective of this lab session about Recommendation ITU-T H.261 is to get the students familiar with many aspects

More information

ROBUST REGION-OF-INTEREST SCALABLE CODING WITH LEAKY PREDICTION IN H.264/AVC. Qian Chen, Li Song, Xiaokang Yang, Wenjun Zhang

ROBUST REGION-OF-INTEREST SCALABLE CODING WITH LEAKY PREDICTION IN H.264/AVC. Qian Chen, Li Song, Xiaokang Yang, Wenjun Zhang ROBUST REGION-OF-INTEREST SCALABLE CODING WITH LEAKY PREDICTION IN H.264/AVC Qian Chen, Li Song, Xiaokang Yang, Wenjun Zhang Institute of Image Communication & Information Processing Shanghai Jiao Tong

More information

Chapter 2. Advanced Telecommunications and Signal Processing Program. E. Galarza, Raynard O. Hinds, Eric C. Reed, Lon E. Sun-

Chapter 2. Advanced Telecommunications and Signal Processing Program. E. Galarza, Raynard O. Hinds, Eric C. Reed, Lon E. Sun- Chapter 2. Advanced Telecommunications and Signal Processing Program Academic and Research Staff Professor Jae S. Lim Visiting Scientists and Research Affiliates M. Carlos Kennedy Graduate Students John

More information

(12) Patent Application Publication (10) Pub. No.: US 2006/ A1

(12) Patent Application Publication (10) Pub. No.: US 2006/ A1 (19) United States US 20060222067A1 (12) Patent Application Publication (10) Pub. No.: US 2006/0222067 A1 Park et al. (43) Pub. Date: (54) METHOD FOR SCALABLY ENCODING AND DECODNG VIDEO SIGNAL (75) Inventors:

More information

Intra-frame JPEG-2000 vs. Inter-frame Compression Comparison: The benefits and trade-offs for very high quality, high resolution sequences

Intra-frame JPEG-2000 vs. Inter-frame Compression Comparison: The benefits and trade-offs for very high quality, high resolution sequences Intra-frame JPEG-2000 vs. Inter-frame Compression Comparison: The benefits and trade-offs for very high quality, high resolution sequences Michael Smith and John Villasenor For the past several decades,

More information

Express Letters. A Novel Four-Step Search Algorithm for Fast Block Motion Estimation

Express Letters. A Novel Four-Step Search Algorithm for Fast Block Motion Estimation IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. 6, NO. 3, JUNE 1996 313 Express Letters A Novel Four-Step Search Algorithm for Fast Block Motion Estimation Lai-Man Po and Wing-Chung

More information

Advanced Video Processing for Future Multimedia Communication Systems

Advanced Video Processing for Future Multimedia Communication Systems Advanced Video Processing for Future Multimedia Communication Systems André Kaup Friedrich-Alexander University Erlangen-Nürnberg Future Multimedia Communication Systems Trend in video to make communication

More information

Research Article. ISSN (Print) *Corresponding author Shireen Fathima

Research Article. ISSN (Print) *Corresponding author Shireen Fathima Scholars Journal of Engineering and Technology (SJET) Sch. J. Eng. Tech., 2014; 2(4C):613-620 Scholars Academic and Scientific Publisher (An International Publisher for Academic and Scientific Resources)

More information

GLOBAL DISPARITY COMPENSATION FOR MULTI-VIEW VIDEO CODING. Kwan-Jung Oh and Yo-Sung Ho

GLOBAL DISPARITY COMPENSATION FOR MULTI-VIEW VIDEO CODING. Kwan-Jung Oh and Yo-Sung Ho GLOBAL DISPARITY COMPENSATION FOR MULTI-VIEW VIDEO CODING Kwan-Jung Oh and Yo-Sung Ho Department of Information and Communications Gwangju Institute of Science and Technolog (GIST) 1 Orong-dong Buk-gu,

More information

ERROR CONCEALMENT TECHNIQUES IN H.264 VIDEO TRANSMISSION OVER WIRELESS NETWORKS

ERROR CONCEALMENT TECHNIQUES IN H.264 VIDEO TRANSMISSION OVER WIRELESS NETWORKS Multimedia Processing Term project on ERROR CONCEALMENT TECHNIQUES IN H.264 VIDEO TRANSMISSION OVER WIRELESS NETWORKS Interim Report Spring 2016 Under Dr. K. R. Rao by Moiz Mustafa Zaveri (1001115920)

More information

DCT Q ZZ VLC Q -1 DCT Frame Memory

DCT Q ZZ VLC Q -1 DCT Frame Memory Minimizing the Quality-of-Service Requirement for Real-Time Video Conferencing (Extended abstract) Injong Rhee, Sarah Chodrow, Radhika Rammohan, Shun Yan Cheung, and Vaidy Sunderam Department of Mathematics

More information

University of Bristol - Explore Bristol Research. Peer reviewed version. Link to published version (if available): /ICASSP.2016.

University of Bristol - Explore Bristol Research. Peer reviewed version. Link to published version (if available): /ICASSP.2016. Hosking, B., Agrafiotis, D., Bull, D., & Easton, N. (2016). An adaptive resolution rate control method for intra coding in HEVC. In 2016 IEEE International Conference on Acoustics, Speech and Signal Processing

More information