Stream Conversion to Support Interactive Playout of. Videos in a Client Station. Ming-Syan Chen and Dilip D. Kandlur. IBM Research Division

Size: px
Start display at page:

Download "Stream Conversion to Support Interactive Playout of. Videos in a Client Station. Ming-Syan Chen and Dilip D. Kandlur. IBM Research Division"

Transcription

1 Stream Conversion to Support Interactive Playout of Videos in a Client Station Ming-Syan Chen and Dilip D. Kandlur IBM Research Division Thomas J. Watson Research Center Yorktown Heights, New York fmschen, kandlurg@watson.ibm.com Abstract In this paper we address the problem of supporting interactive playout of an MPEG encoded video stream at a player device. We propose a method for transforming the standard MPEG stream to a local form at the player device, which then enables the device to support ecient interactive playout, specically for backward playout, even when the buer space available is constrained. Explicitly, we devise a stream conversion scheme that encodes P frames as I frames after the decompression and playout of each P frame. Such a scenario of transforming a P frame to an I frame is termed P-I conversion. Note that using the technique of P-I conversion, backward playout will not require any additional memory buer than normal forward playout, thus avoiding the large buer requirement that would be needed for backward playout in the original MPEG stream because of interframe dependencies. It will be seen that since this P-I conversion is performed after a P frame is decompressed and played out, there is no extra cost required for decoding. Also, since there is no motion estimation and compensation required for compressing a single frame into an I frame, this I frame encoding is done very eciently. We have evaluated several potential interactive playout methods using video experiments. P- I conversion is shown to be cost-eective, easy to implement and able to provide high visual quality interactive playout, and is therefore deemed a viable approach to supporting interactive playout for MPEG video in a client station. Index Terms Stream conversion, downloading, interactive playout, MPEG, video-on-demand.

2 1 Introduction Recent advances in technologies such as computing, storage, and communication, have made possible the creation of several exciting multimedia applications [6, 11]. Compression techniques play a key role in processing digital multimedia data, particularly for video data. There are several factors which drive the use of compressed video data: (1) the prohibitively large storage required for uncompressed video data, (2) relatively slow storage devices that are unable to retrieve video data for real-time playout unless the data is compressed, and (3) network bandwidth that does not allow real-time video transmission for uncompressed data. For example, a single uncompressed color frame with pixel and 24 bits per pixel will require approximately one Mbyte of storage. At a full-motion playout rate of 30 frames per second, a 30-minute video would require more than 50 Gbytes of storage. Currently, the prevalent standard for the compressed video/audio is ISO MPEG [1]. Inter-frame compression techniques provided by MPEG render signicant advantages in storage and transmission. In order to facilitate storage and retrieval, the MPEG standard denes a compressed stream whose rate is bounded. Interactive TV and video-on-demand (VOD) have been identied as two important services made possible by advances in video compression and network transmission technologies [4]. In a VOD system, multimedia streams are stored on a storage server (the video server) and played out to the user station upon request. A signicant amount of eort has been elaborated upon the design of a video server [7, 8, 9, 10, 12, 14]. A VOD server is expected not only to concurrently serve many clients (hundreds or more), but also to provide many interactive features for video playout, such as pause/resume, backward play, and fast-forward and fast-backward play, which home viewers have come to expect from their current VCR systems. However, recent studies indicate that to meet these requirements, the server would need a tremendous amount of computing power, storage, and communication bandwidth [2, 5]. As pointed out in [2], the inter-frame dependencies of MPEG make it prohibitively expensive to provide some interactive features over the network. Furthermore, such factors as skewed movie requests and peak-hour activities have made it very dicult, if not impossible, to have a cost-eective resource allocation (in terms of CPU, storage and network bandwidth) in a VOD system. Consequently, the feasibility of providing interactive movie viewing over the network (including backbone and cable networks) is unclear. To avoid the above drawbacks, we consider in this paper an alternative solution for the movieon-demand service. This solution involves downloading of the video data into the storage of a player device located at the customer premise, so that the customer can view the video subsequently without further intervention from the network. It can be shown that such a player device is economically 1

3 video player device video server video player device video server Backbone and community network archive Figure 1: An illustration for video servers and client stations. feasible. Using the MPEG technique, a 100 minute MPEG-1 movie will occupy 1{1.5 GBytes of storage. Currently, the price of a 1.6 GByte disk is slightly under $400, and it is expected that this cost will reduce rapidly in the years to come due to rapid increases in recording densities, thus falling into the price range of consumer products. With the current disk bandwidth (e.g., a SCSI disk), downloading a 100 minute MPEG-1 movie from the remote video server over the network to the disk of a client station will take only 3 to 5 minutes, close to the time for TV commercial breaks that is generally acceptable for the end viewers. With video data stored in the player's storage, viewers can then enjoy all the interactive features for video viewing without incurring any server resources and network bandwidth. In addition, since downloading can be done prior to viewing, the eects of skewed movie requests and peak-hour activities can be minimized. Figure 1 illustrates an environment for a movie-on-demand system that has a video player device at the customer premises. In this environment, video data is stored in the video server and transmitted to the player device upon request. The transmission may occur at high speed so as to permit downloading of the entire movie within a few minutes of elapsed time. Note that under the downloading model, the VOD server is able to transmit videos out as fast as possible without explicit pacing. Also, since this is not real-time playout, the server has the exibility of queuing up requests for downloading. Based on these trends, we believe that downloading digital movies into a player device at the customer premises for viewing is economical and desirable, and will be a competitive choice to real-time VOD. 2

4 Given this downloading model, it is important to enhance the product competitiveness of such a player device by minimizing its system resource requirement. It is noted that, even with this device, one still encounters a deciency for interactively playing MPEG movies, which arises in backward playout (and also in fast-backward playout). As will be described in detail later, due to the interframe dependency of MPEG, backward playout requires a large amount of buer memory to store many decompressed frames for decoding a frame 1. Since the video player, as with most consumer products, is a very price-sensitive component, such a requirement for large memory buers would be highly undesirable for product competitiveness. To address this issue, we propose in this paper an ecient method which uses stream conversion to support interactive playout for MPEG videos and minimizes the buer requirement in the player device. In essence, we seek to employ a compressed stream that is compatible with the standards for video data distribution, and locally enhance it for special eects. The standard stream is dened to be highly compressed, so as to minimize the cost of distribution, such as storage and network transmission, whereas the local stream is optimized for eective playback. While the concept of transforming a standard compressed stream into a local stream can be realized in many ways, we explicitly utilize this concept to devise a scheme that encodes P frames as I frames after the decompression and playout of each P frame, so as to eciently support interactive playout for MPEG videos. Such a scenario of transforming a P frame to an I frame is termed P-I conversion in this paper. A detailed description of MPEG data organization is given in Section 2. It is noted that since this P-I conversion is performed after a P frame is decompressed and played out, there is no extra cost required for decoding. More importantly, since there is no motion estimation and compensation required for compressing a single frame into an I frame, this I frame encoding can be done very eciently. As will be seen later, using the technique of P-I conversion, backward playout will not require any additional memory buer than normal playout, thus avoiding the requirement for large buer that would be needed for backward playout in the original MPEG stream because of interframe dependencies. It is understood that one could transform all P and B frames into I frames, i.e., converting MPEG to JPEG [15], after their playout. However, P-I conversion is preferable to the MPEG- JPEG conversion in that it requires a much smaller amount of secondary storage in the player device and still enables backward playout to be operated with the minimal amount of buer required, i.e., the amount of buer required for MPEG forward playout. We shall describe the method 1 It should be pointed out, nevertheless, that such a deciency is not unique to the downloading model, and in fact also exists for real-time VOD. 3

5 of P-I conversion and its implementation in detail, and provide the corresponding cost analysis. Since the backward operation is mostly employed in the form of fast-backward playout, several video experiments are conducted to evaluate various types of fast-backward playout and show the advantage of using P-I conversion. Among the cases evaluated, it is shown that the interactive playout achieved by an approach using P-I conversion is, visually, most acceptable. It is worth mentioning that most prior work on VOD mainly focused on the resource management and task scheduling in the video server [7, 8, 9, 10, 12, 14], there is little work reported on either discussing the provisions required for the downloading model or dealing with stream conversion to facilitate interactive playout in the client station. This feature distinguishes this work from others. It is noted that video playback by software was dealt with in [13]. However, the work in [13] does not modify the MPEG sequence, and consequently the decoder may have more states (for reference frames) while performing backward playout. Overall, P-I conversion is shown to be cost-eective, easy to implement and able to provide high visual quality interactive playout, and is therefore deemed a viable approach to supporting interactive playout for MPEG video in a client station. This paper is organized as follows. Section 2 describes the MPEG data organization. The method of stream conversion is presented in Section 3. Some visual experiments are conducted in Section 4. Section 5 summarizes our results. 2 MPEG Data Organization The structure of the MPEG stream imposes several constraints on the video data storage and playout. An MPEG video stream consists of intra frames (I), predictive frames (P), and interpolated frames (B). In this stream, I frames are coded such that they are independent of any other frames in the sequence, and P frames are coded using motion estimation and have a dependency on the preceding I or P frame. On the other hand, B frames depend on two \anchor" frames: the preceding I/P frame and the following I/P frame. Since P and B frames use inter-frame compression, they are substantially smaller than I frames. Figure 2 shows the inter-frame dependencies in a sequence of MPEG frames, where the frames are numbered in temporal order. The arrows indicate the dependencies between frames. The inter-frame dependency implies that it is not possible to decode a P frame without the preceding I or P frame. Similarly, it is not possible to decode a B frame without the corresponding two anchor frames (i.e., two P frames, or one I and one P frames). Figure 3 shows the dierences between the order in which compressed frames are presented to the decoder (presentation order) and the order in which decompressed frames are presented to the viewer (temporal order). It can be seen that for normal forward playout, it is necessary to keep exactly two decompressed frames in the memory buer for decoding a frame that references these 4

6 I B B P B B P B B P B B P B B I Figure 2: Inter-frame dependency in a sequence of MPEG frames. Temporal Order: I B B P B B P B B P B B P B B I... Frame Number: Presen./Storage Ord.: I P B B P B B P B B P B B I B B... Frame Number: Figure 3: Temporal order (to the viewer) and presentation order (to the decoder) of MPEG frames. two frames. For the example in Figure 3, decompressed frames 1 (I frame) and 4 (P frame) are required to decode frame 2 (B frame). On the other hand, when decoding frame 5 (B frame), we need decompressed frames 4 and 7 (two P frames), and do not need frame 1 anymore. Since decompressed frames are of the same size, we need buer space for two decompressed frames to do the decoding for normal playout. While this presentation order reduces the buer space required for forward playout, it does not address the problem of backward playout. Note that since frames are encoded using forward prediction, in order to display a particular frame it is necessary to decompress a large number of preceding frames on which this frame may be dependent. These decompressed frames are large and 5

7 they increase the memory requirement of the decoder substantially. Moreover, the number of such buers required increases linearly with the length of the chain of predicted frames. Consequently, to resolve this deciency of MPEG, we shall present in the following section an approach of encoding P frames as I frames after the decompression and playout of each P frame. As will be seen later, such a P-I conversion will signicantly reduce the buer requirement of a player device and facilitate the interactive playout in the client station. 3 Compressed Stream Conversion for MPEG Videos In this section, we shall describe a method to transform a standard compressed video stream to a local form at the player device. We present the method in the form of a P-I conversion for an MPEG stream, with the understanding that similar conversions can be devised for other video compression algorithms that utilize motion compensation. The basic idea of P-I conversion is described in Section 3.1 and its implementation is given in Section MPEG Stream Conversion As explained earlier, although the presentation sequence of MPEG obviates the need for storing compressed frames during forward playout, it does not address the problems of backward playout. For example, consider the case that a viewer decides to play backward when he is viewing frame 14 in Figure 3 (at that moment we have decompressed frames 13 and 16 in the buer). He can then view frame 13. However, to decode frame 12, the decoder needs decompressed frames 10 and 13. To obtain decompressed frame 10, the decoder needs decompressed frame 7, which in turn requires decompressed frame 4 and frame 1. Thus, to decode a frame P during the backward playout, it is necessary to decode, in a reverse sequence, all the P frames until an I frame is reached. Note that this reverse chained-decoding is required for backward playout, but not for forward playout, since a P frame is encoded based on the previous I/P frame. The buer space required for backward playout thus increases signicantly (we need buer space for 5 decompressed frames in this case). In order to facilitate backward playout, we propose a transformation of the standard MPEG stream into a local compressed form. Specically, after a P frame is retrieved, decompressed and played out, we encode this frame as an I frame and store it back to the secondary storage. As mentioned before, since this P-I conversion is performed after a P frame is decompressed and played out, there is no extra cost required for decoding. Also, since there is no motion estimation and compensation required for compressing a single frame into an I frame, this I frame encoding can be done very eciently. Figure 4 shows a snapshot for the compressed frames stored in the secondary storage when the normal playout reaches frame 14 (when we keep decompressed frames 13 and 16 6

8 Orig. Frames Stored: I P B B P B B P B B P B B I B B... Frame Number: Frames Stored After P/I Conv: I I B B I B B I B B P B B I B B... Frame Number: Figure 4: A snapshot for the result of P-I conversion. in the buer and frame 13 is yet to be converted into an I frame). It is important to see that using the proposed P-I conversion, the buer space required for backward play will be the amount for storing two decompressed frames, i.e., the same as required for forward play. For example, consider again the case where a viewer decides to play backward when he is viewing frame 14 (with decompressed frames 13 and 16 in the buer). He next views frame 13, and is then able to view frame 12 which is decoded based on frames 10 and 13. Note that with P-I conversion, frame 10 is now stored as an I frame in the secondary storage, and can be retrieved and decompressed by itself to be used for decoding frame 12. The reverse chained-decoding required for the backward playout in the original MPEG stream is thus avoided. After the P-I conversion, the temporal order (to the viewer) and presentation order (to the decoder) for backward playout are shown in Figure 5. It can be shown that the additional storage required due to this P-I conversion is small. Assuming that the ratio of frame sizes for I, P and B frames is 5:3:2, Table 1 shows the additional secondary storage required for the P-I conversion and the MPEG-JPEG conversion (in terms of the percentage over the size of the original MPEG stream) for various MPEG streams. The frame ratio in Table 1 indicates the mix of I, P and B frames in the MPEG stream. For instance, the MPEG stream in Figure 2 has a frame ratio of 1:4:10. Consider this stream as an example. Since the ratio of frame sizes for I, P and B frames is 5:3:2, the percentage of size increase by P-I conversion will be ?( ) = 21.6%. On the other hand, the percentage of size increase by MPEG-JPEG conversion for this stream will be 515?( ) = 102.7%. Following the same procedure, the numbers in other columns can be obtained. It can be seen that while requiring the same amount of buer for decoding 2, P-I conversion requires a signicantly smaller amount of secondary storage than MPEG-JPEG conversion. From Table 1, it is seen that the additional secondary storage required by P-I conversion is small and fairly acceptable in view of the resulting 2 It is noted that a player device for MPEG-JPEG conversion also requires the buer for two decompressed frames to handle an incoming standard MPEG stream. 7

9 Temporal Order: I B B I B B I B B I B B I B B I... Frame Number: Presentation Order: I I B B I B B I B B I B B I B B... Frame Number: Figure 5: Temporal order (to the viewer) and presentation order (to the decoder) for backward playout. frame ratio (I:P:B) 1:3:8 1:3:12 1:4:10 1:4:15 P-I conversion 20.0% 15.7% 21.6% 17.0% MPEG-JPEG conv % 110.5% 102.7% 112.7% Table 1: Additional secondary storage required by P-I conversion and MPEG-JPEG conversion. benets and the inexpensive nature of the secondary storage. 3.2 Implementation In this subsection, we shall show that the proposed P-I conversion method is easy to implement. To illustrate the apparatus required to implement this transformation, Figure 6 shows a block diagram of a player device. This player contains an input device, a temporary storage device, video/audio decoder, encoder, control logic, buer memory, and display logic. The input device may be a network interface, a CD-ROM reader, or some such device, and it is used for reading an incoming standard video stream. The temporary storage device, which is a read/write device, is used to store the transformed video stream. The control logic implements the dierent operations on the device, while the conventional display logic is used to display images from the buer. It is worth mentioning that depending on the applications, a downloading process could be performed in a pipelined manner so as to further reduce the local storage required, in which case, however, additional provision is needed to ensure the execution of interactive functions. The execution ow for decoding during the normal playout is shown in Figure 7, where the player reads consecutive video frames, decodes them, and displays them. The decoder operations are determined by the frame type, and they rely on two decompressed \anchor" frames. If the frame is an I frame, it is decompressed without depending on any other frame. The decompressed frame is retained in the buer memory as an anchor frame for successive frames. If the frame is a P frame, it is decompressed using the preceding anchor frame. This decompressed frame is also retained in the buer memory as an anchor frame. In this gure, the dotted line indicates the extra operations 8

10 Input (network or CD ROM) Decoder Encoder Buffer Control logic Secondary storage Display logic Output display Figure 6: A player device with the capability of transforming a standard compressed stream into its local form. required to convert P frames to I frames. The decompressed frame is now compressed as an I frame and stored back to the secondary storage. Since this P-I conversion is performed after a P frame is decompressed and played out, it does not impose any additional cost/delay on the decoder. Also, since the encoding process does not require any CPU intensive motion search/estimation, it can be performed easily in real-time. It is noted that we can not perform an in-place editing of P frames to I frames, since an I frame is in general larger than a P frame. Instead, one can copy a group of pictures (GOP), modify it, and then store it back. The original GOP can then be deleted. The execution ow for decoding during the backward playout is shown in Figure 8, where the player reads successive video frames, decodes them, and displays them. The order of frame retrieval for backward playout is the reverse retrieval order for forward playout. As in forward playout, frames are presented to the decoder in an order which is dierent from the temporal order. For example, in Figure 5, frame 13 is decoded before frame 15 since frame 13 is an anchor frame that is required for decoding frame 15. However, frame 15 is presented (displayed) before frame 13. Since P frames are replaced by I frames during forward play, the only frame types encountered during backward play are I and B frames. These frames are decoded and displayed in a manner that follows the description above for forward playout. Note that it is, in general, necessary to create osets to I frames to access them eciently during backward playout. However, such a need 9

11 Start more frames? Yes No Stop P frame type? B I Referencing the prior I/P frame for decoding Referencing the two anchors for decoding Decode this I frame by itself Play out this decompressed P frame Retain decompressed frame as an anchor frame Encode this frame as an I frame Play out this decompressed B frame Play out this decompressed I frame Retain decompressed frame as an anchor frame Store compressed I frame in the secondary storage Figure 7: Execution ow for the decoder during the forward playout. 10

12 Backward play more frames? Yes No Stop B frame type? I Referencing the two anchors for decoding Decode this I frame by itself Play out this decompressed B frame Play out this decompressed I frame Retain decompressed frame as an anchor frame Figure 8: Execution ow for the decoder during the backward playout. 11

13 does not arise from the use of P-I conversion. It can be seen that in the original MPEG stream, creation of osets to I frames is also needed for ecient frame access during backward playout. In addition, it is noted that although the GOP size changes in the modied stream, an MPEG decoder can still operate eectively. In addition to the stream level, an MPEG decoder can be kept informed of the picture pattern in the GOP level. Hence, depending upon the type of frame to be processed, an MPEG decoder can take appropriate actions for intraframe or interframe decoding. As such, an MPEG decoder is able to handle dierent GOP sizes in one video stream. 4 Visual Experiments for Fast-Backward Playout In our opinion, the backward operation will be used mainly the form of fast-backward playout 3. In light of this, we would naturally like to know the impact of P-I conversion to the visual eect of fast-backward (FB) playout. For comparison, we assume that the player device only has the amount of buer for MPEG forward playout. The chained-decoding scenario described before for FB playout for the standard MPEG, which requires a much larger amount of buer, is deemed unfavorable and not included here for comparison. Specically, we consider the following three types of FB playout. 1. type FB. Without downloading, we use the segment skipping method devised in [2] to implement FB playout. 2. type FB. Without stream conversion, we only play I frames during the FB playout. This method can be used either with downloading or without downloading. 3. type FB. With P-I conversion, an FB playout is performed using the backward playout technique described in Section 3. Illustrative examples for these three types of FB are shown in Figure 9. Independent of their visual eects, it is noted that while and types of FB can provide variable FB speeds, type of FB is restricted to certain FB speeds. More specically, the FB speedup that type FB can provide has to be a multiple of the number of frames an I frame is associated with (i.e., 15, 30, 45, etc. in Figure 9b). Also, when type FB is performed over the network, it has to be operated either at a higher cost (i.e., higher data rate) or at a slower frame rate since the size of an I frame is larger than the average size of a combination of I, P and B frames. In order to perform this visual experiment, we used the MMT (Multimedia Multiparty Teleconferencing) system, a prototype desktop collaboration system developed at the IBM Thomas J. Watson Research Center [3]. The current MMT hardware consists of an IBM PS/2 computer equipped with two custom-built 3 This is consistent with the fact that most commercial VCR's only provide the fast-backward play option. 12

14 i-1 i i+1 i+2 i+3 i+4 i+5 i+6 skip skip skip skip skip play play play IBBPBBP...B IBBPBBP...B IBBPBBP...B (a) I B B P B B P B B P B B P B B I B B P B B P B B P B B P B B I B B P B B P B B P B B P B B I (b) I B B B B B B B B B B I B B B B B B B B B B I B B P B B I B B I B B I B B I I I I I I I I I (c) Figure 9: Three types of FB playout evaluated: (a) type (FB speedup: 3; starting from segment i + 6), (b) type (FB speedup: 15, and (c) type (FB speedup: 4). 13

15 CPU system memory microchannel bus comm adapter CODEC adapter VAC adapter Ethernet Network audio video in/out Figure 10: The MMT System. adaptors. One adaptor (VAC) interfaces with analog video and audio components and performs capture (digitization) and playback functions. The other adaptor (MMT) is for compression, networking, processing, and decompression of video and audio. Figure 10 shows one of the possible data paths through the MMT system. In this scenario, the video application extracts video and audio data from the MMT adaptor and transports it across the network. This video application has been modied to (a) store the video data to a le, and (b) playout video data from a le. In the rst instance, the timing/pacing for the recording process is provided naturally by the video source and data is generated whenever a new video frame is captured and compressed. However, in the case of stored video playout, no suitable timing signal is available from the operating system to pace the playout process. We therefore chose to exploit the video source to provide the pacing for the playout. The playout application congures the MMT adaptor for the capture and playout of video. It then interprets the incoming video data to demarcate frames and paces the playout by ensuring that the number of video frames played out to the MMT adaptor closely corresponds to the number of video frames captured. We developed a lter program that processes the stored video to produce an output le with the appropriate segment size and speedup. This lter represents an o-line implementation of the FB mechanism. 14

16 Using these tools, we have experimented with these three types of FB playout for various video clips. The dierences among these three types of FB are dependent on the video content. For video clips with very little motion, such as those showing weather maps and news announcements, the visual eect of these three FB methods is similar. However, for video clips containing objects moving toward one direction, such as track actions, swimming, and long distance touch-down runs in a football game, the dierences among these FB methods becomes very prominent. We perceived some zig-zag motion for type of FB, i.e., objects appear to be moving back and forth. Also, we observed that watching type FB is similar to watching a slide projector operating at a high speed. On the other hand, type FB is very smooth and found to be most visually acceptable, showing a better visual quality resulting from P-I conversion. Note that since the objective of our experiments is to determine the visual impact of dierent types of FB, and not the eciency of the compression, using JPEG (in MMT) as the compression format will achieve the same visual eect. Also, the MMT provides us with facilities to capture various interesting scenes from TV programs for evaluation. Note that these visual experiments may also be performed using software MPEG decoders, such as the one from the University of California at Berkeley [13]. 5 Conclusions In this paper we have explored the notion of a consumer player device to provide interactive video functions for digital video streams. The model we considered involves downloading of the video data into the storage of a player device located at the customer premise, so that the customer can view the video subsequently without further intervention from the network. In this context, we proposed the concept of stream conversion to support the interactive playout, both forward and backward, of MPEG encoded video streams. This stream conversion results in a substantial reduction of memory buer requirement in the player device. We have described this method of P-I conversion and its implementation, and provided the corresponding cost analysis. We also conducted some video experiments to evaluate various types of FB playout that illustrate the advantages of using P-I conversion. Based on its cost-eectiveness, ease of implementation, and its capability for providing high visual quality, we believe that P-I conversion is a viable approach to supporting interactive playout for MPEG video in a client station. References [1] Coding of moving pictures and associated audio { for digital storage media at up to about 1.5Mbit/s, May

17 [2] M.-S. Chen, D. D. Kandlur, and P. S. Yu. Support for Fully Interactive Playout in a Disk- Array-Based Video Server. Proceedings of ACM Multimedia, pages 391{398, October, [3] M.-S. Chen, Z.-Y. Shae, D. D. Kandlur, T. P. Barzilai, and H. M. Vin. A Multimedia Desktop Collaboration System. In Proceedings GLOBECOM 92, pages 739{746, December [4] D. Deloddere, W. Verbiest, and H. Verhille. Interactive Video on Demand. IEEE Communications Magazine, 32(5):82{88, May [5] J. K. Dey, J. D. Salehi, J. F. Kurose, and D. Towsley. Providing VCR capabilities in large-scale video servers. In Proc. ACM MULTIMEDIA'94, pages 25{32, October [6] W. I. Grosky. Multimedia Information Systems. IEEE Multimedia, pages 12{24, Spring, [7] D. D. Kandlur, M.-S. Chen, and Z.-Y. Shae. Design of a Multimedia Storage Server. In Proc. IS&T/SPIE Symposium on Electronic Imaging { Conference on High speed networking and Multimedia Applications. SPIE, February [8] T. Mori, K. Nishimura, H. Nakano, and Y. Ishibashi. Video-on-demand system using optical mass storage system. Japanese Journal of Applied Physics, 1(11B):5433{5438, November [9] R. T. Ng and J. Yang. Maximizing Buer and Disk Utilizations for News on-demand. In Proceedings of the 20th International Conference on Very Large Databases, pages 451{462, September [10] B. Ozden, A. Biliris, R. Rastogi, and A. Silberschatz. A Low-Cost Storage Server for Movie on Demand Databases. In Proceedings of the 20th International Conference on Very Large Databases, pages 594{605, September [11] S. Ramanathan and P. V. Rangan. Architectures for Personalized Multimedia. IEEE Multimedia, 1(1):37{46, Spring, [12] P. V. Rangan, H. M. Vin, and S. Ramanathan. Designing A Multi-User Multimedia On- Demand Service. IEEE Communications Magazine, 30(7):56{65, July [13] L. A. Rowe, K. D. Patel, B. C. Smith, and K. Liu. MPEG Video in Software: Pepresentation, Transmission, and Playback. In Proc. IS&T/SPIE Symposium on High-Speed Networking and Multimedia Computing, pages 134{144. SPIE, February [14] H. M. Vin and P. V. Rangan. Designing a Multi-User HDTV Storage Server. IEEE Journal on Selected Areas in Communication, 11(1):15{16, January [15] G. K. Wallace. The JPEG still picture compression standard. Communications of the ACM, 34(4):30{44, April

Storage and Retrieval Methods to Support Fully Interactive. Playout in a Disk-Array-Based Video Server

Storage and Retrieval Methods to Support Fully Interactive. Playout in a Disk-Array-Based Video Server Storage and Retrieval Methods to Support Fully Interactive Playout in a Disk-Array-Based Video Server Ming-Syan Chen, Dilip D. Kandlur and Philip S. Yu IBM Research Division Thomas J. Watson Research Center

More information

VVD: VCR operations for Video on Demand

VVD: VCR operations for Video on Demand VVD: VCR operations for Video on Demand Ravi T. Rao, Charles B. Owen* Michigan State University, 3 1 1 5 Engineering Building, East Lansing, MI 48823 ABSTRACT Current Video on Demand (VoD) systems do not

More information

8 Concluding Remarks. random disk head seeks, it requires only small. buered in RAM. helped us understand details about MPEG.

8 Concluding Remarks. random disk head seeks, it requires only small. buered in RAM. helped us understand details about MPEG. cur buf is the viewer buer containing the FF-version of the movie from the movie buer that output the bits being transmitted In [2], we present a scheme that eliminates the delay associated with all of

More information

Network. Decoder. Display

Network. Decoder. Display On the Design of a Low-Cost Video-on-Demand Storage System Banu Ozden Rajeev Rastogi Avi Silberschatz AT&T Bell Laboratories 600 Mountain Avenue Murray Hill NJ 07974-0636 fozden, rastogi, avig@research.att.com

More information

Supporting Random Access on Real-time. Retrieval of Digital Continuous Media. Jonathan C.L. Liu, David H.C. Du and James A.

Supporting Random Access on Real-time. Retrieval of Digital Continuous Media. Jonathan C.L. Liu, David H.C. Du and James A. Supporting Random Access on Real-time Retrieval of Digital Continuous Media Jonathan C.L. Liu, David H.C. Du and James A. Schnepf Distributed Multimedia Center 1 & Department of Computer Science University

More information

Impact of scan conversion methods on the performance of scalable. video coding. E. Dubois, N. Baaziz and M. Matta. INRS-Telecommunications

Impact of scan conversion methods on the performance of scalable. video coding. E. Dubois, N. Baaziz and M. Matta. INRS-Telecommunications Impact of scan conversion methods on the performance of scalable video coding E. Dubois, N. Baaziz and M. Matta INRS-Telecommunications 16 Place du Commerce, Verdun, Quebec, Canada H3E 1H6 ABSTRACT The

More information

Chapter 10 Basic Video Compression Techniques

Chapter 10 Basic Video Compression Techniques Chapter 10 Basic Video Compression Techniques 10.1 Introduction to Video compression 10.2 Video Compression with Motion Compensation 10.3 Video compression standard H.261 10.4 Video compression standard

More information

Implementation of MPEG-2 Trick Modes

Implementation of MPEG-2 Trick Modes Implementation of MPEG-2 Trick Modes Matthew Leditschke and Andrew Johnson Multimedia Services Section Telstra Research Laboratories ABSTRACT: If video on demand services delivered over a broadband network

More information

Pattern Smoothing for Compressed Video Transmission

Pattern Smoothing for Compressed Video Transmission Pattern for Compressed Transmission Hugh M. Smith and Matt W. Mutka Department of Computer Science Michigan State University East Lansing, MI 48824-1027 {smithh,mutka}@cps.msu.edu Abstract: In this paper

More information

Understanding Compression Technologies for HD and Megapixel Surveillance

Understanding Compression Technologies for HD and Megapixel Surveillance When the security industry began the transition from using VHS tapes to hard disks for video surveillance storage, the question of how to compress and store video became a top consideration for video surveillance

More information

Relative frequency. I Frames P Frames B Frames No. of cells

Relative frequency. I Frames P Frames B Frames No. of cells In: R. Puigjaner (ed.): "High Performance Networking VI", Chapman & Hall, 1995, pages 157-168. Impact of MPEG Video Trac on an ATM Multiplexer Oliver Rose 1 and Michael R. Frater 2 1 Institute of Computer

More information

Skip Length and Inter-Starvation Distance as a Combined Metric to Assess the Quality of Transmitted Video

Skip Length and Inter-Starvation Distance as a Combined Metric to Assess the Quality of Transmitted Video Skip Length and Inter-Starvation Distance as a Combined Metric to Assess the Quality of Transmitted Video Mohamed Hassan, Taha Landolsi, Husameldin Mukhtar, and Tamer Shanableh College of Engineering American

More information

Content storage architectures

Content storage architectures Content storage architectures DAS: Directly Attached Store SAN: Storage Area Network allocates storage resources only to the computer it is attached to network storage provides a common pool of storage

More information

DCT Q ZZ VLC Q -1 DCT Frame Memory

DCT Q ZZ VLC Q -1 DCT Frame Memory Minimizing the Quality-of-Service Requirement for Real-Time Video Conferencing (Extended abstract) Injong Rhee, Sarah Chodrow, Radhika Rammohan, Shun Yan Cheung, and Vaidy Sunderam Department of Mathematics

More information

Frame Compatible Formats for 3D Video Distribution

Frame Compatible Formats for 3D Video Distribution MITSUBISHI ELECTRIC RESEARCH LABORATORIES http://www.merl.com Frame Compatible Formats for 3D Video Distribution Anthony Vetro TR2010-099 November 2010 Abstract Stereoscopic video will soon be delivered

More information

Video compression principles. Color Space Conversion. Sub-sampling of Chrominance Information. Video: moving pictures and the terms frame and

Video compression principles. Color Space Conversion. Sub-sampling of Chrominance Information. Video: moving pictures and the terms frame and Video compression principles Video: moving pictures and the terms frame and picture. one approach to compressing a video source is to apply the JPEG algorithm to each frame independently. This approach

More information

MPEG has been established as an international standard

MPEG has been established as an international standard 1100 IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. 9, NO. 7, OCTOBER 1999 Fast Extraction of Spatially Reduced Image Sequences from MPEG-2 Compressed Video Junehwa Song, Member,

More information

MPEGTool: An X Window Based MPEG Encoder and Statistics Tool 1

MPEGTool: An X Window Based MPEG Encoder and Statistics Tool 1 MPEGTool: An X Window Based MPEG Encoder and Statistics Tool 1 Toshiyuki Urabe Hassan Afzal Grace Ho Pramod Pancha Magda El Zarki Department of Electrical Engineering University of Pennsylvania Philadelphia,

More information

MSB LSB MSB LSB DC AC 1 DC AC 1 AC 63 AC 63 DC AC 1 AC 63

MSB LSB MSB LSB DC AC 1 DC AC 1 AC 63 AC 63 DC AC 1 AC 63 SNR scalable video coder using progressive transmission of DCT coecients Marshall A. Robers a, Lisimachos P. Kondi b and Aggelos K. Katsaggelos b a Data Communications Technologies (DCT) 2200 Gateway Centre

More information

Motion Video Compression

Motion Video Compression 7 Motion Video Compression 7.1 Motion video Motion video contains massive amounts of redundant information. This is because each image has redundant information and also because there are very few changes

More information

FLEXIBLE SWITCHING AND EDITING OF MPEG-2 VIDEO BITSTREAMS

FLEXIBLE SWITCHING AND EDITING OF MPEG-2 VIDEO BITSTREAMS ABSTRACT FLEXIBLE SWITCHING AND EDITING OF MPEG-2 VIDEO BITSTREAMS P J Brightwell, S J Dancer (BBC) and M J Knee (Snell & Wilcox Limited) This paper proposes and compares solutions for switching and editing

More information

A Real-Time MPEG Software Decoder

A Real-Time MPEG Software Decoder DISCLAIMER This report was prepared as an account of work sponsored by an agency of the United States Government. Neither the United States Government nor any agency thereof, nor any of their employees,

More information

P1: OTA/XYZ P2: ABC c01 JWBK457-Richardson March 22, :45 Printer Name: Yet to Come

P1: OTA/XYZ P2: ABC c01 JWBK457-Richardson March 22, :45 Printer Name: Yet to Come 1 Introduction 1.1 A change of scene 2000: Most viewers receive analogue television via terrestrial, cable or satellite transmission. VHS video tapes are the principal medium for recording and playing

More information

Analysis of MPEG-2 Video Streams

Analysis of MPEG-2 Video Streams Analysis of MPEG-2 Video Streams Damir Isović and Gerhard Fohler Department of Computer Engineering Mälardalen University, Sweden damir.isovic, gerhard.fohler @mdh.se Abstract MPEG-2 is widely used as

More information

A Video Frame Dropping Mechanism based on Audio Perception

A Video Frame Dropping Mechanism based on Audio Perception A Video Frame Dropping Mechanism based on Perception Marco Furini Computer Science Department University of Piemonte Orientale 151 Alessandria, Italy Email: furini@mfn.unipmn.it Vittorio Ghini Computer

More information

MULTIMEDIA TECHNOLOGIES

MULTIMEDIA TECHNOLOGIES MULTIMEDIA TECHNOLOGIES LECTURE 08 VIDEO IMRAN IHSAN ASSISTANT PROFESSOR VIDEO Video streams are made up of a series of still images (frames) played one after another at high speed This fools the eye into

More information

Scalable Foveated Visual Information Coding and Communications

Scalable Foveated Visual Information Coding and Communications Scalable Foveated Visual Information Coding and Communications Ligang Lu,1 Zhou Wang 2 and Alan C. Bovik 2 1 Multimedia Technologies, IBM T. J. Watson Research Center, Yorktown Heights, NY 10598, USA 2

More information

Digital Television Fundamentals

Digital Television Fundamentals Digital Television Fundamentals Design and Installation of Video and Audio Systems Michael Robin Michel Pouiin McGraw-Hill New York San Francisco Washington, D.C. Auckland Bogota Caracas Lisbon London

More information

Region Adaptive Unsharp Masking based DCT Interpolation for Efficient Video Intra Frame Up-sampling

Region Adaptive Unsharp Masking based DCT Interpolation for Efficient Video Intra Frame Up-sampling International Conference on Electronic Design and Signal Processing (ICEDSP) 0 Region Adaptive Unsharp Masking based DCT Interpolation for Efficient Video Intra Frame Up-sampling Aditya Acharya Dept. of

More information

Fast MBAFF/PAFF Motion Estimation and Mode Decision Scheme for H.264

Fast MBAFF/PAFF Motion Estimation and Mode Decision Scheme for H.264 Fast MBAFF/PAFF Motion Estimation and Mode Decision Scheme for H.264 Ju-Heon Seo, Sang-Mi Kim, Jong-Ki Han, Nonmember Abstract-- In the H.264, MBAFF (Macroblock adaptive frame/field) and PAFF (Picture

More information

Module 8 VIDEO CODING STANDARDS. Version 2 ECE IIT, Kharagpur

Module 8 VIDEO CODING STANDARDS. Version 2 ECE IIT, Kharagpur Module 8 VIDEO CODING STANDARDS Lesson 27 H.264 standard Lesson Objectives At the end of this lesson, the students should be able to: 1. State the broad objectives of the H.264 standard. 2. List the improved

More information

Analysis of Retrieval of Multimedia Data Stored on Magnetic Tape

Analysis of Retrieval of Multimedia Data Stored on Magnetic Tape Analysis of Retrieval of Multimedia Data Stored on Magnetic Tape Olav Sandstå and Roger Midtstraum Department of Computer and Information Science Norwegian University of Science and Technology N-734 Trondheim,

More information

Digital Media. Daniel Fuller ITEC 2110

Digital Media. Daniel Fuller ITEC 2110 Digital Media Daniel Fuller ITEC 2110 Daily Question: Video How does interlaced scan display video? Email answer to DFullerDailyQuestion@gmail.com Subject Line: ITEC2110-26 Housekeeping Project 4 is assigned

More information

Coded Channel +M r9s i APE/SI '- -' Stream ' Regg'zver :l Decoder El : g I l I

Coded Channel +M r9s i APE/SI '- -' Stream ' Regg'zver :l Decoder El : g I l I US005870087A United States Patent [19] [11] Patent Number: 5,870,087 Chau [45] Date of Patent: Feb. 9, 1999 [54] MPEG DECODER SYSTEM AND METHOD [57] ABSTRACT HAVING A UNIFIED MEMORY FOR TRANSPORT DECODE

More information

Seamless Workload Adaptive Broadcast

Seamless Workload Adaptive Broadcast Seamless Workload Adaptive Broadcast Yang Guo, Lixin Gao, Don Towsley, and Subhabrata Sen Computer Science Department ECE Department Networking Research University of Massachusetts University of Massachusetts

More information

How Does H.264 Work? SALIENT SYSTEMS WHITE PAPER. Understanding video compression with a focus on H.264

How Does H.264 Work? SALIENT SYSTEMS WHITE PAPER. Understanding video compression with a focus on H.264 SALIENT SYSTEMS WHITE PAPER How Does H.264 Work? Understanding video compression with a focus on H.264 Salient Systems Corp. 10801 N. MoPac Exp. Building 3, Suite 700 Austin, TX 78759 Phone: (512) 617-4800

More information

(a) (b) Figure 1.1: Screen photographs illustrating the specic form of noise sometimes encountered on television. The left hand image (a) shows the no

(a) (b) Figure 1.1: Screen photographs illustrating the specic form of noise sometimes encountered on television. The left hand image (a) shows the no Chapter1 Introduction THE electromagnetic transmission and recording of image sequences requires a reduction of the multi-dimensional visual reality to the one-dimensional video signal. Scanning techniques

More information

Understanding Multimedia - Basics

Understanding Multimedia - Basics Understanding Multimedia - Basics Joemon Jose Web page: http://www.dcs.gla.ac.uk/~jj/teaching/demms4 Wednesday, 9 th January 2008 Design and Evaluation of Multimedia Systems Lectures video as a medium

More information

OPEN STANDARD GIGABIT ETHERNET LOW LATENCY VIDEO DISTRIBUTION ARCHITECTURE

OPEN STANDARD GIGABIT ETHERNET LOW LATENCY VIDEO DISTRIBUTION ARCHITECTURE 2012 NDIA GROUND VEHICLE SYSTEMS ENGINEERING AND TECHNOLOGY SYMPOSIUM VEHICLE ELECTRONICS AND ARCHITECTURE (VEA) MINI-SYMPOSIUM AUGUST 14-16, MICHIGAN OPEN STANDARD GIGABIT ETHERNET LOW LATENCY VIDEO DISTRIBUTION

More information

Bridging the Gap Between CBR and VBR for H264 Standard

Bridging the Gap Between CBR and VBR for H264 Standard Bridging the Gap Between CBR and VBR for H264 Standard Othon Kamariotis Abstract This paper provides a flexible way of controlling Variable-Bit-Rate (VBR) of compressed digital video, applicable to the

More information

16.5 Media-on-Demand (MOD)

16.5 Media-on-Demand (MOD) 16.5 Media-on-Demand (MOD) Interactive TV (ITV) and Set-top Box (STB) ITV supports activities such as: 1. TV (basic, subscription, pay-per-view) 2. Video-on-demand (VOD) 3. Information services (news,

More information

Lecture 23: Digital Video. The Digital World of Multimedia Guest lecture: Jayson Bowen

Lecture 23: Digital Video. The Digital World of Multimedia Guest lecture: Jayson Bowen Lecture 23: Digital Video The Digital World of Multimedia Guest lecture: Jayson Bowen Plan for Today Digital video Video compression HD, HDTV & Streaming Video Audio + Images Video Audio: time sampling

More information

A low-power portable H.264/AVC decoder using elastic pipeline

A low-power portable H.264/AVC decoder using elastic pipeline Chapter 3 A low-power portable H.64/AVC decoder using elastic pipeline Yoshinori Sakata, Kentaro Kawakami, Hiroshi Kawaguchi, Masahiko Graduate School, Kobe University, Kobe, Hyogo, 657-8507 Japan Email:

More information

Lecture 2 Video Formation and Representation

Lecture 2 Video Formation and Representation 2013 Spring Term 1 Lecture 2 Video Formation and Representation Wen-Hsiao Peng ( 彭文孝 ) Multimedia Architecture and Processing Lab (MAPL) Department of Computer Science National Chiao Tung University 1

More information

Dual frame motion compensation for a rate switching network

Dual frame motion compensation for a rate switching network Dual frame motion compensation for a rate switching network Vijay Chellappa, Pamela C. Cosman and Geoffrey M. Voelker Dept. of Electrical and Computer Engineering, Dept. of Computer Science and Engineering

More information

Video Sequence. Time. Temporal Loss. Propagation. Temporal Loss Propagation. P or BPicture. Spatial Loss. Propagation. P or B Picture.

Video Sequence. Time. Temporal Loss. Propagation. Temporal Loss Propagation. P or BPicture. Spatial Loss. Propagation. P or B Picture. Published in SPIE vol.3528, pp.113-123, Boston, November 1998. Adaptive MPEG-2 Information Structuring Pascal Frossard a and Olivier Verscheure b a Signal Processing Laboratory Swiss Federal Institute

More information

Audio and Video II. Video signal +Color systems Motion estimation Video compression standards +H.261 +MPEG-1, MPEG-2, MPEG-4, MPEG- 7, and MPEG-21

Audio and Video II. Video signal +Color systems Motion estimation Video compression standards +H.261 +MPEG-1, MPEG-2, MPEG-4, MPEG- 7, and MPEG-21 Audio and Video II Video signal +Color systems Motion estimation Video compression standards +H.261 +MPEG-1, MPEG-2, MPEG-4, MPEG- 7, and MPEG-21 1 Video signal Video camera scans the image by following

More information

Video coding standards

Video coding standards Video coding standards Video signals represent sequences of images or frames which can be transmitted with a rate from 5 to 60 frames per second (fps), that provides the illusion of motion in the displayed

More information

Using Software Feedback Mechanism for Distributed MPEG Video Player Systems

Using Software Feedback Mechanism for Distributed MPEG Video Player Systems 1 Using Software Feedback Mechanism for Distributed MPEG Video Player Systems Kam-yiu Lam 1, Chris C.H. Ngan 1 and Joseph K.Y. Ng 2 Department of Computer Science 1 Computing Studies Department 2 City

More information

Module 8 VIDEO CODING STANDARDS. Version 2 ECE IIT, Kharagpur

Module 8 VIDEO CODING STANDARDS. Version 2 ECE IIT, Kharagpur Module 8 VIDEO CODING STANDARDS Lesson 24 MPEG-2 Standards Lesson Objectives At the end of this lesson, the students should be able to: 1. State the basic objectives of MPEG-2 standard. 2. Enlist the profiles

More information

The transmission of MPEG-2 VBR video under usage parameter control

The transmission of MPEG-2 VBR video under usage parameter control INTERNATIONAL JOURNAL OF COMMUNICATION SYSTEMS Int. J. Commun. Syst. 2001; 14:125}146 The transmission of MPEG-2 VBR video under usage parameter control Lou Wenjing, Chia Liang Tien*, Lee Bu Sung and Wang

More information

A variable bandwidth broadcasting protocol for video-on-demand

A variable bandwidth broadcasting protocol for video-on-demand A variable bandwidth broadcasting protocol for video-on-demand Jehan-François Pâris a1, Darrell D. E. Long b2 a Department of Computer Science, University of Houston, Houston, TX 77204-3010 b Department

More information

An Overview of Video Coding Algorithms

An Overview of Video Coding Algorithms An Overview of Video Coding Algorithms Prof. Ja-Ling Wu Department of Computer Science and Information Engineering National Taiwan University Video coding can be viewed as image compression with a temporal

More information

New forms of video compression

New forms of video compression New forms of video compression New forms of video compression Why is there a need? The move to increasingly higher definition and bigger displays means that we have increasingly large amounts of picture

More information

Digital Video Telemetry System

Digital Video Telemetry System Digital Video Telemetry System Item Type text; Proceedings Authors Thom, Gary A.; Snyder, Edwin Publisher International Foundation for Telemetering Journal International Telemetering Conference Proceedings

More information

HEVC: Future Video Encoding Landscape

HEVC: Future Video Encoding Landscape HEVC: Future Video Encoding Landscape By Dr. Paul Haskell, Vice President R&D at Harmonic nc. 1 ABSTRACT This paper looks at the HEVC video coding standard: possible applications, video compression performance

More information

Interframe Bus Encoding Technique for Low Power Video Compression

Interframe Bus Encoding Technique for Low Power Video Compression Interframe Bus Encoding Technique for Low Power Video Compression Asral Bahari, Tughrul Arslan and Ahmet T. Erdogan School of Engineering and Electronics, University of Edinburgh United Kingdom Email:

More information

Multimedia Communications. Image and Video compression

Multimedia Communications. Image and Video compression Multimedia Communications Image and Video compression JPEG2000 JPEG2000: is based on wavelet decomposition two types of wavelet filters one similar to what discussed in Chapter 14 and the other one generates

More information

MULTI-STATE VIDEO CODING WITH SIDE INFORMATION. Sila Ekmekci Flierl, Thomas Sikora

MULTI-STATE VIDEO CODING WITH SIDE INFORMATION. Sila Ekmekci Flierl, Thomas Sikora MULTI-STATE VIDEO CODING WITH SIDE INFORMATION Sila Ekmekci Flierl, Thomas Sikora Technical University Berlin Institute for Telecommunications D-10587 Berlin / Germany ABSTRACT Multi-State Video Coding

More information

Adaptive Key Frame Selection for Efficient Video Coding

Adaptive Key Frame Selection for Efficient Video Coding Adaptive Key Frame Selection for Efficient Video Coding Jaebum Jun, Sunyoung Lee, Zanming He, Myungjung Lee, and Euee S. Jang Digital Media Lab., Hanyang University 17 Haengdang-dong, Seongdong-gu, Seoul,

More information

An Interactive Broadcasting Protocol for Video-on-Demand

An Interactive Broadcasting Protocol for Video-on-Demand An Interactive Broadcasting Protocol for Video-on-Demand Jehan-François Pâris Department of Computer Science University of Houston Houston, TX 7724-3475 paris@acm.org Abstract Broadcasting protocols reduce

More information

Joint Optimization of Source-Channel Video Coding Using the H.264/AVC encoder and FEC Codes. Digital Signal and Image Processing Lab

Joint Optimization of Source-Channel Video Coding Using the H.264/AVC encoder and FEC Codes. Digital Signal and Image Processing Lab Joint Optimization of Source-Channel Video Coding Using the H.264/AVC encoder and FEC Codes Digital Signal and Image Processing Lab Simone Milani Ph.D. student simone.milani@dei.unipd.it, Summer School

More information

Cost Analysis of Serpentine Tape Data Placement Techniques in Support of Continuous Media Display

Cost Analysis of Serpentine Tape Data Placement Techniques in Support of Continuous Media Display c Springer-Verlag. Published in the Proceedings of the 10 th International Conference on Computing and Information (ICCI 2000), November 18-21, 2000, Kuwait. Cost Analysis of Serpentine Tape Data Placement

More information

Interlace and De-interlace Application on Video

Interlace and De-interlace Application on Video Interlace and De-interlace Application on Video Liliana, Justinus Andjarwirawan, Gilberto Erwanto Informatics Department, Faculty of Industrial Technology, Petra Christian University Surabaya, Indonesia

More information

Real-Time Parallel MPEG-2 Decoding in Software

Real-Time Parallel MPEG-2 Decoding in Software Real-Time Parallel MPEG-2 Decoding in Software Angelos Bilas, Jason Fritts, Jaswinder Pal Singh Princeton University, Princeton NJ 8544 fbilas@cs, jefritts@ee, jps@csg.princeton.edu Abstract The growing

More information

Will Widescreen (16:9) Work Over Cable? Ralph W. Brown

Will Widescreen (16:9) Work Over Cable? Ralph W. Brown Will Widescreen (16:9) Work Over Cable? Ralph W. Brown Digital video, in both standard definition and high definition, is rapidly setting the standard for the highest quality television viewing experience.

More information

Multimedia Time Warping System. Akiko Campbell Presentation-2 Summer/2004

Multimedia Time Warping System. Akiko Campbell Presentation-2 Summer/2004 Multimedia Time Warping System Akiko Campbell Presentation-2 Summer/2004 Outline Overview Facts Features Multimedia Time Warping System Conclusion Effect of TiVo on VoD Overview Facts A Linux box that

More information

REGIONAL NETWORKS FOR BROADBAND CABLE TELEVISION OPERATIONS

REGIONAL NETWORKS FOR BROADBAND CABLE TELEVISION OPERATIONS REGIONAL NETWORKS FOR BROADBAND CABLE TELEVISION OPERATIONS by Donald Raskin and Curtiss Smith ABSTRACT There is a clear trend toward regional aggregation of local cable television operations. Simultaneously,

More information

Motion Re-estimation for MPEG-2 to MPEG-4 Simple Profile Transcoding. Abstract. I. Introduction

Motion Re-estimation for MPEG-2 to MPEG-4 Simple Profile Transcoding. Abstract. I. Introduction Motion Re-estimation for MPEG-2 to MPEG-4 Simple Profile Transcoding Jun Xin, Ming-Ting Sun*, and Kangwook Chun** *Department of Electrical Engineering, University of Washington **Samsung Electronics Co.

More information

Understanding IP Video for

Understanding IP Video for Brought to You by Presented by Part 3 of 4 B1 Part 3of 4 Clearing Up Compression Misconception By Bob Wimmer Principal Video Security Consultants cctvbob@aol.com AT A GLANCE Three forms of bandwidth compression

More information

Multimedia Communications. Video compression

Multimedia Communications. Video compression Multimedia Communications Video compression Video compression Of all the different sources of data, video produces the largest amount of data There are some differences in our perception with regard to

More information

Chapter 2 Introduction to

Chapter 2 Introduction to Chapter 2 Introduction to H.264/AVC H.264/AVC [1] is the newest video coding standard of the ITU-T Video Coding Experts Group (VCEG) and the ISO/IEC Moving Picture Experts Group (MPEG). The main improvements

More information

Bit Rate Control for Video Transmission Over Wireless Networks

Bit Rate Control for Video Transmission Over Wireless Networks Indian Journal of Science and Technology, Vol 9(S), DOI: 0.75/ijst/06/v9iS/05, December 06 ISSN (Print) : 097-686 ISSN (Online) : 097-5 Bit Rate Control for Video Transmission Over Wireless Networks K.

More information

Constant Bit Rate for Video Streaming Over Packet Switching Networks

Constant Bit Rate for Video Streaming Over Packet Switching Networks International OPEN ACCESS Journal Of Modern Engineering Research (IJMER) Constant Bit Rate for Video Streaming Over Packet Switching Networks Mr. S. P.V Subba rao 1, Y. Renuka Devi 2 Associate professor

More information

Case Study: Can Video Quality Testing be Scripted?

Case Study: Can Video Quality Testing be Scripted? 1566 La Pradera Dr Campbell, CA 95008 www.videoclarity.com 408-379-6952 Case Study: Can Video Quality Testing be Scripted? Bill Reckwerdt, CTO Video Clarity, Inc. Version 1.0 A Video Clarity Case Study

More information

1022 IEEE TRANSACTIONS ON IMAGE PROCESSING, VOL. 19, NO. 4, APRIL 2010

1022 IEEE TRANSACTIONS ON IMAGE PROCESSING, VOL. 19, NO. 4, APRIL 2010 1022 IEEE TRANSACTIONS ON IMAGE PROCESSING, VOL. 19, NO. 4, APRIL 2010 Delay Constrained Multiplexing of Video Streams Using Dual-Frame Video Coding Mayank Tiwari, Student Member, IEEE, Theodore Groves,

More information

Implementation of an MPEG Codec on the Tilera TM 64 Processor

Implementation of an MPEG Codec on the Tilera TM 64 Processor 1 Implementation of an MPEG Codec on the Tilera TM 64 Processor Whitney Flohr Supervisor: Mark Franklin, Ed Richter Department of Electrical and Systems Engineering Washington University in St. Louis Fall

More information

The Matched Delay Technique: Wentai Liu, Mark Clements, Ralph Cavin III. North Carolina State University. (919) (ph)

The Matched Delay Technique: Wentai Liu, Mark Clements, Ralph Cavin III. North Carolina State University.   (919) (ph) The Matched elay Technique: Theory and Practical Issues 1 Introduction Wentai Liu, Mark Clements, Ralph Cavin III epartment of Electrical and Computer Engineering North Carolina State University Raleigh,

More information

Abstract WHAT IS NETWORK PVR? PVR technology, also known as Digital Video Recorder (DVR) technology, is a

Abstract WHAT IS NETWORK PVR? PVR technology, also known as Digital Video Recorder (DVR) technology, is a NETWORK PVR VIDEO SERVER ARCHITECTURE Jay Schiller, Senior VP Broadband Strategy and Product Management Michael Fallon, Senior Technical Writer ncube Corporation Abstract Set-top Personal Video Recording

More information

06 Video. Multimedia Systems. Video Standards, Compression, Post Production

06 Video. Multimedia Systems. Video Standards, Compression, Post Production Multimedia Systems 06 Video Video Standards, Compression, Post Production Imran Ihsan Assistant Professor, Department of Computer Science Air University, Islamabad, Pakistan www.imranihsan.com Lectures

More information

RECOMMENDATION ITU-R BT.1203 *

RECOMMENDATION ITU-R BT.1203 * Rec. TU-R BT.1203 1 RECOMMENDATON TU-R BT.1203 * User requirements for generic bit-rate reduction coding of digital TV signals (, and ) for an end-to-end television system (1995) The TU Radiocommunication

More information

Intra-frame JPEG-2000 vs. Inter-frame Compression Comparison: The benefits and trade-offs for very high quality, high resolution sequences

Intra-frame JPEG-2000 vs. Inter-frame Compression Comparison: The benefits and trade-offs for very high quality, high resolution sequences Intra-frame JPEG-2000 vs. Inter-frame Compression Comparison: The benefits and trade-offs for very high quality, high resolution sequences Michael Smith and John Villasenor For the past several decades,

More information

A Novel Approach towards Video Compression for Mobile Internet using Transform Domain Technique

A Novel Approach towards Video Compression for Mobile Internet using Transform Domain Technique A Novel Approach towards Video Compression for Mobile Internet using Transform Domain Technique Dhaval R. Bhojani Research Scholar, Shri JJT University, Jhunjunu, Rajasthan, India Ved Vyas Dwivedi, PhD.

More information

1. INTRODUCTION. Index Terms Video Transcoding, Video Streaming, Frame skipping, Interpolation frame, Decoder, Encoder.

1. INTRODUCTION. Index Terms Video Transcoding, Video Streaming, Frame skipping, Interpolation frame, Decoder, Encoder. Video Streaming Based on Frame Skipping and Interpolation Techniques Fadlallah Ali Fadlallah Department of Computer Science Sudan University of Science and Technology Khartoum-SUDAN fadali@sustech.edu

More information

(12) Patent Application Publication (10) Pub. No.: US 2007/ A1

(12) Patent Application Publication (10) Pub. No.: US 2007/ A1 (19) United States (12) Patent Application Publication (10) Pub. No.: US 2007/0230902 A1 Shen et al. US 20070230902A1 (43) Pub. Date: Oct. 4, 2007 (54) (75) (73) (21) (22) (60) DYNAMIC DISASTER RECOVERY

More information

Compressed-Sensing-Enabled Video Streaming for Wireless Multimedia Sensor Networks Abstract:

Compressed-Sensing-Enabled Video Streaming for Wireless Multimedia Sensor Networks Abstract: Compressed-Sensing-Enabled Video Streaming for Wireless Multimedia Sensor Networks Abstract: This article1 presents the design of a networked system for joint compression, rate control and error correction

More information

FRAMES PER MULTIFRAME SLOTS PER TDD - FRAME

FRAMES PER MULTIFRAME SLOTS PER TDD - FRAME MULTI-FRAME PACKET RESERVATION MULTIPLE ACCESS FOR VARIABLE-RATE MULTIMEDIA USERS J. Brecht, L. Hanzo, M. Del Buono Dept. of Electr. and Comp. Sc., Univ. of Southampton, SO17 1BJ, UK. Tel: +-703-93 1,

More information

Software Quick Manual

Software Quick Manual XX177-24-00 Virtual Matrix Display Controller Quick Manual Vicon Industries Inc. does not warrant that the functions contained in this equipment will meet your requirements or that the operation will be

More information

AN IMPROVED ERROR CONCEALMENT STRATEGY DRIVEN BY SCENE MOTION PROPERTIES FOR H.264/AVC DECODERS

AN IMPROVED ERROR CONCEALMENT STRATEGY DRIVEN BY SCENE MOTION PROPERTIES FOR H.264/AVC DECODERS AN IMPROVED ERROR CONCEALMENT STRATEGY DRIVEN BY SCENE MOTION PROPERTIES FOR H.264/AVC DECODERS Susanna Spinsante, Ennio Gambi, Franco Chiaraluce Dipartimento di Elettronica, Intelligenza artificiale e

More information

Introduction to image compression

Introduction to image compression Introduction to image compression 1997-2015 Josef Pelikán CGG MFF UK Praha pepca@cgg.mff.cuni.cz http://cgg.mff.cuni.cz/~pepca/ Compression 2015 Josef Pelikán, http://cgg.mff.cuni.cz/~pepca 1 / 12 Motivation

More information

Color Image Compression Using Colorization Based On Coding Technique

Color Image Compression Using Colorization Based On Coding Technique Color Image Compression Using Colorization Based On Coding Technique D.P.Kawade 1, Prof. S.N.Rawat 2 1,2 Department of Electronics and Telecommunication, Bhivarabai Sawant Institute of Technology and Research

More information

Using the VideoEdge IP Encoder with Intellex IP

Using the VideoEdge IP Encoder with Intellex IP This application note explains the tradeoffs inherent in using IP video and provides guidance on optimal configuration of the VideoEdge IP encoder with Intellex IP. The VideoEdge IP Encoder is a high performance

More information

Video-on-Demand. Nick Caggiano Walter Phillips

Video-on-Demand. Nick Caggiano Walter Phillips Video-on-Demand Nick Caggiano Walter Phillips Video-on-Demand What is Video-on-Demand? Storage, transmission, and display of archived video files in a networked environment Most popularly used to watch

More information

PAL uncompressed. 768x576 pixels per frame. 31 MB per second 1.85 GB per minute. x 3 bytes per pixel (24 bit colour) x 25 frames per second

PAL uncompressed. 768x576 pixels per frame. 31 MB per second 1.85 GB per minute. x 3 bytes per pixel (24 bit colour) x 25 frames per second 191 192 PAL uncompressed 768x576 pixels per frame x 3 bytes per pixel (24 bit colour) x 25 frames per second 31 MB per second 1.85 GB per minute 191 192 NTSC uncompressed 640x480 pixels per frame x 3 bytes

More information

ELEC 691X/498X Broadcast Signal Transmission Fall 2015

ELEC 691X/498X Broadcast Signal Transmission Fall 2015 ELEC 691X/498X Broadcast Signal Transmission Fall 2015 Instructor: Dr. Reza Soleymani, Office: EV 5.125, Telephone: 848 2424 ext.: 4103. Office Hours: Wednesday, Thursday, 14:00 15:00 Time: Tuesday, 2:45

More information

Transport Stream. 1 packet delay No delay. PCR-unaware scheme. AAL5 SDUs PCR PCR. PCR-aware scheme PCR PCR. Time

Transport Stream. 1 packet delay No delay. PCR-unaware scheme. AAL5 SDUs PCR PCR. PCR-aware scheme PCR PCR. Time A Restamping Approach to Clock Recovery in MPEG-2 Systems Layer Christos Tryfonas Anujan Varma UCSC-CRL-98-4 May 4, 1998 Board of Studies in Computer Engineering University of California, Santa Cruz Santa

More information

CHECKPOINT 2.5 FOUR PORT ARBITER AND USER INTERFACE

CHECKPOINT 2.5 FOUR PORT ARBITER AND USER INTERFACE 1.0 MOTIVATION UNIVERSITY OF CALIFORNIA AT BERKELEY COLLEGE OF ENGINEERING DEPARTMENT OF ELECTRICAL ENGINEERING AND COMPUTER SCIENCE CHECKPOINT 2.5 FOUR PORT ARBITER AND USER INTERFACE Please note that

More information

Chapter 2. Advanced Telecommunications and Signal Processing Program. E. Galarza, Raynard O. Hinds, Eric C. Reed, Lon E. Sun-

Chapter 2. Advanced Telecommunications and Signal Processing Program. E. Galarza, Raynard O. Hinds, Eric C. Reed, Lon E. Sun- Chapter 2. Advanced Telecommunications and Signal Processing Program Academic and Research Staff Professor Jae S. Lim Visiting Scientists and Research Affiliates M. Carlos Kennedy Graduate Students John

More information

(12) Patent Application Publication (10) Pub. No.: US 2004/ A1

(12) Patent Application Publication (10) Pub. No.: US 2004/ A1 (19) United States US 2004O184531A1 (12) Patent Application Publication (10) Pub. No.: US 2004/0184531A1 Lim et al. (43) Pub. Date: Sep. 23, 2004 (54) DUAL VIDEO COMPRESSION METHOD Publication Classification

More information

Experimental Results from a Practical Implementation of a Measurement Based CAC Algorithm. Contract ML704589 Final report Andrew Moore and Simon Crosby May 1998 Abstract Interest in Connection Admission

More information