3D D HDTV over ATM 2003. 8. 27. Ahn, Chieteuk Radio & Broadcasting Research Laboratory ETRI 2003-08-27 0
Contents! Introduction Abstract Related Work What is 3D HDTV?! Delivery Schemes 3D HDTV over IP (DVB-ASI to IP over Ethernet, DVB-ASI to IP over ATM) 3D HDTV over ATM Mapping MPEG-2 TS into AAL-5! Delivery Experiments Delivery Systems 1 & 2 3D HDTV Signal Flow 3D HDTV Camera & Camera Position 3D HDTV OB Van 3D HDTV Video Multiplexer 3D HDTV Receiver Experimental Results (1..4)! Concluding Remarks 1
Introduction: Abstract Abstract This presentation describes an efficient method of delivering three-dimensional high-definition television(3d HDTV) contents over ATM. In this work, we focus on the problem of delivering compressed stereoscopic video signals over Korea advanced research network(koren) synchronously. Prior to compression, the stereoscopic video signals are multiplexed in a single standard side-by-side video in real-time. Such preprocessing guarantees synchronization between the stereoscopic video signals as well as compatibility with an HDTV transmission system simultaneously. Next, compressing the multiplexed video with MPEG-2 mainprofile high-level(mp@hl) at 40Mbps, we deliver a single transport stream over KOREN from ETRI to ANC Busan. Finally decoding and de-multiplexing the transport stream with a 3D HDTV receiver, we project stereoscopic video signals on a 70 inch 3D HDTV display with polarization filters. 2
Introduction: Related Work I (HDTV)! 2netFX " Compressed HDTV over IP " MPEG-2 compression at 19.2Mbps using the standard RTP payload! The University of Washington (UW) " Compressed HDTV over IP (production quality at 270Mbps)! Tektronix (with the univ. of Washington and USC information sciences institute) " HDTV over an OC-48 POS interface " SMPTE 292M over IP at 1.5Gbps using an RTP payload format! NTT " HDTV over IP (SMPTE 292M over IP at 1.5Gbps) " A multi-processor PC running Linux with a commercial HDTV capture card 3
Introduction: Related Work II (3DTV)! EUROPE: RACE DISTIMA project (1994) " 3DTV over ATM " 10Mbps (from The Netherlands to Germany)! CRC Canda (2002) " 3D SDTV over TCP/IP " A top-bottom multiplexing scheme is used! NHK Japan (1998/2001) " 3D HDTV over satellite at 45Mbps @ 1998 Nagano Winter Games " 3D HDTV over IPv6 at 22.5Mbps each (2001, Tokyo Okayama 750km) " Transmit the stereoscopic video signals separately! ETRI Korea (2002) " 3D HDTV over DS-3/ATM@ 2002 World Cup Korea-Japan " MPEG-2 compression at 40Mbps " A side-by-side multiplexing scheme is used 4
5 Introduction: What is 3D HDTV? (1)
Introduction: What is 3D HDTV? (2)! 3D D HDTV vs. HDTV 3D HDTV uses a pair of high-definition stereoscopic images from acquisition to display To apply an existing HDTV transmission system directly, a kind of multiplexing scheme is highly required prior to the 3D HDTV transmission 3D HDTV requires more bandwidth than HDTV for transmission 3D HDTV is much more impressive than HDTV from the viewpoint of depth perception and sense of reality But, visual comport (fatigue) is an open problem ETRI did experimental services of 3D HDTV broadcasting relay during 2002 FIFA World Cup Korea-Japan 6
Delivery Schemes: 3D HDTV over IP 3D HDTV 292M x 2 3D Demux ATM (155Mbps) IP IP(10/100BT) 292M OC-3 MM Multicasting Router IP Switch IP STB IP Video Gateway DVB-ASI 292M 292M x 2 MPEG-2 Encoder 3D Mux 3D Camera 7
8 DVB-ASI to IP over Ethernet
9 DVB-ASI to IP over ATM
Delivery Schemes: 3D HDTV over ATM 3D HDTV 292M x 2 3D Demux OC-3 SM ATM (155Mbps) ATM Switch OC-3 MM DVB-ASI 292M OC-3 MM ATM Adaptor HDTV STB ATM Switch OC-3 MM ATM Adaptor DVB-ASI 292M 292M x 2 MPEG-2 Encoder 3D Mux 3D Camera 10
Mapping MPEG-2 2 TS into AAL-5 11 SPTS: Single program transport stream CPCS-P(S)DU: Common part convergence layer protocol(service) data unit AAL-5: ATM Adaptation Layer Type 5 TS: Transport stream
Remark: Demo & Presentation A demonstration of 3D HDTV over ATM is cancelled because of no available ATM lines from ETRI and Marriott Hotel. Instead, in the following, I will present experimental services of 3D HDTV broadcasting relay in Korea during 2002 FIFA World Cup Korea- Japan. In this case, we used a DS-3 network to deliver 3D HDTV signals. 12
Delivery Experiments: 3D HDTV System 1 Procedure 3DTV Camera (3) Optical HD-SDI 3DTV OB Van World Cup Stadium KT TOC 1. Capture soccer games with 3D HDTV cameras. 2. Transmit the signals to the 3D HDTV OB van with the use of optical fibers. 3. Send the compressed signal over a DS-3 network to demo venues. 4. Recover the signal with the 3D HDTV receiver. 5. Display the left/right images on the silver screen with polarized beam projectors. 6. Watch the 3D video with a polarized glasses. DS-3 300/120 inch Network Adaptor (TUI-10) DVB-ASI Audio (Stereo) 3DTV Receiver 2 RGB 3DTV Display Demo Venue 13
14 Delivery Experiments: 3D HDTV System 2
Delivery Experiments: 3D HDTV Signal Flow Left 3DTV OB Van 3DTV Video MUX Optical 3DTV Camera Right DS-3 Left 3DTV Display Network Adaptor DVB-ASI 3DTV Receiver (3DTV Demux) RGB 300/120 inch Screen Right 15
3D HDTV Camera & Camera Position 1 Camera at the highest unilateral camera position 2 Cameras at Pitch Level. 16
3D D HDTV OB Van Tally Ind. F.S. C#1 C#2 LINE CG Vec. Scope C#3 Sync Gen. Switcher 17
3D D HDTV Video Multiplexer Original Left-Right Stereoscopic Images Filtered and Squeezed Left-Right Images Multiplexed Image in Side-by-Side Format 18
3D D HDTV Receiver Multiplexed Image in Side-by-Side Format after decoding Separated Left-Right Images Demultiplexing Interpolated Left-Right Images 19
Results (1) PSNR (a) Left image (b) Right images (c) Multiplexed image _ Uncompressed _ Compressed Mux/Demux Only HDTV 3DTV L 35.47 19.39 Mbps 33.78 32.53 R 35.71 34.13 33.75 L 35.47 40 Mbps 34.15 33.20 R 35.71 34.35 34.05 20
Results (2) An Image and Colors 25 0 200 Left Right Green (Y) 15 0 100 5 0 0 1 128 255 382 509 636 763 890 Pixels (a)image (b) Y 2 5 0 200 Left R ig ht 2 5 0 200 Left R ig ht Blue (Cb) 1 5 0 100 Red (Cr) 1 5 0 100 5 0 5 0 0 1 128 255 382 509 636 763 890 Pixels 0 1 128 255 382 509 636 763 890 Pixels 21 (c) Pb (d) Pr
Results (3) Visitor Statistics Demo Venues Korean Foreigner Sub Total IMC 6,228 5,670 11,898 Seoul Yeouido 78,760 2,022 80,782 Peace Park 156,642 10,092 166,634 Daegue 78,414 2,736 81,064 Busan 28,418 1,540 29,958 Daejeon 16,193 716 15,477 Ulsan 80,788 1,045 81,833 Gwangju 14,958 12 14,970 Incheon 73,912 1,600 75,512 Seogwipo 10,724 1,816 12,540 Total 544,937 27,249 570,668 22
Results (4) Subjective Evalution Depth perception of 3D HDTV User-friendly digital broadcasting services 80% 80% 60% 55% 60% 46% 40% 33% 40% 36% 20% 8% 4% 20% 10% 8% 0% Excellent Good Fair Unnoticeable 0% HDTV 3DTV Data Broadcasting Satellite Broadcasting (a) (b) Subjective evaluation results 23
Concluding Remarks Compressed 3D HDTV over DS-3/ATM is a liable transmission solution of delivering a pair of stereoscopic video signals to end users in real-time Proposed 3D HDTV ensures synchronization between stereoscopic video signals Proposed 3D HDTV is compatible with an existing HDTV transmission system 3D HDTV over DS-3/ATM guarantees Quality of Services in delivering a pair of stereoscopic video signals in real-time With a commercial IP encapsulation device, 3D HDTV over ATM can be applied to the problem of 3D HDTV over IP directly We verified the developed 3D HDTV broadcasting systems by field productions during 2002 FIFA World Cup We got invaluable experiences of operating a 3D HDTV system at fields 24