Uncompressed 4K Live Streaming of 23rd Kyoto Prize Events from Kyoto to Stockholm Daisuke Shirai NTT Network Innovation Laboratories Nippon Telegraph and Telephone Corp. shirai.daisuke@lab.ntt.co.jp Kunitake Kaneko Research Institute for Digital Media and Content Keio University kaneko@dmc.keio.ac.jp 1/16
Outline What is 4K? Kyoto Prize 4K Live Transmission Technology details of 4K Video Stream Switching 2/16
Introduction: Positioning of 4K Resolution Images 4K images : with roughly 4000 horizontal and 2000 vertical pixels 3840x2160 (Quad HDTV), 4096x2160 (DCI Digital Cinema Standard), 3840x2400 (WQUXGA) 4K image can surpass the quality of 35-mm film (vertical lines) Spatial Resolution 3000 2000 1000 0 Still Images Printing/Medicine Laser Printer 60mm film 35mm film & Digital Camera Instant Film Motion Pictures 35mm Movie HDTV 1080p 720p Legacy Media 0 24 30 Movie TV Temporal Resolution 4K video with 8M (3840x2160) pixels HDTV(1080i) SDTV(480i) (frame/sec.) 3/16
What is Kyoto Prize ( 京都賞 )? The Kyoto Prize, awarded annually since 1985, is an international award to honor those who have contributed significantly to the scientific, cultural, and spiritual betterment of mankind. The Prize is presented annually in each of the following three categories: Advanced Technology, Basic Sciences, and Arts and Philosophy. The Prize is managed by the Inamori Foundation founded in 1984 by Kazuo Inamori (now Chairman Emeritus of Kyocera Corporation). 2007 Laureates For the category of Advanced Technology, Dr. Hiroo Inokuchi (age 80, Japan, Materials Science and Engineering). For the category of Basic Sciences, Dr. Hiroo Kanamori (age 71, Japan, Earth and Planetary Sciences, Astronomy and Astrophysics). For the category of Arts and Philosophy, Ms. Pina Bausch (age 67, Germany,Theater and Cinema). 4/16
The overview of Kyoto Prize 4K transmission (1/2) 4K uncompressed live streaming (6 Gbit/s) from Kyoto to Stockholm Via 10Gbit Ethernet connections over 21,000km with switching b/w 2 cams in IP domain J2K Recording at Stockholm for the further event in Karlsruhe(4k Internet Streaming) 10-11, Nov., 2007 4K compressed multicast live streaming (500 Mbit/s) from Kyoto to three different places in Japan, and to Stockholm multicast realized by Flexcast technology Acknowledgement This project was supported by GLIF (JGN2, Starlight, CESnet, IRNC, Netherlight, SURFnet, NORDUnet) Japanese Ministry of Internal Affairs and Communications Japanese Ministry of Education, Culture, Sports, Science and Technology 5/16
The overview of Kyoto Prize 4K transmission (2/2) The 23 rd Kyoto Prize Events at Kyoto Int l Conference Center (Kyoto) The Royal Institute of Technology, KTH (Stockholm) 4K Camera (Olympus) Wide shot 4K uncompressed streaming server Remote switching control signals Terminal PC 6 Gbit/s Close-up shot Image switching on network streaming receiver storage 4K JPEG 2000 Codec 500 Mbit/s Keio Univ. (Tokyo) Stream duplicator w/ Flexcast technology NTT Lab. (Yokosuka) Tohoku Univ. (Sendai) 6/16
Trans-Pacific Trans-Atlantic 7/16
4K Switching demo Kyoto Prize opening ceremony 8/16
Why Uncompressed Streaming? uncompressed image is indispensable Highest Quality: Essential for video editing and production For SD, HD, even when 4K Low Latency: minimize codec delay For bi-directional communication 3TB / hour 6 Gbit/s Carrying disks Carrying using network 9/16
Uncompressed 4K Video Transmission System (1/2) Based on HD-SDI over IP transmission system (i-visto) 10Gbps Ethernet HDSDI in/out board (1) Sync Control Ethernet HDSDI in/out board (2) Uncompressed 4K video transmission system ref-in in through-out out out 10/16
Uncompressed 4K Video Transmission System (2/2) 4x HD-SDI over IP (HD-SDI transparent) 4x UDP streams over IP Jumbo frame(9000b) Streaming controlled by terminal PC Frame sync over Ethernet Four output HD-SDI signals are synchronized by a master signal 4x HD-SDI UDP(1.5Gbps) sync master UDP(1.5Gbps) 4K image frame sync 10G Ethernet UDP(1.5Gbps) frame sync HD-SDI signal sync UDP(1.5Gbps) 11/16
4K Video Stream Switching Concept Achieving 6 Gbit/s uncompressed 4K video stream switching on a 10 Gbit/s shared line Conventional Configuration Location A Location B Location C 4K Server 6Gbps 6Gbps 6Gbps Sender side 10G NW 10G NW 10G NW 4K Receiver Receiver side HD-SDI signal switcher Video switching Target Configuration Location A Location B Location C Sender side 4K Server 6Gbps Video switching (by stopping/starting stream) 10G NW 10GbE SW 6Gbps 4K Receiver Receiver side Reducing the cost for a network Providing a network with scalability 12/16
Difficulties in 4K Video Stream Switching Issue : Momentary bandwidth overflow by overlapping two streams Due to phase difference of two video sources, jitter of the network and processing time Server A Request to stop Bandwidth overflow Total bit rate Bit rate Overflowing Bandwidth Server B 6Gbps 10GbE SW Request to start Stream A Stream B Time Approach: Preventing bandwidth overflow with stream crossfading 13/16
Approach: Stream Crossfading Gradually changing the sending bit rate when stopping/starting stream When stopping the video stream, the server decrease the sending bit rate frame by frame, and vice versa. The receiver needs buffers for each stream Bit rate Bit rate corresponding to the first frame Video Stream A ST B Streaming fade-out ET A 2frames 2frames corresponding to the last frame Video Stream B Time Time Streaming fade-in Server A Server B ST B ET A L2 switch Bit rate Total bit rate Video Stream A Playing Stream A 2frames buffered Playing Stream B Video Stream B Time 14/16
Results (with maximum video phase difference) 8.6 Gbit/s 6.4 Gbit/s Where the period of crossfading is N frames, the maximum increase in the total bit rate is 1 / (N+1) of the bit rate of one video stream The result shows the total bit rate was held to 8.6 Gbit/s (133% of the bit rate of one video stream), where the crossfading period is 2 frames bit rate(gbit/s) bit rate(gbit/s) 10 8 6 4 2 0 10 8 6 4 2 Switching stream A to stream B Stream A Stream B Total 1.34 1.36 1.38 1.4 1.42 1.44 1.46 1.48 time(sec) Switching stream B to stream A Stream B Stream A Total 0 3.98 4 4.02 4.04 4.06 4.08 4.1 4.12 time(sec) 15/16
Conclusion Uncompressed 4K Live Streaming of Kyoto Prize Events World s first trans-pacific and trans-atlantic 4K Streaming (21,000km) Proved that 4K images can be produced, recorded, encoded, switched and delivered on the fly over IP networks world-wide. 16/16