3DTV CONTENT CAPTURE, ENCODING AND TRANSMISSION

3DTV CONTENT CAPTURE, ENCODING AND TRANSMISSION BUILDING THE TRANSPORT INFRASTRUCTURE FOR COMMERCIAL SERVICES Daniel Minoli A JOHN WILEY & SONS, INC., PUBLICATION

3DTV CONTENT CAPTURE, ENCODING AND TRANSMISSION

3DTV CONTENT CAPTURE, ENCODING AND TRANSMISSION BUILDING THE TRANSPORT INFRASTRUCTURE FOR COMMERCIAL SERVICES Daniel Minoli A JOHN WILEY & SONS, INC., PUBLICATION

Copyright 2010 by John Wiley & Sons, Inc. All rights reserved Published by John Wiley & Sons, Inc., Hoboken, New Jersey Published simultaneously in Canada No part of this publication may be reproduced, stored in a retrieval system, or transmitted in any form or by any means, electronic, mechanical, photocopying, recording, scanning, or otherwise, except as permitted under Section 107 or 108 of the 1976 United States Copyright Act, without either the prior written permission of the Publisher, or authorization through payment of the appropriate per-copy fee to the Copyright Clearance Center, Inc., 222 Rosewood Drive, Danvers, MA 01923, (978) 750-8400, fax (978) 750-4470, or on the web at www.copyright.com. Requests to the Publisher for permission should be addressed to the Permissions Department, John Wiley & Sons, Inc., 111 River Street, Hoboken, NJ 07030, (201) 748-6011, fax (201) 748-6008, or online at http://www.wiley.com/go/permission. Limit of Liability/Disclaimer of Warranty: While the publisher and author have used their best efforts in preparing this book, they make no representations or warranties with respect to the accuracy or completeness of the contents of this book and specifically disclaim any implied warranties of merchantability or fitness for a particular purpose. No warranty may be created or extended by sales representatives or written sales materials. The advice and strategies contained herein may not be suitable for your situation. You should consult with a professional where appropriate. Neither the publisher nor author shall be liable for any loss of profit or any other commercial damages, including but not limited to special, incidental, consequential, or other damages. For general information on our other products and services or for technical support, please contact our Customer Care Department within the United States at (800) 762-2974, outside the United States at (317) 572-3993 or fax (317) 572-4002. Wiley also publishes its books in a variety of electronic formats. Some content that appears in print may not be available in electronic formats. For more information about Wiley products, visit our web site at www.wiley.com. Library of Congress Cataloging-in-Publication Data: Minoli, Daniel, 1952-3DTV content capture, encoding and transmission : building the transport infrastructure for commercial services / Daniel Minoli. p. cm. ISBN 978-0-470-64973-2 (cloth) 1. Stereoscopic television. I. Title. TK6643.M56 2010 621.388 dc22 2010008432 Printed in Singapore 10987654321

For Anna, Emma, Emile, Gabby, Gino, and Angela

CONTENTS Preface About the Author xi xiii 1 Introduction 1 1.1 Overview 1 1.2 Background 6 1.2.1 Adoption of 3DTV in the Marketplace 6 1.2.2 Opportunities and Challenges for 3DTV 16 1.3 Course of Investigation 19 References 24 Appendix A1: Some Recent Industry Events Related to 3DTV 26 2 3DV and 3DTV Principles 29 2.1 Human Visual System 29 2.1.1 Depth/Binocular Cues 33 2.1.2 Accommodation 34 2.1.3 Parallax 34 2.2 3DV/3DTV Stereoscopic Principles 35 2.3 Autostereographic Approaches 42 References 45 3 3DTV/3DV Encoding Approaches 47 3.1 3D Mastering Methods 51 3.1.1 Frame Mastering for Conventional Stereo Video (CSV) 51 3.1.2 Compression for Conventional Stereo Video (CSV) 55 3.2 More Advanced Methods 59 3.2.1 Video Plus Depth (V + D) 60 vii

viii CONTENTS 3.2.2 Multi-View Video Plus Depth (MV + D) 63 3.2.3 Layered Depth Video (LDV) 65 3.3 Short-term Approach for Signal Representation and Compression 69 3.4 Displays 69 References 69 Appendix A3: Color Encoding 73 Appendix B3: Additional Details on Video Encoding Standards 74 B3.1 Multiple-View Video Coding (MVC) 75 B3.2 Scalable Video Coding (SVC) 78 B3.3 Conclusion 79 4 3DTV/3DV Transmission Approaches and Satellite Delivery 81 4.1 Overview of Basic Transport Approaches 81 4.2 DVB 90 4.3 DVB-H 95 References 99 Appendix A4: Brief Overview of MPEG Multiplexing and DVB Support 101 A4.1 Packetized Elementary Stream (PES) Packets and Transport Stream (TS) Unit(s) 101 A4.2 DVB (Digital Video Broadcasting)-Based Transport in Packet Networks 104 A4.3 MPEG-4 and/or Other Data Support 105 5 3DTV/3DV IPTV Transmission Approaches 113 5.1 IPTV Concepts 114 5.1.1 Multicast Operation 115 5.1.2 Backbone 120 5.1.3 Access 125 5.2 IPv6 Concepts 132 References 135 Appendix A5: IPv6 Basics 138 A5.1 IPv6 Overview 138 A5.2 Advocacy for IPv6 Deployment Example 157

CONTENTS ix 6 3DTV Standardization and Related Activities 163 6.1 Moving Picture Experts Group (MPEG) 165 6.1.1 Overview 165 6.1.2 Completed Work 166 6.1.3 New Initiatives 178 6.2 MPEG Industry Forum (MPEGIF) 182 6.3 Society of Motion Picture and Television Engineers (SMPTE) 3D Home Entertainment Task Force 183 6.4 Rapporteur Group On 3DTV of ITU-R Study Group 6 184 6.5 TM-3D-SM Group of Digital Video Broadcast (DVB) 187 6.6 Consumer Electronics Association (CEA) 188 6.7 HDMI Licensing, LLC 189 6.8 Blu-ray Disc Association (BDA) 189 6.9 Other Advocacy Entities 190 6.9.1 3D@Home Consortium 190 6.9.2 3D Consortium (3DC) 190 6.9.3 European Information Society Technologies (IST) Project Advanced Three-Dimensional Television System Technologies (ATTEST) 191 6.9.4 3D4YOU 192 6.9.5 3DPHONE 196 References 198 Glossary 201 Index 225

PREFACE 3 Dimensions TV (3DTV) became commercially available in the United States in 2010 and service in other countries was expected to follow soon thereafter. 3DTV is a subset of a larger discipline known as 3D Video (3DV). There are now many routine vendor announcements related to 3DTV/3DV, and there are also conferences wholly dedicated to the topic. To highlight the commercial interest in this topic, note that ESPN announced in January 2010 that it planned to launch what would be the world s first 3D sports network with the 2010 World Cup soccer tournament in June 2010, followed by an estimated 85 live sports events during its first year of operation. DirecTV was planning to become the first company to offer satellite-based 3D as announced at the 2010 International Consumer Electronics Show. Numerous manufacturers showed 3D displays at recent consumer electronics trade shows. Several standards bodies and industry consortia are now working to support commercialization of the service. An increasing inventory of content is now also becoming available in 3D. This text offers an overview of the content capture, encoding, and transmission technologies that have emerged of late in support of 3DTV/3DV. It focuses on building the transport infrastructure for commercial services. The book is aimed at interested planners, researchers, and engineers who wish to get an overview of the topic. Stakeholders involved with the rollout of the infrastructure include video engineers, equipment manufacturers, standardization committees, broadcasters, satellite operators, Internet Service Providers, terrestrial telecommunications carriers, storage companies, content-development entities, design engineers, planners, college professors and students, and venture capitalists. While there is a lot of academic interest in various aspects of the overall system, service providers and the consumers ultimately tend to take a system-level view. While service providers do to an extent take a constructionist bottom-up view to deploy the technological building blocks (such as encoders, encapsulators, IRDs, and set-top boxes), 3DTV stakeholders need to consider the overall architectural system-level view of what it will take to deploy an infrastructure that is able to reliably and cost-effectively deliver a commercial-grade quality bundle of multiple 3DTV content channels to paying customers with high expectations. This text, therefore, takes such system-level view. Fundamental visual concepts supporting stereographic perception of 3DTV are reviewed. 3DTV technology and digital video principles are discussed. Elements of an end-to-end 3DTV system are covered. Compression and transmission technologies are assessed xi

xii PREFACE for satellite and terrestrial (or hybrid) IPTV-based architecture. Standardization activities, critical to any sort of broad deployment, are identified. The focus of this text is how to actually deploy the technology. There is a significant quantity of published material in the form of papers, reports, and technical specifications. This published material forms the basis for this synthesis, but the information is presented here in a self-contained, organized, tutorial fashion.

ABOUT THE AUTHOR Mr. Minoli has done extensive work in video engineering, design, and implementation over the years. The results presented in this book are based on work done while at Bellcore/Telcordia, Stevens Institute of Technology, AT&T, and other engineering firms, starting in the early 1990s and continuing to the present. Some of his video work has been documented in the books he has authored such as 3D Television (3DTV) Technology, Systems, and Deployment - Rolling out the Infrastructure for Next-Generation Entertainment (Francis and Taylor, 2010); IP Multicast with Applications to IPTV and Mobile DVB-H (Wiley/IEEE Press, 2008); Video Dialtone Technology: Digital Video over ADSL, HFC, FTTC, and ATM (McGraw-Hill, 1995); Distributed Multimedia Through Broadband Communication Services (co-authored) (Artech House, 1994); Digital Video (4 chapters) in The Telecommunications Handbook, K.Terplan& P. Morreale Editors, IEEE Press, 2000; and, Distance Learning: Technology and Applications (Artech House, 1996). Mr. Minoli has many years of technical hands-on and managerial experience in planning, designing, deploying, and operating IP/IPv6-, telecom-, wireless-, and video networks, and data center systems and subsystems for global best-in-class carriers and financial companies. He has worked in financial firms such as AIG, Prudential Securities, Capital One Financial, and service provider firms such as Network Analysis Corporation, Bell Telephone Laboratories, ITT, Bell Communications Research (now Telcordia), AT&T, Leading Edge Networks Inc., and SES Engineering, where he is Director of Terrestrial Systems Engineering (SES is the largest satellite services company in the world). At SES, in addition to other duties, Mr. Minoli has been responsible for the development and deployment of IPTV systems, terrestrial and mobile IP-based networking services, and other global networks. He also played a founding role in the launching of two companies through the high-tech incubator Leading Edge Networks Inc., which he ran in the early 2000s: Global Wireless Services, a provider of secure broadband hotspot mobile Internet and hotspot VoIP services; and, InfoPort Communications Group, an optical and Gigabit Ethernet metropolitan carrier supporting data center/san/channel extension and cloud computing network access services. For several years, he has been Session, Tutorial, and now overall Technical Program Chair for the IEEE ENTNET (Enterprise Networking) conference; ENTNET focuses on enterprise networking requirements for large financial firms and other corporate institutions. xiii