WD SMPTE STANDARD Interoperable Master Format Application #2 (Example) Version 0.5 (9/7/2011 4:18:00 a9/p9 :: application-2-20110906-v2.doc) Warning Page 1 of 11 pages This document is not a SMPTE Standard. It is distributed for review and comment. It is subject to change without notice and shall not be referred to as a SMPTE Standard. Recipients of this document are invited to submit, with their comments, notification of any relevant patent rights of which they are aware and to provide supporting documentation. Distribution does not constitute publication. Table of Contents 1 Introduction 2 2 Scope 2 3 Conformance Notation 3 4 Normative References 3 5 Image Essence 4 6 Audio Essence 4 7 Data Essence 5 8 Image Track Files 5 9 Audio Track Files 6 10 Composition 6 11 Composition Playlist 7 Annex A IMF Image Variants 9 Foreword SMPTE (the Society of Motion Picture and Television Engineers) is an internationally-recognized standards developing organization. Headquartered and incorporated in the United States of America, SMPTE has members in over 80 countries on six continents. SMPTE s Engineering Documents, including Standards, Recommended Practices, and Engineering Guidelines, are prepared by SMPTE s Technology Committees. Participation in these Committees is open to all with a bona fide interest in their work. SMPTE cooperates Copyright 2007 by THE SOCIETY OF MOTION PICTURE AND TELEVISION ENGINEERS 3 Barker Avenue., White Plains, NY 10601 (914) 761-1100 Approved <TBD>
closely with other standards-developing organizations, including ISO, IEC and ITU. SMPTE Engineering Documents are drafted in accordance with the rules given in Part XIII of its Administrative Practices. This SMPTE Engineering Document was prepared by Technology Committee 35PM-50. 1 Introduction A single TV or movie title is transformed into multiple content versions (airline edits, special edition, languages ) These versions, which share common assets sourced from high-quality source masters, are ultimately made available to multiple distribution channels (Internet, optical media, broadcast...) across multiple territories and over the span of many months to over a year. The IMF is a file-based framework that allows these high-quality versions, called Compositions, to be efficiently represented, managed and processed on file-based systems. For example, it facilitates the generation of multiple outputs of the same Composition (through instructions contained in an Output Profile List define in other documents) to accommodate the specific needs of distribution channels. Since management and processing of Compositions are performed across multiple devices and service providers, interoperability is desirable. Figure 1. The IMF framework allows the management and processing of multiple high-quality versions, called Compositions, of a finished content. 2 Scope This document specifies Compositions for IMF Application #2. It is a specialization of the IMF Framework. Application #2 is meant for studio applications where a TV or movie title is transformed into multiple content versions (airline edits, special edition, languages ) that are made available to multiple consumer distribution channels (Internet, optical media, broadcast...) across multiple territories and over the span of many months to over a year. It uses high-definition image essence coded as a lossy JPEG 2000 codestream and audio essence coded as linear PCM. The transformation of Application #2 Compositions to the output formats appropriate for these aforementioned distribution channels is specified in other documents. Page 2 of 11 pages
3 Conformance Notation Normative text is text that describes elements of the design that are indispensable or contains the conformance language keywords: "shall", "should", or "may". Informative text is text that is potentially helpful to the user, but not indispensable, and can be removed, changed, or added editorially without affecting interoperability. Informative text does not contain any conformance keywords. All text in this document is, by default, normative, except: the Introduction, any section explicitly labeled as "Informative" or individual paragraphs that start with "Note: The keywords "shall" and "shall not" indicate requirements strictly to be followed in order to conform to the document and from which no deviation is permitted. The keywords, "should" and "should not" indicate that, among several possibilities, one is recommended as particularly suitable, without mentioning or excluding others; or that a certain course of action is preferred but not necessarily required; or that (in the negative form) a certain possibility or course of action is deprecated but not prohibited. The keywords "may" and "need not" indicate courses of action permissible within the limits of the document. The keyword reserved indicates a provision that is not defined at this time, shall not be used, and may be defined in the future. The keyword forbidden indicates reserved and in addition indicates that the provision will never be defined in the future. A conformant implementation according to this document is one that includes all mandatory provisions ("shall") and, if implemented, all recommended provisions ("should") as described. A conformant implementation need not implement optional provisions ("may") and need not implement them as described. Unless otherwise specified, the order of precedence of the types of normative information in this document shall be as follows: Normative prose shall be the authoritative definition; Tables shall be next; followed by formal languages; then figures; and then any other language forms. 4 Normative References The following standards contain provisions which, through reference in this text, constitute provisions of this recommended practice. At the time of publication, the editions indicated were valid. All standards are subject to revision, and parties to agreements based on this recommended practice are encouraged to investigate the possibility of applying the most recent edition of the standards indicated below. [ST422] SMPTE 422M-2006, Material Exchange Format Mapping JPEG 2000 Codestreams into the MXF Generic Container [ST296] SMPTE ST296:2001 Television 1280 720 Progressive Image Sample Structure Analog and Digital Representation and Analog Interface [ST274] SMPTE ST274:2008 Television 1920 x 1080 Image Sample Structure, Digital Representation and Digital Timing Reference Sequences for Multiple Picture Rates [MCA] SMPTE STXXXX:2012 Multichannel Audio Labeling Framework Page 3 of 11 pages
[Common Audio Channels and Soundfield Groups] SMPTE STXXXX:2012 Common Audio Channels and Soundfield Groups [ST428-y:2012] D-Cinema Distribution Master Common Audio Channels and Soundfield Groups [IMF Data Essence] STXXXX-5:2012, IMF Data Essence Specification [IMF Core Constraints] STXXXX-2:2012, IMF Core Constraints [IMF Digital Certificates] STXXXX-20:2012, IMF Digital Certificates [IMF Image Variants] STXXXX-10:2012, IMF Image Variants [IMF LPCM Audio] STXXXX-11:2012, IMF LPCM Audio Essence [ISO/IEC 15444-1], 15444-1:2004/Amd 3:2010, Information Technology JPEG 2000 Image Coding System. ISO/IEC (2010). 5 Image Essence 5.1 Characteristics The image essence characteristics shall correspond of one of the variants listed in Annex A. 5.2 Encoding The image essence shall be encoded using one of the profiles of JPEG 2000 [ISO/IEC 15444-1] listed in Table 1. Table 1. JPEG 2000 Profiles. Broadcast Profile Single Tile - Level 2 Broadcast Profile Single Tile - Level 3 Broadcast Profile Single Tile - Level 4 Broadcast Profile Single Tile - Level 5 6 Audio Essence The audio essence characteristics shall conform to [IMF LPCM Audio], with the following constraints applied. 6.1 Bits per Sample The number of bits per audio essence sample shall be one of the values listed in Table 2. Table 2. Audio Essence Bits Per Samples. Page 4 of 11 pages
24 7 Data Essence The data essence shall conform to [IMF Data Essence]. Only the sub-types listed in Table 3 shall be present. Table 3. Date Essence Types. TBD 8 Image Track Files 8.1 Essence An Image Track File shall contain image essence conforming to Section 5. 8.2 Wrapping Image Track Files shall conform to [ST422]. 8.3 Essence Descriptors 8.3.1 JPEG 2000 Picture Sub Descriptor The Top-Level File Package of Image Track File shall reference a JPEG 2000 Picture Sub Descriptor [ST422]. 8.3.2 Picture Essence Descriptor The value of Picture Essence Coding item of the Picture Essence Descriptor of the Top-Level File Package shall reflect JPEG 2000 profile used to encode the image essence (see Section 5) and shall be set to one of the Picture Essence Compression ULs [ST422] of Table 4. Table 4. Specification of the Picture Essence Compression UL. Byte No. Description Value (hex) 1-15 See SMPTE ST422 Meaning 16 JPEG 2000 Codestream Restrictions 05h 06h 07h 08h Broadcast Profile Single-Tile Level 2 per [ISO/IEC 15444-1] Broadcast Profile Single-Tile Level 3 per [ISO/IEC 15444-1] Broadcast Profile Single-Tile Level 4 per [ISO/IEC 15444-1] Broadcast Profile Single-Tile Level 5 per [ISO/IEC 15444-1] Page 5 of 11 pages
9 Audio Track Files 9.1 Essence An Audio Track File shall contain audio essence conforming to Section 6. 9.2 Audio Channels and Soundfield Groups Implementations shall accept the audio channels and soundfield groups defined in [ST428-y:2012] and in [Common Audio Channels and Soundfield Groups]. Not all channels of a given soundfield group need to be present in the audio track file. They may accept audio channels and soundfield groups defined elsewhere if and only if they follow the "MCA Label Dictionary ID Semantics" specified in [MCA]. 9.3 Essence Descriptors The following supplements the normative provisions already present in the underlying normative references. 9.3.1 Wave Audio Essence Descriptor The Audio Ref Level shall indicate the audio reference level (see Section Error: Reference source not found.) 9.3.2 Extended Audio Essence Subdescriptor The Wave Audio Essence Descriptor shall reference one Extended Audio Essence Subdescriptor, as specified in [IMF Core Constraints]. 10 Composition 10.1 Homogenous Image Characteristics Within a given a composition, the image essence characteristics listed in Table 5 shall remain constant. Table 5. Homogeneous Image Essence Characteristics. Characteristic Definition Image Variant See Section 5 Codestream Profile See Section 5 10.2 Homogenous Audio Characteristics Within a given a composition, the audio essence characteristics listed in Table 6 shall remain constant. Page 6 of 11 pages
Table 6. Homogeneous Image Essence Characteristics. Characteristic Bits per Sample Sampling Rate Definition See [IMF LPCM Audio] See [IMF LPCM Audio] 10.3 Sequence Duration A Sequence duration shall be greater than or equal to image essence frame. 10.4 Track File Duration Track Files shall have a duration larger than or equal to that of a image essence frame. 10.5 Image Frame Rate and Audio Sample Rate The sample rate of audio essence in a Composition shall be one of the combinations listed in Table 2. Frame Rate Table 7: Audio Sampling And Image Frame Rates 48,000/1,001 Hz Samples/Frame 48,000 Hz 96,000/1,001 Hz 96,000 Hz 24/1.001 2000 2002 4000 4004 24 n/a 2000 n/a 4000 25 n/a 1920 n/a 3840 30/1.001 1600 1600*1.001 3200 3200*1.001 30 n/a 1600 n/a 3200 50 n/a 960 n/a 1920 60/1.001 800 800*1.001 1600 1600*1.001 60 n/a 800 n/a 1600 48 n/a 1000 n/a 2000 10.6 Entry Point and Duration If, as defined in Section 10.5, the number of audio samples per image frame is not an integer, the duration of Resources with underlying audio essence shall be integer multiples of 5/Edit Rate. 11 Composition Playlist 11.1 Content Version The Id element within the ContentVersion element shall contain a URN value conforming to one of the schemes listed in Table 8. Table 8. Content Version Id URN schemes. Page 7 of 11 pages
Basic UMID [SMPTE 2029] ISAN [RFC 4246] UUID [RFC 4122] 11.2 Edit Rate The Composition Edit Rate shall be equal to the edit rate of the image essence referenced by the ImageSegment or StereoscopicImageSegment elements (see [IMF Core Constraints]). 11.3 Segments 11.3.1 Image Segments There shall be either one ImageSegment or one StereoscopicImageSegment element. 11.3.1.1 ImageSegment Each Resource of type TrackFileResourceType within an ImageSegment shall reference a single Monoscopic Image Track File (see Section 8). 11.3.1.2 StereoscopicImageSegment The StereoscopicImageSegment element shall contain Resources of type TrackFileResourceType, each referencing a single Stereoscopic Image Track File (see Section 8). The XML schema of the StereoscopicImageSegment element is as follows: <?xml version="1.0" encoding="utf-8"?> <xs:schema targetnamespace="http://www.smpte-ra.org/schemas/zzzzzzzz" xmlns:xs="http://www.w3.org/2001/xmlschema" xmlns:cpl="http://www.smpte-ra.org/schemas/yyyyyy" elementformdefault="qualified" attributeformdefault="unqualified"> <xs:import namespace="http://www.smpte-ra.org/schemas/yyyyyy"/> <xs:element name="stereoscopicimagesegment" type="cpl:segmenttype"/> </xs:schema> 11.3.2 Audio Segments There shall be one or more AudioSegment element. Each Resource of type TrackFileResourceType within an AudioSegment element shall reference a single Audio Track File (see Section 9). 11.3.3 Data Essence Segments There may be one or more DataEssenceSegment element. The DataEssenceSegment element shall contain Resources of type DataEssenceTrackFileResourceType, each referencing a single Data Essence Track File (see Section Error: Reference source not found). The XML schema of the DataEssenceTrackFileResourceType element is as follows: Page 8 of 11 pages
<?xml version="1.0" encoding="utf-8"?> <xs:schema targetnamespace="http://www.smpte-ra.org/schemas/zzzzzzzz" xmlns:xs="http://www.w3.org/2001/xmlschema" xmlns:cpl="http://www.smpte-ra.org/schemas/yyyyyy" elementformdefault="qualified" attributeformdefault="unqualified"> <xs:import namespace="http://www.smpte-ra.org/schemas/yyyyyy"/> <xs:complextype name=" DataEssenceTrackFileResourceType"> <xs:complexcontent> <xs:extension base="cpl:trackfileresourcetype"> <xs:sequence> <xs:element name="forcedflagoverride" type="xs:binary" /> </xs:sequence> </xs:extension> </xs:complexcontent> </xs:complextype> </xs:schema> The ForcedFlagOverride shall override the value of the Forced flag contained in the underlying Data Essence Track File. 11.3.4 Digital Certificates If the Signature element is present, the digital certificate used shall conform to [IMF Digital Certificates]. Annex A IMF Image Variants The following defines image variants for used by IMF Applications. Table 9. Image Variants. Normative reference Stereoscopic Pairs Raster Format Pixel Aspect Ratio Component Sampling Colorimetry Component Bit Depth Frame Rate Container Size (WidthxHeight) Line # 1 1920x1080 24/ 1.001 10 Rec.709 4:2:2 1.0 P M/S System 11 at [ST274] using signal 2 1920x1080 24 10 Rec.709 3 1920x1080 25 10 Rec.709 4 1920x1080 50 10 Rec.709 4:2:2 1.0 P M/S System 10 at [ST274] using signal 4:2:2 1.0 P M/S System 9 at [ST274] using signal 4:2:2 1.0 P M/S System 3 at [ST274] using signal 5 1920x1080 60 10 Rec.709 4:2:2 1.0 P M/S System 1 at [ST274] using signal Page 9 of 11 pages
6 1920x1080 30 / 1.001 7 1920x1080 60/ 1.001 10 Rec.709 10 Rec.709 4:2:2 1.0 P M/S System 8 at [ST274] using signal 4:2:2 1.0 I M/S System 5 at [ST274] using signal 8 1920x1080 50 10 Rec.709 4:2:2 1.0 I M/S System 6 at [ST274] using signal 9 1920x1080 24 / 1.001 10 Rec.709 R G B 4:4:4 1.0 P M/S System 11 at [ST274] using or R'G'B' signal sampled at 4:4:4 with 10-10 1920x1080 24 10 Rec.709 R G B 11 1920x1080 25 10 Rec.709 R G B 12 1920x1080 50 10 Rec.709 R G B 13 1920x1080 60 10 Rec.709 -or- -or- -or- -or- -or- R G B 4:4:4 1.0 P M/S System 10 at [ST274] using or R'G'B' signal sampled at 4:4:4 with 10-4:4:4 1.0 P M/S System 9 at [ST274] using or R'G'B' signal sampled at 4:4:4 with 10-4:4:4 1.0 P M/S System 3 at [ST274] using or R'G'B' signal sampled at 4:4:4 with 10-4:4:4 1.0 P M/S System 1 at [ST274] using or R'G'B' signal sampled at 4:4:4 with 10-14 1280x720 60 / 1.001 10 Rec.709 4:2:2 1.0 P M/S System 2 at [ST296] using signal A.1 Container Size The Container Size indicates the width and height, respectively, of the image container in pixel units. A.2 Frame Rate The Frame Rate is the number of image frames or fields (for interlaced systems) displayed per second. Page 10 of 11 pages
A.3 Component Bit Depth The Component Bit Depth is the number of bits used to encode the component values of each pixel. A.4 Colorimetry The Colorimetry indicates the colorimetry and component structure of each pixel. A.5 Component Sampling Frequency The Component Sampling indicates the relative sampling frequency of each component. A.6 Frame System Frame System indicates if the scan pattern of the image essence is progressive (P) or interlaced (I). A.7 Pixel Aspect Ratio The Pixel Aspect Ratio is the shape of the pixel expressed in a ratio of width divided by height of the pixel. A.8 Stereoscopic Pairs Stereoscopic Pairs indicates whether the image essence consists of a sequence of single monoscopic (M) images or stereoscopic (S) image pairs consisting of a left eye image and right eye image. Images that make up the image pairs may be either fields or frames as the case may be, and shall be coincident in time having identical sampling structure, raster resolution, pixel depth and colorimetry. Page 11 of 11 pages