TWD SPECIFICATION Interoperable Master Format Broadcast & Online IMF Application Constraints - ProRes

Transcription

1 TWD SPECIFICATION Interoperable Master Format Broadcast & Online IMF Application Constraints - ProRes SMPTE SP [ProRes] TWD-SP-PRORES-IMF-APP-CONSTRAINTS REDLINE.docx Page 1 of 13 pages To be replaced with SMPTE Specification Technical Requirements Boiler Plate when agreed the text below is for guidance Warning This Specifications Technical Working document is under development and shall not be referred to as a SMPTE Specification. It is distributed for review and comment; distribution does not constitute publication. Recipients of this document are strongly encouraged to submit, with their comments, notification of any relevant patent rights of which they are aware and to provide supporting documentation. Every attempt has been made to ensure that the information contained in this document is accurate. Errors in this document should be reported to the Business Owner identified below with a copy to eng@smpte.org. All other inquiries in respect of this document, including inquiries as to intellectual property requirements, should be addressed to the proposer identified below. Business Owner(s) contact information: Digital Production Partnership 4th Floor, Fat Side, ITV, 200 Gray s Inn Road, London, WC1X 8HF, UK imf@digitalproductionpartnership.co.uk Digital Production Partnership is a UK Registered Company. Company Registration Number: North American Broadcasters Association P.O. Box 500, Station A Toronto, ON M5W 1E6 CANADA contact@nabanet.com or simplify@nabanet.com Telephone: Copyright 201X by THE SOCIETY OF MOTION PICTURE AND TELEVISION ENGINEERS 3 Barker Avenue., White Plains, NY (914) Approved <TBD>

2 SMPTE SP [ProRes] Table of Contents 1 Forward 3 2 Scope 3 3 Conformance Notation 3 4 Normative References 4 5 General 5 6 Image Essence 5 7 Image Coding 6 8 Image Track Files 6 9 Composition 6 10 Audio 6 11 Metadata 6 12 Access Services 7 13 Bibliography 8 Annex A Proposed IMF Sidecar XML Metadata 9 Page 2 of 14 pages

3 Technical WD 1 Forward SMPTE Specification boiler plate text to be added when agreed. Intellectual Property Attention is drawn to the possibility that some of the elements of this document may be the subject of patent rights. SMPTE shall not be held responsible for identifying any or all such patent rights. Any issues relating to patent rights should be referred to the Business Owners with a copy to eng@smpte.org. 2 Scope This document is a Specification that constrains an Application of SMPTE ST the Interoperable Master Format. This Specification follows the Image Characteristics, Track File and Composition constraints specified in SMPTE RDD 45, Interoperable Master Format Application ProRes and SMPTE ST Interoperable Master Format Application #2E, whenever possible. The informative annexes describe details and worked examples of how Broadcaster Specific Metadata may be referenced using SMPTE ST Interoperable Master Format Sidecar Composition Map 3 Conformance Notation To be replaced with SMPTE Specification Technical Requirements Boiler Plate when agreed the text below is for guidance Normative text is text that describes elements of the design that are indispensable or contains the conformance language keywords: "shall", "should", or "may". Informative text is text that is potentially helpful to the user, but not indispensable, and can be removed, changed, or added editorially without affecting interoperability. Informative text does not contain any conformance keywords. All text in this document is, by default, normative, except: the Introduction, any section explicitly labeled as "Informative" or individual paragraphs that start with "Note: The keywords "shall" and "shall not" indicate requirements strictly to be followed in order to conform to the document and from which no deviation is permitted. The keywords, "should" and "should not" indicate that, among several possibilities, one is recommended as particularly suitable, without mentioning or excluding others; or that a certain course of action is preferred but not necessarily required; or that (in the negative form) a certain possibility or course of action is deprecated but not prohibited. The keywords "may" and "need not" indicate courses of action permissible within the limits of the document. Page 3 of 14 pages

4 SMPTE SP [ProRes] The keyword reserved indicates a provision that is not defined at this time, shall not be used, and may be defined in the future. The keyword forbidden indicates reserved and in addition indicates that the provision will never be defined in the future. A conformant implementation according to this document is one that includes all mandatory provisions ("shall") and, if implemented, all recommended provisions ("should") as described. A conformant implementation need not implement optional provisions ("may") and need not implement them as described. It is intended that text in square brackets [ ] be incorporated when supported by other documents in the SMPTE ST2067 suite. 4 Normative References The following standards contain provisions, which, through reference in this text, constitute provisions of this specification. At the time of publication, the editions indicated were valid. All standards are subject to revision, and parties to agreements based on this standard are encouraged to investigate the possibility of applying the most recent edition of the standards indicated below. SMPTE RDD 36:2015, Apple ProRes Bitstream Syntax and Decoding Process SMPTE RDD 44:2017, Material Exchange Format Mapping and Application of Apple ProRes SMPTE RDD 45:2017, Interoperable Master Format Application ProRes SMPTE RP :12, Conversion from CEA-608 Data to SMPTE TT SMPTE ST :2016, Interoperable Master Format Core Constraints SMPTE ST :2016, Interoperable Master Format Application #2E SMPTE ST :201X Dynamic Metadata for Color Volume Transform (DMCVT) Plug-in SMPTE RDD 6: Description and Guide to the Use of the Dolby E Audio Metadata Serial Bitstream SMPTE ST Interoperable Master Format Sidecar Composition Map SMPTE ST 2094 Dynamic Metadata for Color Volume Transform - Suite ITU-R BT.2100, Image parameter values for high dynamic range television for use in production and international programme exchange Page 4 of 14 pages

5 Technical WD 5 General This Specification constrains the provisions of SMPTE RDD 45 and SMPTE ST Image Essence 6.1 Characteristics Image frames shall conform to the combinations of characteristics allowed in Table 1. These characteristics constrain the general provisions of Table 1 in SMPTE RDD 45 and Table 3 of SMPTE ST :2016. Table 1. Image Parameters Image Frame Width [7680] Image Frame Height [4320] Frame Structure Progressive Stereoscopy Monoscopic Stereoscopic Frame Rate / / /1001 [100] [120] [120000/1001] Sampling [4:2:0] 4:4:4 [4:2:0] 4:4:4 [4:2:0] 4:4:4 4:2:2 4:2:2 4:2:2 Quantisation QE.1 QE.1 QE.1 QE.1 QE.1 QE.1 QE.2 QE.2 QE.2 Color Components Y C B C R R G B Y C B C R R G B Y C B C R R G B Colorimetry COLOR.3 COLOR.3 COLOR.3 COLOR.5 COLOR.5 COLOR.5 COLOR.5 COLOR.5 COLOR.5 COLOR.7 COLOR.7 COLOR.7 COLOR.7 COLOR.7 COLOR.7 [COLOR.8] [COLOR.8] [COLOR.8] [COLOR.8] [COLOR.8] [COLOR.8] Pixel Bit Depth NOTE 1: COLOR.3 shall only be applicable to ITU-R BT.709 delivered material [NOTE 2: COLOR.8 corresponds to the HLG system specified in Recommendation ITU-R BT.2100] Page 5 of 14 pages

6 SMPTE SP [ProRes] 7 Image Coding Image coding parameters shall conform to section 5 of SMPTE RDD 45 with constrained COLOR options as described in Table 2 below 7.1 color_primaries, transfer_characteristic and matrix_coefficients The color_primaries, transfer_characteristic and matrix_coefficients parameter shall be set according to Table 3 Table 2. Color Primaries, transfer characteristics and matric coefficients Colorimetry color_primaries transfer_characteristic matrix_coefficients COLOR COLOR COLOR [COLOR ] 8 Image Track Files Image track file parameters shall conform to section 6 of SMPTE RDD 45 9 Composition Composition parameters shall conform to section 7 of SMPTE RDD Audio Audio shall conform to Section 5 of SMPTE Metadata The information in this section is INFORMATIVE 11.1 AS-11 DPP Metadata When required AS-11 Air Master metadata shall be packages in an SMPTE SR Sidecar Composition Map (Example given in Annex 1) 11.2 EBU QC Metadata AS-11 QC When required AS-11 Air Master metadata shall be packages in an SMPTE SR Sidecar Composition Map (Example given in Annex 1) 11.3 Dolby Audio Metadata When required AS-11 Air Master metadata should be packages in an SMPTE SR Sidecar Composition Map (Example given in Annex 1) Page 6 of 14 pages

7 Technical WD 11.4 HDR Dynamic Metadata (DMCVT) When required the Composition shall contain one DMCVT Virtual Track, as specified in SMPTE ST , whose DMCVT Application Sets conform to the relevant SMPTE ST2094 application. 12 Access Services 12.1 Closed Subtitles/Captions Closed Captions/Subtitles should normally conform to sections 5 and 6 of SMPTE ST or they can comply with the following options EBU-TT-D As an IMSC1.0.1 constrained TTML document encapsulated as an MXF track. The IMSC1.0.1 shall additionally be constrained to meet the requirements of EBU-TT (EBU-Tech 3350/3390) EBU STL As EBU STL (EBU-Tech 3264), carried in addition to the IMSC1.0.1 TTML, it shall be encapsulated as an MXF Track File according to SMPTE ST The MXF Track file shall be referenced from an ST Sidecar Map at the point of delivery CTA 608 As CTA , carried in addition to the IMSC1.0.1 TTML, it shall be encapsulated as an MXF Track File according to SMPTE ST 2052 and referenced by an Ancillary Data Essence Virtual Track according to SMPTE ST NOTE 3: The definition of an Ancillary Data Essence Virtual Track is currently in progress NOTE 4: This Specification will be amended to follow any SMPTE guidelines for Captions/Subtitles when available and appropriate particularly the implementation of IMSC Audio Description (AD) / Described Video Service (DVS) Where an audio described/described video service is required it shall be supplied as fully rendered Soundfield(s)/Groups The fully rendered audio can be either a Soundfield containing the AD/DVS as a complete entity or can be the description dialogue with a control track that is contain as PCM audio where the output profile 1 More than one option may be required Page 7 of 14 pages

8 SMPTE SP [ProRes] list (OPL) simply allocates the describing dialogue and the control audio to specific channels or tracks in the output file. NOTE 5: This Specification will be amended to follow any SMPTE guidelines for AD/DVS when available and appropriate Signing Signed video shall be provided as a fully rendered track as defined in SMPTE ST (Section seven Packaging ) sometimes referred to as a supplementary package NOTE 6: This Specification will be amended to follow any SMPTE guidelines for Signing when available and appropriate. 13 Bibliography Recommendation ITU-R BT , Image parameter values for high dynamic range television for use in production and international programme exchange EBU TECH 3350, EBU-TT Part 1 - Subtitle format definition EBU TECH 3390, EBU-TT Part M - Metadata Definitions Page 8 of 14 pages

9 Technical WD Annex A Proposed IMF Sidecar XML Metadata THE TEXT IN THIS ANNEX IS INFORMATIVE Sidecar Metadata Worked Example The Sidecar Composition Map is a stand-alone document that lists assets and the Compositions they are associated with. Sidecar Composition Map <?xml version="1.0" encoding="utf-8"?> <SidecarCompositionMap xmlns=" <Id>urn:uuid:17661cd1-81f6-4f a2bc4c43a04b</Id> <Properties> <Annotation>DPP SPecifications</Annotation> <IssueDate> T18:03:15+00:00</IssueDate> <Issuer>DPP SPecifications</Issuer> </Properties> <SidecarAssetList> <SidecarAsset> <Id>urn:uuid:028e d1-4bb6-885a-e9f b4</Id> <AssociatedCPLList> <CPLId>urn:uuid:0bce2aa9-cb79-4b51-acc6-ff9187a0a0a4</CPLId> </AssociatedCPLList> </SidecarAsset> <SidecarAsset> <Id>urn:uuid:ed79b5d ef-aad4-cf9e06379e60</Id> <AssociatedCPLList> <CPLId>urn:uuid:0bce2aa9-cb79-4b51-acc6-ff9187a0a0a4</CPLId> </AssociatedCPLList> </SidecarAsset> <SidecarAsset> <Id>urn:uuid:6ac19cdd bc88-49c9e2b15708</Id> <AssociatedCPLList> <CPLId>urn:uuid:0bce2aa9-cb79-4b51-acc6-ff9187a0a0a4</CPLId> </AssociatedCPLList> </SidecarAsset> </SidecarAssetList> </SidecarCompositionMap> RDD 6 Example <?xml version="1.0" encoding="utf-8"?> <rdd6 xmlns = " <first_subframe> <sync> Page 9 of 14 pages

10 SMPTE SP [ProRes] <rev_id>0x00</rev_id> <orig_id>0x01</orig_id> <orig_addr>0x0000</orig_addr> <frame_count>201</frame_count> </sync> <dolby_e_complete> <program_config>5.1</program_config> <frame_rate>25</frame_rate> <descr_text> <program>dpp_test</program> </descr_text> </dolby_e_complete> <dolby_digital_complete_ext_bsi> <program_id>0</program_id> <ac_mode>3/2</ac_mode> <bs_mode>main_complete</bs_mode> <center_mix_level>-3.0</center_mix_level> <sur_mix_level>-6.0</sur_mix_level> <sur_encoded>false</sur_encoded> <lfe_on>true</lfe_on> <dialnorm>-23</dialnorm> <copyright>true</copyright> <orig_bs>true</orig_bs> <downmix_mode>lo_ro</downmix_mode> <lt_rt_center_mix>-3.0</lt_rt_center_mix> <lt_rt_sur_mix>-6.0</lt_rt_sur_mix> <lo_ro_center_mix>-3.0</lo_ro_center_mix> <lo_ro_sur_mix>-6.0</lo_ro_sur_mix> <ad_conv_type>standard</ad_conv_type> <hp_filter>true</hp_filter> <bw_lp_filter>true</bw_lp_filter> <lfe_lp_filter>true</lfe_lp_filter> <sur_90_filter>false</sur_90_filter> <sur_att_filter>false</sur_att_filter> <rf_preemph_filter>false</rf_preemph_filter> <compr_pf_1>film_light</compr_pf_1> <dyn_range_pf_1>none</dyn_range_pf_1> <dyn_range_pf_2>none</dyn_range_pf_2> <dyn_range_pf_3>none</dyn_range_pf_3> <dyn_range_pf_4>none</dyn_range_pf_4> </dolby_digital_complete_ext_bsi> </first_subframe> <second_subframe> <sync> <rev_id>0x00</rev_id> <orig_id>0x01</orig_id> <orig_addr>0x0000</orig_addr> <frame_count>201</frame_count> </sync> <dolby_e_essential> <program_config>5.1</program_config> <frame_rate>25</frame_rate> </dolby_e_essential> Page 10 of 14 pages

11 Technical WD <dolby_digital_essential_ext_bsi> <program_id>0</program_id> <ac_mode>3/2</ac_mode> <bs_mode>main_complete</bs_mode> <lfe_on>true</lfe_on> <dialnorm>-23</dialnorm> <compr_pf_2>film_light</compr_pf_2> <dyn_range_pf_5>none</dyn_range_pf_5> <dyn_range_pf_6>none</dyn_range_pf_6> <dyn_range_pf_7>none</dyn_range_pf_7> <dyn_range_pf_8>none</dyn_range_pf_8> </dolby_digital_essential_ext_bsi> </second_subframe> </rdd6> AS-11 UK DPP HD V1.1 Example <?xml version = "1.0" encoding = "UTF-8" standalone = "yes"?> <Programme xmlns = " <Editorial> <SeriesTitle>Planet Earth II</SeriesTitle> <ProgrammeTitle>IMF Test Promo</ProgrammeTitle> <EpisodeTitleNumber>Graphics Version</EpisodeTitleNumber> <ProductionNumber>TEST123H_01</ProductionNumber> <Synopsis>Explanitory graphic version of iplayer test file</synopsis> <Originator>BBC</Originator> <CopyrightYear>2017</CopyrightYear> <Genre>Tests</Genre> <Distributor>BBC</Distributor> </Editorial> <Technical> <ShimName>UK DPP HD</ShimName> <ShimVersion>1.1</ShimVersion> <Video> <VideoBitRate unit = "Mbps">100</VideoBitRate> <VideoCodec>AVC - Intra 100</VideoCodec> <VideoCodecParameters>High 4:2 : 2 Intra@L4.1</VideoCodecParameters> <PictureFormat>1080i50 16:9</PictureFormat> <AFD>10</AFD> <PictureRatio>16 : 9 (1.78:1)</PictureRatio> <ThreeD>false</ThreeD> <PSEPass>Yes</PSEPass> <PSEManufacturer>Vidchecker</PSEManufacturer> <PSEVersion>6.4.1</PSEVersion> </Video> <Audio> <AudioSamplingFrequency unit = "khz">48</audiosamplingfrequency> <AudioBitDepth>24</AudioBitDepth> <AudioCodecParameters>PCM</AudioCodecParameters> <AudioTrackLayout>EBU R 123 : 4b</AudioTrackLayout> Page 11 of 14 pages

12 SMPTE SP [ProRes] <PrimaryAudioLanguage>eng</PrimaryAudioLanguage> <SecondaryAudioLanguage>zxx</SecondaryAudioLanguage> <TertiaryAudioLanguage>zxx</TertiaryAudioLanguage> <AudioLoudnessStandard>EBU R 128</AudioLoudnessStandard> </Audio> <Timecodes> <LineUpStart>09:59:30:00</LineUpStart> <IdentClockStart>09:59:50:00</IdentClockStart> <Parts> <Part> <PartNumber>1</PartNumber> <PartTotal>1</PartTotal> <PartSOM>10:00:00:00</PartSOM> <PartDuration>00:04:48:00</PartDuration> </Part> </Parts> <TotalNumberOfParts>1</TotalNumberOfParts> <TotalProgrammeDuration>00:04:48:00</TotalProgrammeDuration> </Timecodes> <AccessServices> <AudioDescriptionPresent>false</AudioDescriptionPresent> <ClosedCaptionsPresent>false</ClosedCaptionsPresent> <OpenCaptionsPresent>false</OpenCaptionsPresent> <SigningPresent>No</SigningPresent> </AccessServices> <Additional> <CompletionDate> </CompletionDate> <TextlessElementsExist>true</TextlessElementsExist> <ProgrammeHasText>true</ProgrammeHasText> <ProgrammeTextLanguage>eng</ProgrammeTextLanguage> <AssociatedMediaFilename>#work_file#FKAC343E_02.mxf</AssociatedMediaFilename> <MediaChecksumType>MD5</MediaChecksumType> <MediaChecksumValue>6c5fda4452edaec5bc12b97675f446f6</MediaChecksumValue> </Additional> <ContactInformation> <Contact >delivery@filmsat59.com</Contact > <ContactTelephoneNumber> </ContactTelephoneNumber> </ContactInformation> </Technical> </Programme> </dolby_digital_essential_ext_bsi> </second_subframe> </rdd6> Part UK DPP Automated QC Template Example (produced by EBU.IO/QC FIMS Template builder) <?xml version="1.0" encoding="utf-8"?> <qat:qatemplate qatemplateid="7f78c10a-fd2d-11e7-b ac120003" qatemplatename="aq-dpp" xmlns:bms=" xmlns:desc=" xmlns:qat=" xmlns:tim=" xmlns:xsi=" Page 12 of 14 pages

13 Technical WD instance"> <bms:resourceid>7f78c10a-fd2d-11e7-b ac120003</bms:resourceid> <qat:qaatom qaitemid="0001f" qaitemname="active Format Description"> <qat:qaitemtype>check</qat:qaitemtype> <qat:layer>bitstream</qat:layer> <qat:category>absolute</qat:category> <qat:qaiteminput> <qat:parametername>activeformatdescriptionbitstreamexpected</qat:parametername> <qat:value/> <qat:type>integer</qat:type> <qat:unit/> <qat:representation>decimal or binary left padded with zeros to 5 digits</qat:representation> <qat:valuerange>(0,16)</qat:valuerange> </qat:qaiteminput> </qat:qaatom> <qat:qaatom qaitemid="0001w" qaitemname="active Format Description"> <qat:qaitemtype>check</qat:qaitemtype> <qat:layer>wrapper</qat:layer> <qat:category>absolute</qat:category> <qat:qaiteminput> <qat:parametername>activeformatdescriptionexpected</qat:parametername> <qat:value/> <qat:type>integer</qat:type> <qat:unit>n/a</qat:unit> <qat:representation>binary left padded with zeros to length 4</qat:representation> <qat:valuerange>[0,15]</qat:valuerange> </qat:qaiteminput> </qat:qaatom> <qat:qaatom qaitemid="0001x" qaitemname="active Format Description"> <qat:qaitemtype>check</qat:qaitemtype> <qat:layer>crosscheck</qat:layer> <qat:category>absolute</qat:category> <qat:qaiteminput> <qat:parametername>activeformatdescriptionwrappervalue</qat:parametername> <qat:value/> <qat:type>integer</qat:type> <qat:unit/> <qat:representation/> <qat:valuerange>[0,16]</qat:valuerange> </qat:qaiteminput> <qat:qaiteminput> <qat:parametername>activeformatdescriptionbitstreamvalue</qat:parametername> <qat:value/> <qat:type>integer</qat:type> <qat:unit/> <qat:representation/> <qat:valuerange>[0,16]</qat:valuerange> </qat:qaiteminput> </qat:qaatom> </qat:qatemplate> Page 13 of 14 pages

14 SMPTE SP [ProRes] Page 14 of 14 pages