ASP-DAC2011 Session 8D-1 Advanced System LSIs for Home 3D Systems January 28, 2011 Takao Suzuki Panasonic Corporation Strategic Semiconductor Development Center
Agenda 1. Overview of 3D Systems - Principles of 3D Imaging - Frame Sequential Method 2. Advanced System LSIs for Home 3D - Integrated Platform UniPhier - System LSIs for 3D TV and Blu-ray 3D 3. Supporting Technologies and Our Efforts - Realization of MPEG-4 MVC Decoding - Efficiency of System LSIs for Blu-ray Recorders - System Emulators 4. Conclusion
Principles of 3D Imaging Our brains synthesize 3D image from parallax => Difference between images on the left and right eyes Image on Right Eye Stereoview (Behind) Convergence line (Screen) Stereoview (In Front) Image on Left Eye Left Eye Right Eye Left Eye Right Eye
Eyeglasses Approaches for Theater Polarized Method Active Shutter Method Color Separation Method Left Image Right Image Left Image Right Image Left Image Right Image ZScreen (Switching Polarization) R L R L Screen Synchronized Signal R R L L L R R R R L L L L L Screen Color Wheel (Wave Filter) R L R L Screen Circular Polarized Glasses Active Shutter Glasses Wave Filter Glasses L R L R L R
Home 3D System Using Frame Sequential Method Full HD 3D system components : Blu-ray 3D device (MPEG-4 MVC-compliant) HDMI version 1.4 3D plasma TV (2x speed display) Active shutter glasses Blu-ray 3D 2ch x Full-HD Images MPEG-4 MVC Playback MPEG-4 MVC HDMI (Ver. 1.4) MPEG-4 MVC Recording 3D TV Double Speed (120 frames/s) Double Speed Display 1080 1920 3D Content Two Full HD Images (Left + Right) 1080 1920 Active Shutter Glasses
Overview of Home 3D System Using 3D LSIs 3D technologies were implemented into a suite of system LSIs UniPhier system LSI for Blu-ray 3D TV recording Processor (MPEG-4 AVCH) 3D video playback (MPEG-4 MVC) Ext. memory HDMI Tx Blu-ray 3D device Main system LSI (UniPhier architecture) HDMI Tx LSI (Ver. 1.4) HDMI (Ver. 1.4) Shutter glasses Rx Video playback Left 3D TV video processing Right Full HD 3D Display Processor UniPhier system LSI for 3D TV Ext. memory Ir Tx PDP panel Sync info 3D TV Main system LSI (UniPhier architecture) 3D display LSI
Structure of UniPhier Platform UniPhier is built from a software and a hardware platform UniPhier system LSIs are based on the same architecture Application Middleware Software Platform OS Device Drivers Microcode Microcode CPU IPP DPP Hardware UniPhier Processor Stream I/O Memory Controller AV I/O Hardware Platform (UniPhier System LSI)
Structure of UniPhier Processor The UniPhier processor is the key module for media processing 3D MPEG4-MVC function was achieved by using these mechanism Microcode Device Drivers Microcode IPP Instruction Parallel Processor IPP Core Instruction cache & RAM Accelerator Data cache & RAM DPP Data Parallel Processor Controller DPP Core Instruction RAM Data RAM Hardware Controller Video Decode Hardware Controller Video Decode for sequential operation for parallel processing
Structure of System LSI for 3D TV The main LSI is based on the UniPhier architecture. HDMI (Ver. 1.4) Feature UniPhier system LSI HDMI Rx TV video playback for 3D TV 3D TV video processing Ext. memory Processor Supports multiple 3D signal formats - For broadcasting - For storage devices 3D graphics / 3D OSD overlay 3D high-quality pictures Left Right High-performance processor @600 MHz Display LSI Ir Tx Synchronous Ir signal generation 3D Video 3D Subtitles 3D Menu Plasma Panel Active Shutter Glasses
Structure of 3D Blu-ray Recorder/Player 1-chip solution for Blu-ray recorder with 3D support, achieving compact chassis and low power 3D 232 mm Blu-ray 3D Recorder (back side) 119 mm 68mm 239mm Digital PCB UniPhier System LSI Feature UniPhier system LSI for Blu-ray 3D TV recording (H.264 Full HD) 3D video playback (MPEG-4 MVC) Ext. memory Processor HDMI Tx Double Full HD decoding (MPEG-4 MVC) 3D graphics / 3D OSD overlay 3D high-quality pictures Double H.264 encoding SMP CPU @ 500 MHz HDMI (Ver.1.4)
Overview of HDMI LSI HDMI LSI transmits 3D data with copyright protection UniPhier system LSI for Blu-ray 3D 3D Structure Processor 3D video playback (MPEG-4 MVC) Feature Video Data Left/Right Audio Data HDMI 1.4a compliant - Support for Blu-ray 3D formats - Max transfer rate: 2.25 GHz x 3ch Encryption : HDCP Ver1.4 Multiple 3D formats available - Frame sequential, side-by-side, line-by-line, etc. HDMI Transmitter LSI MUX HDCP Encrypt TMDS Driver HDMI cable
Overview of MPEG-4 MVC Processing Expansion of MPEG-4 AVC spec; reduced data size of 3D content. Maintains compatibility with legacy players; 2D playback on left video. 3D Imaging (Disc production) Playback Blu-ray 3D Player Blu-ray 3D disc L L L L R R R R Full HD 2ch Blu-ray Player Blu-ray 3D Disc 3D Encoding L L L L R R R R 3D Decoding L L L L R R R R 2D Decoding Reduces R data by 50% by referencing L data L R L R L R L R Rebuilds the R image by referencing back and forth between R and L images L R L R L R L R L L L L L R L R L R L R Plays back only L-side data L L L L Blu-ray 3D disc 3D 2D 3D TV 2D TV
MPEG-4 MVC with Hardware and Software Processing MPEG-4 MVC decoding was achieved through a combination of hardware and software processing 2D Operation Control: MPEG-4 AVC x 2-ch decode ch0 ch0 ch0 ch0 2D + 3D 3D Operation Control: Correlation of left and right images L L L L ch1 ch1 ch1 ch1 Microcode Device Drivers R R R R 1) Decode processing start 2) Control of data input and output IPP Core Instruction cache & RAM IPP Accelerator Data cache & RAM DPP Controller DPP Core Instruction RAM Data RAM Hardware Controller Video Decode Hardware Controller Video Decode
Improvement of Blu-ray Recorder through LSI Integration Enhanced UniPhier delivers compact chassis and low power 2006 Year 2D Model 3D 3D Model W 430 x D 332 mm Power: 56W 23 W 93 mm W 430 x D 239 mm Power: 33W Modem / Tuner / Digital PCB 157.0 mm 191.0 mm H 85 mm 4mainLSIs 3 PCBs Power 41% Volume 42% UniPhier System LSI for MPEG-2 17 mm Digital PCB 119.0 mm 232.0 mm 10x long time W recording H 68 mm 1-chip super Integration 1 PCB UniPhier System LSI for MPEG-4 MVC
System Emulator for Microcode Development System emulator was used for 1) Microcode development in parallel with the LSI development 2) Verification of system LSI 3) Confirmation of system validity and necessary performance Hardware Emulator Mapping of LSI Circuit Hardware Emulator Cooperation Software Simulator Peripheral Model Application Middleware OS Device Drivers Model of UniPhier System LSI Peripheral Model System emulation before ES by connection to the evaluation board
Conclusion We continue to evolve the UniPhier for future applications, 4k2k, glasses-less 3D, network and more future 8k4k Glasses-less 3D Solution 8k4k 3D solution Performance Full-HD 3D Solution 2160 pixels 4k2k 3D Solution 4x the pixels of Full HD 3840 pixels Next-Generation UniPhier 2010 2012 2015
Thank you for your attention.