Internet Of Things Introduction & Testing Challenges Tony Opferman tony.opferman@rsa.rohde-schwarz.com Key Account and Technology Support Mgr Rohde and Schwarz USA, Inc.
Rohde and Schwarz is an 82 year old family-owned private company headquartered in Munich, Germany. Sales -FY 14/15: ~$2B In over 70 countries R&D: 17 % of Sales 9800 employees IoT Test Challenges Nov 2015 2
Four Main Business Fields Test & Measurement Broadcasting/Video Secure Communications and IT Security SIGINT, Signal Monitoring and Signal Location IoT Test Challenges Nov 2015 3
Agenda l IoT Market Overview l Testing Challenges for IoT devices l Stages of IoT Testing l Test Solution for Coexistence IoT Test Challenges Nov 2015 4
IoT Test Challenges Nov 2015 5
IoT Internet Of Things The Internet of Things (IoT) refers to machine-to-machine (M2M) technology enabled by secure network connectivity and cloud infrastructure, to reliably transform data into useful information for people, businesses, and institutions. IoT Test Challenges Nov 2015 6
IoT Internet Of Things To be considered an IoT device, it should demonstrate the Three A s * Must be able to sense something about its surroundings (eg location, temperature, motion, light level, etc) Data processed from IoT device must be transferred to a central location automatically (at set time, when condition is met, threshold passed) Data must not only be gathered, but it must be used to make better decisions * Verizon : State of the Market : The Internet Of Things 2015 IoT Test Challenges Nov 2015 7
Market Segment IoT According to the GSMA, the total number of mobile connections including IoT is expected to reach 7.4 billion in 2015 rising to 10 billion by 2020. IoT Test Challenges Nov 2015 8
IoT Test Challenges Nov 2015 9
IoT By The Numbers Manufacturing l Asset Tracking l Real Time Tracking of Shipments l Predictive Maintenance l Smart Thermostats IoT Test Challenges Nov 2015 10
IoT By The Numbers Energy and Utilities l Smart Meters l Sensor data and adv analytics IoT Test Challenges Nov 2015 11
IoT By The Numbers Public Sector l Smart Street Lighting l Smart Parking IoT Test Challenges Nov 2015 12
Enabling IoT Development IoT Test Challenges Nov 2015 13
Which technologies address the IoT market WIFI IEEE802.11 a/b/g/n IEEE802.11 p, ac, ad IoT Technologies BT LR-WPAN LP-WAN BR / EDR (Basic rate/enh. Data rate) BLE Low Rate Wireless Personal Area Network 802.15.4 ZigBee, Thread, WiSun, Onramp. LoRA SigFox Cellular (3GPP*) low cost machine type communication desined for extremly low power 200 kbps 1 Mbps Data rate IoT Test Challenges Nov 2015 14 14
3GPP Harmonizing the industry on a narrowband IoT spec Scaling cellular to connect to a wider range of consumer & enterprise use cases IoT Test Challenges Nov 2015 15
Market view IEEE 802.15.4 Used in Smart Homes & Smart Buildings Annual shipment of 802.15.4 chips Smart Buildings Smart Homes Industry Automation Smart Utilities Source: ABI Research Nov. 2014 others The installed base for 802.15.4 enabled devices is forecast to increase almost fivefold rising from just under 425 million today to over 2.1 billion in 2019. (ABI 2014) IoT Test Challenges Nov 2015 16 16
Wireless Food Chain for IoT Deployment SYSTEM INTEGRATORS CONTRACT DEVICE MANUFACTURERS Manufacture an end product for market Contract development /High Volume Manufacturers EMBEDDED MODEM DEVELOPERS Provide their embedded modules to integrators CHIPSET MANUFACTURERS MOBILE NETWORK OPERATORS Cellular vs Non-cellular technologies IoT Test Challenges Nov 2015 17
Agenda l IoT Market Overview l Testing Challenges for IoT devices l Stages of IoT Testing l Test Solution for Coexistence IoT Test Challenges Nov 2015 18
Testing Challenges For IoT Manufactures Wireless not Core Competency of product offering Non or limited Subject Matter Expert Dependent on type of end product / customer Pre-Cert, Cert, Validation, Manufacturing, Service / Repair, Operator Testing LACK WIRELESS TEST EXPERTISE DETERMINATION OF TEST PLAN / REQUIREMENTS COST OF TESTING IMPLEMENTATION OF TEST PLAN Cost of equipment Rent or purchase Out source test strategy (Contract Manufacturer / Test Houses) What tools are available for testing? Test equipment Turn Key Solution Future Proof Tech Support IoT Test Challenges Nov 2015 19
Determination of Test Requirements DETERMINATION OF TEST PLAN / REQUIREMENTS l Dependent on position in Wireless food chain l Test requirements vary depending on chipset supplier, network operator, module vendor supplier, high volume manufacturing, etc l Dependent on stage in product release life cycle l Early R&D / Validation l Pre- Certification / Conformance l High Volume Manufacturing l Service & Repair l Testing typically centered around: l RF Parametric Testing (Conformance / Performance) l Data Testing (Conformance / Performance / Throughput) l Functional / User Experience Testing (eg Battery Life) IoT Test Challenges Nov 2015 20
Agenda l IoT Market Overview l Testing Challenges for IoT devices l Stages of IoT Testing l Test Solution for Coexistence IoT Test Challenges Nov 2015 21
Product Release Stage vs Layers of Test Layer Application development Application conformance testing Protocol development/iot Protocol conformance testing RF and radio development RF conformance / Precompliance / Validation testing High Volume Manufacturing Service / Repair The various stages of wireless devices deployment IoT Test Challenges Nov 2015 22
Early R&D / Validation Testing RF PARAMETRICS (TRANSMITTER / RECIEVER) - 3GPP / 3GPP2 Specified RF Conformance Testing - MIMO / FADING Scenarios - Over the top Applications - Overall system Interaction OTT APPLICATIONS RF ANTENNA PERFORMANCE (OTA) - Total Isotropic Sensitivity (TIS) - Total Radiated Power (TRP) - Current Drain - Application Specific req POWER CONSUMPTION R&D / VALIDATION Inter-RAT - Mobility - Handover between RAT s - Complex Signaling Scenarios - WIFI Offloading - Max Data rates (MAC / IP Layer) - Data re-try / performance - Packet data E2E Connection DATA THROUGHTPUT CO-EXISTENCE TESTING - In-device Co-existence - Co-location of Antenna LOCATION BASED SERVICES - A-GNSS - Navigation - E-911 Applications IoT Test Challenges Nov 2015 23
Conformance / Pre Certification Testing l Conformance Testing l Standards Requirement RF, Data, Protocol Performed by certified Test labs l Network Operator Certification (aka Carrier Acceptance) UE / Device Specific RF Supplementary, Data, LBS, Audio etc Performed internally by operators / Approved test labs l Pre- Certification l Standards Pre- Cert l Network Operator Pre- Cert l In house solutions (RF, Data, Co-existence, Audio, IRAT etc) IoT Test Challenges Nov 2015 24
Conformance / Pre Certification Testing Example: Nest - company that makes products for home monitoring, thermostats and smoke detectors with wireless connectivity functionality WIRELESS ENABLED SMOKE DETECTORS WIRELESS ENABLED CAMERA WIRELESS ENABLED THERMOSTAT If this device requires access to the Verizon network it will have to pass Verizon Carrier Acceptance tests as per the Test Entrance Criteria Checklist Non-traditional device testing (Boston Innovation Lab)
Manufacturing Testing l Volume production of devices l Limited internal build for development / validation (EVT) l Internal build for certification / compliance testing (DVT) l Final build for mass production (MP) l 3 Stage RF parametric testing l RF Calibration Freq/Amp Tuning, Write Calibration offsets to Flash memory l RF Verification Tx Performance (modulation, spectrum mask..) Rx Performance (BER/PER..) l Functional Testing Go/No-Go Printing and Placement Reflow Soldering Automatic Optical Inspection Panel Separation PCB Board Test PCB Calibration PCB Verification Assembly Final Test Packaging IoT Test Challenges Nov 2015 26
Manufacturing Testing l Time = Money l Limited testing done compared to R&D and Conformance testing l Implementation of new testing techniques for higher throughput Multi- DUT testing, batch measurements, Single Ended BER, Sig vs Non-sig etc l Determination of efficient test process (test plan / fixtures / test steps) l Challenges faced l Device Automation sometimes difficult due to lack of control interfaces (eg USB) l Different operating systems need supported (Andriod, MS, ) l Chipset interface not standardized IoT Test Challenges Nov 2015 27
Service and Repair Testing l Determination of Repair Strategy l Is it worth it at all to repair? l Can it be done in-house? If so, how and at what cost? l Outsourcing options l Tiered Approach to Repair l Level 1: Functional / General inspection l Level 2: Fault detection Basic RF Go/ No Go testing l Level 3: Device component replacement, soldering etc l Time = Money l Very Limited testing done compared to R&D / Validation test l Testing done with new techniques for higher throughput Multi- DUT testing, Multi technology testing, batch measurements, Sig vs Non-sig etc l Efficient test process (test plan / fixtures / test steps / Shielding) IoT Test Challenges Nov 2015 28
Agenda l IoT Market Overview l Testing Challenges for IoT devices l Stages of IoT Testing l Test Solution for Co-existence IoT Test Challenges Nov 2015 29
Eg: IoT test setup for In-Device Coexistence LTE-FDD TD-LTE GNSS WLAN Bluetooth IoT Test Challenges Nov 2015 30
Coexistence Cellular and Non-cellular Standardization Groups Coexistence issues discussed in various standardization groups Cellular standardization e.g. TS 36.813 + TS 36.521 Non-cellular standardization e.g. CWG test plan version 1.4 draft 12 IoT Test Challenges Nov 2015 31
LTE and WLAN Coexistence Example l Adjacent to the 2.4 GHz ISM band are LTE Bands 7 and 40 l Possible interference between LTE Band 40 and lower WLAN channels, as well as the upper WLAN channels and LTE Band 7 UL l Intermodulation products from WLAN TX end up in the LTE Band 7 DL and can affect the LTE RX l Test Plan for RF Performance Evaluation of Wi-Fi Mobile Converged Devices (Wifi Alliance) IoT Test Challenges Nov 2015 32
Coexistence Test Setup Test Setup for Coexistence Test (e.g. LTE and WLAN) Network Emulator (R&S CMW500) UL-LTE DL-LTE DL/UL WLAN Shield Box IoT Test Challenges Nov 2015 33
Automated Soln For Coexistence Testing Eg. LTE WLAN Coexistence Testing LTE / UL Ch 21100 2535 MHz LTE / DL Ch 3449 2655 MHz WLAN Ch 21100 2535 MHz IoT Test Challenges Nov 2015 34
Automated Soln For Coexistence Testing Eg. LTE WLAN Coexistence Testing (LTE B7, WLAN Chn 13) Intermodulation products from WLAN TX end up in the LTE Band 7 DL and can affect the LTE RX Weak WLAN signal Incr WLAN to -40dBm IoT Test Challenges Nov 2015 35
IoT Test Challenges Nov 2015 36 Thank you!
R&S Test Solution Portfolio Development of 802.11 Network Signaling RX/TX Modules RF Layer Test and Performance R&S SMW R&S SMW & R&S FSW Wideband Communication Tester R&S CMW500 Coexistence LTE/WiFi Coexistence Wideband Communication Tester R&S CMW500 Production Testing Solution Wideband Communication Tester R&S CMW500 R&S SMBV R&S SGT R&S FSW R&S SGT & R&S FPS OTA Test 802.11 System OTA Test System R&S TS8991 Offloading LTE/WiFi Offloading Generator/Analyzer R&S SGT/FPS/OSP R&S FSV Wideband Communication Tester R&S CMW500 Wideband Communication Tester R&S CMW500 Power Meter R&S NRP R&S FPS Research and Design Manufacturing IoT Test Challenges Nov 2015 37