![IoT Data-Driven Testing (DDT): JSON File Example
// This file exemplifies the syntax used for creating a BLE Peripheral
// It defines the following Services: Health Thermometer, Blood Pressure, Heart Rate, Battery
name : "HMO", // The Peripheral name ("Health Maintenance Organization")
services : [ {// This service is defined according to https://www.bluetooth.com/specifications/…org.bluetooth.service.health_thermometer.xml
name : "Health Thermometer", // The service name may be used by a script for updating it
uuid : 1809, // Service assigned number as defined in the link above
characteristics : [ { // See https://www.bluetooth.com/specifications/…org.bluetooth.characteristic.temperature_measurement.xml
name : "Temperature Measurement", // The service name may be used by a script for updating it
uuid : 2A1C, // The Characteristic assigned number as defined in the link above
value : [
{float : 36.2}, // Temperature in centigrade (Floating point)
0x07 // Temperature type (See https://www.bluetooth.com/specifications/…org.bluetooth.characteristic.temperature_type.xml)
],
properties : [read, notify], // Characteristic is readable and notifiable
interval : 30000 // Notification interval is 30 seconds
},{
name : "Temperature Type", // See https://www.bluetooth.com/specifications/gatt/viewer?attributeXmlFile=org.bluetooth.characteristic.temperature_type.xml
uuid : 2A1D,
value : [0x06], // Mouth
…](https://image.slidesharecdn.com/t1611-171108162308/85/Testing-in-the-IoT-Era-22-320.jpg)
Testing in the IoT Era
- 1. Transforming Agile Digital Quality Testing in the IoT Era Amir Rozenberg, Director of Product
- 2. Me BUT: I still have ~20 GitHub projects!
- 3. Introducing Perfecto 9/30/2017 3© 2015, Perfecto Mobile Ltd. All Rights Reserved. Strong Ecosystem Perfecto @ a glance • Founded in late 2006, Business HQ in Boston • Over 300 employees globally • Fortune 500 customerbase Dominant leader & visionary “Perfecto Mobile marks shift in mobile apps quality with Continuous Quality Lab” Setting the bar for market success Partnering with Enterprises to deliver exceptional digital experiences
- 4. Continuous Quality for the Digital Experience Financial ServicesTelecomm Other Retail Manufacturing Technology InsuranceTravel
- 5. 9/30/2017 5© 2015,Perfecto MobileLtd. All RightsReserved. Agenda IOT DRIVING DIGITAL TRANSFORMATION QUALITY REQUIREMENTS MEDICAL APPS ACHIEVING SUCCESS WITH IOT APP Q&A
- 7. How does IoT fit into your Agile Strategy?
- 8. Different IoT Segments Source: Charalampos Doukas
- 9. Digital IoT Healthcare Improves Patient Care
- 11. IoT Healthcare Example: Application Architecture (Pro/Reactive) Sensors Connected Apps Cloud Operations Healthcare Ecosystem • Are the measurements correct? • Is the action correct? • Is the data sent correct? • Given data, does the app behave as expected? • Feature/function • Compliance • Backend processes • Sharing • Compliance
- 13. Sensors Requirements • Proactive, Invasive • Independent (not relying on backend availability) • Class 3 FDA approval • Certification against every device, OS, version, Bluetooth version • Cannot leave premises • Retail/Medical • Reactive- informational • Semi-Independent
- 14. How to test the sensors? : Firmware approach Test Considerations • LONG development cycles • Extensive compliance requirements and process • Follows embedded SW practices Examples of Test Practices • Testing mostly HW/FW oriented • Connectivity (BLE): On/Off • No API- No way to automate • Test bench onprem • Scale challenges (especially proactive devices) • Inability to ‘shrink time’
- 15. How to test the sensors? : Simulators (fake device, same SW) Examples of Test Practices • Simulated sensor data • Test application logic • Test firmwareupdate process • Trend responsiveness of action Test Challenges • Vendor typically owns the simulator • No/Few APIs, no automation • No connectivity testing • Test bench onprem
- 16. Testing real sensors is hard, so..
- 18. Healthcare Applications ✓ Mission critical: saving lives and improving patient care ✓ Treatment research ✓ Streamlining healthcare processes
- 19. Data-driven testing • Mainstream data • Extreme data • Data at different frequency • Long term data • Mix of conditions Auth Data intake AUX functions Dev-Test-Staging-Prod Stub Backend Testing the App (Given sensor data)
- 20. Testing the App (Given sensor data) BLENO Box 20-30 m Value: 140 BPM Object (Json file) Auth Data intake AUX functions Dev-Test-Staging-Prod Stub Backend
- 21. The Bleno Box BLENO Box Docker Image Bleno 3rd Party Code (JS) Spring Front-end nodejs Bluetooth Library Linux • Script sends ‘Create’ message • Contains a Json file • File is translated to JS code, based on Bleno classes • JS is executed with nodejs
- 22. IoT Data-Driven Testing (DDT): JSON File Example // This file exemplifies the syntax used for creating a BLE Peripheral // It defines the following Services: Health Thermometer, Blood Pressure, Heart Rate, Battery name : "HMO", // The Peripheral name ("Health Maintenance Organization") services : [ {// This service is defined according to https://www.bluetooth.com/specifications/…org.bluetooth.service.health_thermometer.xml name : "Health Thermometer", // The service name may be used by a script for updating it uuid : 1809, // Service assigned number as defined in the link above characteristics : [ { // See https://www.bluetooth.com/specifications/…org.bluetooth.characteristic.temperature_measurement.xml name : "Temperature Measurement", // The service name may be used by a script for updating it uuid : 2A1C, // The Characteristic assigned number as defined in the link above value : [ {float : 36.2}, // Temperature in centigrade (Floating point) 0x07 // Temperature type (See https://www.bluetooth.com/specifications/…org.bluetooth.characteristic.temperature_type.xml) ], properties : [read, notify], // Characteristic is readable and notifiable interval : 30000 // Notification interval is 30 seconds },{ name : "Temperature Type", // See https://www.bluetooth.com/specifications/gatt/viewer?attributeXmlFile=org.bluetooth.characteristic.temperature_type.xml uuid : 2A1D, value : [0x06], // Mouth …
- 24. Your Success Criteria: Lab Maximize Test Coverage Maximize % of Automation Compliance Scalable Reporting
- 25. Your Success Criteria: Reporting Maximize Test Coverage Maximize % of Automation Compliance Scalable Reporting
- 26. Your Success Criteria: Network Traffic Compliance Maximize Test Coverage Maximize % of Automation Compliance Scalable Reporting HAR File • What is impacting the responsiveness of my app? • What servers am I interacting with? • What data is exposed in my service API calls?
- 27. Your Success Criteria: Compliance Maximize Test Coverage Maximize % of Automation Compliance Scalable Reporting Uncompromised Security • Network Operations team • Support Desk • Infrastructure monitoring 24x7 14 Global data centers • High Availability architecture • Auto recovery • Data recoveryWorld Class
- 28. Let’s Summarize Complexity, compliance Time, $, Resources Divide and Conquer (Test what you can) Define, prioritize platforms, test cases and data (Factors for IoT) Set the lab: Assets, global, scalable & compliant Build service virtualization Automate, Automate, Automate Audit- ready reporting
- 30. @Amir_Rozenberg