IoT Tech Day Coding Mojo slides. Utrecht, April 2016
1 like986 views
Mark West discusses reviving his coding interest by combining Raspberry Pi and Arduino to create a Nodebot Rover. The presentation covers hardware integration, using Johnny-Five for JavaScript control, implementing MQTT for communication, and integrating speech recognition. West evaluates various aspects of the project and demonstrates the Nodebot Rover's capabilities, ultimately affirming his coding enthusiasm.
IoT Tech Day Coding Mojo slides. Utrecht, April 2016
- 1. HOW I GOT BACK MY CODING MOJO! Mark West #iottechday
- 12. The Arduino Ecosystem • MicroController platform. • Many different Arduino models. • Open Source design. • MicroControllers extensible via “Shields”.
- 17. Two Servos for Camera Pan & Tilt Servos wired to Arduino Chassis Raspberry PI In Plastic Case WIFI Dongle
- 19. Actuators Sensors Nervous System Raspberry PI 2Raspberry PI Cam Arduberry Microcontroller Arduino Chassis Servo Servo Brain NodeBot Rover Hardware
- 20. Combining the Raspberry PI & Arduino Raspberry PI • Linux PC. • Supports USB peripherals. • Programming. ArduinoPlatform • MicroController. • Robust. • Native analogue support. The whole is greater than the sum of parts!
- 21. Actuators Sensors Nervous System Raspberry PI 2Raspberry PI Cam Arduberry Microcontroller Arduino Chassis Servo Servo Brain NodeBot Rover Hardware
- 23. Raspberry PI 2 Arduberry Servo Software Communication across Hardware Layers Servo Raspberry PI Chassis JavaScriptPI Binary (Compiled C / C++)
- 26. 1. Maturity 2. Community 3. DSL 4. Portability 5. Open Source 6. Node.js ecosystem 7. REPL Benefits of using Johnny-Five
- 27. Imports J5 Dependancy Adds LED instance to REPL Declares LED as connected to UNO Pin 13 Blinks LED every 500 milliseconds Code block triggered by UNO ”Ready” Event Initialises UNO Johnny-Five Code Example var five = require("johnny-five"); var myBoard = new five.Board(); myBoard.on("ready", function() { var myLed = new five.Led(13); myLed.blink(500); this.repl.inject({ replLed: myLed }); });
- 29. Arduberry Servo Bridging the gap with Firmata Servo Raspberry PI Chassis Johnny-Five (Firmata Client) Std. Firmata (Firmata Server) JavaScriptPI Binary (Compiled C / C++)
- 31. Getting Started with Johnny-Five 1. Buy an Arduino Experimenters Kit. 2. Follow the tutorials at http://node-ardx.org. 3. Visit http://johnny-five.io for more information and inspiration.
- 33. Speech Recognition Requirements Need to have • Quality and speed of speech recognition. • Free, no restrictions. • Software based. • JavaScript. Nice to have • Speech to text. • One stop service. • Battle tested.
- 41. Button press and release connected to Web Speech API start and stop Control methods. Continuous dictation switched on, to avoid cutting commands short. Interim results switched on – shown in green text (final results in white). Each set of results checked for uniqueness to avoid sending duplicate commands to the Robot. Web Speech API : Robot
- 46. Johnny-Five Process Express Process Raspberry PI 2 WE Browser HTTPS NodeBot Rover Hardware Firmata
- 48. Why Add a Message Broker? • Seperation of concerns. • Isolate main components for easier testing.
- 49. MQTT – MQ Telemetry Transport • Internet of Things connectivityprotocol. • Designed to be lightweightwith a small footprint and little overhead. • Is a protocoland a Pub-Sub Message Broker. • Used by Facebook for pushing updates to mobile clients.
- 50. Adding MQTT to the NodeBot Rover Broker • Public MQTT Broker – ManyPublic Brokers exist. – One less process to run on RaspberryPI. Client • MQTT.js – Provides an MQTT client libraryfor Node.js. – Extremelysimple to use. – Integrates seamlesslywith Johnny-Five.
- 52. MQTT Over WebSockets with MQTT.js • MQTT.js is a Node.js package and is meant for use on the Server Side. • To allow MQTT.js to run from the Browser, we first needed to ”Browserify” the MQTT library. • We could then access the ”Browserified” MQTT client library from the Browser. • This solution requires that your MQTT Broker has a WebSocket endpoint.
- 53. MQTT Over WebSockets Demo Demo of the HiveMQ WebSocket Client http://www.hivemq.com/demos/websocket- client
- 55. Node.js Twitter Client • Fully fledged Twitter Client: – Asynchronous. – Supports REST API (read and write) – Supports Streaming API (eventsand tweets). • Requires developer credentials from Twitter: – Trivial to get hold of.
- 57. Video Streaming via Motion • Motion: Software Motion Detector. • Provides streaming video with possibility to create snapshots. • Good performance on the Raspberry PI. • Potential side project: get Robot to follow moving objects?
- 60. So Did I Get My Coding Mojo Back?
- 65. “please rate my talk in the offical IoT Tech Day app” @markawest