Going Serverless with OpenWhisk
2 likes1,161 views
The document provides an overview of serverless computing, specifically focusing on the OpenWhisk platform, an open-source serverless solution developed by IBM. It discusses the evolution and market landscape of serverless platforms, the unique features and architecture of OpenWhisk, challenges faced in serverless environments, and practical examples of its application. Additionally, it highlights the benefits of serverless technology in enabling efficient development and operation of cloud-native applications.
![Serverless in a Nutshell
• ‘Next-gen’ PaaS (developers just write the business logic)
• for ETL-style services decomposable into event sources
(e.g., stateful/persistent services) triggering stateless handlers
• scaled, metered [and charged] by individual handler invocation
The motivation behind the ‘serverless’ term is that the application provider doesn’t need
to care about managing the underlying servers
(pioneered by Amazon, who didn’t have fully managed PaaS offering before Lambda)
2](https://image.slidesharecdn.com/serverlessopenwhiskhaifa07-feb-2017-170208091900/85/Going-Serverless-with-OpenWhisk-3-320.jpg)
Going Serverless with OpenWhisk
- 1. Going ‘Serverless’ with OpenWhisk Alex Glikson Cloud Platforms, IBM Research glikson@il.ibm.com Haifa Cloud Meetup February 7, 2017 https://www.meetup.com/Haifa-Cloud/events/236843362/
- 2. Outline 1. Overview of Serverless 2. OpenWhisk – open source ‘Serverless’ platform 3. Challenges of Serverless 1
- 3. Serverless in a Nutshell • ‘Next-gen’ PaaS (developers just write the business logic) • for ETL-style services decomposable into event sources (e.g., stateful/persistent services) triggering stateless handlers • scaled, metered [and charged] by individual handler invocation The motivation behind the ‘serverless’ term is that the application provider doesn’t need to care about managing the underlying servers (pioneered by Amazon, who didn’t have fully managed PaaS offering before Lambda) 2
- 4. analyze reading OpenWhisk create order alert customer alarm changes changes service order appliance events IBM Watson IoT Example: bit.ly/open-fridge @ Daniel Krook
- 5. Serverless Market • Amazon Lambda – Pioneer of serverless, launched in Nov 2014 – Rapid growth, dedicated mini-con at Re:Invent 2016 • Similar offerings by other commercial cloud providers – Google Functions, Azure Functions, IBM OpenWhisk • Multiple niche players, rapidly growing ecosystem – iron.io, pubnub.com, etc • OpenWhisk – the open source serverless platform – Developed by IBM, now under incubation in Apache (w/Adobe) – Also offered on IBM Bluemix as a fully managed service 4
- 6. Serverless: Why Now? The Perfect Storm 5 Serverless PaaS Evolution Developers enjoy the ‘low touch’ experience, but scaling is a challenge Event-Driven Use-Cases More application can be architected as a collection of events and handlers Containers Maturity Technologies for fine-grained sandboxing become mainstream API Economy Proliferation of RESTful, composable (micro)services, often charged by API call Image: http://bobkaylor.typepad.com/bob_kaylor/2012/01/the-meaning-of-jesus-part-2-the-perfect-storm.html
- 7. OpenWhisk: Open Source Serverless Platform Trigger Package Feed Package Feed Package Feed Package Feed REST CLI iOS SDK CRUD triggers, actions, and rules Invoke actions UI Action NodeJS Action Swift Action Docker Rule Rule Rule Action NodeJS Action Docker Service ecosytem Bluemix services 3rd party services Self-enabled services Chain Chain Invoke Docker API Gateway OpenWhisk Tenets: • Fully open (source, dev, community, ecosystem) • Extensible (feeds, actions, packages) • Polyglot (JS, Python, Swift, Java, *any*/docker) • Composable (e.g., sequences) • Per-event/request scaling, metering http://openwhisk.org/
- 8. OpenWhisk Internal Architecture 7 Controller …Invoker InvokerInvoker
- 9. OpenWhisk Catalog • Cron • Utils (e.g., jq) • CouchDB/Cloudant • Object Storage • MQTT • Kafka • Node-RED * Some of the above are work in progress 8 Github Slack IBM Watson Weather WebHooks Mobile Push etc
- 10. OpenWhisk and API Gateway • OpenWhisk CLI is extended to to allow user to define routes for actions $ wsk action create hello hello.js $ wsk api create GET /v1/hello hello Route URL: https://api-gw.mybluemix.net/api/ /nsuuid/v1/hello $ curl –XGET https://api-gw.mybluemix.net/api/ /nsuuid/v1/hello { message: ”Hello World” } 1 Browser Mobile App Web App APIGateway 2 OpenWhisk 3 Invoke associated OpenWhisk action „getCustomers“ Swift DockerJS Python Java Incoming HTTP request, e.g. HTTP GET api-gw.mybluemix.net/…/getCustomers - API Gateway takes care of… - security (authenticate, authorize, threat protect, validate) - control (rate limiting, response caching) - mediation - parameter mapping - schema validation - etc
- 11. Example: Monitoring Github comments • Goals: 1. Watch for new comments in a given github.com repository 2. Save github.com events in a DB in Bluemix 3. Provide REST API to access data in the DB (e.g., aggregate stats) 10 glikson/meetup/issues/1 cloudant/ create-document cloudant/ list-documents issue_comment meetup prepGh2Db writeToDb API Gateway /meetup/v1/count totalRows
- 12. Example: monitoring Github comments 11 glikson/meetup/issues/1 cloudant/ create-document cloudant/ list-documents issue_comment meetup prepGh2Db writeToDb API Gateway /meetup/v1/count totalRows
- 13. Example: monitoring Github comments 12 glikson/meetup/issues/1 cloudant/ create-document cloudant/ list-documents issue_comment meetup prepGh2Db writeToDb API Gateway /meetup/v1/count totalRows
- 14. Getting started with OpenWhisk in Bluemix Click here and run your first action in 30 secs: https://console.ng.bluemix.net/openwhisk/ Associate an action with event triggers:
- 15. Challenges of Serverless • Opinionated programming model – Aligned with 12-factor approach to cloud-native applications • Per-handler resource allocation limits • Per-invocation latency & overhead • Lack of high-performance persistent state • Ability to reuse and share handler functions (‘marketplace’) • Lifecycle management of composite serverless applications • Monitoring, error handling, testing, debugging 14
- 16. QUESTIONS? Alex Glikson Cloud Platforms, IBM Research glikson@il.ibm.com
- 17. OpenWhisk Debugger (https://github.com/openwhisk/openwhisk-debugger ) • Allows to… – debug actions locally – inspect parameter values – edit code & push changes • Supports debugging… – NodeJS, Python and Swift actions
- 19. The Essence of Serverless • What is Serverless? –‘Serverless’ is a cloud-native design pattern, accompanied with a programming model and a runtime architecture –Aimed at radically simplified, faster and more efficient development and operation of (certain) applications • The Pattern –Application is architected a set of ‘business logic’ functions, local or remote, triggered by discrete events or requests –The underlying runtime is (infinitely) elastic, with scaling (and chargeback) granularity of single function invocation (100ms) –Each local function is invoked in a sandbox, which is short-lived and ephemeral (interacting with stateful services) 18
- 20. What is serverless good for? 19
- 21. Example: Serverless at Thomson Reuters 20 https://www.portal.reinvent.awsevents.com/connect/sessionDetail.ww?SESSION_ID=8674
- 22. Example: Serverless at Bustle 21 https://aws.amazon.com/solutions/case-studies/bustle/
- 23. Example: Serverless at Expedia 22 https://www.portal.reinvent.awsevents.com/connect/sessionDetail.ww?SESSION_ID=8671
- 24. Example: Serverless at Expedia 23 https://www.portal.reinvent.awsevents.com/connect/sessionDetail.ww?SESSION_ID=8671
- 25. OpenWhisk CLI: Create and test action Create the Action that analyzes IoT readings, then stores in the database wsk action create analyze-service-event analyze-service-event.js --param cloudant_user $CLOUDANT_USER --param cloudant_pass $CLOUDANT_PASS Invoke the Action manually with sample message data to test wsk action invoke --blocking --result analyze-service-event --param service '{ "appliance_serial": "xxxxyyyyzzzz", "part_number": "ddddeeeeffff", "reading": 13, "timestamp": 1466188262}'
- 26. OpenWhisk CLI: Link trigger to action Create the Trigger that subscribes to an MQTT topic pattern wsk trigger create openfridge-feed-trigger --feed mqtt/mqtt-feed-action --param topic 'iot-2/type/+/id/+/evt/+/fmt/json' --param url 'ssl://example.messaging.internetofthings.ibmcloud.com:8883’ Link the Trigger to the Action using a Rule wsk rule create --enable openfridge-feed-rule openfridge-feed-trigger analyze-service-event
- 27. Serverless check processing with OpenWhisk https://github.com/krook/openchecks
- 28. Serverless can handle many cloud native app 12 Factors I Codebase Handled by developer (Manage versioning of functions on their own) II Dependencies Handled by developer, facilitated by serverless platform (Runtimes and packages) III Config Handled by platform (Environment variables or injected event parameters) IV Backing services Handled by platform (Connection information injected as event parameters) V Build, release, run Handled by platform (Deployed resources are immutable and internally versioned) VI Processes Handled by platform (Single stateless containers often used) VII Port binding Handled by platform (Actions or functions are automatically discovered) VIII Concurrency Handled by platform (Process model is hidden and scales in response to demand) IX Disposability Handled by platform (Lifecycle is hidden from the user, fast startup and elastic scale is prioritized) X Dev/prod parity Handled by developer (The developer is the deployer. Scope of what differs is narrower) XI Logs Handled by platform (Developer writes to console.log, platform handles log streaming) XII Admin processes Handled by developer (No distinction between one off processes and long running)