Reuse, Reduce, Recycle in Serverless World
Download as PPTX, PDF1 like580 views
The document discusses lessons learned from DevOps in the context of serverless computing, highlighting the need for reusable libraries and automation patterns. It introduces StackStorm as a platform for operational automation and proposes recycling its components for serverless applications. The future directions emphasize creating a discoverable and community-maintained serverless function catalog to enhance developer experience.
Reuse, Reduce, Recycle in Serverless World
- 1. WITH LESSONS LEARNED IN DEVOPS IN SERVERLESS by Dmitri Zimine ExtremeNetworks StackStorm @dzimine
- 2. Simon says... Source: Why the Fuss About Serverless? | Simon Wardley | ServerlessConf 17
- 3. DevOps is a new legacy … and rejected Source: Why the Fuss About Serverless? | Simon Wardley ServerlessConf 17
- 4. DevOps is a new legacy … and rejected Source: Why the Fuss About Serverless? | Simon Wardley ServerlessConf 17
- 5. 1. State of reuse in Serverless 2. What we can learn from DevOps if we care 3. Demo: experiment of recycling DevOps to Serverless 4. Future directions
- 7. 0 100 200 300 400 500 600 700 800 1 11 21 31 41 51 61 71 81 91 101 111 121 131 141 151 161 171 181 191 201 211 221 231 241 251 261 271 281 291 301 1 alexa-skills-kit-nodejs-factskill 7280 2 SecretsManagerRDSMySQLRotationSingleUser 736 3 alexa-skills-kit-nodejs-triviaskill 674 4 hello-world 472 5 alexa-skills-kit-nodejs-howtoskill 425 6 alexa-skills-kit-color-expert 331 7 SecretsManagerRDSPostgreSQLRotationSingleUser 305 8 SecretsManagerRDSMySQLRotationMultiUser 250 9 microservice-http-endpoint 230 10 alexa-skills-kit-color-expert-python 224 60 greengrass-hello-world 27 61 splunk-logging 27 62 crypto-monitor 27 63 s3-static-site 26 64 sns-message-python 26 65 DailyDoggo 25 • Since Nov’17, GA Feb ’18 • 306 apps, up from 246 May’18 • Top: 7280 deployments - outlier? • 2nd top: 736 deployments • 16 apps (5%) with > 100 deployments
- 8. • Launched April 2018 • 22 components in repository: Mostly basic types: lambda, s3, api-gateway No “catalog” site – just a github repo. • 649 GitHub stars • No public stats on usage found Serverless Components – GitHub Stars
- 10. DevOps is a new legacy … and rejectedbecause they’re Ops Patterns
- 11. DevOps is a new legacy … and rejected Huh? because they’re Ops Patterns
- 12. REUSE Code Libraries Design Patterns DEVELOPERS
- 13. REUSE Code Libraries Design Patterns Ops Patterns DEVELOPERSDEVOPS 1. Code 2. Works out of box 3. Never used “as is”, always forked.
- 14. Chef has recepies and cookbooks Ansible has modules and playbooks Stackstorm has integrations and automations libraries and ops patterns
- 15. Ops pattern example: StackStorm automation Automation EngineerService Monitoring Incident Management Event: “low disk on web301” Web301 is “low disk” Resolve known cases, fast. Is it /var/log? Clean up! Unknown problem, need a human Wake up, buddy. Something real is going on… Remediate low-disk space
- 20. StackStorm Exchange • Open Source Catalog of Reusable Actions • Since 2014 • 160+ integrations, 6,500+ actions Recycle • Use Exchange as Open Catalog of Serverless functions • Turn StackStorm actions into Lambda functions • Make it easy with @goserverless Framework RECYCLE StackStorm Exchange for Serverless
- 21. How people Lambda before Serverless?
- 23. in 30 seconds ActionsSensors WorkflowsRules IT Domains Config mgmtStorageNetworking ContainersCloud InfraMonitoring Ops Support Triggers Calls For details: StackStorm.com
- 24. Automation EngineerService Monitoring Incident Management Event: “low disk on web301” Web301 is “low disk” Resolve known cases, fast. Is it /var/log? Clean up! Unknown problem, need a human Wake up, buddy. Something real is going on… Remediate low-disk space
- 25. StackStorm is like … ActionsSensors WorkflowsRules Step Functions AWS Lambda open-source born 2013 server-full
- 26. StackStorm is like … Sensors WorkflowsRules open-source born 2013 server-full Actions: like Functions, REUSABLE
- 27. show Exchagne →
- 28. Action is like a Function (command pattern)
- 29. StackStorm Exchange Facts • 140 integration packs, 6,500+ actions • Open Source • Mature – packs since 2014, Exchange site launched 2016 • Heavily used and contributed • Strong community
- 30. What if I could •Reuse Exchange integrations in #Serverless projects? •Recycle #StackStorm actions to Lambda functions? •Make it easy?
- 31. 31 Show time
- 32. Set up a new serverless project $ mkdir stormless $ cd stormless $ npm init ... $ sls plugin install --name serverless-plugin-stackstorm ... $ sls stackstorm --help
- 33. run commands →
- 34. shw Action from StackStorm Exchange, {pack}.{action_name} Input transformation, with Jinja templates Output transformation, with Jinja templates Handy for use in StepFunctions Plugin reference Pack-level configuration parameters.
- 35. run commands →
- 36. Look under the hood
- 37. #stormless
- 38. #stormless
- 43. #codeless Just kidding ! ... but we didn’t write any code! We REUSED it.
- 45. since Nov’17 246 apps since Apr’18 ? apps since 2014 160 packs
- 46. DevOps is a new legacy … and rejectedYoung Serverless, will you use Exchange? No thanks DevOps, I’ll be building my own
- 47. The Serverless Function Catalog of the Future • Discoverable – by humans and computers == site, index… check exchange.stackstorm.com • Full of usable functions • Frictionless dev experience • Easy to consume – integration with dev frameworks: SAM, Serverless... • Easy to contribute – new functions, patches • Open… … and sustainable • Backed up by major cloud(s)? Independent? Foundation? • Community maintained • Code is cheap. Community is not.
- 48. What’s Next • Star the plugin https://github.com/StackStorm/serverless-plugin-stackstorm • Follow the tutorial – experience it: • https://goo.gl/EyGGVE • Explore Exchange • exchange.stackstorm.org • Let’s keep discussion going • Come by StackStorm table @ServerlessConf • forum.serverless.com or forum.stackstorm.com • Twitter: @Stack_Storm, @goserverless, @dzimine
Editor's Notes
- #35: For the javascript crowd here: Jinga is a templating engine like Mustache or Handlebars, in Python