Developing and deploying serverless applications (February 2017)
6 likes1,082 views
- The document discusses developments and tools for serverless applications on AWS Lambda. It begins with an overview of new Lambda features like environment variables and Step Functions for orchestrating Lambda functions. - Several serverless frameworks are demonstrated, including the Serverless Framework, Gordon, and Chalice, which simplify developing and deploying Lambda functions and event sources. - The AWS Serverless Application Model (SAM) is presented as a way to bundle Lambda functions, APIs, and events using CloudFormation for simplified deployment. Additional resources on Lambda are also listed.
![Serverless: “Hello World” API
$ serverless create
Edit handler.js, serverless.yml and event.json
$ serverless deploy [--stage stage_name]
$ serverless invoke [local] --function function_name
$ serverless info
$ http $URL
$ serverless remove](https://image.slidesharecdn.com/l2-170202093108/85/Developing-and-deploying-serverless-applications-February-2017-11-320.jpg)
![Gordon: “Hello World” API
$ gordon startproject helloworld
$ gordon startapp helloapp
Write hellofunc() function
$ gordon build
$ echo '{"name":"Julien"}' | gordon run helloapp.hellofunc
$ gordon apply [--stage stage_name]
$ http post $URL name=Julien](https://image.slidesharecdn.com/l2-170202093108/85/Developing-and-deploying-serverless-applications-February-2017-14-320.jpg)
![AWS Chalice: “Hello World” API
$ chalice new-project helloworld
Write your function in app.py
$ chalice local
$ chalice deploy
$ export URL=`chalice url`
$ http $URL
$ http put $URL/hello/julien
$ chalice logs [ --include-lambda-messages ]](https://image.slidesharecdn.com/l2-170202093108/85/Developing-and-deploying-serverless-applications-February-2017-17-320.jpg)
![AWS Chalice: PUT/GET in S3 bucket
$ chalice new-project s3test
Write your function in app.py
$ chalice local
$ http put http://localhost:8000/objects/doc.json value1=5 value2=8
$ http get http://localhost:8000/objects/doc.json
$ chalice deploy [stage_name]
$ export URL=`chalice url`
$ http put $URL/objects/doc.json value1=5 value2=8
$ http get $URL/objects/doc.json](https://image.slidesharecdn.com/l2-170202093108/85/Developing-and-deploying-serverless-applications-February-2017-18-320.jpg)
Developing and deploying serverless applications (February 2017)
- 1. © 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Julien Simon Principal Technical Evangelist, AWS julsimon@amazon.fr @julsimon Developing and deploying serverless applications
- 2. Agenda • What’s new on AWS Lambda? • Simplifying development • Demo: The Serverless framework • Demo: Gordon • Demo: Chalice • Other tools • Simplifying deployment • Demo: AWS Serverless Application Model • Additional resources • Q&A
- 3. " " What’s new on AWS Lambda?" "
- 4. Environment variables for Lambda functions New https://aws.amazon.com/fr/blogs/aws/new-for-aws-lambda-environment-variables-and-serverless-application-model/
- 5. Serverless CI/CD pipeline GitHub Source Deploy CloudFormationCodeBuild Build NEW! • Pull source directly from GitHub or AWS CodeCommit " using AWS CodePipeline • Build and package serverless apps with AWS CodeBuild • Deploy your completed Lambda app with AWS CloudFormation https://docs.aws.amazon.com/lambda/latest/dg/automating-deployment.html
- 6. Easily create reliable end-to-end event processing solutions • Sends all unprocessed events to your SQS queue or SNS topic: 3-strike rule • Preserves events even if your code has an issue or the call was throttled • Per-function • Works for all async invokes, including S3 and SNS events Dead-letter queue for events New Amazon SQS Amazon SNS AWS Lambda https://docs.aws.amazon.com/lambda/latest/dg/dlq.html
- 7. • Attempt a function more than 3X • Add callbacks to asynchronous functions • Handle situations that require waiting • Chain function execution (AàBàC) • Supports long-running workflows AWS Step Functions New Reliably orchestrate multiple Lambda functions https://aws.amazon.com/fr/blogs/aws/new-aws-step-functions-build-distributed-applications-using-visual-workflows/
- 8. " Simplifying Development " "Code samples available at https://github.com/juliensimon/aws/tree/master/lambda_frameworks " "
- 9. Typical development workflow 1. Write and deploy a Lambda function 2. Create a REST API with API Gateway 3. Connect the API to the Lambda function 4. Invoke the API 5. Test, debug and repeat ;)
- 10. The Serverless framework " formerly known as JAWS: Just AWS Without Servers • Announced at re:Invent 2015 by Austen Collins and Ryan Pendergast • Supports Node.js, as well as Python and Java • Auto-deploys and runs Lambda functions, locally or remotely • Auto-deploys your Lambda event sources: API Gateway, S3, DynamoDB, etc. • Creates all required infrastructure with CloudFormation • Simple configuration in YML http://github.com/serverless/serverless https://serverless.com AWS re:Invent 2015 | (DVO209) https://www.youtube.com/watch?v=D_U6luQ6I90 & https://vimeo.com/141132756
- 11. Serverless: “Hello World” API $ serverless create Edit handler.js, serverless.yml and event.json $ serverless deploy [--stage stage_name] $ serverless invoke [local] --function function_name $ serverless info $ http $URL $ serverless remove
- 13. Gordon • Released in Oct’15 by Jorge Batista • Supports Python, Javascript, Golang, Java, Scala, Kotlin (including in the same project) • Auto-deploys and runs Lambda functions, locally or remotely • Auto-deploys your Lambda event sources: API Gateway, CloudWatch Events, DynamoDB Streams, Kinesis Streams, S3 • Creates all required infrastructure with CloudFormation • Simple configuration in YML https://github.com/jorgebastida/gordon https://news.ycombinator.com/item?id=11821295
- 14. Gordon: “Hello World” API $ gordon startproject helloworld $ gordon startapp helloapp Write hellofunc() function $ gordon build $ echo '{"name":"Julien"}' | gordon run helloapp.hellofunc $ gordon apply [--stage stage_name] $ http post $URL name=Julien
- 15. Demo: " Gordon
- 16. AWS Chalice " Think of it as a serverless framework for Flask apps" • Released in Jul’16, still in beta • Just add your Python code • Deploy with a single call and zero config • The API is created automatically, the IAM policy is auto-generated • Run APIs locally on port 8000 (similar to Flask) • Fast & lightweight framework • 100% boto3 calls (AWS SDK for Python) à fast • No integration with CloudFormation à no creation of event sources https://github.com/awslabs/chalice https://aws.amazon.com/blogs/developer/preview-the-python-serverless-microframework-for-aws/
- 17. AWS Chalice: “Hello World” API $ chalice new-project helloworld Write your function in app.py $ chalice local $ chalice deploy $ export URL=`chalice url` $ http $URL $ http put $URL/hello/julien $ chalice logs [ --include-lambda-messages ]
- 18. AWS Chalice: PUT/GET in S3 bucket $ chalice new-project s3test Write your function in app.py $ chalice local $ http put http://localhost:8000/objects/doc.json value1=5 value2=8 $ http get http://localhost:8000/objects/doc.json $ chalice deploy [stage_name] $ export URL=`chalice url` $ http put $URL/objects/doc.json value1=5 value2=8 $ http get $URL/objects/doc.json
- 19. Demo: " Chalice
- 20. Summing things up Serverless The most popular serverless framework Built with and for Node.js. Python and Java: YMMV Rich features, many event sources Not a web framework Gordon Great challenger! Node.js, Python, Java, Scala, Golang Comparable to Serverless feature-wise Not a web framework Chalice AWS project, in beta Python only Does only one thing, but does it great Dead simple, zero config Flask web framework
- 21. More Lambda frameworks • Kappa https://github.com/garnaat/kappa • Released Dec’14 by Mitch Garnaat, author of boto and the AWS CLI (still maintained?) • Python only, multiple event sources • Apex https://github.com/apex/apex • Released in Dec’15 by TJ Holowaychuk • Python, Javascript, Java, Golang • Terraform integration to manage infrastructure for event sources • Zappa https://github.com/Miserlou/Zappa • Released in Feb’16 by Rich Jones • Python web applications on AWS Lambda + API Gateway • Docker-lambda https://github.com/lambci/docker-lambda • Released in May’16 by Michael Hart • Run functions in Docker images that “replicate” the live Lambda environment
- 22. 2 Java tools for AWS Lambda https://java.awsblog.com/post/TxWZES6J1RSQ2Z/Testing-Lambda-functions-using-the-AWS-Toolkit-for-Eclipse https://aws.amazon.com/blogs/developer/aws-toolkit-for-eclipse-serverless-application https://github.com/awslabs/aws-serverless-java-container Eclipse plug-in • Code, test and deploy Lambda from Eclipse • Run your functions locally and remotely • Test with local events and Junit4 • Deploy standalone functions, or with the " AWS Serverless Application Model (Dec’16) Serverless Java Container • Run Java RESTful APIs as-is • Default implementation of the Java servlet HttpServletRequest " HttpServletResponse • Support for Java frameworks such as Jersey or Spark
- 24. AWS Serverless Application Model (SAM)" formerly known as Project Flourish • CloudFormation extension released in Nov’16 to bundle Lambda functions, APIs & events • 3 new CloudFormation resource types • AWS::Serverless::Function • AWS::Serverless::Api • AWS::Serverless::SimpleTable • 2 new CloudFormation CLI commands • ‘aws cloudformation package’ • ‘aws cloudformation deploy’ • Integration with CodeBuild and CodePipeline for CI/CD • Expect SAM to be integrated in most / all frameworks https://aws.amazon.com/fr/blogs/compute/introducing-simplified-serverless-application-deplyoment-and-management https://github.com/awslabs/serverless-application-model/ New
- 25. AWSTemplateFormatVersion: '2010-09-09’ Transform: AWS::Serverless-2016-10-31 Resources: GetHtmlFunction: Type: AWS::Serverless::Function Properties: CodeUri: s3://flourish-demo-bucket/todo_list.zip Handler: index.gethtml Runtime: nodejs4.3 Policies: AmazonDynamoDBReadOnlyAccess Events: GetHtml: Type: Api Properties: Path: /{proxy+} Method: ANY ListTable: Type: AWS::Serverless::SimpleTable Functions APIs Storage AWS Serverless Application Model
- 26. AWSTemplateFormatVersion: '2010-09-09’ Transform: AWS::Serverless-2016-10-31 Resources: GetHtmlFunction: Type: AWS::Serverless::Function Properties: CodeUri: s3://flourish-demo-bucket/todo_list.zip Handler: index.gethtml Runtime: nodejs4.3 Policies: AmazonDynamoDBReadOnlyAccess Events: GetHtml: Type: Api Properties: Path: /{proxy+} Method: ANY ListTable: Type: AWS::Serverless::SimpleTable AWSTemplateFormatVersion: '2010-09-09' Resources: GetHtmlFunctionGetHtmlPermissionProd: Type: AWS::Lambda::Permission Properties: Action: lambda:invokeFunction Principal: apigateway.amazonaws.com FunctionName: Ref: GetHtmlFunction SourceArn: Fn::Sub: arn:aws:execute-api:${AWS::Region}: ${AWS::AccountId}:${ServerlessRestApi}/Prod/ ANY/* ServerlessRestApiProdStage: Type: AWS::ApiGateway::Stage Properties: DeploymentId: Ref: ServerlessRestApiDeployment RestApiId: Ref: ServerlessRestApi StageName: Prod ListTable: Type: AWS::DynamoDB::Table Properties: ProvisionedThroughput: WriteCapacityUnits: 5 ReadCapacityUnits: 5 AttributeDefinitions: - AttributeName: id AttributeType: S KeySchema: - KeyType: HASH AttributeName: id GetHtmlFunction: Type: AWS::Lambda::Function Properties: Handler: index.gethtml Code: S3Bucket: flourish-demo-bucket S3Key: todo_list.zip Role: Fn::GetAtt: - GetHtmlFunctionRole - Arn Runtime: nodejs4.3 GetHtmlFunctionRole: Type: AWS::IAM::Role Properties: ManagedPolicyArns: - arn:aws:iam::aws:policy/ AmazonDynamoDBReadOnlyAccess - arn:aws:iam::aws:policy/service-role/ AWSLambdaBasicExecutionRole AssumeRolePolicyDocument: Version: '2012-10-17' Statement: - Action: - sts:AssumeRole Effect: Allow Principal: Service: - lambda.amazonaws.com ServerlessRestApiDeployment: Type: AWS::ApiGateway::Deployment Properties: RestApiId: Ref: ServerlessRestApi Description: 'RestApi deployment id: 127e3fb91142ab1ddc5f5446adb094442581a 90d' StageName: Stage GetHtmlFunctionGetHtmlPermissionTest: Type: AWS::Lambda::Permission Properties: Action: lambda:invokeFunction Principal: apigateway.amazonaws.com FunctionName: Ref: GetHtmlFunction SourceArn: Fn::Sub: arn:aws:execute-api:${AWS::Region}: ${AWS::AccountId}:${ServerlessRestApi}/*/ ANY/* ServerlessRestApi: Type: AWS::ApiGateway::RestApi Properties: Body: info: version: '1.0' title: Ref: AWS::StackName paths: "/{proxy+}": x-amazon-apigateway-any-method: x-amazon-apigateway-integration: httpMethod: ANY type: aws_proxy uri: Fn::Sub: arn:aws:apigateway:$ {AWS::Region}:lambda:path/2015-03- 31/functions/${GetHtmlFunction.Arn}/ invocations responses: {} swagger: '2.0' AWS Serverless Application Model REPLACES:
- 27. SAM: Open Specification Apache 2.0 licensed GitHub project New https://github.com/ awslabs/serverless- application-model
- 28. Demo: " Serverless Application Model"
- 30. The only Lambda book you need to read Written by AWS Technical Evangelist Danilo Poccia Just released! https://www.amazon.com/Aws-Lambda-Action- Event-driven-Applications/dp/1617293717/
- 31. New Lambda videos from re:Invent 2016 AWS re:Invent 2016: What’s New with AWS Lambda (SVR202) https://www.youtube.com/watch?v=CwxWhyGteNc AWS re:Invent 2016: Serverless Apps with AWS Step Functions (SVR201) https://www.youtube.com/watch?v=75MRve4nv8s AWS re:Invent 2016: Real-time Data Processing Using AWS Lambda (SVR301) https://www.youtube.com/watch?v=VFLKOy4GKXQ AWS re:Invent 2016: Serverless Architectural Patterns and Best Practices (ARC402) https://www.youtube.com/watch?v=b7UMoc1iUYw AWS re:Invent 2016: Bringing AWS Lambda to the Edge (CTD206) https://www.youtube.com/watch?v=j26novaqF6M AWS re:Invent 2016: Ubiquitous Computing with Greengrass (IOT201) https://www.youtube.com/watch?v=XQQjX8GTEko
- 32. AWS User Groups Lille Paris Rennes Nantes Bordeaux Lyon Montpellier Toulouse Côte d’Azur (soon!) facebook.com/groups/AWSFrance/ @aws_actus
- 33. Merci ! Julien Simon Principal Technical Evangelist, AWS julsimon@amazon.fr @julsimon