Serverless: State of The Union I AWS Dev Day 2018

© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Serverless: State of the Union
Randall Hunt
Technical Developer Evangelist
randhunt@amazon.com
@jrhunt
ranman

@jrhunt
ThankYou to our sponsors!

@jrhunt
Acknowledgements
• Thanks to all the service teams that build this service
• Thanks to all my colleagues that build these decks

A typical day for a developer…
Manager “We need an app to let our customers update preference
settings – our competitors just launched the same thing, so I need it
fast. I don’t want to pay a lot for it, especially when no one is using it.
But remember that we’re growing, so make sure it scales great and is
easy to manage and operate. And you’re on your own – sorry!”
Developer “Not a problem. I’ll make it serverless…”

Serverless means…
No Server Management Flexible Scaling
No Idle Costs
$
High Availability

Serverless Benefits
• Never pay for idle, request-based pricing
• No infrastructure to provision, monitor, or manage
• Scaling and fault-tolerance built in
• Easy to author, deploy, and secure
• Enables best practices (events, stateless functions)

Joe promised his boss an app.
Now what?
Step 1: Find a working example!
Serverless web app with
…an API hosted on Amazon API Gateway
…access to existing data stored in Amazon DynamoDB
…static content served by Amazon S3 and Amazon CloudFront
…dynamic content/business logic encoded as Lambda functions
What we need

• Search and browse ready-made apps
and samples
• Customize open source apps to get
started quickly
• Share apps privately or publically
•Monetize APIs using theAWS
Marketplace
• Powered by AWS Serverless
Application Model (AWS SAM)!
AWS Serverless Application Repository
(preview)
© 2017, Amazon Web Services, Inc. or its Affiliates.All rights reserved.

Lambda Function Editor
• Edit multiple files at once!
• Create new files for existing
packages
• Run tests and view results
and logs without leaving the
editor
• Save test inputs and reuse
them later

Serverless app benefits
Go from concept to working code in under 15 minutes. And
your app isn’t just a prototype…
• 1,000 concurrent executions by default.
• Every account in good standing is automatically
approved to 3X the default!

• 1,000 concurrent executions (10K
TPS) by default. Auto-approvals for
everyone to triple.
Faster perf with
cold-start
optimization!
Up to 80% reduction in start
times for larger functions

everyone to triple.
• Up to 80% faster cold start times
Built-in logging and
monitoring, now with:
“grab-n-go” logs in the
Lambda console

everyone to triple.
• Find Lambda logs instantly 1.5GB
3GB
Top memory size
of…

everyone to triple.
• Find Lambda logs instantly
• Top memory size of 3GB
Go
Serverless!

Next, Joe needs to make some changes.
Step 2: Customize and share
Need an IDE for local dev/test/debug
Customize the app we deployed in step 1
Set up a CI/CD pipeline for the team
Deploy (safely!)
What we need
to do

Easy-to-use IDE in the cloud
Builtin GitHub support
Builtin Lambda blueprint support
Builtin SAM Local:
Local testing!
IDE debugging!
Deploy directly to Lambda and/or push
updates to GitHub
New
AWS Cloud9

Automated CI/CD process
Git push your changes from Cloud9
when ready to share…
Set up an AWS CodePipeline to
build automatically on updates
Local Testing

I need to deploy Lambda functions
safely and incrementally.
Customer feedback
How can I deploy multiple
functions and APIs in a
coordinated way?
How do I roll back
automatically?
How can I shape traffic
between two versions of
an API?

Safe, incremental serverless deployment
Lambda: Weighted aliases
• Set percentage of traffic between two versions of the same
function
API Gateway: Sub-stages for incremental deployments
• Share traffic between two stages
AWS CodeDeploy: Automated support for safe serverless
deployments
• Amazon CloudWatch metrics-driven rollout/rollback

Another typical day…
Manager: “That app you built is working great, but now we need to
include data from a relational DB and one of our legacy services in our
VPC. Is your serverless architecture going to handle that?”
Developer “Not a problem.”

Next up: Deal with legacy stuff.
Step 3: Connect to enterprise
systems
Monitor concurrency
Limit concurrency for legacy connectivity
Hook up APIs to VPC-based services
Audit and log all invocations
What we need
to do

I need a way to protect the capacity of a
Lambda function from others running in
the same account.
Customer feedback
I want to temporarily disable
a function.
Can you create a “dev mode”
for functions?
Lambda can overwhelm
my legacy systems with
too many calls

I need a way to protect the capacity of a
Lambda function from others running in
the same account.
Customer Feedback
I want to temporarily disable
a function.
Can you create a “dev mode”
for functions?
Lambda can overwhelm
my legacy systems with
too many calls
Insight: Concurrency control is a key
element of managing functions in a
serverless app.

Lambda: Concurrency metric
Lambda: Per-function concurrency throttles
Enterprise connectivity
What you can do with it
1. Limit concurrency to legacy systems
2. Protect serverless production services from
other functions in the same account
3. Temporarily disable a function
4. Develop functions with limited billing and
“runaway” protection

VPC (PrivateLink) integrations
Access services and data in
your VPC from an API
Regional endpoints
Fast, region-specific API
endpoints
Enterprise connectivity: API Gateway

API Gateway connectivity solutions
To
From
Internet
Regional
AWS Service
Customer VPC
Internet
Regional
AWS Service
Existing Service
(Edge-optimized, public integrations)
Private VPC
Region-optimized Endpoints
Region Endpoints
+Private VPC
Recent
New

Log and audit
Structured logging for APIs
AWS CloudTrail support for
Lambda functions

Serverless for the enterprise: checklist
Uptime
Scale
Performance
Management
Safe deploys
Concurrency controls

What about GraphQL?

GraphQL
Open, declarative data-fetching specification
!= Graph database
Use NoSQL, Relational, HTTP, etc.
Traditional data-fetching GraphQL
/posts
/postInfo
/postJustTitle
/postsByAuthor
/postNameStartsWithX
/commentsOnPost

How does GraphQL work?
{
"id": "1",
"name": "Get Milk",
“priority": "1"
},
{
"id": “2",
"name": “Go to gym",
“priority": “5"
},…
type Query {
getTodos: [Todo]
}
type Todo {
id: ID!
name: String
description: String
priority: Int
duedate: String
}
query {
getTodos {
id
name
priority
}
}
Model data with
application schema
Client requests what it
needs
Only that data is
returned

GraphQL
Schema
type Event {
id: ID!
name: String
where: String
when: String
description: String
comments: [Comment]
}
type Comment {
commentId: String!
eventId: ID!
content: String!
createdAt: String!
}

GraphQL
Schema
Mutation
type Mutation {
createEvent(
name: String!,
when: String!,
where: String!,
description: String!
): Event
deleteEvent(id: ID!): Event
commentOnEvent(
eventId: ID!,
content: String!,
createdAt: String!
): Comment
}

GraphQL
Schema
Mutation
Query
type Query {
getEvent(id: ID!): Event
listEvents(
limit: Int,
nextToken: String
): EventConnection
}

GraphQL
Schema
Mutation
Query
Subscription
type Subscription {
subscribeToEventComments(eventId: String!): Comment
@aws_subscribe(mutations: ["commentOnEvent"])
}

GraphQL
Schema
Mutation
Query
Subscription
Realtime? YES
Batching? YES
Pagination? YES
Relations? YES
Aggregations? YES
Search? YES
Offline? YES

AWS AppSync
DynamoDB
Table
Lambda
Function Elasticsearch
Service
GraphQL
Schema
Upload
Schema
GraphQL
Query
Mutation
Subscription
Real-time
Offline
AppSync
API
Cognito
User Pool

AWS AppSync
DynamoDB
Table
Lambda
Service
GraphQL
Schema
Upload
Schema
GraphQL
Query
Mutation
Subscription
Real-time
Offline
AppSync
API
Cognito
User Pool
Legacy
Application

AWS AppSync
DynamoDB
Table
Lambda
Service
GraphQL
Schema
Upload
Schema
GraphQL
Query
Mutation
Subscription
Real-time
Offline
DynamoDB to Elasticsearch
Sync Function
AppSync
API
Cognito
User Pool

AWS AppSync
DynamoDB
Table
Lambda
Service
GraphQL
Schema
Autogenerate
Schema
GraphQL
Query
Mutation
Subscription
Real-time
Offline
AppSync
API
Cognito
User Pool

Serverless Aurora
Aut omat ically
scalescapacity up
and down
Pay per second
and only for t he
dat abase
capacit y youuse
St art supon
demandand
shut sdownwhen
not inuse
Noneedt o
provision
inst ances
On-demand, auto-scaling database for applications with unpredictable
or cyclical workloads
In preview today

Serverless for everything
Lambda and API Gateway in every commercial AWS Region +
AWS GovCloud
Lambda@Edge new features:
• Content-based Dynamic Origin Selection
• Network Calls from Viewer Events
• Advanced Response Generation

Serverless for everything
• Faster cold start performance
• Assurance programs: ISO, PCI, HIPAA
• …and now SOC 1, SOC 2, and SOC 3
• Lambda for devices (AWS Greengrass, AWS Snowball Edge)
• Lambda for Windows – CoreCLR 2.0

AWS LAMBDA IS EVERYWHERE
AWS Lambda Amazon S3 Amazon CloudFormation AWS IoT
Amazon API Gateway Amazon DynamoDB Amazon CloudWatch Logs AWS IoT Button
AWS Step Functions Amazon Kinesis Streams Amazon CloudWatch Events AWS Greengrass
AWS X-Ray Amazon Kinesis Firehose AWS CodeCommit AWS Snowball
Edge
Amazon SNS AWS Config AWS
Lambda@Edge
Amazon SES Amazon Lex
Amazon Cognito Amazon CloudFront
AWS IoT
AWS
Lambda
Event-driven services Event sources
Lambda
inside

Enterprises are achieving massive scale with Lambda
• Thomson Reuters processes 4,000 requests per second
• FINRA processes half a trillion validations of stock trades daily
• Hearst reduced the time to ingest and process data for its
analytics pipeline by 97%
• Vevo can handle spikes of 80x normal traffic
• Expedia triggers 1.2 billion Lambda requests each month

Customers innovating with AWS Lambda

An expanding Serverless ecosystem
Build and CI/CD
Logging and MonitoringApplications and Deployment
Chalice Framework Serverless Java Container

• Turn any Go program into a
Lambda function by adding 2
lines
• Open source connector
• Now available!
Golang in Lambda

@jrhunt
Thanks!

Serverless: State of The Union I AWS Dev Day 2018

More Related Content

Similar to Serverless: State of The Union I AWS Dev Day 2018 (20)

More from AWS Germany (20)

Recently uploaded (20)

Serverless: State of The Union I AWS Dev Day 2018