From the course: AWS Certified Data Engineer Associate (DEA-C01) Cert Prep

Unlock this course with a free trial

Join today to access over 24,700 courses taught by industry experts.

Using Amazon EFS with AWS Lambda

Using Amazon EFS with AWS Lambda

From the course: AWS Certified Data Engineer Associate (DEA-C01) Cert Prep

Start my 1-month free trial Buy for my team

Using Amazon EFS with AWS Lambda

“

- [Instructor] The execution environments for Lambda functions by default only have temporary ephemeral storage. So each execution of a Lambda function has its own separate storage, which is destroyed at the end of the function execution. But what if you want multiple concurrent Lambda executions to work on the same data? In this lesson, we'll describe how a good solution for this scenario is to use EFS. Amazon EFS is a file system service that can be shared amongst compute resources such as multiple EC2 instances, containers, and even Lambda functions. And when you configure a Lambda function, you can specify that Lambda automatically attach an elastic file system to each execution environment. Lambda manages the connection and encrypts all traffic to and from the file system. This is great because the EFS file system is then shared across the Lambda functions as it scales up the number of concurrent executions. As files are written by one instance of a Lambda function, all other…

Contents