MidLink - re:Invent 2018 meetup presentation - new amazon s3 features
- 1. Itay Tal| itay@midlink.co.il | 054-481-5445
- 2. I work for MidLink by EMET as DevOps team leader www.midlink.co.il
- 3. S3 S3 storage classes S3 Intelligent Tiering (A new storage class) Batch Operations for Object Management AWS Transfer for SFTP in S3
- 4. Amazon Simple Storage Service (Amazon S3) is an object storage service that offers industry-leading scalability, data availability, security, and performance. Industry-leading performance, scalability, availability, and durability Unmatched security, compliance, and audit capabilities
- 5. Common use cases: • backup and restore of AWS services • Disaster recovery (DR) • Archive • Data lakes and big data analytics Cloud-native application data
- 6. Common use cases: • S3 Standard • S3 Standard-Infrequent Access • Amazon S3 Glacier
- 7. cycle policies S3 IT AWS DevOps user
- 8. allows automatic optimization of storage costs while at the same time removing a level of administration. • 99.9% availability • 99.999999999% durability • Price: $0.0025 per 1,000 objects
- 9. The small details: • minimum eligible object size of 128KB for auto-tiering. 1. If you put objects in IA smaller than 128 KB it will be charged as 128 KB 2. If you put objects in IT smaller than 128 KB it will be charged as frequent access. • S3 Intelligent-Tiering are charged for a minimum storage duration of 30 days • PUT, COPY, POST, LIST, GET, SELECT requests costs like standard tier.
- 11. Use cases: • Copy 300 TB between buckets • Retain from glacier big amount of files • Tagging all my objects for lifecycle policies • Standardize formats • Change ACL • Encrypt existing objects (using copy) • Rearrange the prefixes
- 12. Features: • Completion report • Automatic retries • Scalability • Progress visibility • Cloudwatch >>> Sns • Priorities
- 13. 1. Choose objects a) Inventory b) Csv 2. Choose action (built in or lambda) 3. priority 4. View progress + completion report Regional !!!
- 15. • Migrate your Secure Shell File Transfer Protocol (SFTP) to AWS without needing to modify your applications or manage any SFTP servers • Use S3 as a storage for the SFTP instead of a limited space local storage • integrating with existing authentication systems • No SFTP servers to manage
- 17. Pricing: • $0.30 per hour • $0.04 per gigabyte (GB) transferred
- 19. Itay Tal| itay@midlink.co.il | 054-4815445