EC2 and S3 Level 100
Download as PPTX, PDF0 likes266 views
The document provides information about AWS services including EC2, S3, and CloudFront. It discusses EC2 instance types, pricing models, and storage options. It describes S3's 99.999999999% durability, storage tiers including standard, infrequent access, and glacier, and encryption options. CloudFront is introduced as a CDN that caches content at edge locations to improve distribution.
EC2 and S3 Level 100
- 2. Agenda • AWS Global Infrastructure • AWS EC2 (Elastic Compute Cloud) • S3 (Simple Storage Services)
- 4. AWS EC2 (1 of 6) • Elastic Compute Cloud (EC2): – Web service that provides secure, resizable compute capacity in the cloud. It is designed to make web-scale cloud computing easier. – Amazon EC2 reduces the time required to obtain and boot new server instances to minutes. – Amazon EC2 changes the economics of computing by allowing you to pay only for capacity that you actually use.
- 5. AWS EC2 (2 of 6) EC2 instances (OnDemand – Reserved – On Spot - Dedicated): 1. On Demand: – Pay as you go as fixed rate per hour(Windows)/second(Linux) with no commitment. – Application has unpredictable behavior. – Application cannot be interrupted. 2. Reserved: Reserve your instance capacity in advance with a significant discount for 1 – 3 years contract. – Application has predictable behavior. – Standard RI (up to 75% off On-Demand) – Convertible RI (up to 54% off On-Demand) – change the instance attributes with equal or greater values. – Scheduled RI to be launched in a predefined time window within a (day/week/month)
- 6. AWS EC2 (3 of 6) EC2 instances (OnDemand – Reserved – On Spot - Dedicated): 3. Scheduled Instances: – Purchase instances that are always available on the specified recurring schedule, for a one-year term. 4. On Spot: – Bid for the price of your instance capacity providing a massive savings if your application has flexible start and end date. – Large amount of data processing. – Afford losing your instances any time.
- 7. AWS EC2 (4 of 6) EC2 instances (OnDemand – Reserved – On Spot - Dedicated): 3. Dedicated host: – Physical machine will be dedicated for you, not shared with any other customers. Allowing the use of existing licenses. – Can be purchased as on-Demand or Reserved. 4. Dedicated Instances: – Pay by the hour, for instances that run on single-tenant hardware. – May share hardware with other instances from the same AWS account that are not Dedicated instances.
- 8. AWS EC2 (5 of 6) EC2 instance Types General purpose t 8 32 EBS only - Moderate General purpose m 2 8 EBS only Yes Up to 10 Gigabit Compute optimized c 36 60 EBS only Yes 10 Gigabit FPGA instances f 64 976 4 x 940 (SSD) Yes 25 Gigabit GPU instances g 32 60 2 x 120 (SSD) - 10 Gigabit GPU compute p 64 488 EBS only Yes 25 Gigabit Memory optimized r 64 488 EBS only Yes 25 Gigabit Memory optimized x 128 1952 2 x 1920 (SSD) Yes 25 Gigabit Storage optimized d 36 244 24 x 2048 Yes 10 Gigabit Storage optimized i 4 30.5 1 x 800 (SSD) Yes Moderate Storage optimized h 64 256 8 x 2000 Yes 25 Gigabit EBS- Optimized Available Network PerformanceFamily Type vCPUs Memory (GiB) Instance Storage (GB)
- 9. AWS EC2 (6 of 6) Amazon Machine Image(AMI) Instance store (Ephemeral Storage) – CAN NOT stop instance (either reboot or terminate). – CAN NOT detach the instance volume. – Root device is created from template stored in S3. – If the host fails, you will lose your data. EBS backed volume: – Stop/Start/Reboot/Terminate. – Can detach the volume and attach it to another instance. – Root device is launched from EBS snapshot. – You can keep the root volume after termination.
- 10. AWS EBS types Solid State Drives (SSD) Hard Disk Drives (HDD) General purpose - GPs Provisioned IOPS - IO1 Throughput Optimized –ST1 Cold Storage - SC1 Magnatic - Standard Balances price performance for a wide variety of transactional workloads. Designed for latency- sensitive transactional workloads Designed for frequently accessed, throughput intensive workloads Designed for less frequently accessed workloads Designed for infrequent accessed data Boot volumes I/O-intensive NoSQL & RDS (Boot volumes) Big data, DWH, log processing Colder data requiring fewer scans per day Boot volumes Max IOPS 10,000/volume Max IOPS 32,000/volume Max IOPS 500/volume Max IOPS 250/volume Max IOPS 40/volume $0.10/GB-month $0.125/GB-month $0.065/provisioned IOPS $0.045/GB-month $0.025/GB- month $0.05/GB-month $0.05/million I/O
- 12. DEMO
- 13. S3 – Is an object storage (files) built to store and retrieve any amount of data from anywhere. – Not suitable for operating systems. – Provides secure, store, and analyze the data at a massive scale. – Running powerful analytics directly on data at rest in S3. – The data spread across multiple devices and facilities. – Key-value store: • Key: object name • Value: data as sequence of bytes. • Version ID, Metadata.
- 14. S3 Characteristics – It is designed to deliver 99.999999999% durability (11 nines). – It is designed to deliver 99.99 availability (guarantee SLA 99.9). – Files from 0 bytes to 5 TB. – Files more than 100 MB Use multipart upload (APIs). – Files stored in Buckets. – S3 bucket is a universal namespace – names must be unique https://s3.amazonaws.com/aws.saudi.ug/ – Successful upload file to S3 will be responded with HTTP 200 code. – Read after write consistency for PUTS of new objects. – Eventual Consistency for overwrite PUTS and DELETES (propagation delay).
- 15. S3 Storage tiers/classes (1 of 2) S3: – 99.99% availability and 99.999999999% durability, stored redundant across multiple devices in multiple facilities and designed to sustain the concurrent loss of data in two facilities. S3 IA (Infrequent Access): – For data that is accessed less frequently, but requires rapid access when needed. – A low per GB storage price and per GB retrieval fee. – offers 99.9% availability SLA and 99.999999999% durability. S3 One-Zone IA (Infrequent Access): – Store objects redundantly in a single availability zone. – 20% less cost than geographically redundant S3-IA. – offers 99% availability SLA and 99.999999999% durability.
- 16. S3 Storage tiers/classes (2 of 2) Intelligent-Tiering: – Access patterns are difficult to learn. – Automatic cost savings (frequent access, infrequent access). – No retrieval fees. – 99.9% availability and 99.999999999% durability. (thumbnail case). Glacier: – Low-cost storage for data archival , Longer time for data retrieval (3-5 hours). – $0.004 per gigabyte per month (10GB data per month for free). – minimum of 90 days of storage. Glacier (Deep Archive): – accessed once or twice in a year – $0.00099 per GB-month
- 17. S3 Encryption (1 of 2) In Transit: – SSL/TLS At Rest: – Use Client-Side Encryption: Encrypt your object before saving it on disks – Use Server-Side Encryption: • S3-Managed Keys (SSE-S3): – Object is encrypted with a unique key – It encrypts the key itself with a master key • AWS KMS-Managed Keys (SSE-KMS): – Use of an envelope key. – Audit trail of when your key was used and by whom – Have the option to create and manage encryption keys yourself
- 18. S3 Encryption (2 of 2) – Customer-Provided Keys (SSE-C): • Encrypt data client-side and upload the encrypted data to Amazon S3 • With the encryption key you provide as part of your request • Amazon S3 manages both the encryption • The only thing you do is manage the encryption keys you provide • Amazon S3 does not store the encryption key you provide. Instead, we store a randomly salted HMAC value of the encryption key • If you lose the encryption key any GET request for an object without its encryption key will fail, and you lose the object
- 19. CloudFront • A web service that speeds up distribution of your static and dynamic web content, such as .html, .css, .js, and image files, to your users. • CloudFront delivers your content through a worldwide network of data centers called edge locations (NOT Region/NOT AZ). • Works with AWS and non-AWS origins. • Edge Location: – Location where the contents will be cached . • Origin: – Files which CDN will distribute (EC2, HTTP, S3, Load Balancer, ….etc) • Distributions: – Web : for website – RTMP : for media streaming
- 20. CloudFront • It is read/write service. • Objects have TTL (time to live). • You can flush your distributions, however you will be charged. • Regional edge caches are CloudFront locations that are deployed globally. • Located between your origin server and the global edge locations that serve content directly to viewers. • Regional edge caches are used for custom origins, but not Amazon S3 origins. • Dynamic content, as determined at request time, does not flow through regional edge caches, but goes directly to the origin.
- 21. CloudFront
- 23. DEMO
- 26. See You Next Meetup AWS Riyadh User Group
Editor's Notes
- #12: Elevate the user: >sudo su >yum update –y >yum install httpd –y >cd /var/www/html >service httpd start
- #27: You can safely remove this slide. This slide design was provided by SlideModel.com – You can download more templates, shapes and elements for PowerPoint from http://slidemodel.com