AWS Summit Seoul 2015 - AWS 최신 서비스 살펴보기 - Aurora, Lambda, EFS, Machine Learning, ECS
8 likes5,777 views
The document discusses a paradigm shift towards cloud-first solutions, emphasizing the adoption of AWS services for improved resource allocation and customer focus. It outlines the integration of various AWS tools such as EC2, Lambda, and Aurora to enhance scalability, availability, and application management. The content highlights the challenges of traditional IT setups and how containerization, microservices, and machine learning can optimize businesses' operational efficiency.
![Simulate failures using SQL
• To cause the failure of a component at the database node:
ALTER SYSTEM CRASH [{INSTANCE | DISPATCHER | NODE}]
• To simulate the failure of disks:
ALTER SYSTEM SIMULATE percent_failure DISK failure_type IN
[DISK index | NODE index] FOR INTERVAL interval
• To simulate the failure of networking:
ALTER SYSTEM SIMULATE percent_failure NETWORK failure_type
[TO {ALL | read_replica | availability_zone}] FOR INTERVAL interval](https://image.slidesharecdn.com/1-150427052001-conversion-gate01/85/AWS-Summit-Seoul-2015-AWS-Aurora-Lambda-EFS-Machine-Learning-ECS-58-320.jpg)
AWS Summit Seoul 2015 - AWS 최신 서비스 살펴보기 - Aurora, Lambda, EFS, Machine Learning, ECS
- 1. Seoul
- 2. 신규 서비스 살펴보기 Thomas Park Head of Solutions Architecture, Korea
- 3. What if you could devote 30% more of your resources to your customers?
- 4. IT Map - Traditional IT E-mail, Productivity, Collaboration, HR, Finance, ERP Desktop Support, Device Management, Telephony, IT Support Information Security, CISO Encryption, Key Management, Identity Management, Firewalls, IDS, DDoS Business Applications Digital Products, Brand Websites, Mobile Applications, Point of Sale Systems, Commerce Corporate Applications End User Computing Infrastructure Servers, Storage, Networking, Databases, Data Warehousing, Data Centers
- 5. IT Map - Traditional IT with AWS Information Security, CISO Corporate Applications End User Computing Infrastructure Business Applications AWS Elastic Beanstalk, AWS Lambda, Amazon SQS, Amazon SNS, Amazon Mobile Analytics, Amazon CloudFront Amazon WorkMail, Amazon WorkDocs, AWS Marketplace, AWS Directory Service, SaaS Amazon WorkSpaces, Amazon AppStream, AWS Marketplace, AWS Mobile Services, SaaS AWS Identity and Access Management (IAM), AWS CloudHSM, AWS Key Management Service (AWS KMS), Security Groups, AWS Marketplace Amazon EC2, Amazon S3, Amazon RDS, Amazon VPC, Amazon Direct Connect, Directory Service, IAM, AWS Service Catalog
- 7. IT Map - A Cloud-First Tomorrow Information Security, CISO Business Applications DevOps Corporate Applications End User Computing AWS Elastic Beanstalk, AWS Lambda, Amazon SQS, Amazon SNS, Amazon Mobile Analytics, Amazon CloudFront Amazon WorkMail, Amazon WorkDocs, AWS Marketplace, AWS Directory Service, SaaS Amazon WorkSpaces, Amazon AppStream, AWS Marketplace, AWS Mobile Services, SaaS Amazon EC2, Amazon S3, Amazon RDS, Amazon VPC, Amazon Direct Connect, Directory Service, IAM, AWS Service Catalog, AWS Code Services AWS Identity and Access Management (IAM), AWS CloudHSM, AWS Key Management Service (AWS KMS), Security Groups, AWS Marketplace
- 9. • Service-Oriented Architecture (SOA) • Everything gets a service interface • Primitives • “Microservices”
- 10. • Decentralized • Two-pizza teams • Agility, autonomy, accountability, and ownership • “DevOps”
- 12. • Deployment service • Zero downtime • Health checking • Versioned artifacts & rollbacks
- 13. • Continuous delivery • From check-in to production • CI/CD + release automation • >90% of teams Pipelines
- 14. DevOps Pipeline Source Developers commit changes Build Changes are built and unit tested Staging Code deployed to staging and load/UI tested Production Code is deployed to production Changes, Updates, and Fixes Ideas, Requests, and Bugs Developers Customers
- 15. = 50 million deployments a year Thousands of teams + Microservices architecture + Multiple environments + Continuous delivery
- 17. AWS Code services CodeCommit Private Beta CodePipeline Private Beta CodeDeploy Launched
- 18. What about the infrastructure?
- 19. Amazon EC2 Container Service
- 20. What are containers? • OS virtualization • Process isolation • Automation • ImagesServer Guest OS Bins/Libs Bins/Libs App2App1
- 22. Common Customer Challenges/Desires • Cluster Management • Configuration Management • Availability • Scalability (application and repository) • Scheduling • Monitoring • AWS integration – VPC, ELB, Auto Scaling, CloudWatch, etc.
- 24. Amazon EC2 Container Service • Building Block Service • Cluster Management Made Easy • Flexible Scheduling • Performance at Scale • Security • Extensible
- 25. AWS Lambda
- 26. Amazon S3 Bucket Events Original image Thumbnailed image 1 2 3 Application Monitoring Security Deploy
- 27. Yes, you can do with EC2 instances… Amazon S3 Bucket Events Original image Thumbnailed image 1 2 3 Application Monitoring Security Deploy High Availability Scalability
- 29. PUT Original GET PUT Thumbnail Application Monitoring Security Deploy An event-driven computing service for dynamic applications High Availability Scalability
- 30. What is AWS Lambda? AWS Lambda is a compute service that runs your code in response to events such as image uploads, in-app activity, website clicks, or outputs from connected devices.
- 31. Data Triggers: Amazon S3 Amazon S3 Bucket Events AWS Lambda Original image Thumbnailed image 1 2 3
- 33. Three types of data-driven development Retrospective analysis and reporting Here-and-now real-time processing and dashboards Predictions to enable smart applications Amazon Kinesis Amazon EC2 AWS Lambda Amazon Redshift, Amazon RDS Amazon S3 Amazon EMR
- 34. Machine learning and smart applications Machine learning is the technology that automatically finds patterns in your data and uses them to make predictions for new data points as they become available Your data + machine learning = smart applications
- 35. Building smart applications – a counter-pattern Dear Thomas, This awesome quadcopter is on sale for just $49.99!
- 36. Smart applications by counter-example SELECT c.ID FROM customers c LEFT JOIN orders o ON c.ID = o.customer GROUP BY c.ID HAVING o.date > GETDATE() – 30 We can start by sending the offer to all customers who placed an order in the last 30 days
- 37. Smart applications by counter-example SELECT c.ID FROM customers c LEFT JOIN orders o ON c.ID = o.customer GROUP BY c.ID HAVING AND o.date > GETDATE() – 30 … let’s narrow it down to just customers who bought toys
- 38. Smart applications by counter-example SELECT c.ID FROM customers c LEFT JOIN orders o ON c.ID = o.customer GROUP BY c.ID HAVING o.category = ‘toys’ AND (COUNT(*) > 2 AND ) … and expand the query to customers who purchased other toy helicopters recently
- 39. Smart applications by counter-example SELECT c.ID FROM customers c LEFT JOIN orders o ON c.ID = o.customer GROUP BY c.ID HAVING o.category = ‘toys’ AND (COUNT(*) > 2 AND SUM(o.price) > 200 AND o.date > GETDATE() – 30) ) Use machine learning technology to learn your business rules from data!
- 40. Why aren’t there more smart applications? 1. Machine learning expertise is rare 2. Building and scaling machine learning technology is hard 3. Closing the gap between models and applications is time-consuming and expensive
- 41. Introducing Amazon Machine Learning Easy to use, managed machine learning service built for developers Robust, powerful machine learning technology based on Amazon’s internal systems Create models using your data already stored in the AWS cloud Deploy models to production in seconds
- 42. Explore and understand your data
- 44. Batch predictions with Amazon Redshift Structured data In Amazon Redshift Load predictions into Amazon Redshift -or- Read prediction results directly from S3 Predictions in S3 Query for predictions with Amazon ML batch API Your application
- 45. Real-time predictions for interactive applications Your application Query for predictions with Amazon ML real-time API
- 46. Unconstrained Big Data Growth • IT/Application server logs IT Infrastructure logs, Metering, Audit logs, Change logs • Websites/Mobile apps/Ads Clickstream, User Engagement • Sensor data/IoT Weather, Smart Grids, Wearables • Social media, user content 450MM+ Tweets/day GB TB PB ZB EB
- 49. Current DB architectures are monolithic Multiple layers of functionality all on a single box SQL Transactions Caching Logging
- 50. Current DB architectures are monolithic Even when you scale it out, you’re still replicating the same stack SQL Transactions Caching Logging SQL Transactions Caching Logging Application
- 51. Current DB architectures are monolithic SQL Transactions Caching Logging SQL Transactions Caching Logging Storage Application Even when you scale it out, you’re still replicating the same stack
- 52. This is a problem. For cost. For flexibility. And for availability.
- 53. Reimagining the relational database What if you were inventing the database today? You wouldn’t design it the way we did in 1970. At least not entirely. You’d build something that can scale out, that is self-healing, and that leverages existing AWS services.
- 54. Amazon Aurora is Easy to Use Amazon RDS Aurora
- 55. Aurora storage • Highly available by default – 6-way replication across 3 AZs – 4 of 6 write quorum • Automatic fallback to 3 of 4 if an AZ is unavailable – 3 of 6 read quorum • SSD, scale-out, multi-tenant storage – Seamless storage scalability – Up to 64 TB database size – Only pay for what you use • Log-structured storage – Many small segments, each with their own redo logs – Log pages used to generate data pages – Eliminates chatter between database and storage SQL Transactions AZ 1 AZ 2 AZ 3 Caching Amazon S3
- 56. Self-healing, fault-tolerant • Lose two copies or an AZ failure without read or write availability impact • Lose three copies without read availability impact • Automatic detection, replication, and repair SQL Transactio n AZ 1 AZ 2 AZ 3 Caching SQL Transactio n AZ 1 AZ 2 AZ 3 Caching Read and write availabilityRead availability
- 57. Survivable caches • We moved the cache out of the database process • Cache remains warm in the event of a database restart • Lets you resume fully loaded operations much faster • Instant crash recovery + survivable cache = quick and easy recovery from DB failures SQL Transactions Caching SQL Transactions Caching SQL Transactions Caching Caching process is outside the DB process and remains warm across a database restart
- 58. Simulate failures using SQL • To cause the failure of a component at the database node: ALTER SYSTEM CRASH [{INSTANCE | DISPATCHER | NODE}] • To simulate the failure of disks: ALTER SYSTEM SIMULATE percent_failure DISK failure_type IN [DISK index | NODE index] FOR INTERVAL interval • To simulate the failure of networking: ALTER SYSTEM SIMULATE percent_failure NETWORK failure_type [TO {ALL | read_replica | availability_zone}] FOR INTERVAL interval
- 59. Amazon Elastic File System (EFS)
- 60. Operating shared file storage today is a pain Application owner or developer IT administrator Business owner • Estimate demand • Procure hardware • Set aside physical space • Set up and maintain hardware (and network) • Manage access and security • Provide demand forecasts/business case • Add lead times and extra coordination to your schedule • Limit your flexibility and agility • Make up-front capital investments, over-buy, stay on a constant upgrade/refresh cycle • Sacrifice business agility • Distract your people from your business’s mission
- 61. We focused on changing the game EFS is simple EFS is elastic EFS is scalable 1 2 3
- 62. EFS is simple • Fully managed – No hardware, network, file layer – Create a scalable file system in seconds! • Seamless integration with existing tools and apps – NFS v4—widespread, open – Standard file system semantics – Works with standard OS file system APIs • Simple pricing = simple forecasting 1
- 63. EFS is elastic • File systems grow and shrink automatically as you add and remove files • No need to provision storage capacity or performance • You pay only for the storage space you use, with no minimum fee 2
- 64. • File systems can grow to petabyte scale • Throughput and IOPS scale automatically as file systems grow • Consistent low latencies regardless of file system size • Support for thousands of concurrent NFS connections EFS is scalable3
- 65. Cloud Has Become The New Normal
- 66. Infrastructure Regions Points of PresenceAvailability Zones Core Services Storage (Object, Block and Archival) Compute (VMs, Auto-scaling and Load Balancing) Databases (Relational, NoSQL, Caching) Networking (VPC, DX, DNS) CDN Access Control Usage Auditing Monitoring and Logs Administration & Security Key Storage Identity Management Platform Services Deployment & Management One-click web app deployment Dev/ops resource management Resource Templates Push Notifications Mobile Services Mobile Analytics Identity Sync App Services Workflow Transcoding Email Search Queuing & Notifications App streaming Analytics Hadoop Data Pipelines Data Warehouse Real-time Streaming Data Enterprise Applications Virtual Desktops Collaboration and Sharing More Functionality Than Any Other Infrastructure Provider
- 67. What if you could devote 30% more of your resources to your customers?
- 69. PLACE