YOOXlabTechEvent: How Cloud helps Innovation
- 2. THE LANDSCAPE HAS CHANGED The Cloud landscape has changed, from simple infrastructure solution to platform as a service, abstracting many layers of complexity within a reliable framework. Cloud services are the best choice to • Focus on design challenges • Experiment continuously • Innovate at speed • Test Learn Adapt • Measure everything • Affordable • Immediately available • Provide sufficient abstraction • Flexible / Scalable • Accessible / based on standards
- 3. EMBRACE THE CLOUD • Team DevOps mindset • Discovery / Experiment approach • Operate on full software stack • Immediate deploy Æ changes measured in minutes • Speed up the Development Pipeline
- 4. THE PIPELINE Development Tools/IDE Cloud9 Codeanywhere IntelliJ IDEA Visual Studio Notepad / VI SCM Github Bitbucket AWS CodeCommit VisualSVN Server Git / Mercurial on premise CI / Deployment Travis-CI AWS Code Deploy AppVeyor TeamCity Jenkins Production environments AWS Elastic Beanstalk Heroku AppHarbor InHouse servers
- 6. MACHINE LEARNING IN CLOUD Requirements • 0 provisioning time • Low/No effort in infrastructure management • Optimized infrastructure uptime • One-click scaling out Results • 1 TB logs • 25 min processing time
- 7. PARALLEL PROCESSING: BACKGROUND Æ #FFFFFF • 6 nodes EC2 • 100 processes per node • 37 million files processed • Exec time 3,5 hours • no manually-handled errors • Logs and stats EC2 instances RDS DB Instance Amazon S3 • Input files • Output files • Code repository Amazon SQS • Job repository Challenge: change the background of all the product images in yoox.com from grey to white
- 8. PARTICLE PHOTON OVERVIEW THE BEGINNING…