Basic architecuture and operation concept of Backlog and Cacoo
2 likes1,281 views
This document summarizes a presentation about operating services on AWS. It discusses the company Nulab's experience migrating the project management tool Backlog and diagramming tool Cacoo to AWS. The presentation covers basic architectures using services like EC2, RDS, and S3. It emphasizes automating infrastructure changes, implementing monitoring, and designing for failure through techniques like running in multiple availability zones. The goal is not to avoid failures but to enable quickly recovering from them. AWS is said to provide flexibility to change infrastructure easily as services grow and allows even small teams to provide globally-used services.
Basic architecuture and operation concept of Backlog and Cacoo
- 1. Basic architecuture and operation concept of and 2013.05.09(thr) Takashi SOMEDA
- 2. Takashi SOMEDA AWS User Group Singapore 1st Meetup http://twitter.com/tksmd Nulab, Inc. Technology Evangelist JAWS UG Kyoto Branch leader About me http://facebook.com/takashi.someda
- 3. AWS User Group Singapore 1st Meetup My favorite http://en.clouddesignpattern.org/index.php/Main_Page About CDP AWS Service CDP
- 4. AWS User Group Singapore 1st Meetup My career Sun Microsystems (acquired by Oracle) Benchmark Engineer Exploratory IT Human Resources Project ( MITOH Program ) Freelance Engineer Synergy Marketing, Inc. Technology Researcher Choistudio, Inc. CTO Nulab, Inc. Engineer / Evangelist 2002 2005 2006 2008 2010
- 6. AWS User Group Singapore 1st Meetup Backlog is a project management tool used by 145,000 users mainly in Japan. In addition to issue management feature, Backlog provides • File sharing by WebDAV • Git and Subversion repository hosting. 2 years ago, we increased available capacity up to 30 times while the price was not raised.
- 7. 840,000 users around the world draw wireframes, network diagrams, business plans etc on Cacoo. Cacoo provides basic functionality as a draw tool and powerful collaborative features like • Simultaneous Editing on same diagram by multiple users • Tightly integration with Google+ Hangouts that enables users to edit diagrams while Video chatting.
- 8. Nulab & AWS Oct. 2010 Cacoo launched Sep. 2010 Started migrating Backlog to AWS Apr. 2011 Renewal of plan ( completely migrated ) Nov. 2011 backlogtool.com launched Apr. 2012 Cacoo for Google+ Hangouts started AWS User Group Singapore 1st Meetup We’re now developing brand new service ! It will be unveiled on Summer 2013. Please follow us on twitter @nulabinc.
- 11. Ops Team AWS User Group Singapore 1st Meetup 2010/10 2011/10 2012/10 2013/05 Backlog :38,000users Cacoo:62,000users Backlog :62,000users Cacoo:200,000users Backlog :110,000users Cacoo:600,000users Backlog :145,000users Cacoo:840,000users
- 12. Agenda AWS User Group Singapore 1st Meetup Basic Architecture Action First Automation Monitoring Design for failure Summary
- 14. Backlog AWS User Group Singapore 1st Meetup
- 15. Cacoo AWS User Group Singapore 1st Meetup
- 16. AWS services we use AWS User Group Singapore 1st Meetup
- 17. AWS User Group Singapore 1st Meetup Do you have an experience to operate a service stored data size of which is 1〜2TB.
- 18. We love RDBMS AWS User Group Singapore 1st Meetup
- 19. Running on LVM AWS User Group Singapore 1st Meetup RAID0 Striping
- 20. Working with partition AWS User Group Singapore 1st Meetup
- 21. AWS User Group Singapore 1st Meetup Keep Simple Be careful which AWS services to use. Don‟t choose No-SQL storage just because you want to be a cloud guy. Data store you selected affects both development and operation process.
- 22. Action First http://www.flickr.com/photos/83633410@N07/7658268052/in/photostream/
- 23. AWS User Group Singapore 1st Meetup
- 24. AWS User Group Singapore 1st Meetup
- 25. AWS User Group Singapore 1st Meetup Value first Don‟t prepare too much for uncertain future. Infrastructure CAN be fit to a service afterward. The most important thing is to deliver “value” to users.
- 27. fabric AWS User Group Singapore 1st Meetup @task @roles(„app‟) def all_release(): sudo(“service tomcat stop”) put(“new.war”,”/tmp/new.war”) run(“cp –p /tmp/new.war /webapps/ROOT.war”) sudo(“service tomcat start”) @task @hosts(„web01‟,‟web02‟,‟mail01‟,‟mail02‟) def fluent_agent_reload(): sudo("/etc/init.d/fluent-agent-lite reload") http://fabfile.org/ # install by pip $ pip install Fabric # execute task $ fab app.all_release
- 28. cuisine AWS User Group Singapore 1st Meetup def install(): if file_exists('/usr/local/fluent-agent-lite/bin/fluent-agent-lite'): return with mode_sudo(): with cd('/usr/local/src'): run('wget https://github.com/downloads/tagomoris/fluent-agent-lite/fluent- agent-lite.v0.6.tar.gz') run('tar zxvf fluent-agent-lite.v0.6.tar.gz') with cd ('fluent-agent-lite'): run('./bin/install.sh‟) https://github.com/sebastien/cuisine
- 29. fabric/cuisine AWS User Group Singapore 1st Meetup With boto ( python SDK ), you can do various operations. cuisine helps you to build environment like chef. Simple! Simple! Simple!
- 30. AWS User Group Singapore 1st Meetup Staging & Deploy
- 31. Automation! Automation! AWS User Group Singapore 1st Meetup For everyone to be able to operate easily. Automation itself is NOT a goal.
- 33. Monitoring Stack AWS User Group Singapore 1st Meetup
- 34. Daily Monitoring AWS User Group Singapore 1st Meetup
- 35. Log mangement AWS User Group Singapore 1st Meetup
- 36. Monitoring AWS User Group Singapore 1st Meetup Add monitoring point to detect failure in the future. Tools call us when they find something wrong. Keep monitoring working well.
- 38. Multiple AZ AWS User Group Singapore 1st Meetup
- 39. Multiple AZ AWS User Group Singapore 1st Meetup You should monitor network connectivity between the instances on other AZ. Fortunately, we have not experienced AZ failure yet. We don‟t experience network latency between AZ so far.
- 40. Multi tenancy AWS User Group Singapore 1st Meetup
- 41. Multi tenancy AWS User Group Singapore 1st Meetup It is quite well that the impact of failure is limited. You might need extra-effort to integrate other services. For business or personal use
- 42. If service failure happen AWS User Group Singapore 1st Meetup Your website should be running on other AZ/region than production environment.
- 44. Design Basics AWS User Group Singapore 1st Meetup We focus on NOT decreasing failures BUT building process to recover quickly after failure happens.
- 45. What AWS brings to us ?! AWS User Group Singapore 1st Meetup Flexibility that enables us to change infrastructure quite easily corresponding to service growth afterward.
- 46. What AWS brings to us ?! AWS User Group Singapore 1st Meetup Giving huge power that enables even a small team to provide a service used around the world.
- 47. AWS User Group Singapore 1st Meetup Thanks!! Any Questions ?!