The Effort of Rakuten for A Distributed Key- Value Store "ROMA" in Ruby. GUI change Key-Value Store
5 likes3,114 views
The document presents an overview of Rakuten's distributed key-value store 'Roma,' developed in Ruby, highlighting its architecture and functionalities. It discusses Rakuten's global operations, development practices, and the introduction of a GUI tool named Gladiator for managing Roma, which simplifies cluster control and configuration. The document emphasizes the importance of agile methodologies and continuous development within Rakuten's tech teams.
The Effort of Rakuten for A Distributed Key- Value Store "ROMA" in Ruby. GUI change Key-Value Store
- 1. "The Effort of Rakuten for A Distributed Key- Value Store "ROMA" in Ruby. - GUI change Key-Value Store“ - Vol.01 Nov/13/2014 Hiroaki Iwase, Bando rui Global Operations Department, Rakuten Inc. http://roma-kvs.org Ruby World Conference 2014
- 2. 2 Agenda 1. What’s about Rakuten? 2. Rakuten’s development style 3. ROMA 4. Gladiator
- 3. 3 Rui Bando Engineer & Scrum Master Twitter : @banrui Career 2011.3 Graduate from Waseda Univ. M.A Program in Journalism 2011.4 Rakuten, Inc. 2011.8 New Service Development 2014.1 Global Operations Department (Current Team) Self introduction
- 4. 4 1. What’s about Rakuten?
- 5. Rakuten,Inc. Founded: February 7, 1997 IPO: April 19, 2000 (JASDAQ Stock Exchange) Office: Rakuten Tower (Tokyo, Japan) Employees: 10,867 (as of Dec. 2013) Market Cap: JPY 2,332 Billion (as of Jan 17, 2014)
- 6. 6 Rakuten Group Internet Services (1997) (2003) (2006) (2007) (2010) in USA EC in France (2009) (2004) (2008) (2008) (2011) EC in UK EC inAustria In Indonesia in Brazil (2005) (2009) EC In Thailand (2010) Internet Finance (2001)(2000) (2005) In Germany (2012) EC in Malaysia (2013) (2013) In Spain EC In Singapore EC In Japan Online Books, DVD Store Online Hotel Reservation Pay-per-view Video Service Portal Site Performance Marketing In USA Internet Research Internet Auction EC in Taiwan Global eBook Global Video streaming Global Video Streaming Global Social Messaging App Online Security Brokerage Credit Card E-moneyInternet Banking Rakuten Life Insurance IP Telephony Professional Baseball Marriage Consultant 1997 2014 (2014) Credit Card Payment By Smartphone (2012) Point Service (2013) Phone Service Online Golf Reservation Others Energy Service Real Café Service Curation Service Over 40 different services
- 8. About Rakuten Ichiba in Japan http://global.rakuten.com/corp/about/strength/data.html
- 9. About Rakuten Ichiba in Japan http://global.rakuten.com/corp/about/strength/data.html
- 10. About Rakuten Ichiba in Japan
- 11. Global Business
- 12. Rapidly Expanding Worldwide from 2010 English-nization/ Globalization. Global Expansion
- 13. Expanding Business Por>olio Taiwan 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014
- 14. Global Expansion E-Commerce eBook Travel Other services & businesses Rakuten Institute of Technology Development center Head Office / Regional Headquarters Head Office • E-commerce in 14 countries and regions • All services and businesses in 28 countries
- 15. 15 2. Rakuten’s development style
- 16. 16 I do not know…
- 17. 17 We have many services and teams !!
- 18. Our Development Environment ✔️ Global ✔️ Service ✔️ Employee（DEV） ✔️ Repositories 28 countries Over 40 services Over 1300 members Over 9500 repos
- 20. 20 Our Team Scrum Master Engineer In Paris Product Owner Product Owner
- 21. 21 But… We are Engineer !!
- 22. 22 We are Ruby Engineer !!
- 23. 23 Our work style ✔️ Agile ✔️ Sprint ✔️ Daily ✔️ Retrospective ✔️ Sharing Knowledge
- 24. 24 About sprint 2 week sprint
- 25. 25 Our new target board
- 27. 27 Task stauts sharing • What I did yesterday • Facing problems • What I will do today Daily Scrum (everyday)
- 29. 29 Why? Scrum MasterEngineer Product Owner No consensus L Build consensus J
- 33. 33 Keep working logs on issues Keep working logs
- 34. 34 New Issue…
- 35. 35 No Rule Scrum Master EngineerIn Paris Product Owner Create Issue freely
- 36. 36 We have many interesting things!!
- 37. 37 New Issue… Scrum Master Engineer Product Owner New Tickets
- 38. 38 Start Sprint
- 39. 39 Result
- 40. 40 Any Idea how this happened??
- 41. 41 New Issue… Scrum Master Engineer Product Owner Notification
- 43. 43 New Rule!! Back logsFree Tasks
- 44. 44 Our Target !? ✔️ Expand ROMA & LeoFS ✔️ Rapidly & efficiently support for users
- 45. 45 Target Tasks 35 35 36 36 38 39 40 41 42 43 45 45 48 47 50 51 48 50 0 10 20 30 40 50 60 Sprint 1 Sprint 2 Sprint 3 Sprint 4 Sprint 5 Sprint 6 Sprint 7 Sprint 8 Sprint 9 Sprint 11 Sprint 12 Sprint 13 Sprint 14 Sprint 15 Sprint 16 Sprint 17 Sprint 18 Sprint 19 Target Tasks ✔️ Increase sprint target efficiently
- 46. 46 But…
- 47. 47 High Dependence Pull Request Pull Request Pull RequestPull Request
- 48. 48 To realize dream and common goal !!
- 51. 51 Result!! Pull Request Pull Request Pull Request New Issue New Issue New Tech
- 52. 52 Target Tasks 35 35 36 36 38 39 40 41 42 43 45 45 48 47 50 51 48 50 0 10 20 30 40 50 60 Sprint 1 Sprint 2 Sprint 3 Sprint 4 Sprint 5 Sprint 6 Sprint 7 Sprint 8 Sprint 9 Sprint 11 Sprint 12 Sprint 13 Sprint 14 Sprint 15 Sprint 16 Sprint 17 Sprint 18 Sprint 19 Target Tasks ✔️ Increase sprint target efficiently
- 53. 53 Discover Rakuten !! Overseas Conference Pics of study session Study Sessions (Tech Talk)
- 54. 54 Discover other team Daily scrum Kanban
- 55. 55 Discover overseas scrum and know-how
- 56. 56 Discover Rakuten !! ✔️ Many teams ✔️ Many services ✔️ Tech talks ✔️ Conference ✔️ Know-how We have…
- 57. 57 Pursue our ideal environment !!
- 58. 58 3. ROMA
- 59. 59 Hiroaki Iwase(岩瀬 裕章) Career 2011.3 Graduated from Tohoku University 2011.4 Join Rakuten, Inc. 2012.5 Join OSS team. Skill Ruby Ruby on Rails PHP, Ad platform, etc… Self introduction
- 61. 61 What’s about ROMA？ n ROMA(Rakuten On-Memory Architecture) Ø Ruby based Distributed Key Value Store(NOSQL). ROMA project HP • http://roma-kvs.org Github • https://github.com/roma
- 62. 62 What’s about ROMA？ n ROMA(Rakuten On-Memory Architecture) Ø Developed by RIT(楽天技術研究所) with Matz. - 2007年 ROMA start Development - 2009年 Release as a OSS product 20 services
- 63. 63 What’s about ROMA？ n Specialty of ROMA • Pure P2P architecture • Consistent Hashing and Virtual Nodes • Data replication • Auto recovering system • Plug-in Architecture • Memcached compatible protocol
- 64. 64 4. Gladiator
- 65. 65 ROMA Gladiator is a GUI tool of ROMA Gladiator Management Control
- 66. 66 Why need GUI tool?
- 75. 75 tough…
- 77. 77 Operation benefit Gladiator reduce these costs!! ！
- 78. 78 What can Gladiator do?
- 80. 80
- 83. 83 You can change cluster architecture.
- 84. 84 In case of Cluster Error….
- 85. 85 In case of only CUI management….
- 86. 86 bothered...
- 87. 87 But in case of Gladiator ・・・！
- 88. 88
- 90. 90 Redundancy down was happen! But you can solve by “Recover” button
- 91. 91 Recover process repair the redundancy problem.
- 92. 92 Can management by non-engineers!
- 93. 93 Can management more easily, more intuitively!!
- 95. 95 You can check ROMA’s configuration parameters.
- 96. 96 If you want, you can change parameters directly. Without Stopping ROMA!
- 98. 98
- 99. 99 4. Log
- 100. 100 You can check logs of each instances.
- 101. 101 LOG LEVEL filter Can sort and filtering.
- 102. 102 Can sort and filtering. LOG contents filter
- 104. 104
- 108. 108 Demo Try to use Gladiator!!
- 109. 109 Events by Global Human Resources Department For Students For Engineers “Hiring Party” at Rakuten Café Next events: November 28th at 19:00- Big Data December 18th at 19:00- OPS…... If you are interested in our events, please talk to me (Bando) or send an inquiry to recruit-tech@mail.rakuten.com Hackathon Rakuten Tower Tour Recruiting events etc. Next events: Will be updated on engineer recruiting home page and facebook
- 110. 110 Thanks for your listening. ご静聴ありがとうございました。 http://roma-kvs.org/