Pluk2011 deploy-mysql-like-a-devops-sysadmin
2 likes348 views
This document discusses how database administrators (DBAs) can adopt a DevOps approach to their work. It suggests DBAs focus on communication, configuration management, testing, and visibility/monitoring. Some specific DevOps practices for DBAs include: discussing database designs with developers and sysadmins; treating schema changes like code migrations; automating configurations with tools like Puppet; integrating database testing; and sharing monitoring dashboards. The overall goal is for DBAs, developers and sysadmins to work as a collaborative "DevDBAOps" team with improved communication and feedback loops.
Pluk2011 deploy-mysql-like-a-devops-sysadmin
- 1. Manage MySQL like a devops sysadmin Percona Live London 2011 Frédéric Descamps
- 2. www.percona.com Who am I ? Frédéric Descamps @lefred http://about.be/lefred Managing MySQL since 3.23 (as far as I remember) devops believer
- 3. www.percona.com Thank You to Our Sponsors Platinum Sponsor Gold Sponsor Silver Sponsors
- 4. www.percona.com Percona Live London Sponsors Exhibitor Sponsors Friends of Percona Sponsors Media Sponsors
- 5. www.percona.com To start with... Let's use devops like slides...
- 6. 6 Let's use devops like slides...
- 7. 7 from
- 8. 8
- 9. 9 to
- 10. 10
- 11. 11 devops is a movement willing to help aligning IT with company needs (starting by aligning devs and ops) @endemics - Gildas Le Nadan - “The Devops movement”, Mixit Lyon 2011
- 13. 13 devops is about communication ! between dev and ops
- 14. 14 devs ops Small and frequent successful iterations This is one of the most fundamental ideas in devops: the feedback loop !
- 15. 15 We can say that devops is bringing together people and practices from development and operations
- 16. 16 We can say that devops is bringing together people and practices from development and operations I am a happy dev !I am a happy op !
- 17. 17 devops now = ● being professional ● improving the collaboration by increasing trust and respect
- 18. 18 /me likes ! HOW can I reach that goal ?
- 20. 20 Everybody should have a status overview Is there any problem ? How are the test going ? How is performance ?
- 25. 25 What about DBAs ?
- 26. 26 Join the team, follow the movement !
- 27. 27 You are already between devs and ops
- 28. 28 You are already between devs and ops I am a happy dba !
- 29. 29 But we are still closer to the dark side of the force: sysadmins
- 30. 30 But we are still closer to the dark side of the force: sysadmins
- 31. 31 How can we apply devops ideas to our dba job ?
- 32. 32 1. communication 2. configuration management 3. testing 4. visibility
- 33. 33 1. Communication Usually DEVS communicate with managers, quality managers, products managers, ...
- 34. 34 OPS “communicate” with support, ISP's and... their servers
- 36. 36 The interaction between developers, sysadmins, dbas and all the actors should begin from the start of any projects
- 37. 37
- 38. 38
- 39. 39 Discuss everything database related with developers and sysadmins: ● disks and raid design ● schema design & partitions ● additional columns & indexes ● tables repair, ...
- 40. 40 2. configuration management Can we automate DBAs job ? Should we ? Even if we have only one database ?
- 41. 41
- 42. 42
- 43. 43 A lot of things to configure ● binaries ● databases ● configs ● cron jobs ● monitoring ● grants ● replication
- 44. 44 Documentation is needed and must be up to date
- 45. 45 Needs to be reproducible quickly without missing anything !
- 46. 46 Keep track of any changes Mind the gap
- 47. 47 3. testing Test every changes every new package... EVERYTHING
- 48. 48 4. visibility Expose monitoring, trending, test results and project status to EVERYONE in your company!! Everybody should know why the database is slooooow !
- 49. 49 Use all these metrics to plan ahead all the changes ! NOT ALONE BUT WITH EVERYBODY
- 51. 51 We are DBAs we work with data, we need something more concrete !
- 52. 52 We are DBA's we work with data, we need something more concrete !
- 53. 53 TRUE !
- 54. 54 communication
- 55. 55 Use an agile method to handle your projects
- 56. 56 For operations the best method is kanban
- 57. 57
- 58. 58
- 59. 59 Use dashboards and make them available to EVERYONE
- 60. 60 share all your dashboards with everybody in your company
- 63. 63 Use puppet (or any other configuration management tool) to deploy everything related to your database
- 64. 64 Save your puppet recipes into a version control system
- 65. 65 but also save your database schema changes in that system
- 66. 66 test
- 67. 67
- 68. 68 What should you test as a devops dba ?
- 69. 69 Test if you can deploy everything and if you didn't forget anything
- 70. 70 Test also the performance ! Is it faster with this change ?
- 73. 73 visibility
- 74. 74 monitoring
- 75. 75 Monitor your database with an alerting system (nagios). Disk/IO, CPU load, Network traffic, disk usage
- 76. 76 But do you want to be woken up at night because replication of the machine taking backups is 60sec behind ?
- 77. 77 NO!
- 78. 78 Then do you want to be woken up in the middle of the night because they are 1000 more selects than usual ?
- 79. 79 NO!
- 80. 80 Your alerting should answer those questions: Is the database server running ? Does it allow connections ? Is replication lagging on production slaves ?
- 81. 81 trending
- 82. 82 The most interesting facts for a DBA are the trending results ! Use cacti ... with mysql templates ! They provide very good metrics
- 83. 83 Correlate changes in the trending results with your configuration changes... everything should be tracked
- 84. 84 others ?
- 85. 85 You can also use other “devops” oriented tools like :
- 87. 87 If there is only one thing you remember from this presentation
- 88. 88 Yes, even a schema change MUST be considered like a migration !
- 89. 89 review it test it plan it do it
- 90. 90 and now that we have a devdbaops team
- 91. 91 we can start working on really interesting tasks for everyone
- 93. 93 When this goal is achieved DEVS have less pressure OPS have less pressure DBAs have less pressure
- 95. 95
- 96. 96 v 1.9application v 2.0 db schema v 1.9 v 2.0 present future
- 97. 97 v 1.9application v 2.0 db schema v 1.9 v 2.0 present future
- 98. 98 v 1.9application v 2.0 db schema v 1.9 v 2.0 present
- 99. 99 v 1.9application v 2.0 db schema v 1.9 v 2.0 present Issue !!
- 100. 100 v 1.9application v 2.0 db schema v 1.9 v 2.0
- 101. 101 v 1.9application v 2.0 db schema v 1.9 v 2.0 Issue !!
- 102. 102 v 1.9application v 2.0 db schema v 1.9 v 2.0
- 103. 103 This can only be the result of
- 105. 105 demo
- 107. 107 Change the schema (add an index for example) Commit !
- 108. 108 Launches a new virtual machine from scratch using vagrant Install everything and populate a test db
- 109. 109 Start some tests with pt-query-digest and compares to old values Faster is a success Slower is a fail
- 111. www.percona.com You can find all these recipes here !
- 113. www.percona.com Annual MySQL Users Conference Presented by Percona Live The Hyatt Regency Hotel, Santa Clara, CA April 10th-12th, 2012 Featured Speakers Mark Callaghan, Facebook Jeremy Zawodny, Craigslist Marten Mickos, Eucalyptus Systems Sarah Novotny, Blue Gecko Peter Zaitsev, Percona Baron Schwartz, Percona The Call for Papers is Now Open! Visit www.percona.com/live/mysql-conference-2012/
- 121. 7from
- 122. 8
- 123. 9to
- 124. 10
- 135. 21devopsisaboutCAMS
- 139. 25WhataboutDBAs?
- 150. 36Theinteractionbetweendevelopers,sysadmins,dbasandalltheactorsshouldbeginfromthestartofanyprojects
- 151. 37
- 152. 38
- 155. 41
- 156. 42
- 167. 53TRUE!
- 168. 54communication
- 171. 57
- 172. 58
- 180. 66test
- 181. 67
- 185. 71usePerconaToolkit
- 186. 72automateyourtests
- 187. 73visibility
- 188. 74monitoring
- 191. 77NO!
- 193. 79NO!
- 195. 81trending
- 198. 84others?
- 206. 92thesmoothmigration
- 209. 95
- 219. 105demo