SlideShare a Scribd company logo

Riak Operations

G
gschofield

The document discusses various topics related to operating Riak including installing and configuring Riak, the directory structure, using riak-admin commands, performance tuning, backups, security, and system recommendations. Key directories discussed include /etc/riak for configuration files, /usr/sbin for riak and riak-admin executables, /var/log for logs, and /var/lib for data. Performance tuning depends on the backend (Bitcask or Innostore) and hardware used. Backups and restoring nodes are also covered.

Technology
1 of 34
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
Riak Operations Grant Schofield Developer Advocate Basho Technologies, Inc. basho Friday, April 15, 2011
Installing Riak ‣ http://downloads.basho.com ‣ Packages (Debs, RPMs, Pkgs) ‣ Source Install (Requires Erlang) ‣ “Dev” Installs basho Friday, April 15, 2011
Where is Riak ‣ Source and Solaris ‣ /etc/riak ‣ /usr/sbin/riak|riak-admin ‣ /usr/lib|lib64/riak << Meat ‣ /var/log/riak << Log Dir ‣ /var/lib/riak << Data Dir ‣ /tmp/riak << Sockets basho Friday, April 15, 2011
/etc/riak ‣ app.config ‣ Riak Configuration ‣ riak_core,riak_kv, bitcask ‣ vm.args ‣ Erlang VM Settings ‣ -name riak@<ip> basho Friday, April 15, 2011
/usr/sbin/riak ‣ Wrapped by /etc/init.d/riak ‣ Runs Riak User (sudo) ‣ start | stop ‣ restart|reboot ‣ ping ‣ console | attach basho Friday, April 15, 2011
/usr/sbin/riak-admin ‣ join | leave | remove | reip ‣ backup | restore (cluster or node) ‣ test | status | js_reload ‣ wait-for-service | ringready | transfers ‣ cluster_info basho Friday, April 15, 2011
riak-admin status vnode gets/puts in read-repairs in the the last 60 seconds gets/puts total vnode last 60 seconds node gets since start in the total node gets last 60 seconds since start times get_fsm node puts in inthe microseconds total node puts last 60 seconds since start put_fsm times total read-repairs in microseconds since start basho Friday, April 15, 2011
riak-admin transfers basho Friday, April 15, 2011
riak-admin cluster_info basho Friday, April 15, 2011
cluster_info cont... Total Memory Use <0.108.0>?? basho Friday, April 15, 2011
<0.108.0> snmp process basho Friday, April 15, 2011
mailboxes (message queue) basho Friday, April 15, 2011
mailboxes cont.. basho Friday, April 15, 2011
Logging ‣ Not Typical (Built in Rotation) ‣ /var/log/riak/erlang.log.X ‣ Console Output ‣ /var/log/riak/sasl-error.log ‣ Errors and Crash Reports ‣ /var/log/riak/sasl << Report Browser basho Friday, April 15, 2011
Using rb basho Friday, April 15, 2011
Using rb cont... basho Friday, April 15, 2011
Using rb cont... basho Friday, April 15, 2011
Riak Performance ‣ MANY Variables ‣ Backend Choice (Innostore vs Bitcask) ‣ Hardware vs Virtualized ‣ Access Patterns ‣ Correct System Configuration ‣ Knowing your Environment basho Friday, April 15, 2011
Bitcask Tuning ‣ KeyDir is in Memory ‣ Fileystem Cache (Access Profile Considerations) ‣ Merge Trigger Settings ‣ Scheduling Bitcask Merges ‣ Key Expiration basho Friday, April 15, 2011
Innostore Tuning ‣ Similar to MySQL + InnoDB ‣ buffer pool size ‣ o_direct ‣ log_files_in_groups ‣ Separate Spindles for Log and Data basho Friday, April 15, 2011
Tools You Should Know ‣ riak-admin status ‣ top ‣ iostat -x 2 ‣ sar ‣ basho_bench basho Friday, April 15, 2011
A Basic Bottleneck basho Friday, April 15, 2011
basho Friday, April 15, 2011
Tips for Performance ‣ Start with a “DB” Like Machine Profile ‣ noatime mounts ‣ Ring Size ‣ Horizontal vs Vertical Scaling ‣ Basho Bench Testing ‣ Limit List Keys and Full Bucket MapReduce ‣ Graph Everything basho Friday, April 15, 2011
Metrics & Monitoring ‣ Integrates with Everything!! ‣ SNMP (Enterprise Plug) ‣ JMX (Enterprise Plug) ‣ Wrapping riak-admin status ‣ /ping ‣ /stats ‣ Read/Write a Key basho Friday, April 15, 2011
Load Balancing ‣ HTTP - HAProxy, nginx, etc... ‣ Protocol Buffers - Any TCP Load Balancer ‣ Least Connected basho Friday, April 15, 2011
Backups ‣ Different Depending on Backend ‣ Innostore ‣ riak-admin backup (node | cluster) ‣ Bitcask ‣ rsync ‣ snapshots ‣ cp ? ‣ Enterprise Replication basho Friday, April 15, 2011
A node has horked! Now what? ‣ That Depends..... ‣ How did the node die? ‣ Do you still have the data? ‣ Start the Node ‣ No data? ‣ Restore or Replace Node basho Friday, April 15, 2011
Configuration Management ‣ Riak is Unix ‣ Chef, Puppet, Etc. ‣ Chef Cookbook is Advanced ‣ “Auto” Joining Nodes to a Cluster (ringready) ‣ Node vs IP Naming (vm.args -name) basho Friday, April 15, 2011
Security ‣ SSL ‣ No Built In Authentication ‣ HTTP Auth Via Proxy ‣ Riak on the Internet? ‣ Follow Best Practices basho Friday, April 15, 2011
System Recommendations ‣ Multi-core 64-bit CPUs ‣ The More RAM the Better ‣ Fast Disk (Raid0? SSD? SAS?) ‣ SAN vs Local Disk ‣ Virtualization Caveats basho Friday, April 15, 2011
EC2 and EBS ‣ Follow DB Best Practices ‣ To EBS or Not to EBS? ‣ Raid0 is Faster, but an OPS Headache ‣ Speed vs Fault Tolerance (Availability Zones) ‣ Specific Tweaks for EC2 (net_ticktime) ‣ There are MANY successful deployments. basho Friday, April 15, 2011
Obligatory Plug For more information about support, professional services, or an Enterprise licenses please contact info@basho.com or visit http://www.basho.com/contact.php basho Friday, April 15, 2011
Questions? basho Friday, April 15, 2011

More Related Content

PDF
How tos nagios - centos wiki
shahab071
 
PDF
Configuration Management with Saltstack
inovex GmbH
 
PDF
Play ja kansai
Takafumi Ikeda
 
PDF
Improving Your Heroku App Performance with Asset CDN and Unicorn
Simon Bagreev
 
PDF
如何安装Oracle one off临时小补丁及注意事项
maclean liu
 
PDF
Relational Databases to Riak
Basho Technologies
 
PPT
Riak a successful failure
GiltTech
 
KEY
Introduction to Riak - Red Dirt Ruby Conf Training
Sean Cribbs
 
How tos nagios - centos wiki
shahab071
 
Configuration Management with Saltstack
inovex GmbH
 
Play ja kansai
Takafumi Ikeda
 
Improving Your Heroku App Performance with Asset CDN and Unicorn
Simon Bagreev
 
如何安装Oracle one off临时小补丁及注意事项
maclean liu
 
Relational Databases to Riak
Basho Technologies
 
Riak a successful failure
GiltTech
 
Introduction to Riak - Red Dirt Ruby Conf Training
Sean Cribbs
 

Viewers also liked (6)

KEY
Introducing Riak
Kevin Smith
 
KEY
Riak Training Session — Surge 2011
DstroyAllModels
 
PDF
Riak (Øredev nosql day)
Sean Cribbs
 
PDF
Riak - From Small to Large
Rusty Klophaus
 
PDF
Distributed Key-Value Stores- Featuring Riak
samof76
 
KEY
Riak in Ten Minutes
Jon Meredith
 
Introducing Riak
Kevin Smith
 
Riak Training Session — Surge 2011
DstroyAllModels
 
Riak (Øredev nosql day)
Sean Cribbs
 
Riak - From Small to Large
Rusty Klophaus
 
Distributed Key-Value Stores- Featuring Riak
samof76
 
Riak in Ten Minutes
Jon Meredith
 
Ad

Similar to Riak Operations (20)

PDF
Oracle Release 12 E-Business Suite Patching Best Practices
Scott Jenner
 
KEY
Deploying and maintaining your software with RPM/APT
Joshua Thijssen
 
KEY
Using Basho Bench to Load Test Distributed Applications
Basho Technologies
 
PDF
Percona xtrabackup - MySQL Meetup @ Mumbai
Nilnandan Joshi
 
ODP
about Debian "squeeze" @201002 OSC Tokyospring
Hideki Yamane
 
PDF
Subversion Day Berlin 2011 Configuration Management With Subversion And Rpm
Schlomo Schapiro
 
PDF
OpenNebula, the foreman and CentOS play nice, too
inovex GmbH
 
PDF
Ansible on AWS
Diego Pacheco
 
ODP
Nagios Conference 2012 - Dan Wittenberg - Case Study: Scaling Nagios Core at ...
Nagios
 
PDF
Filesystem Performance from a Database Perspective
Mark Wong
 
PDF
Ungooglable
Elizabeth Leddy
 
PDF
[ElasticStack]What happens when you visualize servers exposed to the world?
Masamitsu Maehara
 
PPT
1. Scaling PHP/MySQL...Presentation from Flickr
akshat
 
PDF
HBaseConAsia2019 Keynote
Michael Stack
 
PDF
Dynamic tracing of MariaDB on Linux - problems and solutions (MariaDB Server ...
Valeriy Kravchuk
 
PDF
Rails Application Optimization Techniques & Tools
guest05c09d
 
PDF
Migrating to a bazel based CI system: 6 learnings
Or Shachar
 
PDF
CPANTS: Kwalitative website and its tools
charsbar
 
PPTX
Perl
Raghu nath
 
PDF
Introduction to Ansible (Pycon7 2016)
Ivan Rossi
 
Oracle Release 12 E-Business Suite Patching Best Practices
Scott Jenner
 
Deploying and maintaining your software with RPM/APT
Joshua Thijssen
 
Using Basho Bench to Load Test Distributed Applications
Basho Technologies
 
Percona xtrabackup - MySQL Meetup @ Mumbai
Nilnandan Joshi
 
about Debian "squeeze" @201002 OSC Tokyospring
Hideki Yamane
 
Subversion Day Berlin 2011 Configuration Management With Subversion And Rpm
Schlomo Schapiro
 
OpenNebula, the foreman and CentOS play nice, too
inovex GmbH
 
Ansible on AWS
Diego Pacheco
 
Nagios Conference 2012 - Dan Wittenberg - Case Study: Scaling Nagios Core at ...
Nagios
 
Filesystem Performance from a Database Perspective
Mark Wong
 
Ungooglable
Elizabeth Leddy
 
[ElasticStack]What happens when you visualize servers exposed to the world?
Masamitsu Maehara
 
1. Scaling PHP/MySQL...Presentation from Flickr
akshat
 
HBaseConAsia2019 Keynote
Michael Stack
 
Dynamic tracing of MariaDB on Linux - problems and solutions (MariaDB Server ...
Valeriy Kravchuk
 
Rails Application Optimization Techniques & Tools
guest05c09d
 
Migrating to a bazel based CI system: 6 learnings
Or Shachar
 
CPANTS: Kwalitative website and its tools
charsbar
 
Perl
Raghu nath
 
Introduction to Ansible (Pycon7 2016)
Ivan Rossi
 
Ad

Recently uploaded (20)

PPTX
Machine Learning_overview_presentation.pptx
kondavamsidharreddy2
 
PPTX
1. Introduction to Computer Programming.pptx
bonakiduza1024
 
PPTX
A Presentation on Artificial Intelligence
memembruh336
 
PPTX
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
muhammadmuneebnaeem7
 
PDF
Empathic Computing: Creating Shared Understanding
Mark Billinghurst
 
PDF
Per capita expenditure prediction using model stacking based on satellite ima...
IAESIJAI
 
PDF
Diabetes mellitus diagnosis method based random forest with bat algorithm
IAESIJAI
 
PDF
Getting Started with Data Integration: FME Form 101
Safe Software
 
PDF
gpt5_lecture_notes_comprehensive_20250812015547.pdf
Chinchu40
 
PDF
The Rise and Fall of 3GPP – Time for a Sabbatical?
3G4G
 
PDF
Encapsulation_ Review paper, used for researhc scholars
gurumoop
 
PDF
NewMind AI Weekly Chronicles - August'25-Week II
NewMind AI
 
PPTX
Big Data Technologies - Introduction.pptx
kuthubussaman1
 
PDF
Reach Out and Touch Someone: Haptics and Empathic Computing
Mark Billinghurst
 
PPT
Teaching material agriculture food technology
LiaRayya
 
PPTX
Tartificialntelligence_presentation.pptx
ry7r52mzb4
 
PDF
Electronic commerce courselecture one. Pdf
OmerMohamed64
 
PDF
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
SOFTTECHHUB
 
PDF
Dropbox Q2 2025 Financial Results & Investor Presentation
Dropbox
 
PDF
Unlocking AI with Model Context Protocol (MCP)
Brian McKeiver
 
Machine Learning_overview_presentation.pptx
kondavamsidharreddy2
 
1. Introduction to Computer Programming.pptx
bonakiduza1024
 
A Presentation on Artificial Intelligence
memembruh336
 
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
muhammadmuneebnaeem7
 
Empathic Computing: Creating Shared Understanding
Mark Billinghurst
 
Per capita expenditure prediction using model stacking based on satellite ima...
IAESIJAI
 
Diabetes mellitus diagnosis method based random forest with bat algorithm
IAESIJAI
 
Getting Started with Data Integration: FME Form 101
Safe Software
 
gpt5_lecture_notes_comprehensive_20250812015547.pdf
Chinchu40
 
The Rise and Fall of 3GPP – Time for a Sabbatical?
3G4G
 
Encapsulation_ Review paper, used for researhc scholars
gurumoop
 
NewMind AI Weekly Chronicles - August'25-Week II
NewMind AI
 
Big Data Technologies - Introduction.pptx
kuthubussaman1
 
Reach Out and Touch Someone: Haptics and Empathic Computing
Mark Billinghurst
 
Teaching material agriculture food technology
LiaRayya
 
Tartificialntelligence_presentation.pptx
ry7r52mzb4
 
Electronic commerce courselecture one. Pdf
OmerMohamed64
 
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
SOFTTECHHUB
 
Dropbox Q2 2025 Financial Results & Investor Presentation
Dropbox
 
Unlocking AI with Model Context Protocol (MCP)
Brian McKeiver
 

Riak Operations

  • 1. Riak Operations Grant Schofield Developer Advocate Basho Technologies, Inc. basho Friday, April 15, 2011
  • 2. Installing Riak ‣ http://downloads.basho.com ‣ Packages (Debs, RPMs, Pkgs) ‣ Source Install (Requires Erlang) ‣ “Dev” Installs basho Friday, April 15, 2011
  • 3. Where is Riak ‣ Source and Solaris ‣ /etc/riak ‣ /usr/sbin/riak|riak-admin ‣ /usr/lib|lib64/riak << Meat ‣ /var/log/riak << Log Dir ‣ /var/lib/riak << Data Dir ‣ /tmp/riak << Sockets basho Friday, April 15, 2011
  • 4. /etc/riak ‣ app.config ‣ Riak Configuration ‣ riak_core,riak_kv, bitcask ‣ vm.args ‣ Erlang VM Settings ‣ -name riak@<ip> basho Friday, April 15, 2011
  • 5. /usr/sbin/riak ‣ Wrapped by /etc/init.d/riak ‣ Runs Riak User (sudo) ‣ start | stop ‣ restart|reboot ‣ ping ‣ console | attach basho Friday, April 15, 2011
  • 6. /usr/sbin/riak-admin ‣ join | leave | remove | reip ‣ backup | restore (cluster or node) ‣ test | status | js_reload ‣ wait-for-service | ringready | transfers ‣ cluster_info basho Friday, April 15, 2011
  • 7. riak-admin status vnode gets/puts in read-repairs in the the last 60 seconds gets/puts total vnode last 60 seconds node gets since start in the total node gets last 60 seconds since start times get_fsm node puts in inthe microseconds total node puts last 60 seconds since start put_fsm times total read-repairs in microseconds since start basho Friday, April 15, 2011
  • 10. cluster_info cont... Total Memory Use <0.108.0>?? basho Friday, April 15, 2011
  • 11. <0.108.0> snmp process basho Friday, April 15, 2011
  • 12. mailboxes (message queue) basho Friday, April 15, 2011
  • 14. Logging ‣ Not Typical (Built in Rotation) ‣ /var/log/riak/erlang.log.X ‣ Console Output ‣ /var/log/riak/sasl-error.log ‣ Errors and Crash Reports ‣ /var/log/riak/sasl << Report Browser basho Friday, April 15, 2011
  • 18. Riak Performance ‣ MANY Variables ‣ Backend Choice (Innostore vs Bitcask) ‣ Hardware vs Virtualized ‣ Access Patterns ‣ Correct System Configuration ‣ Knowing your Environment basho Friday, April 15, 2011
  • 19. Bitcask Tuning ‣ KeyDir is in Memory ‣ Fileystem Cache (Access Profile Considerations) ‣ Merge Trigger Settings ‣ Scheduling Bitcask Merges ‣ Key Expiration basho Friday, April 15, 2011
  • 20. Innostore Tuning ‣ Similar to MySQL + InnoDB ‣ buffer pool size ‣ o_direct ‣ log_files_in_groups ‣ Separate Spindles for Log and Data basho Friday, April 15, 2011
  • 21. Tools You Should Know ‣ riak-admin status ‣ top ‣ iostat -x 2 ‣ sar ‣ basho_bench basho Friday, April 15, 2011
  • 24. Tips for Performance ‣ Start with a “DB” Like Machine Profile ‣ noatime mounts ‣ Ring Size ‣ Horizontal vs Vertical Scaling ‣ Basho Bench Testing ‣ Limit List Keys and Full Bucket MapReduce ‣ Graph Everything basho Friday, April 15, 2011
  • 25. Metrics & Monitoring ‣ Integrates with Everything!! ‣ SNMP (Enterprise Plug) ‣ JMX (Enterprise Plug) ‣ Wrapping riak-admin status ‣ /ping ‣ /stats ‣ Read/Write a Key basho Friday, April 15, 2011
  • 26. Load Balancing ‣ HTTP - HAProxy, nginx, etc... ‣ Protocol Buffers - Any TCP Load Balancer ‣ Least Connected basho Friday, April 15, 2011
  • 27. Backups ‣ Different Depending on Backend ‣ Innostore ‣ riak-admin backup (node | cluster) ‣ Bitcask ‣ rsync ‣ snapshots ‣ cp ? ‣ Enterprise Replication basho Friday, April 15, 2011
  • 28. A node has horked! Now what? ‣ That Depends..... ‣ How did the node die? ‣ Do you still have the data? ‣ Start the Node ‣ No data? ‣ Restore or Replace Node basho Friday, April 15, 2011
  • 29. Configuration Management ‣ Riak is Unix ‣ Chef, Puppet, Etc. ‣ Chef Cookbook is Advanced ‣ “Auto” Joining Nodes to a Cluster (ringready) ‣ Node vs IP Naming (vm.args -name) basho Friday, April 15, 2011
  • 30. Security ‣ SSL ‣ No Built In Authentication ‣ HTTP Auth Via Proxy ‣ Riak on the Internet? ‣ Follow Best Practices basho Friday, April 15, 2011
  • 31. System Recommendations ‣ Multi-core 64-bit CPUs ‣ The More RAM the Better ‣ Fast Disk (Raid0? SSD? SAS?) ‣ SAN vs Local Disk ‣ Virtualization Caveats basho Friday, April 15, 2011
  • 32. EC2 and EBS ‣ Follow DB Best Practices ‣ To EBS or Not to EBS? ‣ Raid0 is Faster, but an OPS Headache ‣ Speed vs Fault Tolerance (Availability Zones) ‣ Specific Tweaks for EC2 (net_ticktime) ‣ There are MANY successful deployments. basho Friday, April 15, 2011
  • 33. Obligatory Plug For more information about support, professional services, or an Enterprise licenses please contact info@basho.com or visit http://www.basho.com/contact.php basho Friday, April 15, 2011