Cassandra Day Atlanta 2015: Software Development with Apache Cassandra: A Walkthrough
0 likes885 views
The document outlines a software development walkthrough for Apache Cassandra presented by Nate McCall at Cassandra Day Atlanta 2015. It covers essential topics for successful software development, including data modeling, writing code with the Java driver, managing environments, and testing strategies. The document also provides resources and tools to assist developers in effectively working with Cassandra's distributed architecture.
![server_count = 3
network = '192.168.2.'
first_ip = 10
servers = []
seeds = []
cassandra_tokens = []
(0..server_count-1).each do |i|
name = 'node' + (i + 1).to_s
ip = network + (first_ip + i).to_s
seeds << ip
servers << {'name' => name,
'ip' => ip,
'initial_token' => (2**64 / server_count * i) - 2**63}
end](https://image.slidesharecdn.com/softdevwithcassandraawalkthrough-150323233743-conversion-gate01/85/Cassandra-Day-Atlanta-2015-Software-Development-with-Apache-Cassandra-A-Walkthrough-58-320.jpg)
![server_count = 3
network = '192.168.2.'
first_ip = 10
servers = []
seeds = []
cassandra_tokens = []
(0..server_count-1).each do |i|
name = 'node' + (i + 1).to_s
ip = network + (first_ip + i).to_s
seeds << ip
servers << {'name' => name,
'ip' => ip,
'initial_token' => (2**64 / server_count * i) - 2**63}
end](https://image.slidesharecdn.com/softdevwithcassandraawalkthrough-150323233743-conversion-gate01/85/Cassandra-Day-Atlanta-2015-Software-Development-with-Apache-Cassandra-A-Walkthrough-59-320.jpg)
![server_count = 3
network = '192.168.2.'
first_ip = 10
servers = []
seeds = []
cassandra_tokens = []
(0..server_count-1).each do |i|
name = 'node' + (i + 1).to_s
ip = network + (first_ip + i).to_s
seeds << ip
servers << {'name' => name,
'ip' => ip,
'initial_token' => (2**64 / server_count * i) - 2**63}
end](https://image.slidesharecdn.com/softdevwithcassandraawalkthrough-150323233743-conversion-gate01/85/Cassandra-Day-Atlanta-2015-Software-Development-with-Apache-Cassandra-A-Walkthrough-60-320.jpg)
![chef.json = {
:cassandra => {'cluster_name' => 'VerifyCluster',
'version' => '2.0.8',
'setup_jna' => false,
'max_heap_size' => '512M',
'heap_new_size' => '100M',
'initial_token' => server['initial_token'],
'seeds' => "192.168.2.10",
'listen_address' => server['ip'],
'broadcast_address' => server['ip'],
'rpc_address' => server['ip'],
'conconcurrent_reads' => "2",
'concurrent_writes' => "2",
'memtable_flush_queue_size' => "2",
'compaction_throughput_mb_per_sec' => "8",
'key_cache_size_in_mb' => "4",
'key_cache_save_period' => "0",
'native_transport_min_threads' => "2",
'native_transport_max_threads' => "4"
},
}](https://image.slidesharecdn.com/softdevwithcassandraawalkthrough-150323233743-conversion-gate01/85/Cassandra-Day-Atlanta-2015-Software-Development-with-Apache-Cassandra-A-Walkthrough-61-320.jpg)
![Testing - Suites:
Interesting test plumbing
• [Before|Afer]Suite
• [Before|After]Group
• Listeners](https://image.slidesharecdn.com/softdevwithcassandraawalkthrough-150323233743-conversion-gate01/85/Cassandra-Day-Atlanta-2015-Software-Development-with-Apache-Cassandra-A-Walkthrough-71-320.jpg)
Cassandra Day Atlanta 2015: Software Development with Apache Cassandra: A Walkthrough
- 1. CASSANDRA DAY ATLANTA 2015 SOFTWARE DEVELOPMENT WITH CASSANDRA: A WALKTHROUGH Nate McCall @zznate #CassandraDays Co-Founder & Sr.Technical Consultant Licensed under a Creative Commons Attribution-NonCommercial 3.0 New Zealand License
- 2. AboutThe Last Pickle. Work with clients to deliver and improve Apache Cassandra based solutions. Based in New Zealand & USA.
- 3. OVERVIEW
- 4. Overview: What makes a software development project successful?
- 5. Overview: Successful Software Development - it ships - maintainable - good test coverage - check out and build
- 8. Data Modeling: … a topic unto itself. But quickly:
- 9. Data Modeling - Quickly • It’s Hard • Do research • #1 performance problem • Tip: don’t “port” your schema
- 10. Data Modeling - Using CQL: • tools support • easy tracing (and trace discovery) • documentation* *Maintained in-tree: https://github.com/apache/cassandra/blob/cassandra-1.2/doc/cql3/CQL.textile https://github.com/apache/cassandra/blob/cassandra-2.0/doc/cql3/CQL.textile https://github.com/apache/cassandra/blob/cassandra-2.1/doc/cql3/CQL.textile
- 11. Data Modeling - DevCenter: Tools: DataStax DevCenter http://www.datastax.com/what-we-offer/products-services/devcenter
- 13. WRITING CODE
- 14. Writing Code: ORM? maybe - only if it’s very simple more later… http://www.datastax.com/documentation/developer/java-driver/2.1/java-driver/reference/crudOperations.html
- 16. Writing Code: Use the Java Driver
- 17. Writing Code - Java Driver: • Reference implementation • Well written, extensive coverage • open source • dedicated resources https://github.com/datastax/java-driver/
- 18. Writing Code - Java Driver: Existing Spring Users: Spring Data Integration http://projects.spring.io/spring-data-cassandra/
- 19. Writing Code - Java Driver: Guice Users: “GuicyFig:” Archaius + Guice https://stash.safehaus.org/projects/GFIG/repos/main/browse
- 20. Writing Code - Java Driver: Four rules for Writing Code • one Cluster for physical cluster • one Session per app per keyspace • use PreparedStatements • use Batches to reduce network IO
- 21. Writing Code - Java Driver: Configuration is Similar to Other DB Drivers (with caveats**) http://www.datastax.com/documentation/developer/java-driver/2.1/common/drivers/reference/clusterConfiguration_c.html
- 22. Writing Cluster - Java Driver - Configuration: Major Difference: it’s a Cluster!
- 23. Writing Code - Java Driver - Configuration: Two groups of configurations • policies • connections
- 24. Writing Code - Java Driver - Configuration: Three Policy Types: • load balancing • connection • retry
- 25. Writing Code - Java Driver - Configuration: Connection Options: • protocol* • pooling • socket *https://github.com/apache/cassandra/blob/cassandra-2.1/doc/native_protocol_v3.spec
- 26. Writing Code - Java Driver: Embrace Asynchronicity (but use RxJava) https://github.com/ReactiveX/RxJava
- 27. Writing Code - Java Driver: A note about User Defined Types (UTDs)
- 28. Writing Code - Java Driver - Using UDTs: Wait. - serialized as blobs !!?! - new version already being discussed* - will be a painful migration path * https://issues.apache.org/jira/browse/CASSANDRA-7423
- 29. Writing Code: Metrics API for your own code https://github.com/apache/cassandra/blob/cassandra-2.1/src/java/org/apache/cassandra/metrics/ColumnFamilyMetrics.java https://dropwizard.github.io/metrics/3.1.0/
- 30. Writing Code - Instrumentation via Metrics API: Run Riemann locally http://riemann.io/
- 32. Writing Code: Using Trace (and doing so frequently)
- 33. Writing Code -Tracing: Trace per query via DevCenter http://www.datastax.com/documentation/cql/3.0/cql/cql_reference/tracing_r.html
- 34. Writing Code -Tracing: Trace per query via cqlsh http://www.datastax.com/documentation/cql/3.0/cql/cql_reference/tracing_r.html
- 35. cqlsh> tracing on; Now tracing requests. cqlsh> SELECT doc_version FROM data.documents_by_version ... WHERE application_id = myapp ... AND document_id = foo ... AND chunk_index = 0 ... ORDER BY doc_version ASC ... LIMIT 1; doc_version ------------- 65856 Tracing session: 46211ab0-2702-11e4-9bcf-8d157d448e6b
- 36. Preparing statement | 18:05:44,845 | 192.168.1.197 | 22337 Enqueuing data request to /192.168.1.204 | 18:05:44,845 | 192.168.1.197 | 22504 Sending message to /192.168.1.204 | 18:05:44,847 | 192.168.1.197 | 24498 Message received from /192.168.1.197 | 18:05:44,854 | 192.168.1.204 | 872 Executing single-partition query on documents_by_version | 18:05:44,888 | 192.168.1.204 | 35183 Acquiring sstable references | 18:05:44,888 | 192.168.1.204 | 35459 Merging memtable tombstones | 18:05:44,889 | 192.168.1.204 | 35675 Key cache hit for sstable 2867 | 18:05:44,889 | 192.168.1.204 | 35792 Seeking to partition beginning in data file | 18:05:44,889 | 192.168.1.204 | 35817 …
- 37. Preparing statement | 18:05:44,845 | 192.168.1.197 | 22337 Enqueuing data request to /192.168.1.204 | 18:05:44,845 | 192.168.1.197 | 22504 Sending message to /192.168.1.204 | 18:05:44,847 | 192.168.1.197 | 24498 Message received from /192.168.1.197 | 18:05:44,854 | 192.168.1.204 | 872 Executing single-partition query on documents_by_version | 18:05:44,888 | 192.168.1.204 | 35183 Acquiring sstable references | 18:05:44,888 | 192.168.1.204 | 35459 Merging memtable tombstones | 18:05:44,889 | 192.168.1.204 | 35675 Key cache hit for sstable 2867 | 18:05:44,889 | 192.168.1.204 | 35792 Seeking to partition beginning in data file | 18:05:44,889 | 192.168.1.204 | 35817 …
- 38. … Merging data from memtables and 8 sstables | 18:05:44,892 | 192.168.1.204 | 38605 Read 1 live and 2667 tombstoned cells | 18:05:54,135 | 192.168.1.204 | 9282428 Enqueuing response to /192.168.1.197 | 18:05:54,136 | 192.168.1.204 | 9283423 Sending message to /192.168.1.197 | 18:05:54,138 | 192.168.1.204 | 9284753 Message received from /192.168.1.204 | 18:05:54,155 | 192.168.1.197 | 9332505 Processing response from /192.168.1.204 | 18:05:54,158 | 192.168.1.197 | 9335372 Request complete | 18:05:54,158 | 192.168.1.197 | 9335592
- 39. … Merging data from memtables and 8 sstables | 18:05:44,892 | 192.168.1.204 | 38605 Read 1 live and 2667 tombstoned cells | 18:05:54,135 | 192.168.1.204 | 9282428 Enqueuing response to /192.168.1.197 | 18:05:54,136 | 192.168.1.204 | 9283423 Sending message to /192.168.1.197 | 18:05:54,138 | 192.168.1.204 | 9284753 Message received from /192.168.1.204 | 18:05:54,155 | 192.168.1.197 | 9332505 Processing response from /192.168.1.204 | 18:05:54,158 | 192.168.1.197 | 9335372 Request complete | 18:05:54,158 | 192.168.1.197 | 9335592 !!?!
- 40. … Merging data from memtables and 8 sstables | 18:05:44,892 | 192.168.1.204 | 38605 Read 1 live and 2667 tombstoned cells | 18:05:54,135 | 192.168.1.204 | 9282428 Enqueuing response to /192.168.1.197 | 18:05:54,136 | 192.168.1.204 | 9283423 Sending message to /192.168.1.197 | 18:05:54,138 | 192.168.1.204 | 9284753 Message received from /192.168.1.204 | 18:05:54,155 | 192.168.1.197 | 9332505 Processing response from /192.168.1.204 | 18:05:54,158 | 192.168.1.197 | 9335372 Request complete | 18:05:54,158 | 192.168.1.197 | 9335592
- 41. Writing Code -Tracing: Enable traces in the driver http://www.datastax.com/documentation/developer/java-driver/2.0/java-driver/tracing_t.html
- 42. Writing Code -Tracing: `nodetool settraceprobability`
- 43. Writing Code -Tracing: …then make sure you try it again with a node down!
- 44. Writing Code -Tracing: Final note on tracing: do it sparingly
- 45. Writing Code -Tracing: Coming Soon: slow query log (client side) https://github.com/datastax/java-driver/compare/java646 https://datastax-oss.atlassian.net/browse/JAVA-646
- 46. Writing Code: LoggingVerbosity can be changed dynamically** ** since 0.4rc1 http://www.datastax.com/documentation/cassandra/2.0/cassandra/configuration/configLoggingLevels_r.html
- 47. Writing Code: nodetool for developers • cfstats • cfshistograms • proxyhistograms
- 48. Writing Code - nodetool - cfstats: cfstats: per-table statistics about size and performance (single most useful command)
- 49. Writing Code - nodetool - cfhistograms: cfhistograms: column count and partition size vs. latency distribution
- 50. Writing Code - nodetool - proxyhistograms: proxyhistograms: performance of inter-cluster requests
- 52. Managing Environments: Configuration Management is Essential
- 53. Managing Environments: Laptop to Production with NO Manual Modifications!
- 54. Managing Environments: Running Cassandra during development
- 55. Managing Environments - Running Cassandra: Local Cassandra • easy to setup • you control it • but then you control it!
- 56. Managing Environments - Running Cassandra: CCM • supports multiple versions • clusters and datacenters • up/down individual nodes https://github.com/pcmanus/ccm
- 57. Managing Environments - Running Cassandra: Vagrant • isolated, controlled environment • configuration mgmt integration • same CM for production! http://www.vagrantup.com/
- 58. server_count = 3 network = '192.168.2.' first_ip = 10 servers = [] seeds = [] cassandra_tokens = [] (0..server_count-1).each do |i| name = 'node' + (i + 1).to_s ip = network + (first_ip + i).to_s seeds << ip servers << {'name' => name, 'ip' => ip, 'initial_token' => (2**64 / server_count * i) - 2**63} end
- 59. server_count = 3 network = '192.168.2.' first_ip = 10 servers = [] seeds = [] cassandra_tokens = [] (0..server_count-1).each do |i| name = 'node' + (i + 1).to_s ip = network + (first_ip + i).to_s seeds << ip servers << {'name' => name, 'ip' => ip, 'initial_token' => (2**64 / server_count * i) - 2**63} end
- 60. server_count = 3 network = '192.168.2.' first_ip = 10 servers = [] seeds = [] cassandra_tokens = [] (0..server_count-1).each do |i| name = 'node' + (i + 1).to_s ip = network + (first_ip + i).to_s seeds << ip servers << {'name' => name, 'ip' => ip, 'initial_token' => (2**64 / server_count * i) - 2**63} end
- 61. chef.json = { :cassandra => {'cluster_name' => 'VerifyCluster', 'version' => '2.0.8', 'setup_jna' => false, 'max_heap_size' => '512M', 'heap_new_size' => '100M', 'initial_token' => server['initial_token'], 'seeds' => "192.168.2.10", 'listen_address' => server['ip'], 'broadcast_address' => server['ip'], 'rpc_address' => server['ip'], 'conconcurrent_reads' => "2", 'concurrent_writes' => "2", 'memtable_flush_queue_size' => "2", 'compaction_throughput_mb_per_sec' => "8", 'key_cache_size_in_mb' => "4", 'key_cache_save_period' => "0", 'native_transport_min_threads' => "2", 'native_transport_max_threads' => "4" }, }
- 62. TESTING
- 63. Testing: Use a Naming Scheme • *UnitTest.java: no external resources • *ITest.java: uses external resources • *PITest.java: safely parallel “ITest”
- 64. Testing: Tip: wildcards on the CLI are not a naming schema.
- 66. Testing - Suites: Benefits of Suites: • share test data • share Cassandra instance(s) • build profiles
- 69. Testing - Suites: Using annotations for suites in code
- 71. Testing - Suites: Interesting test plumbing • [Before|Afer]Suite • [Before|After]Group • Listeners
- 74. Testing: Verify Assumptions: test failure scenarios explicitly
- 75. Testing - Integration: Runtime Integrations: • local • in-process • forked-process
- 76. Testing - Integration - Runtime: EmbeddedCassandra https://github.com/jsevellec/cassandra-unit/
- 77. Testing - Integration - Runtime: ProcessBuilder to fork Cassandra(s)
- 78. Testing - Integration - Runtime: CCMBridge: delegate to CCM https://github.com/datastax/java-driver/blob/2.1/driver-core/src/test/java/com/datastax/driver/core/CCMBridge.java
- 79. Testing - Integration - Runtime: Vagrant: delegate to vagrant cli
- 80. Testing - Integration: Best Practice: Jenkins should be able to manage your cluster
- 81. Testing - Integration - Best Practices: Vagrant vs. CCMBridge? • choice of style, really • developer integration with CM • what else is in the architecture?
- 82. Testing: Load Testing Goals • reproducible metrics • catch regressions • test to breakage point
- 83. Testing - LoadTesting: Stress.java (lot’s of changes recently) https://www.datastax.com/documentation/cassandra/2.1/cassandra/tools/toolsCStress_t.html http://www.datastax.com/dev/blog/improved-cassandra-2-1-stress-tool-benchmark-any-schema
- 84. Testing - LoadTesting: Workload recording and playback coming soon one day https://issues.apache.org/jira/browse/CASSANDRA-8929
- 85. Testing: Primary testing goal: Don’t let cluster behavior surprise you.
- 86. Summary: • Go slowly with bite sized chunks • Segment your tests and use build profiles • Monitor and Instrument • Use reference implementation drivers • Control your environments • Verify any assumptions about failures
- 87. Thanks.
- 88. Nate McCall @zznate Co-Founder & Sr.Technical Consultant www.thelastpickle.com #CassandraDays