Glue con denver may 2015 sql to nosql
Download as PPTX, PDF1 like945 views
The document discusses the transition from relational database management systems (RDBMS) to NoSQL databases, highlighting the advantages of NoSQL in terms of scalability, performance, and developer productivity. It details the differences between RDBMS and NoSQL, introduces various NoSQL types, and emphasizes key aspects of data modeling and migration strategies. Lastly, it provides practical advice on achieving efficient data handling and performance optimization.
Glue con denver may 2015 sql to nosql
- 1. Peter Milne peter@aerospike.com @helipilot50 helipilot50 SQL to NoSQL Migration
- 2. Wisdom vs Guessing "Everything that can be invented has been invented.” - Charles Holland Duell – US Patent Office 1899 “Insanity is doing the same thing over & over again expecting different results” – Albert Einstein
- 3. Why we love RDBMS ■ Reliability ■ Concurrency made easy ■Atomic ■Consistency ■Isolation ■Durability ■ 2 phase commit ■ Rigorous Schema ■ Normalization (normal forms) …And it is what we all know Edgar “Ted” Codd
- 4. Why switch to NoSQL ■ Scalability ■ Performance ■ Developer productivity
- 5. RDBMS and NoSQL differences ■ RDBMS is accessible for many types of applications ■ Schema helps to control rules common for everybody ■ NoSQL is about focusing on particular need ■ Model your data for specific use case ■ Speed at Scale
- 6. 10 Reasons why NoSQL is the Key to Velocity 1. RAM is fast 2. Easy for developers 3. Flex schema 4. Read / write agility 5. Scale-out clustering works 6. Flash-enabled for big data 7. Geographic replication 8. Cloud or On-premise 9. KVS+ for fast analytics 10. Open source
- 7. Polyglot Persistence ■Different solutions are designed to solve different problems ■session & fast transactions ■Cache ■Aggregations ■Analytical ad-hock scans ■Traversal ■The requirements for OLTP and OLAP storages are very different
- 9. NoSQL types: Key-value & Key-document Key-Value: ■Riak ■Redis ■Aerospike ■Kyoto Tycoon Key-Document ■MongoDB ■CouchBase
- 10. NoSQL types: Column oriented & Graph Column oriented ■Cassandra ■Hbase Graph Databases ■Neo4j ■OrientDB
- 11. NoSQL Data Modeling Basics
- 12. Normalization ■ Normalization is the process of structuring relational database schema such that most ambiguity is removed. The stages of normalization are referred to as normal forms and progress from the least restrictive (First Normal Form) through the most restrictive (Fifth Normal Form).
- 13. De-normalization or Duplication ■ De-normalization is OK ■Immutable data ■ Aggregation vs Association ■“Consists of” vs “related to” Consists of Related to
- 14. Aggregates Aggregation is a technique of embedding data structures into each other. Why? ■ Simple read/write is fast ■ Optimize storage I/O ■ Parallelism through clustering What it costs ■ Updates and Queries are heavy and complex Aggregation gives you Velocity
- 15. Joins in your code Not all the questions can be answered by the same data model. ■ Frequent questions move to the data model ■Composite key, aggregation, etc ■ Infrequent questions done as an application Join Example: User profile and Photo Join
- 16. Composite keys Single record, 2 pieces of related data, Single composite key ■ Chat example: ■ Bank account example:
- 17. Append As events occur Append them to a List* ■ Banking example ■Deposit ■Withdrawal ■Deposit *Row oriented ■List, Byte Array, Set *Column oriented ■Add a column Append
- 19. Practical migration steps ■ What do you want to achieve ■Speed at Scale ■ Know your traffic ■ Know your data ■ What are you willing to sacrifice ■Consistency, Transactions, Data loss ■ Apply polyglot persistence ■ Model you data
- 20. Latency of your application Latency = Sum(LD) + Sum(LS) ■LD = Device latency ■LS = Stupidity latency ■ Minimize stupidity
- 21. Right tool for the job
- 22. Load test ■ Simulation ■Simulate real load ■ Nothing is better than real data ■Record live data and playback in testing
- 23. Finally.. A well designed and build application should ■ Deliver the correct result ■ Perform adequately ■ Be maintainable by the average Guy or Girl
Editor's Notes
- #2: SQL to NoSQL migration Key topics that he will talk about are following: ● Why would you want to migrate to NoSQL ● Conceptual difference between RBDMS and NoSQL ● Data modeling and architectural best practices ● "I got it. But what exactly I need to do?" Practical migration steps Peter will explain the main advantages of NoSQL, common use cases in which the migration to NoSQL makes sense. You will learn about key questions that you have to ask before migration, as well as difference in data modeling and architectural approaches that you should know. Finally, we will take a look at typical application based on RDBMS and will migrate it to NoSQL step by step.