MySQL as a Document Store
1 like372 views
The document outlines the features and functionalities of MySQL as a document store, including its schema-less storage and new development APIs for document management. It discusses the integration of both NoSQL and relational capabilities, providing advantages like rapid prototyping and operational efficiency while ensuring data integrity through ACID transactions. The document also emphasizes MySQL's vision for scalability, ease of use, and an integrated out-of-the-box solution for developers and business owners.
![Copyright © 2015, Oracleand/orits affiliates. Allrights reserved. |
Why can you not…
• Have both schema-less and schema in the same technology stack?
• One that checks all the boxes of all stakeholders:
7
Developers:
[ x ] Schemaless
[ x ] Rapid Prototyping/SimplerAPIs
[ x ] Document Model
Operations:
[ x ] Performance Management/Visibility
[ x ] Robust Replication, Backup, Restore
[ x ] ComprehensiveTooling Ecosystem
Business Owner:
[ x ] Don’t lose my data = ACID transactions
[ x ] Capture all my data = Extensible/Schemaless
[ x ] ProductsOn Schedule/Timeto Market = Rapid Development](https://image.slidesharecdn.com/mysqldocstorevisionv2-170607052754/85/MySQL-as-a-Document-Store-7-320.jpg)
![Copyright © 2015, Oracleand/orits affiliates. Allrights reserved. | 12
tomas@localhost $ mysqlsh --uri root@localhost/test
Creatingan X Sessionto root@localhost:33060/test
Enter password:
Default schema `test` accessible through db.
…
Currently in JavaScript mode. Use sql to switch to SQL mode and execute queries.
mysql-js> db.createCollection("posts");
<Collection:posts>
mysql-js> db.posts.add({"title":"Hello World", "text":"First post!"})
Query OK, 1 item affected(0.03 sec)
mysql-js> db.posts.find("title = 'Hello World'").sort(["title"]);
[
{
"_id": "8202bda28206e611140b3229389b6526",
"text": "First post!",
"title": "Hello World"
}
]
1 document in set (0.01 sec)](https://image.slidesharecdn.com/mysqldocstorevisionv2-170607052754/85/MySQL-as-a-Document-Store-12-320.jpg)
MySQL as a Document Store
- 1. Copyright © 2015, Oracleand/orits affiliates. Allrights reserved. |Copyright © 2015, Oracleand/orits affiliates. Allrights reserved. | MySQL as a Document Store Ted Wennmark ted.wennmark@oracle.com
- 2. Copyright © 2015, Oracleand/orits affiliates. Allrights reserved. | Safe Harbor Statement The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitmentto deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionalitydescribed for Oracle’s products remains at the sole discretion of Oracle.
- 3. Copyright © 2015, Oracleand/orits affiliates. Allrights reserved. | Program Agenda MySQL Document Store MySQL Future 1 2 3
- 4. Copyright © 2015, Oracleand/orits affiliates. Allrights reserved. | Program Agenda MySQL Document Store MySQL Future 1 2 4
- 5. Copyright © 2015, Oracleand/orits affiliates. Allrights reserved. | Today’s Challenges • Developers want to move faster • Time to market has a premium value • Rapid prototyping, iterate fast… 5
- 6. Copyright © 2015, Oracleand/orits affiliates. Allrights reserved. | Today’s Challenges (cont.) • Relational databases ask for schema up front – Potentiallysaving you time in the future – Less variations; less code to handle edge cases – Added cost with each schema change • NoSQL databases do not ask for schema – Saving you time up front – But potentially adding operational costs over time – No cost per schema change 6
- 7. Copyright © 2015, Oracleand/orits affiliates. Allrights reserved. | Why can you not… • Have both schema-less and schema in the same technology stack? • One that checks all the boxes of all stakeholders: 7 Developers: [ x ] Schemaless [ x ] Rapid Prototyping/SimplerAPIs [ x ] Document Model Operations: [ x ] Performance Management/Visibility [ x ] Robust Replication, Backup, Restore [ x ] ComprehensiveTooling Ecosystem Business Owner: [ x ] Don’t lose my data = ACID transactions [ x ] Capture all my data = Extensible/Schemaless [ x ] ProductsOn Schedule/Timeto Market = Rapid Development
- 8. Copyright © 2015, Oracleand/orits affiliates. Allrights reserved. | NEW! MySQL Document Store • NativeJSON Documents in MySQL 5.7 – Schema-less Document Storage • X Protocol (MySQL 5.7.12 DMR) – Implementedby X Plugin to Extend MySQL Server as a Document Store • X Dev API – SQL and Document CRUD Operations – Implementedin Connector/Node.js,Connector/J,Connector/Net • MySQL Shell – Javascript,Python,SQL modes
- 9. Copyright © 2015, Oracleand/orits affiliates. Allrights reserved. | Architecture 9 MySQL Plugins X ProtocolPlugin MemcachedPlugin Core X ProtocolStdProtocol X Protocol 33060 StdProtocol 3306 SQLAPI CRUD API X and Std Protocols MySQL Shell
- 10. Copyright © 2015, Oracleand/orits affiliates. Allrights reserved. | New! MySQL X DevAPI • Modern: fluent API, method chaining • Stateless sessions enable transparent scaling to multi-server environments • SQL support • CRUD for Collections of Documents and Tables – Documentsas simple basic domain objects – Search expressions match SQL SELECT expressions • Implemented in MySQL Shell & MySQL Connectors – NEW! MySQL Connector/node.js – MySQLConnector/J – MySQLConnector/Net
- 11. Copyright © 2015, Oracleand/orits affiliates. Allrights reserved. | New! MySQL Shell • Integrated Development and Administration Shell • Exposes New X DevAPI • Multi-Language scripting – JavaScript, Python, and SQL • Configurable results formats – Traditional Table, JSON, Tab Separated 11
- 12. Copyright © 2015, Oracleand/orits affiliates. Allrights reserved. | 12 tomas@localhost $ mysqlsh --uri root@localhost/test Creatingan X Sessionto root@localhost:33060/test Enter password: Default schema `test` accessible through db. … Currently in JavaScript mode. Use sql to switch to SQL mode and execute queries. mysql-js> db.createCollection("posts"); <Collection:posts> mysql-js> db.posts.add({"title":"Hello World", "text":"First post!"}) Query OK, 1 item affected(0.03 sec) mysql-js> db.posts.find("title = 'Hello World'").sort(["title"]); [ { "_id": "8202bda28206e611140b3229389b6526", "text": "First post!", "title": "Hello World" } ] 1 document in set (0.01 sec)
- 13. Copyright © 2015, Oracleand/orits affiliates. Allrights reserved. | 13 Under the Hood
- 14. Copyright © 2015, Oracleand/orits affiliates. Allrights reserved. | 14 Collections are tables Tables with: - JSON column - GeneratedColumn Create a Collection
- 15. Copyright © 2015, Oracleand/orits affiliates. Allrights reserved. | Under The Hood II 15 • X-Plugin translatesCRUD -> SQL • No code changes in core parts of MYSQL Create Document (CRUD) Look inside general-log
- 16. Copyright © 2015, Oracleand/orits affiliates. Allrights reserved. | Under The Hood III 16 Read Document (CRUD) Look inside general-log
- 17. Copyright © 2015, Oracleand/orits affiliates. Allrights reserved. | CRUD Operations – NoSQL/Document and SQL/Relational Operation Document Relational Create Collection.add() Table.insert() Read Collection.find() Table.select() Update Collection.modify() Table.update() Delete Collection.remove() Table.delete() 17
- 18. Copyright © 2015, Oracleand/orits affiliates. Allrights reserved. | CRUD Operations NoSQL/Document Javascript Java C#NodeJS
- 19. Copyright © 2015, Oracleand/orits affiliates. Allrights reserved. | CRUD Operations SQL/Relational 19 Javascript Java C#NodeJS
- 20. Copyright © 2015, Oracleand/orits affiliates. Allrights reserved. | MySQL Document Store ✔ Built on Proven SQL/InnoDB/Replication ✔ Schema-less/Relational/Hybrid ✔ ACID/Transactions ✔ CRUD/JSON/Documents ✔ Modern Dev API ✔ Modern/Efficient Protocol ✔ SQL Queries/Analytics over JSON Documents ✔ Transparent and Easy HA/Scaling/Sharding
- 21. Copyright © 2015, Oracleand/orits affiliates. Allrights reserved. | New! Documentation • Developer Guides • Lots of examples New Style - Developer Focused 21 http://dev.mysql.com/doc/dev/mysqlsh-api-javascript/
- 22. Copyright © 2015, Oracleand/orits affiliates. Allrights reserved. | Program Agenda MySQL Document Store MySQL Future 1 2 22
- 23. Copyright © 2015, Oracleand/orits affiliates. Allrights reserved. | Vision
- 24. Copyright © 2015, Oracleand/orits affiliates. Allrights reserved. | “Be the most popular open source database for scale-out” 24
- 25. Copyright © 2015, Oracleand/orits affiliates. Allrights reserved. | 3 MySQL will focus on three things. 25
- 26. Copyright © 2015, Oracleand/orits affiliates. Allrights reserved. | 26 Scale-Out Ease-of-Use Out-of-Box Solution MySQL
- 27. Copyright © 2015, Oracleand/orits affiliates. Allrights reserved. | 27 Ease-of-Use • Download, Install, HA & Scale-Out in 15 minutes • Single Interface for Everything MySQL • Easy to Setup, Scale-Out, Manage & Monitor • Excellent Quality MySQL
- 28. Copyright © 2015, Oracleand/orits affiliates. Allrights reserved. | 28 Out-of-Box Solution • Integrated Solution vs. Individual Components • Designed & Developed Together • Tested & Delivered Together • Managed & Monitored Together MySQL
- 29. Copyright © 2015, Oracleand/orits affiliates. Allrights reserved. | 29 Scale-Out • Maintain World-Class Performance • Rock Solid, Server-Side HA With Auto-Failover • Read Scale-Out With Replication • Write Scale-Out With Sharding MySQL
- 30. Copyright © 2015, Oracleand/orits affiliates. Allrights reserved. | 4 Rollout will happen in four steps. 30
- 31. Copyright © 2015, Oracleand/orits affiliates. Allrights reserved. | 31 Read Scale-Out Async Replication+ Auto Failover Write Scale-Out Sharding S1 S2 S3 S4 MySQL Vision – 4 Steps Timeline MySQLDocumentStore Relational & Document Model MySQLHA Out-Of-BoxHA
- 32. Copyright © 2015, Oracleand/orits affiliates. Allrights reserved. | Introducing … 32
- 33. Copyright © 2015, Oracleand/orits affiliates. Allrights reserved. | 33 Scale-Out High Performance Ease-of-Use Built-inHA Out-of-Box Solution Everything Integrated MySQL InnoDB cluster
- 34. Copyright © 2015, Oracleand/orits affiliates. Allrights reserved. | 34 A single product: MySQL • All componentscreated together • Tested together • Packaged together Flexible and Modern • C++ 11 • ProtocolBuffers • Developer friendly MySQL InnoDB Cluster – Goals Easy to use • A single client: MySQL Shell • Easy packaging • Homogenousservers Scale-out • Sharded clusters • Federated system of N replica sets • Each replica set manages a shard
- 35. Copyright © 2015, Oracleand/orits affiliates. Allrights reserved. | MySQL InnoDB cluster MySQL InnoDB Cluster – Architecture - S2 M M M MySQLConnector Application MySQL Router MySQL Connector Application MySQL Router MySQL Shell HA Group Replication
- 36. Copyright © 2015, Oracleand/orits affiliates. Allrights reserved. | S1 S2 S3 S4 S… M M M MySQLConnector Application MySQL Router MySQL Connector Application MySQL Router MySQL Shell HA MySQL InnoDB Cluster – Architecture - S3 MySQL InnoDB cluster Read-Only Slaves
- 37. Copyright © 2015, Oracleand/orits affiliates. Allrights reserved. | S1 S2 S3 S4 S… M M M MySQLConnector Application MySQL Router MySQL Connector Application MySQL Router MySQL Shell HA ReplicaSet(Shard1) S1 S2 S3 S4 S… M M M MySQLConnector Application MySQL Router HA ReplicaSet(Shard2) S1 S2 S3 M M M H ReplicaSet(Shard3) MySQLConnector Application MySQL Router MySQL InnoDB Cluster – Architecture - S4 MySQL InnoDB cluster …
- 38. Copyright © 2015, Oracleand/orits affiliates. Allrights reserved. | MySQLConnector Application MySQL Connector Application MySQL Shell MySQLConnector Application MySQLConnector Application MySQL InnoDB Cluster – Architecture MySQL InnoDB cluster MySQL Enterprise Monitor …
- 39. Copyright © 2015, Oracleand/orits affiliates. Allrights reserved. | MySQL InnoDB cluster
- 40. Copyright © 2015, Oracleand/orits affiliates. Allrights reserved. | Demo MySQL InnoDB cluster
- 41. Copyright © 2015, Oracleand/orits affiliates. Allrights reserved. | MySQL InnoDB cluster MySQL InnoDB Cluster – DEMO M M M Application MySQL Router MySQL Connector Applicaion MySQL Shell HA Group Replication 3310 3320 3330
- 42. Copyright © 2015, Oracleand/orits affiliates. Allrights reserved. | 42 The Demo Showed… • MySQL HA in 4 minutes • Very easy, even for somebody new to MySQL • Everything managed through MySQL Shell • Convenient, easy-to-use AdminAPI MySQL InnoDB cluster
- 43. Copyright © 2015, Oracleand/orits affiliates. Allrights reserved. | 1 One seamless solution for HA: Easy-to-Use, Out-of-Box, Scale- Out. 43 MySQL InnoDB cluster
- 44. Copyright © 2015, Oracleand/orits affiliates. Allrights reserved. | What’s next? 44
- 45. Copyright © 2015, Oracleand/orits affiliates. Allrights reserved. | 45 Read Scale-Out Async Replication+ Auto Failover Write Scale-Out Sharding S1 S2 S3 S4 MySQL Vision – 4 Steps Timeline Download Preview Release from labs.mysql.com MySQLDocumentStore Relational & Document Model MySQLHA Out-Of-BoxHA
- 46. Copyright © 2015, Oracleand/orits affiliates. Allrights reserved. | Resources Topic Link(s) MySQLas a Document Database http://dev.mysql.com/doc/refman/5.7/en/document-database.html MySQLShell http://dev.mysql.com/doc/refman/5.7/en/mysql-shell.html http://dev.mysql.com/doc/refman/5.7/en/mysqlx-shell-tutorial-javascript.html http://dev.mysql.com/doc/refman/5.7/en/mysqlx-shell-tutorial-python.html X Dev API http://dev.mysql.com/doc/x-devapi-userguide/en/ X Plugin http://dev.mysql.com/doc/refman/5.7/en/x-plugin.html MySQLJSON http://mysqlserverteam.com/tag/json/ https://dev.mysql.com/doc/refman/5.7/en/json.html https://dev.mysql.com/doc/refman/5.7/en/json-functions.html 46
- 47. Copyright © 2015, Oracleand/orits affiliates. Allrights reserved. | Thank you!