Introduction of MariaDB 2017 09
3 likes2,902 views
MariaDB is an open-source relational database management system that was created to be more open and community-focused than its predecessor, MySQL. It was founded in 2009 by the original developers of MySQL after Oracle acquired Sun Microsystems. MariaDB aims to preserve the open nature of MySQL by using an open governance model and keeping its code open source under GPL. It has become the default database in several major Linux distributions and is available on major cloud platforms. MariaDB provides an enterprise-grade database with high availability, performance, scalability and security features.
Introduction of MariaDB 2017 09
- 1. Introduction of MariaDB 26th September 2017 GOTO Satoru Customer Solutions Engineer
- 2. What is MariaDB ?
- 3. Michael “Monty” Widenius The Soul of Open Source Founder & CTO of MariaDB MariaDB was created to preserve openness and community, so that we can push ahead faster with the capabilities for tomorrow’s applications. ” “
- 4. History of MySQL & MariaDB 1981 Unireg (base of MySQL code) 1994 Added SQL interface and renamed it MySQL 1995 MySQL released under dual licensing 2005 Oracle acquired InnoDB 2008 Sun acquired MySQL AB for 1 billion USD 2009 Monty & others left Sun in Feb 2009 to work on Maria engine in Monty Program Ab 2009 Oracle acquired Sun 2012 MariaDB foundation was created 2013 MariaDB started replacing MySQL in most Linux distributions 2013 Monty Program Ab merged with SkySQL 2014 SkySQL Ab renamed to MariaDB Corporation 4
- 5. History of MariaDB Feb 2010 MariaDB 5.1 Nov 2010 MariaDB 5.2 Apr 2012 MariaDB 5.3 Feb 2012 MariaDB 5.5 Mar 2014 MariaDB 10.0 Oct 2015 MariaDB 10.1 May 2017 MariaDB 10.2.6 GA Aug 2017 MariaDB 10.3.1 alpha https://downloads.mariadb.org/mariadb/+releases/ https://github.com/MariaDB/server/releases 5
- 7. MariaDB vs. MySQL More Storage Engines • ColumnStore column oriented engine for Data warehousing(DWH) • Spider in 10.0 and later • MyRocks with great compression, in 10.2 • Aria MyISAM replacement with better caching • FederatedX drop-in replacement for Federated • OQGRAPH new in 5.2 - Open Query GRAPH • SphinxSE new in 5.2 • TokuDB in 5.5 and later - • CONNECT in 10.0 and later • SEQUENCE in 10.0 and later • Cassandra in 10.0 https://mariadb.com/kb/en/library/mariadb-vs-mysql-features/ 7
- 8. MariaDB vs. MySQL Performance Improvements • Query Optimizer enhancements • Faster and safer replication • Character set conversions • Thread Pool – allows 200,000+ connections and with a notable speed improvement when using many connections – w/ MySQL only available with Enterprise version https://mariadb.com/kb/en/library/mariadb-vs-mysql-features/ 8
- 9. MariaDB vs. MySQL Extensions & New Features • Window functions new in 10.2 • DECIMAL from 30 to 38 new in 10.2 • Recursive CTE new in 10.2 (Common Table Expressions) • CHECK CONSTRAINT new in 10.2 • DEFAULT new in 10.2, for BLOB and TEXT • Added catchall for list partitions new in 10.2 • EXECUTE IMMEDIATE new in 10.2 (Oracle-style ) • JSON functions new in 10.2 • ms Precision in Processlist • Table Elimination • Virtual Columns new in 5.2 9
- 10. MariaDB vs. MySQL Extensions & New Features • Extended User Statistics new in 5.2 • KILL all queries for a user new in 5.3 • KILL QUERY ID terminates the query by query_id, leaving the connection intact — new in 10.0.5 • Pluggable Authentication new in 5.2 • Enhancements to INFORMATION SCHEMA.PLUGINS table — new in 5.2 • Group commit for the binary log new in 5.3 • Added --rewrite-db mysqlbinlog option to change the used database — new in 5.2 • Progress reporting for ALTER TABLE and LOAD DATA INFILE — new in 5.3 • Faster joins and subqueries new in 5.3 • HandlerSocket and faster HANDLER calls new in 5.3 • Dynamic Columns support new in 5.3 • GIS Functionality new in 5.3 10
- 11. MariaDB vs. MySQL Extensions & New Features • Multi-source replication new in 10.0 • GTID new in 10.0, Global Transaction ID • SHOW EXPLAIN new in 10.0, gives the EXPLAIN query plan • Roles new in 10.0 • PCRE new in 10.0, Perl Compatible Regular Expressions • DELETE ... RETURNING new in 10.0 https://mariadb.com/kb/en/library/mariadb-vs-mysql-features/ 11
- 12. MariaDB vs. MySQL Truly Open Source • All code in MariaDB : released under GPL, LGPL or BSD • MariaDB client libraries (for C, for Java (JDBC), for Windows (ODBC) are released under LGPL – allows link with closed source software – MySQL client libraries are released under GPL that does not allow linking with closed source software • MariaDB includes test cases for all fixed bugs. – Oracle doesn't provide test cases for new bugs fixed in MySQL 5.5 – All bugs / development plans are public •https://jira.mariadb.org/ •https://github.com/MariaDB 12
- 13. By 2018, more than 70% of new in- house applications will be developed on an ODBMS, and 50% of existing commercial RDBMS instances will have been converted or will be in process. “ Gartner | STRATEGIC PLANNING ASSUMPTION 13
- 14. Multisource Replication Galera Cluster InnoDB Storage Engine Spiral Arms – Spider Sharding Security Key Management Plugin WebScaleSQL Patches MaxScale Sehema Sharding MaxScale Binlog XtraDB Storage Engine Atomic Writes Encryption CONNECT Storage Engine OLIVIER BERTRAND MariaDB Optimizer on Power TokuDB Storage Engine 14
- 15. We’re building a database that is easy to use, easy to extend, and easy to deploy: on premise, in the cloud, or hybrid, operational or analytical – and with the languages and frameworks you prefer. 15
- 17. Annual Subscriptions Cloud Infrastructure Modern Hardware Reduced Costs
- 18. Economics of Inevitable Change 3 Year Total Cost of Ownership On premise… • Oracle costs 80x more • Organizations can save $9 million In the cloud… • On AWS, Oracle costs 145x more • On Oracle Cloud, it costs 69x more $5,496,000 $112,500 18
- 19. Default Database on Leading Linux Distros, Available on Leading Cloud Platforms Cloud Services & StacksLinux Distributions 19
- 20. MariaDB Going Mainstream OpenStack user survey April 2017 20
- 21. Distribution Estimated Reach MariaDB Default since CentOS 10 million 2013 RHEL 5.3 million 2013 openSUSE 28 million 2015 Fedora 13.4 million 2015 Debian 1.5 million 2017 Ubuntu 25 million Expected to follow Debian BSD, Mageia, macOS etc 1 million Mostly all default MariaDB MariaDB Going Mainstream 21
- 22. MariaDB Going Mainstream DB-Engines Ranking RDBMS Sep 2017 db-engines.com/en/ranking
- 23. DB-Engines Ranking of RDBMS Sep 2017 db-engines.com/en/ranking MariaDB Going Mainstream 23
- 24. 12 Million Users in 45 Countries Trust Critical Business Data to MariaDB Technology & InternetTelecom Retail & EcommerceTravel Financial Services Gvmt & Education Media & Social 24
- 25. The database market is changing. It is time for a new leader. Expensive Licenses Closed Development Platform Lock-in Yesterday's Interest Resistance to Change Proprietary Open Source Low-cost Subscriptions Community Innovation Infrastructure independent Today’s Excitement Continuous Evolution 25
- 26. What will this new leader provide? Enterprise Reliability High Availability (Replication / Failover) Disaster Recovery (Backup & Restore) Performance (Thread Pool) Scalability (Partitioning and Sharding) Security (Firewall and Encryption) Open Source Innovation Open Development (Tests and Roadmaps) Community Collaboration (New Features) Extensible Architecture (Custom Plugins) Flexible Modeling (Dynamic Columns & JSON) Streaming Integration (CDC and Kafka) 26
- 27. SERVER Enterprise-grade secure, highly available and scalable relational database with a modern, extensible architecture MAXSCALE COLUMNSTORE Next-generation database proxy that manages security, scalability and high availability in scale-out deployments Columnar storage engine for massively parallel distributed query execution and data loading MariaDB Technology 27
- 28. OPERATING SYSTEM / FILE SYSTEM / SAN / CLOUD MariaDB MaxScaleMariaDB Multi-Master Cluster Applications Connectors MariaDB Server NoSQL CRUD API Original Core MariaDB Engineering Community Contribution Replicas Supporting Asynchronous, Semi-Sync & Synchronous replication MariaDB C JDBC ODBC Replication Kernel Production Plugins SQL Parser Parallel Slave GTIDBinLog API Multi-Source Cache/Buffer Optimiser Connection Pool Temporal PL/SQL Audit AWS KMS Authentication Handler Socket SQL Lightweight Transactional InteroperabilityPerformance & Scalability Graph & Search Analytics InnoDB XtraDBMemory MyISAM CONNECTColumnStore Spider OQGRAPH MyRocks Mroonga STORAGE LAYER EXTENSIBILITY KERNEL EXTENSIBILITY 40+ Plugins Extensible Architecture 28
- 30. MariaDB Storage Engines General Purpose • XtraDB : best choice in many cases until MariaDB 10.1 –performance-enhanced fork of InnoDB and is MariaDB's default engine until MariaDB 10.1 • InnoDB : general transactional engine, default MariaDB 10.2 • MyISAM : small footprint and allows for easy copying between systems –MySQL's oldest storage engine • Aria : MariaDB's modern improvement on MyISAM https://mariadb.com/kb/en/library/choosing-the-right-storage-engine/ 30
- 31. MariaDB Storage Engines Scaling, Partitioning • Galera Cluster : synchronous multi-master cluster. only InnoDB supported • TokuDB is a transactional storage engine which is optimized for workloads that do not fit in memory, and provides a good compression ratio • Spider uses partitioning to provide data sharding through multiple servers • https://www.slideshare.net/Kentoku/mariadb-103spider • ColumnStore utilizes a massively parallel distributed data architecture and is designed for big data scaling to process petabytes of data • https://www.slideshare.net/InsightTechnology/dbtstky2017-c37- mariadb 31
- 32. MariaDB Storage Engines Compression / Archive • MyRocks : enables greater compression than InnoDB, as well as less write amplification giving better endurance of flash storage(SSD) and improving overall throughput. Developed at Facebook • https://enterprisezine.jp/dbonline/detail/9450 • TokuDB : transactional storage engine which is optimized for workloads that do not fit in memory, and provides a good compression ratio • Archive : best used for archiving 32
- 33. Storage Engines Connecting to other data sources • CONNECT : allows access to different kinds of text files and remote resources as if they were regular MariaDB tables • CSV : read and append to files stored in CSV format. –since MariaDB 10.0, CONNECT is a better choice and is more flexibly able to read and write such files • FederatedX : uses libmysql to talk to the data source, the data source being a remote RDBMS. –Currently, since FederatedX only uses libmysql, it can only talk to another MySQL RDBMS. • CassandraSE : allowing access to an older version of Apache Cassandra NoSQL DBMS. –It was relatively experimental, and is no longer being actively developed 33
- 34. Storage Engines Full Text Search • SphinxSE : proxy to run statements on a remote Sphinx DB server • Mroonga : fast CJK-ready full text search – http://mroonga.org/ja/blog/2016/07/21/mariadb-community-event-in-tokyo.html – https://www.slideshare.net/kou/dbtechshowcasetokyo2017 34
- 35. Storage Engines Cache, read-only • MEMORY : does not write data on-disk (all rows are lost on crash) and is best-used for read-only caches of data from other tables, or for temporary work areas. – With the default XtraDB and other storage engines having good caching, there is less need for this engine than in the past. 35
- 36. 10.1 (GA) Multi-master Replication (Galera) Data-at-Rest Encryption Password Validation Page Compression Facebook Defragmentation Spatial References (GIS) 10.2 (GA) 10.3 (DEV) MyRocks Flashback (Point in Time Rollback) Common Table Expressions Window Functions Check Constraints JSON & GeoJSON Functions Mult-Trigger Support Delayed Replication Binary Log Compression Per User Resource Limits Virtual Column Indexes Sequences & PL/SQL System Versioned Tables As Of (Point in Time Querying) User-defined Aggregate Functions Intersect & Except Hidden Columns Evolution of MariaDB Server 36
- 37. High Availability Ensure uptime with no single point of failure and minimize downtime during upgrade Data Streaming Stream transactional data to data lake for real-time analytics Scalability Manage your scaled-out infrastructure without changing application code Security Secure database firewall to prevent cyber attacks like SQL injection and DDoS MariaDB MaxScale is a next-generation database proxy that manages security, scalability and high availability in a scale out deployment. MariaDB MaxScale 37
- 38. High performance columnar storage engine that supports a wide variety of analytical use cases in highly scalable distributed environments Parallel query processing for distributed environments Faster, More Efficient Queries Single Interface for OLTP and analytics Easy to Manage and Scale Easier Enterprise Analytics Power of SQL and Freedom of Open Source to Big Data Analytics Better Price Performance MariaDB ColumnStore(AX) 38
- 39. MariaDB ColumnStore Architecture Columnar Distributed Data Storage Local Storage | SAN | EBS | GlusterFS BI Tool SQL Client Custom Big Data App Application MariaDB SQL Front End Distributed Query Engine Data Storage User Module (UM) Performance Module (PM) 39
- 40. Put our Expertise to Work for You Enterprise Architect Technical Support Services and Support 40
- 41. MariaDB TX 2.0 MariaDB Services Remote Administration Enterprise Architecture Migration Management Technical Support MariaDB Tools MariaDB Admin MariaDB Monitor MariaDB Backup MariaDB Notifications Pluggable Storage Replication MariaDB Server Pluggable Storage Replication MariaDB Server Pluggable Storage Replication MariaDB Server MariaDB Cluster MariaDB Connectors MariaDB MaxScale (Proxy) Failover Sharding Streaming Caching Security Routing Transaction Platform 41
- 42. MariaDB TX 2.0 Software licensing and support for databases, the database proxies and database connectors Services credits for remote administration, enterprise architecture, migration planning services and more Tools tools for administration, monitoring, backup and replication management Transaction Platform 42
- 43. Customer and Use Cases • Multi-terabyte DB • 80M transactions / month • 50+ Node Cluster • Multi-billion rows • 600 Million reads/second • 250 servers, 600G + 1.5T archive • 10M travelers/quarter • 4M transactions/ month • ~14TB in MariaDB production clusters • Over 150 servers • 150-200k queries / sec on the MariaDB Cluster • 6TB and millions of CDR’s • 70 million rows per day • 4 billion impressions per month • 3 to 10 TB • Over billion rows, most tables 100’s of millions of rows • Over 5 TB in Pay Per click application 43
- 44. Download https://mariadb.com/downloads 1 Read the Technical overviews https://mariadb.com/resources/datashe ets-guides 2 Search the Knowledge Base https://mariadb.com/kb 3 Watch a Webinar https://mariadb.com/resources/webinars 4 Get Started with MariaDB 44
- 45. Upcoming events
- 47. M|18 FEB 26–27, 2018 CONRAD NEW YORK m18.mariadb.com
- 48. Latest news
- 49. What is new in ColumnStore 1.1 ? Data Engine ● Columnar Engine based on MariaDB 10.2 Streaming ● Native Data API for ColumnStore files: C++: LGPL ● Data Adapters ○ Avro, JSON - BSL ○ Streaming Change Data Capture via MaxScale & Kafka - BSL ● Streaming Insert via MaxScale - BSL HA ● Built-in Data Redundancy: Integrated GlusterFS for Data HA Analytics ● User defined distributed aggregate and Window functions Data Types ● Text, BLOB Ease of Use ● Backup, restore tool - BSL Performance ● Improved string handling / memory utilization ● General performance improvements Security ● Audit Plugin Integration Certification ● Tableau https://mariadb.com/downloads/mariadb-tx
- 50. Thank you