SlideShare a Scribd company logo
SequoiaDB Distributed Relational Database
SequoiaDB Distributed Relational Database
SequoiaDB Distributed Relational Database
SequoiaDB Distributed Relational Database
SequoiaDB Distributed Relational Database
•
•
•
•
•
•
•
•
•
SequoiaDB Distributed Relational Database
SequoiaDB Distributed Relational Database
SequoiaDB Distributed Relational Database
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
SequoiaDB Distributed Relational Database
SequoiaDB Distributed Relational Database
SequoiaDB Distributed Relational Database
SequoiaDB Distributed Relational Database
SequoiaDB Distributed Relational Database
SequoiaDB Distributed Relational Database
SequoiaDB Distributed Relational Database
SequoiaDB Distributed Relational Database
SequoiaDB Distributed Relational Database
§ E
§
§ C M
§
§
E
CE-
5
CE
E 7
40
-3
40 21
E
C
C
/
C IT
R
/
/ / / / /
……
/
/
/
/
O /
/ / /
SequoiaDB Distributed Relational Database
TB
PB
PC
TB
SequoiaDB Distributed Relational Database
•
•
•
•
•
•
SequoiaDB Distributed Relational Database
MySQL
PostgreSQL
SparkSQL
JSON
S3
Posix
Catalog
Data
Data
Data
Catalog
Data
Data
Data
Catalog
Data
Data
Data
Coord
Data
Data
Data
Data
Data
Data
Coord
Data
Data
Data
1181011800
11820
11830
11840
11820
11830
11840
192.168.1.1 192.168.1.2 192.168.1.3 192.168.1.4 192.168.1.5 192.168.1.6
datagroup1
datagroup2
datagroup3
datagroup4
datagroup5
datagroup6
Coord
MySQL MySQL MySQL
3306
APP/JDBC
3
CPU 2 48C 2 32C 2 24C
256GB 256GB 128GB
6 x 512GB SSD 12 x 2TB SAS 12 x 4TB SATA
CentOS 7.4 CentOS 7.4 CentOS 7.4
SequoiaDB Distributed Relational Database
TargetPartition = DHT ( Row->PartitionKey )
datagroup1 datagroup2 datagroup3
•
• 2
• 2
•
Data
Data
Data
Data
Data
Data
Data
Data
Data
11820
11830
11840
192.168.1.1 192.168.1.2 192.168.1.3
datagroup1
datagroup2
datagroup3
MySQL
Coord
MySQL
Coord
MySQL
Coord
3306
11810
192.168.1.4 192.168.1.5 192.168.1.6
Catalog Catalog Catalog11800 Catalog Catalog Catalog 11800
Data
Data
Data
Data
Data
Data
Data
Data
Data
11820
11830
11840
datagroup4
datagroup5
datagroup6
•
•
•
•
•
•
•
•
• SQL DML
• DDL DCL
•
• MySQL
• JDBC
• MySQL
• MySQL
• MySQL
SequoiaDB Distributed Relational Database
SequoiaDB Distributed Relational Database
SequoiaDB Distributed Relational Database
SequoiaDB Distributed Relational Database
SequoiaDB Distributed Relational Database
• mydumper/myloader
• Kettle
• sdbimprt/sdbexprt
• Oracle Golden Gate
• IBM CDC
• MySQL Binlog Replication
o
rS e
d p i T
fL A6 4C B T a
ih 10 0
MO Iy n c
x
5 o
t
2B6 6C
2B6 / 1 + + / 1
// / 1 / B D
+6 1E430
G m lQ
p e c QO
Oracle
DB2
Informix
MySQL
b N d
P V b N
N C
+ V N
S
3 124F
N
O b N + N d i
J T
Oracle
DB2
Informix
MySQL
•
• /
• /
•
• /
•
1
n
1 T P Q
o O 2
4 2D ySB M 3
Q
o 0 % I
L
G
1 M J
2
3
P S Q
LH N
k
k1 Q 2 3
2
a
kT L S
Q E 2
N O 4J
M 2
M B
M D
M 1 3
1
S2
S
S 4 A
S 5 3
S 5
bash
ls
……
Linux Kernel
vfs fuse
libfuse
1 4
1
1 3
2 L
MySQL 1 MySQL 2 MySQL 3 MySQL 4
SparkSQL 1 SparkSQL 2
MySQL
MySQL 1 MySQL 2 S3 Posix
SequoiaDB Distributed Relational Database
I4
P3
2
1
SequoiaDB Distributed Relational Database
SequoiaDB Distributed Relational Database
File Header
Space Management Extent
Data Segment Metadata
CS Metadata
page1 page2 ...
offset1 offset2
key2 key1
SequoiaDB Distributed Relational Database
Insert into T1 values ( 1, ‘hello’ ) ;JDBC
MySQL
Select * from T1 where c1=1 ;
S3 SDK Bucket.put ( objectID, fileName ) ;
objectID
File = Bucket.get ( objectID ) ;
objectID
MySQL
GTM
1 insert 1
2
3 insert 1
4 1
5 insert 2
6 insert 2
7 2
8 commit
9 pre-commit
10 confirm
11 commit
12 commit
13 commit
14
1 r
C
O w O
% y p
I D P D
1 U
OT 1
1 9 1 U A –
m t
% / 1 U 3 255 3 l
U
4 24
co o A A o
o – m
% // / / s / 0
A t o
U
s i o w a –
% A S o
MySQL
sequoiadb_use_partition on
sequoiadb_use_bulk_insert on
sequoiadb_bulk_insert_size 100
sequoiadb_use_autocommit on
sequoiadb_replica_size -1 -1
auto.cnf
maxpool 50
numpreload 0
sortbuf 256MB
preferedinstance M
plancachelevel 0
/conf/local/ /sdb.conf
transactionon true
transactiontimeout 60s
transisolation 0 UR
translockwait false
transautocommit false
transautorollback true
transuserbs true
/conf/local/ /sdb.conf
MySQL
SequoiaDB MySQL InnoDB SequoiaDB
stock order item
MySQL
item SequoiaDBorderstock
MySQL binlog replication
100% MySQL SequoiaDB MySQL
MySQL SequoiaDB
F5
Binlog Replication
S3 API
PUT Bucket Create User
DELETE Bucket Create AccessKey
GET Service DELETE User
GET Bucket location GET AccessKey
HEAD Bucket LIST Regions
PUT Object PUT Region
GET Bucket (List Objects) Version 2 DELETE Region
GET Bucket Object versions GET Region
GET Object HEAD Region
HEAD Object
DELETE Object
PUT Bucket versioning
GET Bucket versioning
CollectionSpace String -- collection collection space
Collection String -- collection collection space
CreateTime NumberLong 0
SampleRecords NumberLong 0
TotalRecords NumberLong 10 dmsMBStatInfo _totalRecords
TotalDataPages NumberInt 1
TotalDataSize NumberLong dmsMBStatInfo _totalDataLen
AvgNumFields NumberInt 10
CollectionSpace String -- collection collection space
Collection String -- collection collection space
CreateTime NumberLong 0
Index String -- Index
KeyPattern BSONObj -- {a:1, b:-1}
SampleRecords NumberLong 0
TotalRecords NumberLong 10
SYSSTAT.SYSCOLLECTIONSTAT
TotalRecords
dmsMBStatInfo _totalRecords
IndexPages NumberInt 1
IndexLevels NumberInt 1
IsUnique BOOL FALSE Index
DistinctValues NumberLong 0 Collection TotalRecords
NullFrac NumberInt 0 null NullFrac / 10000
UndefinedFrac NumberInt 0 $undefined UndefinedFrac / 10000
MCV Object undefined
Most Common Values
MCV: { Values: [ {a:1,b:1}, {a:2, b:2}, ... ], Frac: [ 1000, 1000, ... ] }
MCV.Values Array MCV
MCV.Frac Array MCV 0 ~ 10000 Frac / 10000
Histogram Object undefined
Histogram.Frac NumberDouble 0 0 ~ 10000 Frac / 10000
Histogram.Bounds Array
TypeSet Object undefined
TypeSet.Types Array
TypeSet.Frac Array 0 ~ 10000 Frac / 10000
MySQL
MySQL Protocol
Query Parser
Query Optimizer
Query Execution
Storage Plugin
Coord
SDB Protocol
Query Parser
Transaction Mgmt
Runtime
Network
Data
SDB Protocol
Runtime
Data Management
Index Management
Log Management
4 1
S n 2e2
0
dA3
3 1 aS
1 3
1
D v D i
hr D
m 3 3
1 3 1 1
aS
43 o2 1
D
D
o2 aS
k8s
sequoiadb Coord Data Catalog sequoisql-mysql MySQL
SequoiaDB Distributed Relational Database

More Related Content

PPTX
MongoDB: Comparing WiredTiger In-Memory Engine to Redis
PDF
HPCC Systems - ECL for Programmers - Big Data - Data Scientist
PDF
Data recovery using pg_filedump
PDF
What's new in Redis v3.2
PPTX
2015 555 kharchenko_ppt
PDF
My sql fulltext search
PDF
Hands On Spring Data
ODP
Elastic Search
MongoDB: Comparing WiredTiger In-Memory Engine to Redis
HPCC Systems - ECL for Programmers - Big Data - Data Scientist
Data recovery using pg_filedump
What's new in Redis v3.2
2015 555 kharchenko_ppt
My sql fulltext search
Hands On Spring Data
Elastic Search

What's hot (20)

PPTX
Node collaboration - Exported Resources and PuppetDB
PDF
Introduction to Pig & Pig Latin | Big Data Hadoop Spark Tutorial | CloudxLab
TXT
Code
PPTX
MongoDB Scalability Best Practices
PPTX
MongoDB - Aggregation Pipeline
PDF
Полнотекстовый поиск в PostgreSQL за миллисекунды (Олег Бартунов, Александр К...
PPTX
Redis Developers Day 2015 - Secondary Indexes and State of Lua
PDF
pg_filedump
PDF
Data warehouse or conventional database: Which is right for you?
PDF
A Practical Introduction to Handling Log Data in ClickHouse, by Robert Hodges...
PDF
Adaptive Query Processing on RAW Data
PPTX
Commit2015 kharchenko - python generators - ext
KEY
Python Development (MongoSF)
PDF
ClickHouse Features for Advanced Users, by Aleksei Milovidov
PDF
Full Text Search in PostgreSQL
PDF
Using MongoDB and Python
PDF
PPT
MongoDB @ fliptop
PDF
Migration from mysql to elasticsearch
PPTX
Visualizing ORACLE performance data with R @ #C16LV
Node collaboration - Exported Resources and PuppetDB
Introduction to Pig & Pig Latin | Big Data Hadoop Spark Tutorial | CloudxLab
Code
MongoDB Scalability Best Practices
MongoDB - Aggregation Pipeline
Полнотекстовый поиск в PostgreSQL за миллисекунды (Олег Бартунов, Александр К...
Redis Developers Day 2015 - Secondary Indexes and State of Lua
pg_filedump
Data warehouse or conventional database: Which is right for you?
A Practical Introduction to Handling Log Data in ClickHouse, by Robert Hodges...
Adaptive Query Processing on RAW Data
Commit2015 kharchenko - python generators - ext
Python Development (MongoSF)
ClickHouse Features for Advanced Users, by Aleksei Milovidov
Full Text Search in PostgreSQL
Using MongoDB and Python
MongoDB @ fliptop
Migration from mysql to elasticsearch
Visualizing ORACLE performance data with R @ #C16LV
Ad

Similar to SequoiaDB Distributed Relational Database (20)

PDF
Beyond the Query – Bringing Complex Access Patterns to NoSQL with DataStax - ...
PDF
A Cassandra + Solr + Spark Love Triangle Using DataStax Enterprise
PDF
Beyond the Query: A Cassandra + Solr + Spark Love Triangle Using Datastax Ent...
PDF
Scaling MySQL Strategies for Developers
ODP
Drupal MySQL Cluster
PDF
Apache Cassandra at Macys
PPT
Direct SGA access without SQL
PPTX
Postgresql Database Administration Basic - Day2
PDF
MongoDB: Optimising for Performance, Scale & Analytics
PPTX
Understanding DSE Search by Matt Stump
PPT
ZFConf 2011: Что такое Sphinx, зачем он вообще нужен и как его использовать с...
PDF
Oracle 12.2 sharding learning more
PDF
Robert Pankowecki - Czy sprzedawcy SQLowych baz nas oszukali?
PDF
Tutorial On Database Management System
PDF
Superficial mongo db
PDF
MySQL Tokudb engine benchmark
PPT
HandlerSocket plugin for MySQL (English)
PPT
11thingsabout11g 12659705398222 Phpapp01
PPT
11 Things About11g
DOC
Rac nonrac clone
Beyond the Query – Bringing Complex Access Patterns to NoSQL with DataStax - ...
A Cassandra + Solr + Spark Love Triangle Using DataStax Enterprise
Beyond the Query: A Cassandra + Solr + Spark Love Triangle Using Datastax Ent...
Scaling MySQL Strategies for Developers
Drupal MySQL Cluster
Apache Cassandra at Macys
Direct SGA access without SQL
Postgresql Database Administration Basic - Day2
MongoDB: Optimising for Performance, Scale & Analytics
Understanding DSE Search by Matt Stump
ZFConf 2011: Что такое Sphinx, зачем он вообще нужен и как его использовать с...
Oracle 12.2 sharding learning more
Robert Pankowecki - Czy sprzedawcy SQLowych baz nas oszukali?
Tutorial On Database Management System
Superficial mongo db
MySQL Tokudb engine benchmark
HandlerSocket plugin for MySQL (English)
11thingsabout11g 12659705398222 Phpapp01
11 Things About11g
Rac nonrac clone
Ad

Recently uploaded (20)

PPTX
01_intro xxxxxxxxxxfffffffffffaaaaaaaaaaafg
PPTX
ALIMENTARY AND BILIARY CONDITIONS 3-1.pptx
PDF
22.Patil - Early prediction of Alzheimer’s disease using convolutional neural...
PDF
Galatica Smart Energy Infrastructure Startup Pitch Deck
PPTX
mbdjdhjjodule 5-1 rhfhhfjtjjhafbrhfnfbbfnb
PDF
TRAFFIC-MANAGEMENT-AND-ACCIDENT-INVESTIGATION-WITH-DRIVING-PDF-FILE.pdf
PPTX
Introduction to machine learning and Linear Models
PDF
Clinical guidelines as a resource for EBP(1).pdf
PPTX
Introduction to Knowledge Engineering Part 1
PPTX
oil_refinery_comprehensive_20250804084928 (1).pptx
PPTX
iec ppt-1 pptx icmr ppt on rehabilitation.pptx
PPTX
Introduction-to-Cloud-ComputingFinal.pptx
PDF
Recruitment and Placement PPT.pdfbjfibjdfbjfobj
PPT
Miokarditis (Inflamasi pada Otot Jantung)
PPTX
climate analysis of Dhaka ,Banglades.pptx
PPTX
The THESIS FINAL-DEFENSE-PRESENTATION.pptx
PDF
168300704-gasification-ppt.pdfhghhhsjsjhsuxush
PPTX
Supervised vs unsupervised machine learning algorithms
PPTX
Computer network topology notes for revision
01_intro xxxxxxxxxxfffffffffffaaaaaaaaaaafg
ALIMENTARY AND BILIARY CONDITIONS 3-1.pptx
22.Patil - Early prediction of Alzheimer’s disease using convolutional neural...
Galatica Smart Energy Infrastructure Startup Pitch Deck
mbdjdhjjodule 5-1 rhfhhfjtjjhafbrhfnfbbfnb
TRAFFIC-MANAGEMENT-AND-ACCIDENT-INVESTIGATION-WITH-DRIVING-PDF-FILE.pdf
Introduction to machine learning and Linear Models
Clinical guidelines as a resource for EBP(1).pdf
Introduction to Knowledge Engineering Part 1
oil_refinery_comprehensive_20250804084928 (1).pptx
iec ppt-1 pptx icmr ppt on rehabilitation.pptx
Introduction-to-Cloud-ComputingFinal.pptx
Recruitment and Placement PPT.pdfbjfibjdfbjfobj
Miokarditis (Inflamasi pada Otot Jantung)
climate analysis of Dhaka ,Banglades.pptx
The THESIS FINAL-DEFENSE-PRESENTATION.pptx
168300704-gasification-ppt.pdfhghhhsjsjhsuxush
Supervised vs unsupervised machine learning algorithms
Computer network topology notes for revision

SequoiaDB Distributed Relational Database