Apache HBase: Introduction to a column-oriented data store
0 likes1,780 views
HBase is an open source, distributed, column-oriented data store modeled after Google's BigTable. It stores data in sorted, sparse tables and supports real-time read/write access to big data. HBase runs on top of Hadoop and provides automatic sharding and scaling of data across nodes. It favors consistency over availability and integrates well with Hadoop for big data analytics.
![11.
April
2013
3
• Sorted map data store
• Table consists of rows, each has a
row key (primary key)
• Each row may have any number of
columns (Map<byte[], byte []>)
• Rows are sorted lexicographically
based on row key
HBase Introduction
Data Model](https://image.slidesharecdn.com/gotozrhhbase-130411091251-phpapp01/85/Apache-HBase-Introduction-to-a-column-oriented-data-store-3-320.jpg)
![11.
April
2013
Different types of data separated 4
into different “column families” Data is all byte[]
Row key Data
amuller info: { ‘height’: ‘2.0m’, ‘state’: ‘ZH’ }
roles: { ‘IBM’: ‘Sales Manager’ }
cguegi info: { ‘height’: ‘1.85m’, ‘state’: ‘BE’ }
roles: { ‘Sentric’: ‘Architect’@ts=2011,
‘Sentric’: ‘Mentor’@ts=2012,
‘SBDUG’: ‘Founder’ }
Different rows may have different
sets of columns (table is sparse)
Single cell may have different values
at different timestampes
HBase Introduction
Sorted Map (Logical View)](https://image.slidesharecdn.com/gotozrhhbase-130411091251-phpapp01/85/Apache-HBase-Introduction-to-a-column-oriented-data-store-4-320.jpg)
![11.
April
2013
6
HBase API
RegionServer
Master HFile Memstore
Write-Ahead Log
HDFS ZooKeeper
[HBase: The Definitive Guide]
HBase Introduction
HBase Architecture](https://image.slidesharecdn.com/gotozrhhbase-130411091251-phpapp01/85/Apache-HBase-Introduction-to-a-column-oriented-data-store-6-320.jpg)
Apache HBase: Introduction to a column-oriented data store
- 1. CC 2.0 by Bryan Pearson | http://flic.kr/p/RUfEt
- 2. 11. April 2013 2 HBase is an open source, distributed, column-oriented data store modeled after Google’s BigTable HBase Introduction About HBase
- 3. 11. April 2013 3 • Sorted map data store • Table consists of rows, each has a row key (primary key) • Each row may have any number of columns (Map<byte[], byte []>) • Rows are sorted lexicographically based on row key HBase Introduction Data Model
- 4. 11. April 2013 Different types of data separated 4 into different “column families” Data is all byte[] Row key Data amuller info: { ‘height’: ‘2.0m’, ‘state’: ‘ZH’ } roles: { ‘IBM’: ‘Sales Manager’ } cguegi info: { ‘height’: ‘1.85m’, ‘state’: ‘BE’ } roles: { ‘Sentric’: ‘Architect’@ts=2011, ‘Sentric’: ‘Mentor’@ts=2012, ‘SBDUG’: ‘Founder’ } Different rows may have different sets of columns (table is sparse) Single cell may have different values at different timestampes HBase Introduction Sorted Map (Logical View)
- 5. 11. info Column Family April 2013 Row key Column key Timestamp Value 5 amuller info:height 1333883187 2.0m amuller info:state 1273871824 ZH Sorted on disk by row key, column key, descending ts cguegi info:height 1325755229 1.85m cguegi info:state 1325751049 TG roles Column Family Row key Column key Timestamp Value amuller roles:IBM 1320105636 Developer cguegi roles:SBDUG 1330561785 Founder cguegi roles:Sentric 1325376723 Mentor cguegi roles:Sentric 1293840959 Architect Unix timestamp HBase Introduction Sorted Map (Physical View)
- 6. 11. April 2013 6 HBase API RegionServer Master HFile Memstore Write-Ahead Log HDFS ZooKeeper [HBase: The Definitive Guide] HBase Introduction HBase Architecture
- 7. 11. April 2013 7 • Favors Consistency over Availability • Great Hadoop integration • Ordered range partitions • Automatically shards/scales • Sparse column storage HBase Introduction HBase vs other “NoSQL”
- 8. CC 2.0 by Aurelien Guichard | http://flic.kr/p/cjg9yw
- 9. 11. April 2013 9 • http://hbase.apache.org • http://www.sentric.ch • http://bigdata-usergroup.ch • http://about.me/cguegi HBase Introduction Resources
- 10. 11. April 2013 10 Source: http://blogs.the451group.com/information_management/2013/02/04/updated-database-lanscape-map-february-2013/ HBase Introduction Database Landscape Map