SlideShare a Scribd company logo

HBase Replication for Bulk Loaded Data

A
Ashish Singhi

The document outlines existing and enhanced designs for HBase replication at Huawei Technologies, emphasizing synchronization and disaster recovery capabilities, with configurable options at the table and column family level. It details the current limitations, including the inability to replicate bulk-loaded data, and introduces enhancements aimed at improving the overall replication design. Future scope includes the potential for additional features and improvements to streamline the replication process.

Data & Analytics
1 of 26
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
www.huawei.com Security Level: HUAWEI TECHNOLOGIES CO., LTD. HBase Replication Replication of Bulk Loaded Data Ashish Singhi (@ashishsinghi89) ashish.singhi@huawei.com HBase Developer 08 October 2015
HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 2 Agenda Existing Replication Design1 Enhanced Replication Design2 Future Scope3
HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 3 Replication  Keep data synchronized between the clusters  Supports multiple destination  Supports cyclic replication  Configurable at table/column family level  Push based architecture  Uses WAL shipping to propagate data  Used for disaster recovery, geo-distributed serving and more
HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 4 Replication
HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 5 Replication State  Maintains its state in ZooKeeper  Default: /hbase/replication  The Peers znode:  Default: /hbase/replication/peers /hbase/replication/peers: /peer1: zk1.host.com,…:2181:/hbase /peer-state: ENABLED /tableCFs: table1;table2:cf1 /peerN: …. Cluster key = ZK quorum:ZK client port:HBase root znode Replication Status Only Replicate this table column families
HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 6 Replication State  The RS znode:  Default: /hbase/replication/rs /hbase/replication/rs: /rs1,16201,1234: /peer1: /wal1:9086 /walN:0 /peerN: … /rsN,16201,1234: … Server name = hostname,port, startcode Peer ID, where logs should be replicated WAL log name & read offset
HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 7 Existing Replication Design WAL Region Server Replication Source/End Point Replication Source/End Point Replication Source Manager Region Server …/peers/ …/rs/ Source Cluster Peer Cluster 1 [tableCfs - 1] Peer Cluster 2 [tableCfs - ] Region Server Replication Sink Replication Sink Table Table ZooKeeper
HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 8 Existing Replication Design WAL 1 1 2 Region Server Replication Source/End Point Replication Source/End Point Replication Source Manager Region Server …/peers/ …/rs/ Source Cluster Peer Cluster 1 [tableCfs - 1] Peer Cluster 2 [tableCfs - ] Region Server Replication Sink Replication Sink Table Table Batch Bulk load ZooKeeper
HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 9 Existing Replication Design WAL 1 1 2 Region Server Replication Source/End Point Replication Source/End Point Replication Source Manager Region Server …/peers/ …/rs/ Source Cluster Peer Cluster 1 [tableCfs - 1] Peer Cluster 2 [tableCfs - ] Region Server Replication Sink Replication Sink Table Table Batch Bulk load ZooKeeper
HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 10 Existing Replication Design WAL 1 1 2 Region Server Replication Source/End Point Replication Source/End Point Replication Source Manager Region Server …/peers/ …/rs/ Source Cluster Peer Cluster 1 [tableCfs - 1] Peer Cluster 2 [tableCfs - ] Region Server 1 2 1 Replication Sink Replication Sink Table Table Batch Bulk load ZooKeeper
HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 11 Existing Replication Design WAL 1 1 2 Region Server Replication Source/End Point Replication Source/End Point Replication Source Manager Region Server …/peers/ …/rs/ Source Cluster Peer Cluster 1 [tableCfs - 1] Peer Cluster 2 [tableCfs - ] Region Server 1 2 1 Batch Batch 1 12 Replication Sink Replication Sink Table Table Batch Bulk load ZooKeeper
HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 12 Existing Replication Design WAL 1 1 2 Region Server Replication Source/End Point Replication Source/End Point Replication Source Manager Region Server …/peers/ …/rs/ Source Cluster Peer Cluster 1 [tableCfs - 1] Peer Cluster 2 [tableCfs - ] Region Server 1 2 1 Batch Batch 1 12 Limitation: Does not support bulk loaded data Replication Sink Replication Sink Table Table Batch Bulk load ZooKeeper
HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 13 Agenda Existing Replication Design1 Enhanced Replication Design2 Future Scope3
HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 14 Enhanced Replication Design (HBASE-13153) WAL Region Server Replication Source/End Point Replication Source/End Point Replication Source Manager Region Server …/peers/ …/rs/ …/hfile-refs/ Source Cluster Peer Cluster 1 [tableCfs - 1] 3 1 TableReplication Sink Region Server TableReplication Sink Peer Cluster 2 [tableCfs - ] ZooKeeper
HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 15 Enhanced Replication Design (HBASE-13153) WAL 1 1 2 Region Server Replication Source/End Point Replication Source/End Point Replication Source Manager Region Server …/peers/ …/rs/ …/hfile-refs/ Source Cluster Peer Cluster 1 [tableCfs - 1] 3 1 TableReplication Sink Region Server TableReplication Sink Peer Cluster 2 [tableCfs - ] Batch Bulk load ZooKeeper
HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 16 Enhanced Replication Design (HBASE-13153) WAL 1 1 2 Region Server Replication Source/End Point Replication Source/End Point Replication Source Manager Region Server …/peers/ …/rs/ …/hfile-refs/ Source Cluster Peer Cluster 1 [tableCfs - 1] 3 1 TableReplication Sink Region Server TableReplication Sink Peer Cluster 2 [tableCfs - ] Batch Bulk load ZooKeeper
HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 17 Enhanced Replication Design (HBASE-13153) WAL 1 1 2 Region Server Replication Source/End Point Replication Source/End Point Replication Source Manager Region Server …/peers/ …/rs/ …/hfile-refs/ Source Cluster Peer Cluster 1 [tableCfs - 1] 1 3 1 TableReplication Sink Region Server TableReplication Sink Peer Cluster 2 [tableCfs - ] 12 1 1 Batch Bulk load ZooKeeper
HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 18 Enhanced Replication Design (HBASE-13153) WAL 1 1 2 Region Server Replication Source/End Point Replication Source/End Point Replication Source Manager Region Server …/peers/ …/rs/ …/hfile-refs/ Source Cluster Peer Cluster 1 [tableCfs - 1] 1 3 1 Table Batch 1 Replication Sink 1 Bulk load Region Server TableReplication Sink Peer Cluster 2 [tableCfs - ] 12 1 Batch Bulk load 12 1 1 Batch Bulk load ZooKeeper
HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 19 Enhanced Replication Design (HBASE-13153) WAL 1 1 2 Region Server Replication Source/End Point Replication Source/End Point Replication Source Manager Region Server …/peers/ …/rs/ …/hfile-refs/ Source Cluster Peer Cluster 1 [tableCfs - 1] 1 3 1 Table Batch 1 Replication Sink 1 Bulk load Region Server TableReplication Sink Peer Cluster 2 [tableCfs - ] 12 1 Batch Bulk load 12 1 1 Batch Bulk load Configuration:hbase.replication.bulkload.enabled [Default False] ZooKeeper
HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 20 Replication State  The HFile References znode:  Default: /hbase/replication/hfile-refs /hbase/replication/hfile-refs: /peer1: /hfile1 /hfileN /peerN: … Peer ID, where hfiles should be replicated Name of hfiles which needs to be replicated
HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 21 Metrics  Source  sizeOfHFileQueue: Number of bulk loaded hfiles pending  shippedHFiles: Number of bulk loaded hfile entries shipped  Sink  appliedHFiles: Number of bulk loaded hfile entries applied
HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 22 Limitation & Constraints  If data is different in visibility labels table in source and peer cluster then scan will fail.  Peer cluster requires read permission on active HDFS cluster.  Peer cluster must have Compression codec library used in source cluster for hfile compression.
HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 23 Agenda Existing Replication Design1 Enhanced Replication Design2 Future Scope3
HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 24 Replication V2 (HBASE-14379)  Eliminate permanent ZooKeeper node (HBASE- 10295)  Admin requests to be routed through master (HBASE-11392)  Hbck support for fixing corrupt and stuck queues (HBASE-14014)
HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 25
Thank you www.huawei.com Copyright©2011 Huawei Technologies Co., Ltd. All Rights Reserved. The information in this document may contain predictive statements including, without limitation, statements regarding the future financial and operating results, future product portfolio, new technology, etc. There are a number of factors that could cause actual results and developments to differ materially from those expressed or implied in the predictive statements. Therefore, such information is provided for reference purpose only and constitutes neither an offer nor an acceptance. Huawei may change the information at any time without notice.

More Related Content

PDF
The State of HBase Replication
HBaseCon
 
PDF
HBase replication
wchevreuil
 
PDF
Hoodie - DataEngConf 2017
Vinoth Chandar
 
PPTX
HBase Low Latency
DataWorks Summit
 
PPTX
What's new in Java 11
Michel Schudel
 
PDF
MMUG18 - MySQL Failover and Orchestrator
Simon J Mudd
 
PPTX
Apache Tez - A New Chapter in Hadoop Data Processing
DataWorks Summit
 
PDF
Softwareentwicklung ohne Abhängigkeiten
Stefan Lieser
 
The State of HBase Replication
HBaseCon
 
HBase replication
wchevreuil
 
Hoodie - DataEngConf 2017
Vinoth Chandar
 
HBase Low Latency
DataWorks Summit
 
What's new in Java 11
Michel Schudel
 
MMUG18 - MySQL Failover and Orchestrator
Simon J Mudd
 
Apache Tez - A New Chapter in Hadoop Data Processing
DataWorks Summit
 
Softwareentwicklung ohne Abhängigkeiten
Stefan Lieser
 

What's hot (20)

PDF
Hudi: Large-Scale, Near Real-Time Pipelines at Uber with Nishith Agarwal and ...
Databricks
 
PDF
Room 3 - 1 - Nguyễn Xuân Trường Lâm - Zero touch on-premise storage infrastru...
Vietnam Open Infrastructure User Group
 
PDF
Monitoring in CloudStack
ShapeBlue
 
PDF
[Oracle DBA & Developer Day 2012] 高可用性システムに適した管理性と性能を向上させるASM と RMAN の魅力
オラクルエンジニア通信
 
PPTX
Practical examples of using extended events
Dean Richards
 
PPT
HBaseCon 2013: Apache HBase Replication
Cloudera, Inc.
 
PDF
Hudi architecture, fundamentals and capabilities
Nishith Agarwal
 
PDF
LinuxIO-Introduction-FUDCon-2015
KASHISH BHATIA
 
PDF
Automated master failover
Yoshinori Matsunobu
 
PDF
Apache Hive Hook
Minwoo Kim
 
PPT
Galera Cluster Best Practices for DBA's and DevOps Part 1
Codership Oy - Creators of Galera Cluster
 
PPTX
Linux MMAP & Ioremap introduction
Gene Chang
 
PPTX
The top 3 challenges running multi-tenant Flink at scale
Flink Forward
 
KEY
Introduction to memcached
Jurriaan Persyn
 
PDF
Storage 101: Rook and Ceph - Open Infrastructure Denver 2019
Sean Cohen
 
PPTX
[오픈소스컨설팅]Ansible overview
Open Source Consulting
 
PDF
Ansible, best practices
Bas Meijer
 
PDF
Webinar: Deep Dive on Apache Flink State - Seth Wiesman
Ververica
 
PDF
Top 5 Mistakes When Writing Spark Applications
Spark Summit
 
PPTX
HDFS Internals
Apache Apex
 
Hudi: Large-Scale, Near Real-Time Pipelines at Uber with Nishith Agarwal and ...
Databricks
 
Room 3 - 1 - Nguyễn Xuân Trường Lâm - Zero touch on-premise storage infrastru...
Vietnam Open Infrastructure User Group
 
Monitoring in CloudStack
ShapeBlue
 
[Oracle DBA & Developer Day 2012] 高可用性システムに適した管理性と性能を向上させるASM と RMAN の魅力
オラクルエンジニア通信
 
Practical examples of using extended events
Dean Richards
 
HBaseCon 2013: Apache HBase Replication
Cloudera, Inc.
 
Hudi architecture, fundamentals and capabilities
Nishith Agarwal
 
LinuxIO-Introduction-FUDCon-2015
KASHISH BHATIA
 
Automated master failover
Yoshinori Matsunobu
 
Apache Hive Hook
Minwoo Kim
 
Galera Cluster Best Practices for DBA's and DevOps Part 1
Codership Oy - Creators of Galera Cluster
 
Linux MMAP & Ioremap introduction
Gene Chang
 
The top 3 challenges running multi-tenant Flink at scale
Flink Forward
 
Introduction to memcached
Jurriaan Persyn
 
Storage 101: Rook and Ceph - Open Infrastructure Denver 2019
Sean Cohen
 
[오픈소스컨설팅]Ansible overview
Open Source Consulting
 
Ansible, best practices
Bas Meijer
 
Webinar: Deep Dive on Apache Flink State - Seth Wiesman
Ververica
 
Top 5 Mistakes When Writing Spark Applications
Spark Summit
 
HDFS Internals
Apache Apex
 
Ad

Similar to HBase Replication for Bulk Loaded Data (20)

PDF
hbaseconasia2017: HBase Disaster Recovery Solution at Huawei
HBaseCon
 
PDF
HBase Replication
ctrezzo
 
PDF
Facebook keynote-nicolas-qcon
Yiwei Ma
 
PDF
支撑Facebook消息处理的h base存储系统
yongboy
 
PDF
Facebook Messages & HBase
强 王
 
PPTX
HBase at Flurry
ddlatham
 
PPT
Leveraging Hadoop in your PostgreSQL Environment
Jim Mlodgenski
 
PPTX
HBaseCon 2015: HBase 2.0 and Beyond Panel
HBaseCon
 
PPTX
HBase Operations and Best Practices
Venu Anuganti
 
PDF
Realtime Apache Hadoop at Facebook
parallellabs
 
PDF
Cisco connect toronto 2015 big data sean mc keown
Cisco Canada
 
PDF
Big Data Architecture and Deployment
Cisco Canada
 
PDF
HBaseCon 2012 | HBase and HDFS: Past, Present, Future - Todd Lipcon, Cloudera
Cloudera, Inc.
 
PPT
Hadoop presentation
Chandra Sekhar Saripaka
 
PPTX
Advance HBase and Zookeeper - Module 8
Rohit Agrawal
 
PDF
HBaseConAsia2018 Track1-3: HBase at Xiaomi
Michael Stack
 
PPTX
HBase Low Latency, StrataNYC 2014
Nick Dimiduk
 
PDF
Storage Infrastructure Behind Facebook Messages
yarapavan
 
PPTX
Big Data and Hadoop - History, Technical Deep Dive, and Industry Trends
Esther Kundin
 
PDF
HBaseConAsia2018 Track3-4: HBase and OpenTSDB practice at Huawei
Michael Stack
 
hbaseconasia2017: HBase Disaster Recovery Solution at Huawei
HBaseCon
 
HBase Replication
ctrezzo
 
Facebook keynote-nicolas-qcon
Yiwei Ma
 
支撑Facebook消息处理的h base存储系统
yongboy
 
Facebook Messages & HBase
强 王
 
HBase at Flurry
ddlatham
 
Leveraging Hadoop in your PostgreSQL Environment
Jim Mlodgenski
 
HBaseCon 2015: HBase 2.0 and Beyond Panel
HBaseCon
 
HBase Operations and Best Practices
Venu Anuganti
 
Realtime Apache Hadoop at Facebook
parallellabs
 
Cisco connect toronto 2015 big data sean mc keown
Cisco Canada
 
Big Data Architecture and Deployment
Cisco Canada
 
HBaseCon 2012 | HBase and HDFS: Past, Present, Future - Todd Lipcon, Cloudera
Cloudera, Inc.
 
Hadoop presentation
Chandra Sekhar Saripaka
 
Advance HBase and Zookeeper - Module 8
Rohit Agrawal
 
HBaseConAsia2018 Track1-3: HBase at Xiaomi
Michael Stack
 
HBase Low Latency, StrataNYC 2014
Nick Dimiduk
 
Storage Infrastructure Behind Facebook Messages
yarapavan
 
Big Data and Hadoop - History, Technical Deep Dive, and Industry Trends
Esther Kundin
 
HBaseConAsia2018 Track3-4: HBase and OpenTSDB practice at Huawei
Michael Stack
 
Ad

Recently uploaded (20)

PPTX
A Complete Guide to Streamlining Business Processes
Accentfuture
 
PPTX
Copy of 16 Timeline & Flowchart Templates – HubSpot.pptx
ahsonbashir
 
PPTX
Acceptance and paychological effects of mandatory extra coach I classes.pptx
ZaheerAhmad228692
 
PPTX
IMPACT OF LANDSLIDE.....................
shinjanmandal111
 
PPTX
Database Infoormation System (DBIS).pptx
TefferiMekonnen2
 
PDF
Introduction to Data Science and Data Analysis
Suraj Patil
 
PDF
Data Engineering Interview Questions & Answers Cloud Data Stacks (AWS, Azure,...
Mindbox Trainings
 
PDF
Transcultural that can help you someday.
jhongarin24
 
PDF
OneRead_20250728_1808.pdfhdhddhshahwhwwjjaaja
DivyanshChauhan66
 
PDF
Optimise Shopper Experiences with a Strong Data Estate.pdf
Prasad Chandane
 
PDF
Business Analytics and business intelligence.pdf
khalidisah4750
 
PDF
Global Data and Analytics Market Outlook Report
ssuser11803e
 
PPTX
IBA_Chapter_11_Slides_Final_Accessible.pptx
SrikantKapoor1
 
PPTX
New ISO 27001_2022 standard and the changes
Mayank Mathur
 
PPT
lectureusjsjdhdsjjshdshshddhdhddhhd1.ppt
dipa69
 
PDF
How to run a consulting project- client discovery
P&CO
 
PPTX
modul_python (1).pptx for professional and student
putusurya12
 
PPTX
importance of Data-Visualization-in-Data-Science. for mba studnts
Tanu Arora
 
PDF
Introduction to the R Programming Language
Suraj Patil
 
PPT
ISS -ESG Data flows What is ESG and HowHow
lucandthemachine
 
A Complete Guide to Streamlining Business Processes
Accentfuture
 
Copy of 16 Timeline & Flowchart Templates – HubSpot.pptx
ahsonbashir
 
Acceptance and paychological effects of mandatory extra coach I classes.pptx
ZaheerAhmad228692
 
IMPACT OF LANDSLIDE.....................
shinjanmandal111
 
Database Infoormation System (DBIS).pptx
TefferiMekonnen2
 
Introduction to Data Science and Data Analysis
Suraj Patil
 
Data Engineering Interview Questions & Answers Cloud Data Stacks (AWS, Azure,...
Mindbox Trainings
 
Transcultural that can help you someday.
jhongarin24
 
OneRead_20250728_1808.pdfhdhddhshahwhwwjjaaja
DivyanshChauhan66
 
Optimise Shopper Experiences with a Strong Data Estate.pdf
Prasad Chandane
 
Business Analytics and business intelligence.pdf
khalidisah4750
 
Global Data and Analytics Market Outlook Report
ssuser11803e
 
IBA_Chapter_11_Slides_Final_Accessible.pptx
SrikantKapoor1
 
New ISO 27001_2022 standard and the changes
Mayank Mathur
 
lectureusjsjdhdsjjshdshshddhdhddhhd1.ppt
dipa69
 
How to run a consulting project- client discovery
P&CO
 
modul_python (1).pptx for professional and student
putusurya12
 
importance of Data-Visualization-in-Data-Science. for mba studnts
Tanu Arora
 
Introduction to the R Programming Language
Suraj Patil
 
ISS -ESG Data flows What is ESG and HowHow
lucandthemachine
 

HBase Replication for Bulk Loaded Data

  • 1. www.huawei.com Security Level: HUAWEI TECHNOLOGIES CO., LTD. HBase Replication Replication of Bulk Loaded Data Ashish Singhi (@ashishsinghi89) ashish.singhi@huawei.com HBase Developer 08 October 2015
  • 2. HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 2 Agenda Existing Replication Design1 Enhanced Replication Design2 Future Scope3
  • 3. HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 3 Replication  Keep data synchronized between the clusters  Supports multiple destination  Supports cyclic replication  Configurable at table/column family level  Push based architecture  Uses WAL shipping to propagate data  Used for disaster recovery, geo-distributed serving and more
  • 4. HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 4 Replication
  • 5. HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 5 Replication State  Maintains its state in ZooKeeper  Default: /hbase/replication  The Peers znode:  Default: /hbase/replication/peers /hbase/replication/peers: /peer1: zk1.host.com,…:2181:/hbase /peer-state: ENABLED /tableCFs: table1;table2:cf1 /peerN: …. Cluster key = ZK quorum:ZK client port:HBase root znode Replication Status Only Replicate this table column families
  • 6. HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 6 Replication State  The RS znode:  Default: /hbase/replication/rs /hbase/replication/rs: /rs1,16201,1234: /peer1: /wal1:9086 /walN:0 /peerN: … /rsN,16201,1234: … Server name = hostname,port, startcode Peer ID, where logs should be replicated WAL log name & read offset
  • 7. HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 7 Existing Replication Design WAL Region Server Replication Source/End Point Replication Source/End Point Replication Source Manager Region Server …/peers/ …/rs/ Source Cluster Peer Cluster 1 [tableCfs - 1] Peer Cluster 2 [tableCfs - ] Region Server Replication Sink Replication Sink Table Table ZooKeeper
  • 8. HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 8 Existing Replication Design WAL 1 1 2 Region Server Replication Source/End Point Replication Source/End Point Replication Source Manager Region Server …/peers/ …/rs/ Source Cluster Peer Cluster 1 [tableCfs - 1] Peer Cluster 2 [tableCfs - ] Region Server Replication Sink Replication Sink Table Table Batch Bulk load ZooKeeper
  • 9. HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 9 Existing Replication Design WAL 1 1 2 Region Server Replication Source/End Point Replication Source/End Point Replication Source Manager Region Server …/peers/ …/rs/ Source Cluster Peer Cluster 1 [tableCfs - 1] Peer Cluster 2 [tableCfs - ] Region Server Replication Sink Replication Sink Table Table Batch Bulk load ZooKeeper
  • 10. HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 10 Existing Replication Design WAL 1 1 2 Region Server Replication Source/End Point Replication Source/End Point Replication Source Manager Region Server …/peers/ …/rs/ Source Cluster Peer Cluster 1 [tableCfs - 1] Peer Cluster 2 [tableCfs - ] Region Server 1 2 1 Replication Sink Replication Sink Table Table Batch Bulk load ZooKeeper
  • 11. HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 11 Existing Replication Design WAL 1 1 2 Region Server Replication Source/End Point Replication Source/End Point Replication Source Manager Region Server …/peers/ …/rs/ Source Cluster Peer Cluster 1 [tableCfs - 1] Peer Cluster 2 [tableCfs - ] Region Server 1 2 1 Batch Batch 1 12 Replication Sink Replication Sink Table Table Batch Bulk load ZooKeeper
  • 12. HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 12 Existing Replication Design WAL 1 1 2 Region Server Replication Source/End Point Replication Source/End Point Replication Source Manager Region Server …/peers/ …/rs/ Source Cluster Peer Cluster 1 [tableCfs - 1] Peer Cluster 2 [tableCfs - ] Region Server 1 2 1 Batch Batch 1 12 Limitation: Does not support bulk loaded data Replication Sink Replication Sink Table Table Batch Bulk load ZooKeeper
  • 13. HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 13 Agenda Existing Replication Design1 Enhanced Replication Design2 Future Scope3
  • 14. HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 14 Enhanced Replication Design (HBASE-13153) WAL Region Server Replication Source/End Point Replication Source/End Point Replication Source Manager Region Server …/peers/ …/rs/ …/hfile-refs/ Source Cluster Peer Cluster 1 [tableCfs - 1] 3 1 TableReplication Sink Region Server TableReplication Sink Peer Cluster 2 [tableCfs - ] ZooKeeper
  • 15. HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 15 Enhanced Replication Design (HBASE-13153) WAL 1 1 2 Region Server Replication Source/End Point Replication Source/End Point Replication Source Manager Region Server …/peers/ …/rs/ …/hfile-refs/ Source Cluster Peer Cluster 1 [tableCfs - 1] 3 1 TableReplication Sink Region Server TableReplication Sink Peer Cluster 2 [tableCfs - ] Batch Bulk load ZooKeeper
  • 16. HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 16 Enhanced Replication Design (HBASE-13153) WAL 1 1 2 Region Server Replication Source/End Point Replication Source/End Point Replication Source Manager Region Server …/peers/ …/rs/ …/hfile-refs/ Source Cluster Peer Cluster 1 [tableCfs - 1] 3 1 TableReplication Sink Region Server TableReplication Sink Peer Cluster 2 [tableCfs - ] Batch Bulk load ZooKeeper
  • 17. HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 17 Enhanced Replication Design (HBASE-13153) WAL 1 1 2 Region Server Replication Source/End Point Replication Source/End Point Replication Source Manager Region Server …/peers/ …/rs/ …/hfile-refs/ Source Cluster Peer Cluster 1 [tableCfs - 1] 1 3 1 TableReplication Sink Region Server TableReplication Sink Peer Cluster 2 [tableCfs - ] 12 1 1 Batch Bulk load ZooKeeper
  • 18. HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 18 Enhanced Replication Design (HBASE-13153) WAL 1 1 2 Region Server Replication Source/End Point Replication Source/End Point Replication Source Manager Region Server …/peers/ …/rs/ …/hfile-refs/ Source Cluster Peer Cluster 1 [tableCfs - 1] 1 3 1 Table Batch 1 Replication Sink 1 Bulk load Region Server TableReplication Sink Peer Cluster 2 [tableCfs - ] 12 1 Batch Bulk load 12 1 1 Batch Bulk load ZooKeeper
  • 19. HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 19 Enhanced Replication Design (HBASE-13153) WAL 1 1 2 Region Server Replication Source/End Point Replication Source/End Point Replication Source Manager Region Server …/peers/ …/rs/ …/hfile-refs/ Source Cluster Peer Cluster 1 [tableCfs - 1] 1 3 1 Table Batch 1 Replication Sink 1 Bulk load Region Server TableReplication Sink Peer Cluster 2 [tableCfs - ] 12 1 Batch Bulk load 12 1 1 Batch Bulk load Configuration:hbase.replication.bulkload.enabled [Default False] ZooKeeper
  • 20. HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 20 Replication State  The HFile References znode:  Default: /hbase/replication/hfile-refs /hbase/replication/hfile-refs: /peer1: /hfile1 /hfileN /peerN: … Peer ID, where hfiles should be replicated Name of hfiles which needs to be replicated
  • 21. HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 21 Metrics  Source  sizeOfHFileQueue: Number of bulk loaded hfiles pending  shippedHFiles: Number of bulk loaded hfile entries shipped  Sink  appliedHFiles: Number of bulk loaded hfile entries applied
  • 22. HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 22 Limitation & Constraints  If data is different in visibility labels table in source and peer cluster then scan will fail.  Peer cluster requires read permission on active HDFS cluster.  Peer cluster must have Compression codec library used in source cluster for hfile compression.
  • 23. HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 23 Agenda Existing Replication Design1 Enhanced Replication Design2 Future Scope3
  • 24. HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 24 Replication V2 (HBASE-14379)  Eliminate permanent ZooKeeper node (HBASE- 10295)  Admin requests to be routed through master (HBASE-11392)  Hbck support for fixing corrupt and stuck queues (HBASE-14014)
  • 25. HUAWEI TECHNOLOGIES CO., LTD. Huawei Confidential 25
  • 26. Thank you www.huawei.com Copyright©2011 Huawei Technologies Co., Ltd. All Rights Reserved. The information in this document may contain predictive statements including, without limitation, statements regarding the future financial and operating results, future product portfolio, new technology, etc. There are a number of factors that could cause actual results and developments to differ materially from those expressed or implied in the predictive statements. Therefore, such information is provided for reference purpose only and constitutes neither an offer nor an acceptance. Huawei may change the information at any time without notice.