SlideShare a Scribd company logo
DATABASES FOR AN ENGAGED
WORLD: REQUIREMENTS AND
DESIGN APPROACH
Keshav Murthy
Senior Director, Couchbase R&D
DATABASES FOR AN ENGAGED
WORLD: REQUIREMENTS AND
DESIGN APPROACH
Keshav Murthy
Senior Director, Couchbase R&D
3
?
• Store, retrieve and manipulate
data.
• Create spheres of control and
protection for concurrent
operations
• Make the application development
easily
• SCALE UP and SCALE OUT
• Data model
• Relational or Document or Graph
• Data types
• Query (SQL*)
• Storage engine
• Index
• Data
• Clustering
• Availability
• Scaling
APPROACH ENGAGEMENTDATABASES
4
Summer Vacation Job
✋
Where are we going
for vacation this
summer?
✔
$
$$
$$
🤔
!
You got a job!
Google,friends,books.
Suggest 5 ideas
👬
Talk to Family, See
trip advisor,
Expedia. Select 2
👪
Talk about &
research the $$$
Decision TimeBUY
Get confirmation;
Book activities
Go on
vacation
Feedback & Social
😎✌ 👍
Initiate the
job
Information
on locations
Initial
shortlist
Final List
Options, cost,
constraints
Decision
Tickets
Bought
JOB IS DONE
Checkin
Relax
Checkout
Tickets
Bought
5
Summer Vacation Job
✋
Where are we going
for vacation this
summer?
✔
$
$$
$$
🤔
!
You got a job!
Google,friends,books.
Suggest 5 ideas
👬
Talk to Family, See
trip advisor,
Expedia. Select 2
👪
Talk about &
research the $$$
Decision TimeBUY
Get confirmation;
Book activities
Go on
vacation
Feedback & Social
😎✌ 👍
Initiate the
job
Information
on locations
Initial
shortlist
Final List
Options, cost,
constraints
Decision
Tickets
Bought
JOB IS DONE
Checkin
Relax
Checkout
Tickets
Bought
Systems of
Engagement
Systems of
Engagement
Systems of
Engagement
Systems of
Engagement
Systems of
Engagement
Systems of
Engagement
Systems of
Engagement
Systems of
Record
Systems of
Record
Systems of
Engagement
System of Record vs.
System of Engagement
Contract matters. Context Matters
Systems of EngagementSystems of Record
Lower throughput
 Except on Black Friday
 And TAX DAY
Relatively higher cost is accepted
Reliability is paramount
Guarantees record of action
Implement the decisions
Speed is of the essence
Lots of questions to help decide
Large number of concurrent users
High Throughput
Low latency
Info from multiple sources and services
Low TCO
7
Systems of Engagement
A system of engagement helps customers to get
the right information, in their context, and to
make decisions and progress on their journey to
get a job done.
8
The traditional approachWhy today’s
digital
transformation
projects fail
Analytical
Database
Transactional
Database
9
Point solutions everywhereWhy today’s
digital
transformation
projects fail
Global
Replication
Search Key
Value
Indexing
Cache
Analytics
Mobile
Query
Transactional
Database
Analytical
Database
10
Why today's
digital
transformation
projects succeed
Transactional
Database
Analytical
Database
Welcome to the Engagement Database
Engagement
Database
11
Always on,
always fast
Secure, secure,
secure
Seamlessly
mobile
Hello cloud,
hello world
Built-in
smarts
Built for change -
at scale
ATTRIBUTES OF AN
ENGAGEMENT DATABASE
Couchbase
Data
Platform
Develop with Agility.
Deploy at any scale.
World’sFirst
Engagement
Database
©2017 Couchbase. All rights reserved. 13
NODE 1
Global
Index
Query
Full
Text
Analytics
Data
Cluster Manager
NODE 4
Sample QA Setup
NODE 1
Query
Global Index
Data
Analytics
Full
Text
Cluster
Manager
NODE 2
Sample Dev Setup
Built for Change at Scale
©2017 Couchbase. All rights reserved. 14
Sample Production Deployment
NODE 1 NODE 12
Cluster Manager
Data
Full
Text
Analytics
Global
Index
Query
Built for Change at Scale
Always On, Always Fast
15
Data movement free from disk bottlenecks
▪ In-memory streaming of updates to all components
▪ In-memory cache
▪ Memory-only data buckets
▪ Memory-only indexes
COUCHBASE SERVER CLUSTER
Node 1 Node 2 Node 3 Node 4 Node 5 Node 6 Node 7 Node 8
Data
Service
Data
Service
Data
Service
Global
Index
Service
Query
Service
Query
Service
Full
Text
Service
Full
Text
Service
DCP
Streaming
DCP
Streaming
• Intra-cluster Replication
• Inter-cluster Replication
• Global secondary Indexing updates
• Full-Text Search update
• Analytics service updates
16
Built-in Smarts: N1QL = SQL + JSON
Client
FetchParse Plan Join Filter
Pre-Aggregate
Offset Limit ProjectSortAggregateScan
{Query Service}
{Index
Service}
{Data
Service}
SELECT DISTINCT route.destinationairport
FROM `travel-sample` airport
INNER JOIN `travel-sample` route
ON (airport.faa = route.sourceairport
AND route.type = "route" )
WHERE airport.type = "airport"
AND airport.city = "san francisco"
AND airport.country = "united states";
Couchbase
Data
Platform
Develop with Agility.
Deploy at any scale.
World’sFirst
Engagement
Database
COUCHBASE.COM

More Related Content

PPTX
MongoDB IoT City Tour LONDON: Hadoop and the future of data management. By, M...
PPTX
Six steps to leveraging location for the Canadian insurance industry
PPTX
Engaging with Cloudera & Morning Wrap Up
PPTX
Create Real Benefits by Accelerating Mobile and Digital Energy Field Adoption
PDF
Dataiku - google cloud platform roadshow - october 2013
PDF
Dataiku - data driven nyc - april 2016 - the solitude of the data team m...
PPTX
Dataiku, Pitch Data Innovation Night, Boston, Septembre 16th
PPT
Hw09 Real Time Business Intelligence
MongoDB IoT City Tour LONDON: Hadoop and the future of data management. By, M...
Six steps to leveraging location for the Canadian insurance industry
Engaging with Cloudera & Morning Wrap Up
Create Real Benefits by Accelerating Mobile and Digital Energy Field Adoption
Dataiku - google cloud platform roadshow - october 2013
Dataiku - data driven nyc - april 2016 - the solitude of the data team m...
Dataiku, Pitch Data Innovation Night, Boston, Septembre 16th
Hw09 Real Time Business Intelligence

What's hot (20)

PDF
43948_HPE Big Data Svcs infographic final
PPTX
Big Data Day LA 2016/ Hadoop/ Spark/ Kafka track - Panel - Interactive Applic...
PPTX
Sql rally amsterdam Aanalysing data with Power BI and Hive
PDF
You Have Data, Now What?
PDF
Dataiku productive application to production - pap is may 2015
PPTX
WhereScape + HVR Webcast – How Progressive Leasing Accelerated Data Warehousi...
PPTX
Roadmap to data driven advice michael goedhart 1v0
PDF
Competitive Advantage from the Data Lake
PDF
Is Your Organization Ready for Data Vault?
PPTX
Sage Intelligence Reporting for your Sage ERP Software
PDF
リアルタイムアクセスログ分析基盤をAWSに構築した話 (JAWS UG BigData Branch)
PPTX
Online Games Analytics - Data Science for Fun
PPTX
Dataiku r users group v2
DOCX
Hadoop Developer
PDF
5 Crucial Considerations for Big data adoption
PPTX
SmartFridge ( Old Sut Smart )
PPTX
Maximize Your Data Warehouse Modernization Efforts Through Automation
PDF
Big Data Analytics: From Insights to Production
PPTX
Seattle montly hadoop nosql scalability meetup
PDF
Architecture for the cloud
43948_HPE Big Data Svcs infographic final
Big Data Day LA 2016/ Hadoop/ Spark/ Kafka track - Panel - Interactive Applic...
Sql rally amsterdam Aanalysing data with Power BI and Hive
You Have Data, Now What?
Dataiku productive application to production - pap is may 2015
WhereScape + HVR Webcast – How Progressive Leasing Accelerated Data Warehousi...
Roadmap to data driven advice michael goedhart 1v0
Competitive Advantage from the Data Lake
Is Your Organization Ready for Data Vault?
Sage Intelligence Reporting for your Sage ERP Software
リアルタイムアクセスログ分析基盤をAWSに構築した話 (JAWS UG BigData Branch)
Online Games Analytics - Data Science for Fun
Dataiku r users group v2
Hadoop Developer
5 Crucial Considerations for Big data adoption
SmartFridge ( Old Sut Smart )
Maximize Your Data Warehouse Modernization Efforts Through Automation
Big Data Analytics: From Insights to Production
Seattle montly hadoop nosql scalability meetup
Architecture for the cloud
Ad

Similar to XLDB Lightning Talk: Databases for an Engaged World: Requirements and Design Approach (20)

PPTX
Get Started with the Most Advanced Edition Yet of Neo4j Graph Data Science
PPTX
Your data layer - Choosing the right database solutions for the future
PPTX
2019 BioIt World - Post cloud legacy edition
PDF
Presumption of Abundance: Architecting the Future of Success
PPTX
Rethink Analytics with an Enterprise Data Hub
PDF
Putting AI to Work on Apache Spark
PDF
2022 Trends in Enterprise Analytics
PDF
Cloudera Breakfast Series, Analytics Part 1: Use All Your Data
PPTX
Big Data and Oracle - 2013
PPTX
NYC Data Amp - Microsoft Azure and Data Services Overview
PDF
It's All About the Data - Tia Dubuisson
PDF
Assessing New Database Capabilities – Multi-Model
PDF
Ask bigger questions
PPTX
JustEnoughDevOpsForDataScientists
PPTX
Bitkom Cray presentation - on HPC affecting big data analytics in FS
PDF
Introduction to BigData
PDF
Data Virtualization enabled Data Fabric: Operationalize the Data Lake (APAC)
PDF
Sudhir Rawat, Sr Techonology Evangelist at Microsoft SQL Business Intelligenc...
PPTX
Democratizing AI with Apache Spark
PDF
Data and AI in education
Get Started with the Most Advanced Edition Yet of Neo4j Graph Data Science
Your data layer - Choosing the right database solutions for the future
2019 BioIt World - Post cloud legacy edition
Presumption of Abundance: Architecting the Future of Success
Rethink Analytics with an Enterprise Data Hub
Putting AI to Work on Apache Spark
2022 Trends in Enterprise Analytics
Cloudera Breakfast Series, Analytics Part 1: Use All Your Data
Big Data and Oracle - 2013
NYC Data Amp - Microsoft Azure and Data Services Overview
It's All About the Data - Tia Dubuisson
Assessing New Database Capabilities – Multi-Model
Ask bigger questions
JustEnoughDevOpsForDataScientists
Bitkom Cray presentation - on HPC affecting big data analytics in FS
Introduction to BigData
Data Virtualization enabled Data Fabric: Operationalize the Data Lake (APAC)
Sudhir Rawat, Sr Techonology Evangelist at Microsoft SQL Business Intelligenc...
Democratizing AI with Apache Spark
Data and AI in education
Ad

More from Keshav Murthy (20)

PDF
N1QL New Features in couchbase 7.0
PPTX
Couchbase Tutorial: Big data Open Source Systems: VLDB2018
PPTX
N1QL+GSI: Language and Performance Improvements in Couchbase 5.0 and 5.5
PDF
Couchbase 5.5: N1QL and Indexing features
PPTX
N1QL: Query Optimizer Improvements in Couchbase 5.0. By, Sitaram Vemulapalli
PPTX
Couchbase N1QL: Language & Architecture Overview.
PPTX
Couchbase Query Workbench Enhancements By Eben Haber
PPTX
Mindmap: Oracle to Couchbase for developers
PPTX
Couchbase N1QL: Index Advisor
PPTX
N1QL: What's new in Couchbase 5.0
PPTX
From SQL to NoSQL: Structured Querying for JSON
PPTX
Tuning for Performance: indexes & Queries
PPTX
Understanding N1QL Optimizer to Tune Queries
PPTX
Utilizing Arrays: Modeling, Querying and Indexing
PPTX
Extended JOIN in Couchbase Server 4.5
PPTX
Bringing SQL to NoSQL: Rich, Declarative Query for NoSQL
PPTX
Query in Couchbase. N1QL: SQL for JSON
PPTX
SQL for JSON: Rich, Declarative Querying for NoSQL Databases and Applications 
PPTX
Introducing N1QL: New SQL Based Query Language for JSON
PPTX
Enterprise Architect's view of Couchbase 4.0 with N1QL
N1QL New Features in couchbase 7.0
Couchbase Tutorial: Big data Open Source Systems: VLDB2018
N1QL+GSI: Language and Performance Improvements in Couchbase 5.0 and 5.5
Couchbase 5.5: N1QL and Indexing features
N1QL: Query Optimizer Improvements in Couchbase 5.0. By, Sitaram Vemulapalli
Couchbase N1QL: Language & Architecture Overview.
Couchbase Query Workbench Enhancements By Eben Haber
Mindmap: Oracle to Couchbase for developers
Couchbase N1QL: Index Advisor
N1QL: What's new in Couchbase 5.0
From SQL to NoSQL: Structured Querying for JSON
Tuning for Performance: indexes & Queries
Understanding N1QL Optimizer to Tune Queries
Utilizing Arrays: Modeling, Querying and Indexing
Extended JOIN in Couchbase Server 4.5
Bringing SQL to NoSQL: Rich, Declarative Query for NoSQL
Query in Couchbase. N1QL: SQL for JSON
SQL for JSON: Rich, Declarative Querying for NoSQL Databases and Applications 
Introducing N1QL: New SQL Based Query Language for JSON
Enterprise Architect's view of Couchbase 4.0 with N1QL

Recently uploaded (20)

PDF
Nekopoi APK 2025 free lastest update
PPTX
Transform Your Business with a Software ERP System
PPTX
Reimagine Home Health with the Power of Agentic AI​
PPTX
Odoo POS Development Services by CandidRoot Solutions
PDF
AI in Product Development-omnex systems
PPTX
VVF-Customer-Presentation2025-Ver1.9.pptx
PDF
Design an Analysis of Algorithms II-SECS-1021-03
PPTX
L1 - Introduction to python Backend.pptx
PDF
Adobe Illustrator 28.6 Crack My Vision of Vector Design
PPTX
Lecture 3: Operating Systems Introduction to Computer Hardware Systems
PDF
How to Migrate SBCGlobal Email to Yahoo Easily
PPTX
Agentic AI : A Practical Guide. Undersating, Implementing and Scaling Autono...
PDF
medical staffing services at VALiNTRY
PDF
Navsoft: AI-Powered Business Solutions & Custom Software Development
PDF
How Creative Agencies Leverage Project Management Software.pdf
PDF
Digital Strategies for Manufacturing Companies
PDF
Softaken Excel to vCard Converter Software.pdf
PDF
Internet Downloader Manager (IDM) Crack 6.42 Build 41
PDF
Internet Downloader Manager (IDM) Crack 6.42 Build 42 Updates Latest 2025
PDF
Design an Analysis of Algorithms I-SECS-1021-03
Nekopoi APK 2025 free lastest update
Transform Your Business with a Software ERP System
Reimagine Home Health with the Power of Agentic AI​
Odoo POS Development Services by CandidRoot Solutions
AI in Product Development-omnex systems
VVF-Customer-Presentation2025-Ver1.9.pptx
Design an Analysis of Algorithms II-SECS-1021-03
L1 - Introduction to python Backend.pptx
Adobe Illustrator 28.6 Crack My Vision of Vector Design
Lecture 3: Operating Systems Introduction to Computer Hardware Systems
How to Migrate SBCGlobal Email to Yahoo Easily
Agentic AI : A Practical Guide. Undersating, Implementing and Scaling Autono...
medical staffing services at VALiNTRY
Navsoft: AI-Powered Business Solutions & Custom Software Development
How Creative Agencies Leverage Project Management Software.pdf
Digital Strategies for Manufacturing Companies
Softaken Excel to vCard Converter Software.pdf
Internet Downloader Manager (IDM) Crack 6.42 Build 41
Internet Downloader Manager (IDM) Crack 6.42 Build 42 Updates Latest 2025
Design an Analysis of Algorithms I-SECS-1021-03

XLDB Lightning Talk: Databases for an Engaged World: Requirements and Design Approach

  • 1. DATABASES FOR AN ENGAGED WORLD: REQUIREMENTS AND DESIGN APPROACH Keshav Murthy Senior Director, Couchbase R&D
  • 2. DATABASES FOR AN ENGAGED WORLD: REQUIREMENTS AND DESIGN APPROACH Keshav Murthy Senior Director, Couchbase R&D
  • 3. 3 ? • Store, retrieve and manipulate data. • Create spheres of control and protection for concurrent operations • Make the application development easily • SCALE UP and SCALE OUT • Data model • Relational or Document or Graph • Data types • Query (SQL*) • Storage engine • Index • Data • Clustering • Availability • Scaling APPROACH ENGAGEMENTDATABASES
  • 4. 4 Summer Vacation Job ✋ Where are we going for vacation this summer? ✔ $ $$ $$ 🤔 ! You got a job! Google,friends,books. Suggest 5 ideas 👬 Talk to Family, See trip advisor, Expedia. Select 2 👪 Talk about & research the $$$ Decision TimeBUY Get confirmation; Book activities Go on vacation Feedback & Social 😎✌ 👍 Initiate the job Information on locations Initial shortlist Final List Options, cost, constraints Decision Tickets Bought JOB IS DONE Checkin Relax Checkout Tickets Bought
  • 5. 5 Summer Vacation Job ✋ Where are we going for vacation this summer? ✔ $ $$ $$ 🤔 ! You got a job! Google,friends,books. Suggest 5 ideas 👬 Talk to Family, See trip advisor, Expedia. Select 2 👪 Talk about & research the $$$ Decision TimeBUY Get confirmation; Book activities Go on vacation Feedback & Social 😎✌ 👍 Initiate the job Information on locations Initial shortlist Final List Options, cost, constraints Decision Tickets Bought JOB IS DONE Checkin Relax Checkout Tickets Bought Systems of Engagement Systems of Engagement Systems of Engagement Systems of Engagement Systems of Engagement Systems of Engagement Systems of Engagement Systems of Record Systems of Record Systems of Engagement
  • 6. System of Record vs. System of Engagement Contract matters. Context Matters Systems of EngagementSystems of Record Lower throughput  Except on Black Friday  And TAX DAY Relatively higher cost is accepted Reliability is paramount Guarantees record of action Implement the decisions Speed is of the essence Lots of questions to help decide Large number of concurrent users High Throughput Low latency Info from multiple sources and services Low TCO
  • 7. 7 Systems of Engagement A system of engagement helps customers to get the right information, in their context, and to make decisions and progress on their journey to get a job done.
  • 8. 8 The traditional approachWhy today’s digital transformation projects fail Analytical Database Transactional Database
  • 9. 9 Point solutions everywhereWhy today’s digital transformation projects fail Global Replication Search Key Value Indexing Cache Analytics Mobile Query Transactional Database Analytical Database
  • 11. 11 Always on, always fast Secure, secure, secure Seamlessly mobile Hello cloud, hello world Built-in smarts Built for change - at scale ATTRIBUTES OF AN ENGAGEMENT DATABASE
  • 12. Couchbase Data Platform Develop with Agility. Deploy at any scale. World’sFirst Engagement Database
  • 13. ©2017 Couchbase. All rights reserved. 13 NODE 1 Global Index Query Full Text Analytics Data Cluster Manager NODE 4 Sample QA Setup NODE 1 Query Global Index Data Analytics Full Text Cluster Manager NODE 2 Sample Dev Setup Built for Change at Scale
  • 14. ©2017 Couchbase. All rights reserved. 14 Sample Production Deployment NODE 1 NODE 12 Cluster Manager Data Full Text Analytics Global Index Query Built for Change at Scale
  • 15. Always On, Always Fast 15 Data movement free from disk bottlenecks ▪ In-memory streaming of updates to all components ▪ In-memory cache ▪ Memory-only data buckets ▪ Memory-only indexes COUCHBASE SERVER CLUSTER Node 1 Node 2 Node 3 Node 4 Node 5 Node 6 Node 7 Node 8 Data Service Data Service Data Service Global Index Service Query Service Query Service Full Text Service Full Text Service DCP Streaming DCP Streaming • Intra-cluster Replication • Inter-cluster Replication • Global secondary Indexing updates • Full-Text Search update • Analytics service updates
  • 16. 16 Built-in Smarts: N1QL = SQL + JSON Client FetchParse Plan Join Filter Pre-Aggregate Offset Limit ProjectSortAggregateScan {Query Service} {Index Service} {Data Service} SELECT DISTINCT route.destinationairport FROM `travel-sample` airport INNER JOIN `travel-sample` route ON (airport.faa = route.sourceairport AND route.type = "route" ) WHERE airport.type = "airport" AND airport.city = "san francisco" AND airport.country = "united states";
  • 17. Couchbase Data Platform Develop with Agility. Deploy at any scale. World’sFirst Engagement Database