Proud to be polyglot!

Proud to be Polygot!
Tugdual “Tug” Grall
@tgrall
Technical Evangelist at

Wednesday, November 6, 13

.

{about : “me”}
• Tugdual “Tug” Grall
Couchbase
Technical Evangelist
eXo
CTO
Oracle
Developer/Product Manager
Mainly Java/SOA
Developer in consulting ﬁrms


• Web

@tgrall

http://blog.grallandco.com

tgrall

NantesJUG co-founder
Pet Project :
http://www.resultri.com
tug@couchbase.com
tugdual@gmail.com

Modern Applications
• Modern Applications Must
Manage any type of data
Scale
Be fault
tolerant
Adapt to change


Standard Architecture
• Mono-Technology
Same “language/architecture”
Single Database : RDBMS

• One size ﬁts all approach


JSP/JSF
Services
Messaging
JTA
DAO/JPA

Is it good for me?
• Many ﬁles
- XML, Sources, ..
• Hibernate/JPA is good for all?
- Impedance mismatch
• Need to scale
- from 0 to 50millions users in
6 weeks (real life)
- can I do that easily with such
architecture?


• How to add new features
easily?
- code, schema change, ...
- and all this for yesterday!
• Lot of code

One
size
does
NOT
ﬁt
all!


Look at our Data....


Big
Data

High Data Variety and Velocity

Trillions
of
Gigabytes
(Ze:abytes)

2.00

1.50

Unstructured
and
Semi-‐
Structured
Data

1.00

Text,
Log
Files,
Click

Streams,
Blogs,

Tweets,
Audio,
Video,

etc.

0.50

0

Structured
Data

2006

2009
Source:
IDC


More
Flexible
Data
Model
Required

2012

50
Million
Users
in
50
Days
Draw
Something
by
OMGPOP
Daily
Ac)ve
Users
(millions)
16

14

12

10

8

6

4

2

2/6

8


10

12

14

16

18

20

22

24

26

28

3/1

3

5

7

9

11

13

15

17

19

21

How do you take this growth?
ApplicaXon
Scales
Out
Just
add
more
commodity
web
servers
System
Cost
ApplicaMon
Performance

Web/App
Server
Tier

Users

RDBMS
Scales
Up
Get
a
bigger,
more
complex
server
System
Cost
ApplicaMon
Performance

Won’t
scale

beyond
this

point
RelaXonal
Database
Users


NoSQL Technology Scales Out
ApplicaXon
Scales
Out
Just
add
more
commodity
web
servers
System
Cost
ApplicaMon
Performance

Web/App
Server
Tier

Users

NoSQL
Database
Scales
Out
Cost
and
performance
mirrors
app
Xer
System
Cost
ApplicaMon
Performance

NoSQL
Distributed
Data
Store

Users


OperaMonal
vs.
AnalyMc
Databases
Real-‐Xme,

InteracXve
Databases

AnalyXc
Databases

NoSQL
Fast
access

to
data

Couchbase
MongoDB


Get
insights
from

data

Cloudera
Hortonworks
Mapr

Polyglot Persistence

Big
Data/Analysis

•
Log
Capture
•
RecommendaMons
•
AdCampaign


Document
&
K/V

•
Products
•
User
Proﬁles
•
Game
AcMons
•
Sessions
•
Shopping
Cart

RDBMS

•
Financial
Data
•
ReporMng

Indexing

•Full
Text
Search
•Ad
hoc
queries

Developer New Skills
• Understand the pros/cons of each solutions
Programming API
How to access the data? (API, Query Languages)
• Learn how to design data-model
De-normalizing and duplicate data is not a problem
• Integrate each solution to your application


Data Service Layer
• Wrap datastore in Services
- Loosely coupled
Data
Service


Use Case : Content Driven Site


Use Case: Mobile Services
Web/App
Server
Tier

Web/App
Server
Tier

Rabbit
MQ
PIM
Database
-‐
Legacy
ApplicaXon
-‐
Product
InformaXon


NoSQL
-‐
Product
Data
-‐
AddiXonal
Metada

Now what?


Why multiple languages?
• Sometimes we have no choice
HTML/CSS/JavaScript + Server Side
Mobile Native Applications
• Java/.Net have not evolved that must these past years
Java EE 5.0 is still mainstream (2006)
• Many languages and frameworks
Scala, Clojure, Groovy, Dart, Go, Ruby, Python, F#, Erlang
Node.js, Rails, Play!, Grails, ...


Examples
• Realtime interaction with WebSockets
- Wait for Java EE 7 to be out?
- Hack your app server and application with Continuation ?
- Use Node.js and Socket.io ?
• Data Collection and Treatment?
- Find a library?
- Create your library?
- Wait for Java 8 and Lambdas?
- Use Scala? ... or other


Examples
• Simple CRUD Application
Use the JavaEE stack with JPA and JSF?
Use Spring ?
Use tools like Play!, Grails, Rails ?


How to chose?
• Maturity/Supportability
• Features Set
• Learning Curve
• Productivity


Polyglot Programming in Action
• Build a distributed database
Manage distributed
processes
Save and retrieve data on
disk
Cache the data on RAM
Build a query engine


Polyglot Programming in Action
• Manage Distributed Process
Erlang and OTP (Open Telecom Platform) has been built for that
Taking this will bootstrap a project quickly instead of implementing in
another language
• Data access and Caching
C/C++ is the best/fastest way to interact with I/O
Leverage existing Caching layer, for example Memcached written in C
• Query & Indexing
Easy to code for developer : Let’s use JavaScript


Couchbase Server

Query
Engine

Query
API

11210
/
11211

8091
Admin
Console

Data
access
ports

hbp

Object-‐managed
Cache

Data
Manager
Wriben
in
C/C++

REST
management

API/Web
UI

Cluster
Manager
ReplicaMon,
ebalance,

Wriben
Sitate
RErlang
n
Manager
Shard

Erlang
/OTP

8092

Storage
Engine

Data
Manager


Cluster
Manager

Use Case: Second Screen Gaming
AdministraXon

Java/Play
ApplicaXon
Python
scrips


Users

Node.js
+
Socket
IO

Conclusion
• Use the good tool for the good task
Do not try to “hack” something when you have a shorter solution
Think about your users ﬁrst... so deliver and get feedback

• Learning is part of our job !
And this will help you and your project

• Operations / DevOps
Think about it from day one... as a developer

• What about maintenance?
Do you think it is easier to maintain complex code?


Q&A
@tgrall
tug@couchbase.com


Proud to be polyglot!

More Related Content

What's hot (17)

Viewers also liked (8)

Similar to Proud to be polyglot! (20)

More from NLJUG (20)

Recently uploaded (20)

Proud to be polyglot!