SlideShare a Scribd company logo

Fusesource camel-persistence-part2-webinar-charles-moulliard

Charles Moulliard, profile picture
Charles Moulliard

This document is part two of a presentation on transaction management with Apache Camel and ServiceMix focusing on Enterprise Integration Patterns (EIPs). The presentation covers how to use Camel to manage transactions with JMS and JDBC connectors alone and with a transaction manager. It also discusses using a global transaction manager, and implementing persistence with EIPs like the Idempotent Processor and Aggregator. The agenda lists the topics that will be covered in the presentation.

Technology
1 of 66
Downloaded 105 times
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
Transac6on  Management  with   Apache  Camel,  ServiceMix  -­‐  EIPs   Part  II   Charles Moulliard – Raul Kripalani, November 22nd, 2011 A  Progress  So3ware  Company   1   Copyright  ©  2010  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
When you joined today’s session … Audio is broadcast from your computer Submit your questions via the Chat Window Contact today’s Host via the Chat Window 2   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
Learn  More  at  hLp://fusesource.com   3   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
Speaker  –  Charles  Moulliard     Engineer  in  Agronomy  &  Master   Follow  me  on  :   in  Zoology     17  years  of  experience  in  IT    hLp://twiLer.com/cmoulliard   world  development  (J2EE,  .NET)    hLp://www.linkedin.com/in/ •  Specialised  in  new  technologies   charlesmoulliard   web/Internet  &  integra6on   •  Project  manager  in  bank,  financial,                    hLp://cmoulliard.blogspot.com   telco,  insurance  and  transport   world                      hLp://www.slideshare.net/   Solu6on  Architect  at  FuseSource       cmoulliard     CommiLer  on  Apache  projects  :     •  Apache  ServiceMix,    Apache  Karaf   (PMC)  ,  Apache  Camel,  Fuse  Fabric,   Scalate   4   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
Agenda     Goal  :  Transac6on  Management  with  Apache   Camel,  ServiceMix  -­‐  EIPs   • Transac6ons  with  Camel   • JMS  and  JDBC  alone   • Fuse  ESB  Tx  Manager   • Using  Global  Transac6on  Manager  (XA)   • Persistence  with  EIPs   • Idempotent  processor   • Aggregator   • Summary   5   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
Table  of  contents     Transac6ons  with  Camel     JMS  and  JDBC  alone     Fuse  ESB  Tx  Manager     Using  Global  Transac6on  Manager  (XA)     Persistence  with  EIPs   • Idempotent  processor   • Aggregator     Summary   6   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
Transac6ons  with  Camel     Camel  does  not  re-­‐invent  the  wheel  and  use  Spring  or   Blueprint  API  (on  Apache  ServiceMix)     Can  work  with  local  or  provided  Tx  Manager   •  Local  =  Spring  (JMS,  JPA,  JDBC,  Hibernate),  Atomikos,   Bitronix,  jOTM   •  Provided  =  J2EE  (WebSphere,  JBoss,  Glassfish,  BEA,   Geronimo),  Apache  ServiceMix     7   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
Transac6ons  with  Camel     Factors  affec6ng  Architecture  depends  on  :   •  Component  (Transac6onal  or  not),     •  Type  of  Transac6on  Manager  and  DataSource  (XA  or  not),     •  Route  (simple,  complex),   •  Transacrion  Propaga6on  Type  (REQUIRED,  NEW,   MANDATORY,  ….)     How  to  configure  a  Camel  route  to  be  transac6onal     2  approaches  exist  and  they  can  be  combined   8   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
Transac6ons  with  Camel  (1)   A)  Using  a  Transac6onal  component  for  producer  or   consumer   How  To  :     Check  which  component  are  Tx   aware    jpa,  sql,  jms,  file,   hibernate,  iba6s.     Configure  a  Transac6on  Manager   for  the  endpoint   9   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
Transac6ons  with  Camel  (2)     Simple  Transac6onal  JMS  client  configura6on  example   Spring JMS Tx manager is defined Here we provide the parameters 10   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
Transac6ons  with  Camel  (3)   B)  Configure  a  Camel  route  as  Transac6onal     Advantage  :  allow  to  include  processors  (beans,  jpa,   hibernate)  with  a  Transac6onal  route     How  to  configure  it    add  <transacted>  to  the  route     How  does  it  work   •  Camel  will  automa6c  lookup  to  find  a  Spring  transac6on   manager   (org.springframework.transac6on.PlasormTransac6onManager)   •  Transac6on  Manager  creates  a  Transac6on  (according  to   PROPAGATION  Policy)   •  Transac6onError  handler  will  take  care  of  excep6ons  occuring   during  camel  exchange  and  propagated  it  to  the  caller   11   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
Transac6ons  with  Camel  (4)     Example  of  Camel  Transac6on  route   A B Camel will lookup for “PROPAGATION_REQUIRED” 12   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
Transac6ons  with  Camel  (5)     Reference  of  the  SpringTransac6onPolicy  can  be  provided   Reference to the bean 13   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
Transac6ons  with  Camel  (6)     Another  example  using  <Policy>  DSL  and   SpringTransac6onPolicy  is  provided  to  the  TxErrorHandler   Transacted is replaced by Policy 14   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
Transac6ons  with  Camel  (7)     Transac6on  policy  can  be  defined  using  class   org.apache.camel.spi.TransactedPolicy     Policies  can  be  mixed  in  Camel  routes  to  use  different   transac6on  propaga6ons  (NEW,  REQUIRED,  …)   15   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
Transac6ons  with  Camel  (8)     Example  of  2  Camel  routes  using  different  Policy         Required policy : will use an existing Transaction or request to create a new Requires-New policy will request a new Transaction 16   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
Transac6ons  with  Camel  (9)     Transac6on  rollback  occurs  when  a  run6me  excep6on  is   raised  but  you  can  also  manage  it  using  <rollback>  DSL   We force a Rollback by generating a org.apache.camel.Rollbac kExchangeException 17   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
Transac6ons  with  Camel  (9)     Using  markRollBackOnly  generates  a  Rollback  without   excep6on  in  the  Camel  route   Rollback occurs in BookService (DB), exception is not send to direct (which is not Tx aware) and exception is send to mock endpoint 18   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
Transac6ons  with  Camel  (10)     When  Apache  Camel  producer/consumer  is  not   Transac6onal,  a  compensa6on  mechanism  can  be   used.     Uses  a  synchronisa6on  mechanism  =  callback  (mimic   Tx)  to  group  tasks  as  a  UnitOfWork     Will  react  with  onComplete  (=commit)  or  onFailure   (=rollback)   19   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
Transac6ons  with  Camel  (11)   onCompletion + link to the bean implementing the rollback logic 20   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
Transac6ons  with  Camel  (12)   Rollback strategy 21   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
Transac6ons  with  Camel  (13)     Be  carefull  about  threads,  threadPool     •  Only  one  should  be  used,   •  Don't  use  seda://,  vm://,  NMR://  which  are  async  to  link   Camel  routes     Tx  async  are  not  supported  in  Camel  2.x  (planned  for   Camel  3.x)     More  info  :  hLp://fusesource.com/docs/router/2.8/ transac6ons/TxnDemarca6on-­‐ErrorHandling.html   22   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
Table  of  contents     Transac6ons  with  Camel     JMS  and  JDBC  alone     Fuse  ESB  Tx  Manager     Using  a  Global  Transac6on  Manager  (XA)     Persistence  with  EIPs   • Idempotent  processor   • Aggregator     Summary   23   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
JMS  and  JDBC     Integra6on  project,  most  probably,  will  use  not  only  1   Tx  Manager  but  a  combina6on  using  JMS  +  JDBC,  JDBC   +  JDBC,  JMS  +  JMS,  …     Such  a  project  can  use  Spring  or  Fuse  ESB  Tx  Managers     2  Approaches  are  available  on  Fuse  ESB   •  Spring  /  Spring  DM  (Dynamic  Modules)   •  Aries  Blueprint     Apache  Aries  project  =  implementa6on  of  Enterprise   features  of  OSGI  EE  specifica6ons  (Transac6on,  JPA,   JNDI,  Web)     24   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
JMS  and  JDBC     Use  Case  descrip6on     25   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
JMS  and  JDBC  (1)  -­‐  Spring     Example  of  a  project  containing  a  JPA,  Datasource  and   a  camel  route  with  Ac6veMQ  JMS  queues   DataSource is created using Apache Commons DBCP And is exported as OSGI Service wit h2 filters 26   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
JMS  and  JDBC  (2)  -­‐  Spring     JPA  Persistence  file  –  transac6on-­‐type  =  "RESOURCE-­‐ LOCAL"   27   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
JMS  and  JDBC  (3)  -­‐  Spring   Spring will inject persistence context Method will be added into an existing Transaction 28   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
JMS  and  JDBC  (4)  -­‐  Spring   DAO will be scanned by spring to find @Annotation DAO is exposed as a service Spring will add Tx demarcation Based on @Transactional annotations Our Spring JPA Tx Manager is exported and will be used by Camel route A  Progress  So3ware  Company   29   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.    
JMS  and  JDBC  (5)  -­‐  Spring   Spring JMS Tx Manager Message rollbacked will be moved directly into the DLQ Transacted = true, ref to Tx manager, CACHE_NONE to avoid that Spring uses another session (thread)) 30   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
JMS  and  JDBC  (6)  -­‐  Spring   We search for JPA Tx Manager   Camel  Spring  configura6on   We configure 2 Transaction Policy (one for JMS, other for JPA) 31   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
JMS  and  JDBC  (5)  -­‐  Spring     Apache  Camel  routes   JMS + JDBC JMS + JMS 32   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
Table  of  contents     Transac6ons  with  Camel     JMS  and  JDBC  alone     Fuse  ESB  Tx  Manager     Using  Global  Transac6on  Manager  (XA)     Persistence  with  EIPs   • Idempotent  processor   • Aggregator     Summary   33   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
Fuse  ESB  –  Transac6on  Manager     Apache  ServiceMix  4.x  plasorm  (Fuse  ESB)  provides  a   Tx  Manager     Based  on  Apache  Geronimo  Tx  Manager  (JTA  1.1)     Deployed  using  feature    transac6on     Contains  the  following  bundle     34   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
Fuse  ESB  –  Transac6on  Manager  (1)     Can  be  used  as  a  Global  JTA  Tx  Manager  with  XA   Resource     Expose  through  OSGI  service  registry  interfaces     Proxified objects available 35   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
Fuse  ESB  –  Transac6on  Manager  (2)     Timeout  and  Tx  log  file  can  be  customised     36   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
Table  of  contents     Transac6ons  with  Camel     JMS  and  JDBC  alone     Fuse  ESB  Tx  Manager     Using  Global  Transac6on  Manager  (XA)     Persistence  with  EIPs   • Idempotent  processor   • Aggregator     Summary   37   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
Global  Tx  Manager  -­‐  XA     Using  a  Global  Transac6on  Manager  on  Fuse  ESB  just   requires  that  we  use  JTA  and  configure  XA  resources     Verify  careful  regarding  to  the  choice  of  the  "drivers"  or   "datasource"  that  you  will  use  (XA  aware)     You  do  not  need  to  use  Spring  JDBC,  JPA,  JMS,   Hibernate  Transac6on  Manager    Aries  Tx  Manager     38   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
Global  Tx  Manager  -­‐  XA     Use  Case   39   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
Global  Tx  Manager  -­‐  XA  (1)     What  will  change  :  Datasource  (JDBC)   Add a XA Datasource Export XA and non XA Datasource as OSGI services (will be used by JPA container) 40   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
Global  Tx  Manager  -­‐  XA  (2)     JPA  -­‐  persistence.xml     Use JTA instead of RESOURCE-LOCAL Configure JTA and non-JTA datasource 41   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
Global  Tx  Manager  -­‐  XA  (3)     JPA  -­‐  spring   We call OSGI Service to retrieve the PlatformTransactionManager object managed by Aries TX Manager 42   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
Global  Tx  Manager  -­‐  XA  (4)     JMS  –  XA  Connec6on  Pool  /  Resource  Manager     ActiveMQ requires JTA Manager and XAPooledConnectionFactory 43   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
Global  Tx  Manager  -­‐  XA  (4)     JMS  –  Ac6veMQ  component   Transacted is false in this configuration as Aries Tx xManager will take care ! 44   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
Global  Tx  Manager  -­‐  XA  (1)     Apache  Camel  Route   We use the Global Tx Manager exposed as OSGI Service through Spring TransactionManager to get it for JPA Service 45   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
Global  Tx  Manager  -­‐  XA  (1)   Nothing has changed except that   Apache  Camel  Route   you could use XA and non XA connection pool for JMS 46   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
Demo   Transac6ons  in  Ac6on  on  Fuse  ESB  !   47   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
Table  of  contents     Transac6ons  with  Camel     JMS  and  JDBC  alone     Fuse  ESB  Tx  Manager     Using  a  Global  Transac6on  Manager  (XA)     Persistence  with  EIPs   • Idempotent  processor   • Aggregator     Summary   48   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
Idempotent  processor     Filter  out  duplicate  messages     Uses  an  Expression  to  calculate  a  unique  message  ID,   which  is  looked  up  in  the  repository     By  default,  memory  based     Supports  several  persistent  mode   •  FileIdempotentRepository   •  HazelcastIdempotentRepository  (Available  as  of  Camel  2.8)   •  JdbcMessageIdRepository  (Available  as  of  Camel  2.7)   •  JpaMessageIdRepository   49   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
Idempotent  processor  (1)     To  use  JPA  Repository,  simply  configure  a  persistence   file     We  use  as  Model  MessageProcessed   50   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
Idempotent  processor  (2)     Model  contains   info  about   propre6es  that   we  will  store   into  the  DB   MessageID = key used to filter out messages 51   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
Idempotent  processor  (3)     Spring  Tx  and  JPA  Template  must  be  configured   Spring Template 52   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
Idempotent  processor  (3)     Setup  JpaMessageIdRepository   Reference to the JPA template Ref for the Spring bean jpaStore 53   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
Demo   Idempotent  Consumer  with  JPA  repo   54   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
Table  of  contents     Transac6ons  with  Camel     JMS  and  JDBC  alone     Fuse  ESB  Tx  Manager     Using  a  Global  Transac6on  Manager  (XA)     Persistence  with  EIPs   • Idempotent  processor   • Aggregator     Summary   55   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
Aggregator     Allows  to  combine  messages  together  into  a  single   message     Support  :   •  JdbcAggregatorRepository  (Available  as  of  Camel  2.7)   •  HawtDBAggregatorRepository  (in-­‐memory  DB)     We  keep  in  DB  the  aggregated  object  as  blob     Allows  to  restart  aggrega6on  process  from  where  it   stops  ! 56   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
Aggregator  (1)     How  agregator  works   57   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
Aggregator  (2)     Configura6on  of  the  Persistent  Repository   Configure Repo with DataSource and Tx Manager   And  DB   58   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
Aggregator  (3)     MyAggrega6onstrategy  simply  concatenates  the  Body  using  old   and  new  exchange   59   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
Aggregator  (4)     Class  contains   Users  and  set   the  Key  id  =   FUSE  that  the   aggregator  will   use  on  the   Exchange   Id = key used 60   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
Aggregator  (5)     Apache  Camel  route  refers  to  the  Persistent  Repository   Persistent repository 61   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
Demo   Aggrega6on  with  JDBC  repository   62   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
Table  of  contents     Transac6ons  with  Camel     Fuse  ESB  Tx  Manager     JMS  and  JDBC  alone     Using  a  Global  Transac6on  Manager  (XA)     Persistence  with  EIPs   • Idempotent  processor   • Aggregator     Summary   63   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
Summary     Transac6ons  in  more  detail   •  Transac6onal  client  <-­‐>  Transacted  /  Policy  mode   •  Propaga6onPolicy   •  Rollback  strategies   •  UnitOfWork  to  synchronise     Present  a  configura6on  with  JDBC,  JMS  Tx  managers     Introduce  Fuse  ESB  Tx  Manager     Global  Transac6on  Manager     EIPs  persistent   •  Idempotent  processor/Consumer   •  Aggregator   64   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
For  More  Informa6on     fusesource.com   •  Free  downloads   •  Documenta6on   •  Geyng  Star6ng    demo,  tools  and  advice   •  Webinars  on    beginner  and  advanced  topics   •  White  papers   •  Customer  case  studies     Get  Help   •  Forums   •  Virtual  training   •  Consul6ng   •  Enterprise  subscrip6ons   65   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
Useful  references     Transac6ons  with  camel  /  Fuse  ESB   • hLp://fusesource.com/docs/router/2.8/ transac6ons/index.html     EIPs  paLerns   • hLp://fusesource.com/docs/router/2.8/eip/ MsgEnd-­‐Idempotent.html     • hLp://fusesource.com/docs/router/2.8/eip/ MsgRout-­‐Aggregator.html     Use  Case  –  Devoxx  Hands  on  Lab   • hLps://github.com/cmoulliard/Devoxx-­‐2011-­‐ HandsOnLab   66   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  

More Related Content

PPT
An Introduction to Apache ServiceMix 4 - FUSE ESB
Adrian Trenaman
 
PDF
Service-Oriented Integration With Apache ServiceMix
Bruce Snyder
 
PDF
Service Oriented Integration with ServiceMix
ghessler
 
PDF
Introduction To OSGi
ccustine
 
PDF
Easy Enterprise Integration Patterns with Apache Camel, ActiveMQ and ServiceMix
elliando dias
 
PDF
Apache ActiveMQ and Apache ServiceMix
Bruce Snyder
 
PPT
ServiceMix 4 -- Integrating OSGi with JBI
Gert Vanthienen
 
PDF
Fusesource camel-persistence-part1-webinar-charles-moulliard
Charles Moulliard
 
An Introduction to Apache ServiceMix 4 - FUSE ESB
Adrian Trenaman
 
Service-Oriented Integration With Apache ServiceMix
Bruce Snyder
 
Service Oriented Integration with ServiceMix
ghessler
 
Introduction To OSGi
ccustine
 
Easy Enterprise Integration Patterns with Apache Camel, ActiveMQ and ServiceMix
elliando dias
 
Apache ActiveMQ and Apache ServiceMix
Bruce Snyder
 
ServiceMix 4 -- Integrating OSGi with JBI
Gert Vanthienen
 
Fusesource camel-persistence-part1-webinar-charles-moulliard
Charles Moulliard
 

Similar to Fusesource camel-persistence-part2-webinar-charles-moulliard (20)

PDF
Be jug 090611_apacheservicemix
Charles Moulliard
 
PDF
Introduction to ActiveMQ Apollo
dejanb
 
KEY
Apache Camel - JEEConf May 2011
Claus Ibsen
 
KEY
What Riding the Camel can do to make integration easier for you
Claus Ibsen
 
PDF
Enterprise Integration Patterns and DSL with Apache Camel
Dmitry Buzdin
 
PDF
Leverage Enterprise Integration Patterns with Apache Camel and Twitter
Bruno Borges
 
PPTX
Apache camel overview dec 2011
Marcelo Jabali
 
PDF
Introducing Scalate, the Scala Template Engine
James Strachan
 
PDF
Syer Monitoring Integration And Batch
Dave Syer
 
PPTX
Until Successful Component
Durga Prasad Kakarla
 
PDF
Apache Camel Introduction
Claus Ibsen
 
PPTX
(ZDM) Zero Downtime DB Migration to Oracle Cloud
Ruggero Citton
 
PDF
Transaction launcher
kalyan238
 
PPTX
Until successful component in mule
javeed_mhd
 
PPTX
Until successful component
Sunil Komarapu
 
PPTX
Until successful component in mule
F K
 
PPTX
Oracle Management Cloud newpres-v1.1
Lee Bonfield
 
PDF
Graeme fleetwood 0 c
Graeme Fleetwood
 
PDF
dmb Portfolio
Darwin Borja
 
KEY
Apache Camel
GenevaJUG
 
Be jug 090611_apacheservicemix
Charles Moulliard
 
Introduction to ActiveMQ Apollo
dejanb
 
Apache Camel - JEEConf May 2011
Claus Ibsen
 
What Riding the Camel can do to make integration easier for you
Claus Ibsen
 
Enterprise Integration Patterns and DSL with Apache Camel
Dmitry Buzdin
 
Leverage Enterprise Integration Patterns with Apache Camel and Twitter
Bruno Borges
 
Apache camel overview dec 2011
Marcelo Jabali
 
Introducing Scalate, the Scala Template Engine
James Strachan
 
Syer Monitoring Integration And Batch
Dave Syer
 
Until Successful Component
Durga Prasad Kakarla
 
Apache Camel Introduction
Claus Ibsen
 
(ZDM) Zero Downtime DB Migration to Oracle Cloud
Ruggero Citton
 
Transaction launcher
kalyan238
 
Until successful component in mule
javeed_mhd
 
Until successful component
Sunil Komarapu
 
Until successful component in mule
F K
 
Oracle Management Cloud newpres-v1.1
Lee Bonfield
 
Graeme fleetwood 0 c
Graeme Fleetwood
 
dmb Portfolio
Darwin Borja
 
Apache Camel
GenevaJUG
 
Ad

More from Charles Moulliard (17)

PDF
Security enforcement of Java Microservices with Apiman & Keycloak
Charles Moulliard
 
PDF
Microservices with WildFly Swarm - JavaSI 2016
Charles Moulliard
 
PDF
Develop a Mobile Application coonected to a REST backend
Charles Moulliard
 
PDF
Security enforcement of Microservices with API Management
Charles Moulliard
 
PDF
MicroService and MicroContainer with Apache Camel
Charles Moulliard
 
PDF
Design a Mobil Hybrid Application connected to a REST Backend
Charles Moulliard
 
PDF
Fuse technology-2015
Charles Moulliard
 
PDF
Continuous Delivery & Integration with JBoss Fuse on Openshift
Charles Moulliard
 
PDF
Development of social media projects with Apache Camel, Fabric8 & Hawtio
Charles Moulliard
 
PDF
iPaas with Fuse Fabric Technology
Charles Moulliard
 
PDF
Make easier Integration of your services with Fuse Solutions - RedHat 2013
Charles Moulliard
 
PDF
Karaf ee-apachecon eu-2012
Charles Moulliard
 
PDF
Cloud fuse-apachecon eu-2012
Charles Moulliard
 
PPT
Camelone-2012 HTML5 WebSocket ActiveMQ/Camel
Charles Moulliard
 
PDF
Devoxx 2011 integration-camel-cxf-servicemix-activemq
Charles Moulliard
 
PDF
Fuse source parisjug-10052011
Charles Moulliard
 
PPT
Apache ServiceMix4 : Dream platform for Java Integration
Charles Moulliard
 
Security enforcement of Java Microservices with Apiman & Keycloak
Charles Moulliard
 
Microservices with WildFly Swarm - JavaSI 2016
Charles Moulliard
 
Develop a Mobile Application coonected to a REST backend
Charles Moulliard
 
Security enforcement of Microservices with API Management
Charles Moulliard
 
MicroService and MicroContainer with Apache Camel
Charles Moulliard
 
Design a Mobil Hybrid Application connected to a REST Backend
Charles Moulliard
 
Fuse technology-2015
Charles Moulliard
 
Continuous Delivery & Integration with JBoss Fuse on Openshift
Charles Moulliard
 
Development of social media projects with Apache Camel, Fabric8 & Hawtio
Charles Moulliard
 
iPaas with Fuse Fabric Technology
Charles Moulliard
 
Make easier Integration of your services with Fuse Solutions - RedHat 2013
Charles Moulliard
 
Karaf ee-apachecon eu-2012
Charles Moulliard
 
Cloud fuse-apachecon eu-2012
Charles Moulliard
 
Camelone-2012 HTML5 WebSocket ActiveMQ/Camel
Charles Moulliard
 
Devoxx 2011 integration-camel-cxf-servicemix-activemq
Charles Moulliard
 
Fuse source parisjug-10052011
Charles Moulliard
 
Apache ServiceMix4 : Dream platform for Java Integration
Charles Moulliard
 
Ad

Recently uploaded (20)

PPTX
Detection-First SIEM: Rule Types, Dashboards, and Threat-Informed Strategy
ReZa AdineH
 
PDF
Encapsulation theory and applications.pdf
gurumoop
 
PPTX
MYSQL Presentation for SQL database connectivity
Swati270511
 
PDF
How UI/UX Design Impacts User Retention in Mobile Apps.pdf
SynapseIndia
 
PPTX
20250228 LYD VKU AI Blended-Learning.pptx
DatVoNgoc
 
PDF
Agricultural_Statistics_at_a_Glance_2022_0.pdf
SandeepSingh286037
 
PDF
Per capita expenditure prediction using model stacking based on satellite ima...
IAESIJAI
 
PDF
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
SOFTTECHHUB
 
PDF
Dropbox Q2 2025 Financial Results & Investor Presentation
Dropbox
 
PDF
Bridging biosciences and deep learning for revolutionary discoveries: a compr...
IAESIJAI
 
PPTX
Cloud computing and distributed systems.
kkkkkhan
 
PDF
KodekX | Application Modernization Development
KodekX
 
PDF
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
Peter Tan
 
PDF
Diabetes mellitus diagnosis method based random forest with bat algorithm
IAESIJAI
 
PDF
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
SOFTTECHHUB
 
PDF
Building Integrated photovoltaic BIPV_UPV.pdf
SandeepSingh286037
 
PPTX
Understanding_Digital_Forensics_Presentation.pptx
ImranKhan423233
 
PPTX
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
muhammadmuneebnaeem7
 
PDF
Blue Purple Modern Animated Computer Science Presentation.pdf.pdf
Akar16
 
PPTX
Digital-Transformation-Roadmap-for-Companies.pptx
David Malick Dieng
 
Detection-First SIEM: Rule Types, Dashboards, and Threat-Informed Strategy
ReZa AdineH
 
Encapsulation theory and applications.pdf
gurumoop
 
MYSQL Presentation for SQL database connectivity
Swati270511
 
How UI/UX Design Impacts User Retention in Mobile Apps.pdf
SynapseIndia
 
20250228 LYD VKU AI Blended-Learning.pptx
DatVoNgoc
 
Agricultural_Statistics_at_a_Glance_2022_0.pdf
SandeepSingh286037
 
Per capita expenditure prediction using model stacking based on satellite ima...
IAESIJAI
 
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
SOFTTECHHUB
 
Dropbox Q2 2025 Financial Results & Investor Presentation
Dropbox
 
Bridging biosciences and deep learning for revolutionary discoveries: a compr...
IAESIJAI
 
Cloud computing and distributed systems.
kkkkkhan
 
KodekX | Application Modernization Development
KodekX
 
Architecting across the Boundaries of two Complex Domains - Healthcare & Tech...
Peter Tan
 
Diabetes mellitus diagnosis method based random forest with bat algorithm
IAESIJAI
 
TokAI - TikTok AI Agent : The First AI Application That Analyzes 10,000+ Vira...
SOFTTECHHUB
 
Building Integrated photovoltaic BIPV_UPV.pdf
SandeepSingh286037
 
Understanding_Digital_Forensics_Presentation.pptx
ImranKhan423233
 
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
muhammadmuneebnaeem7
 
Blue Purple Modern Animated Computer Science Presentation.pdf.pdf
Akar16
 
Digital-Transformation-Roadmap-for-Companies.pptx
David Malick Dieng
 

Fusesource camel-persistence-part2-webinar-charles-moulliard

  • 1. Transac6on  Management  with   Apache  Camel,  ServiceMix  -­‐  EIPs   Part  II   Charles Moulliard – Raul Kripalani, November 22nd, 2011 A  Progress  So3ware  Company   1   Copyright  ©  2010  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
  • 2. When you joined today’s session … Audio is broadcast from your computer Submit your questions via the Chat Window Contact today’s Host via the Chat Window 2   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
  • 3. Learn  More  at  hLp://fusesource.com   3   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
  • 4. Speaker  –  Charles  Moulliard     Engineer  in  Agronomy  &  Master   Follow  me  on  :   in  Zoology     17  years  of  experience  in  IT    hLp://twiLer.com/cmoulliard   world  development  (J2EE,  .NET)    hLp://www.linkedin.com/in/ •  Specialised  in  new  technologies   charlesmoulliard   web/Internet  &  integra6on   •  Project  manager  in  bank,  financial,                    hLp://cmoulliard.blogspot.com   telco,  insurance  and  transport   world                      hLp://www.slideshare.net/   Solu6on  Architect  at  FuseSource       cmoulliard     CommiLer  on  Apache  projects  :     •  Apache  ServiceMix,    Apache  Karaf   (PMC)  ,  Apache  Camel,  Fuse  Fabric,   Scalate   4   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
  • 5. Agenda     Goal  :  Transac6on  Management  with  Apache   Camel,  ServiceMix  -­‐  EIPs   • Transac6ons  with  Camel   • JMS  and  JDBC  alone   • Fuse  ESB  Tx  Manager   • Using  Global  Transac6on  Manager  (XA)   • Persistence  with  EIPs   • Idempotent  processor   • Aggregator   • Summary   5   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
  • 6. Table  of  contents     Transac6ons  with  Camel     JMS  and  JDBC  alone     Fuse  ESB  Tx  Manager     Using  Global  Transac6on  Manager  (XA)     Persistence  with  EIPs   • Idempotent  processor   • Aggregator     Summary   6   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
  • 7. Transac6ons  with  Camel     Camel  does  not  re-­‐invent  the  wheel  and  use  Spring  or   Blueprint  API  (on  Apache  ServiceMix)     Can  work  with  local  or  provided  Tx  Manager   •  Local  =  Spring  (JMS,  JPA,  JDBC,  Hibernate),  Atomikos,   Bitronix,  jOTM   •  Provided  =  J2EE  (WebSphere,  JBoss,  Glassfish,  BEA,   Geronimo),  Apache  ServiceMix     7   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
  • 8. Transac6ons  with  Camel     Factors  affec6ng  Architecture  depends  on  :   •  Component  (Transac6onal  or  not),     •  Type  of  Transac6on  Manager  and  DataSource  (XA  or  not),     •  Route  (simple,  complex),   •  Transacrion  Propaga6on  Type  (REQUIRED,  NEW,   MANDATORY,  ….)     How  to  configure  a  Camel  route  to  be  transac6onal     2  approaches  exist  and  they  can  be  combined   8   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
  • 9. Transac6ons  with  Camel  (1)   A)  Using  a  Transac6onal  component  for  producer  or   consumer   How  To  :     Check  which  component  are  Tx   aware    jpa,  sql,  jms,  file,   hibernate,  iba6s.     Configure  a  Transac6on  Manager   for  the  endpoint   9   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
  • 10. Transac6ons  with  Camel  (2)     Simple  Transac6onal  JMS  client  configura6on  example   Spring JMS Tx manager is defined Here we provide the parameters 10   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
  • 11. Transac6ons  with  Camel  (3)   B)  Configure  a  Camel  route  as  Transac6onal     Advantage  :  allow  to  include  processors  (beans,  jpa,   hibernate)  with  a  Transac6onal  route     How  to  configure  it    add  <transacted>  to  the  route     How  does  it  work   •  Camel  will  automa6c  lookup  to  find  a  Spring  transac6on   manager   (org.springframework.transac6on.PlasormTransac6onManager)   •  Transac6on  Manager  creates  a  Transac6on  (according  to   PROPAGATION  Policy)   •  Transac6onError  handler  will  take  care  of  excep6ons  occuring   during  camel  exchange  and  propagated  it  to  the  caller   11   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
  • 12. Transac6ons  with  Camel  (4)     Example  of  Camel  Transac6on  route   A B Camel will lookup for “PROPAGATION_REQUIRED” 12   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
  • 13. Transac6ons  with  Camel  (5)     Reference  of  the  SpringTransac6onPolicy  can  be  provided   Reference to the bean 13   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
  • 14. Transac6ons  with  Camel  (6)     Another  example  using  <Policy>  DSL  and   SpringTransac6onPolicy  is  provided  to  the  TxErrorHandler   Transacted is replaced by Policy 14   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
  • 15. Transac6ons  with  Camel  (7)     Transac6on  policy  can  be  defined  using  class   org.apache.camel.spi.TransactedPolicy     Policies  can  be  mixed  in  Camel  routes  to  use  different   transac6on  propaga6ons  (NEW,  REQUIRED,  …)   15   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
  • 16. Transac6ons  with  Camel  (8)     Example  of  2  Camel  routes  using  different  Policy         Required policy : will use an existing Transaction or request to create a new Requires-New policy will request a new Transaction 16   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
  • 17. Transac6ons  with  Camel  (9)     Transac6on  rollback  occurs  when  a  run6me  excep6on  is   raised  but  you  can  also  manage  it  using  <rollback>  DSL   We force a Rollback by generating a org.apache.camel.Rollbac kExchangeException 17   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
  • 18. Transac6ons  with  Camel  (9)     Using  markRollBackOnly  generates  a  Rollback  without   excep6on  in  the  Camel  route   Rollback occurs in BookService (DB), exception is not send to direct (which is not Tx aware) and exception is send to mock endpoint 18   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
  • 19. Transac6ons  with  Camel  (10)     When  Apache  Camel  producer/consumer  is  not   Transac6onal,  a  compensa6on  mechanism  can  be   used.     Uses  a  synchronisa6on  mechanism  =  callback  (mimic   Tx)  to  group  tasks  as  a  UnitOfWork     Will  react  with  onComplete  (=commit)  or  onFailure   (=rollback)   19   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
  • 20. Transac6ons  with  Camel  (11)   onCompletion + link to the bean implementing the rollback logic 20   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
  • 21. Transac6ons  with  Camel  (12)   Rollback strategy 21   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
  • 22. Transac6ons  with  Camel  (13)     Be  carefull  about  threads,  threadPool     •  Only  one  should  be  used,   •  Don't  use  seda://,  vm://,  NMR://  which  are  async  to  link   Camel  routes     Tx  async  are  not  supported  in  Camel  2.x  (planned  for   Camel  3.x)     More  info  :  hLp://fusesource.com/docs/router/2.8/ transac6ons/TxnDemarca6on-­‐ErrorHandling.html   22   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
  • 23. Table  of  contents     Transac6ons  with  Camel     JMS  and  JDBC  alone     Fuse  ESB  Tx  Manager     Using  a  Global  Transac6on  Manager  (XA)     Persistence  with  EIPs   • Idempotent  processor   • Aggregator     Summary   23   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
  • 24. JMS  and  JDBC     Integra6on  project,  most  probably,  will  use  not  only  1   Tx  Manager  but  a  combina6on  using  JMS  +  JDBC,  JDBC   +  JDBC,  JMS  +  JMS,  …     Such  a  project  can  use  Spring  or  Fuse  ESB  Tx  Managers     2  Approaches  are  available  on  Fuse  ESB   •  Spring  /  Spring  DM  (Dynamic  Modules)   •  Aries  Blueprint     Apache  Aries  project  =  implementa6on  of  Enterprise   features  of  OSGI  EE  specifica6ons  (Transac6on,  JPA,   JNDI,  Web)     24   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
  • 25. JMS  and  JDBC     Use  Case  descrip6on     25   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
  • 26. JMS  and  JDBC  (1)  -­‐  Spring     Example  of  a  project  containing  a  JPA,  Datasource  and   a  camel  route  with  Ac6veMQ  JMS  queues   DataSource is created using Apache Commons DBCP And is exported as OSGI Service wit h2 filters 26   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
  • 27. JMS  and  JDBC  (2)  -­‐  Spring     JPA  Persistence  file  –  transac6on-­‐type  =  "RESOURCE-­‐ LOCAL"   27   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
  • 28. JMS  and  JDBC  (3)  -­‐  Spring   Spring will inject persistence context Method will be added into an existing Transaction 28   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
  • 29. JMS  and  JDBC  (4)  -­‐  Spring   DAO will be scanned by spring to find @Annotation DAO is exposed as a service Spring will add Tx demarcation Based on @Transactional annotations Our Spring JPA Tx Manager is exported and will be used by Camel route A  Progress  So3ware  Company   29   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.    
  • 30. JMS  and  JDBC  (5)  -­‐  Spring   Spring JMS Tx Manager Message rollbacked will be moved directly into the DLQ Transacted = true, ref to Tx manager, CACHE_NONE to avoid that Spring uses another session (thread)) 30   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
  • 31. JMS  and  JDBC  (6)  -­‐  Spring   We search for JPA Tx Manager   Camel  Spring  configura6on   We configure 2 Transaction Policy (one for JMS, other for JPA) 31   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
  • 32. JMS  and  JDBC  (5)  -­‐  Spring     Apache  Camel  routes   JMS + JDBC JMS + JMS 32   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
  • 33. Table  of  contents     Transac6ons  with  Camel     JMS  and  JDBC  alone     Fuse  ESB  Tx  Manager     Using  Global  Transac6on  Manager  (XA)     Persistence  with  EIPs   • Idempotent  processor   • Aggregator     Summary   33   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
  • 34. Fuse  ESB  –  Transac6on  Manager     Apache  ServiceMix  4.x  plasorm  (Fuse  ESB)  provides  a   Tx  Manager     Based  on  Apache  Geronimo  Tx  Manager  (JTA  1.1)     Deployed  using  feature    transac6on     Contains  the  following  bundle     34   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
  • 35. Fuse  ESB  –  Transac6on  Manager  (1)     Can  be  used  as  a  Global  JTA  Tx  Manager  with  XA   Resource     Expose  through  OSGI  service  registry  interfaces     Proxified objects available 35   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
  • 36. Fuse  ESB  –  Transac6on  Manager  (2)     Timeout  and  Tx  log  file  can  be  customised     36   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
  • 37. Table  of  contents     Transac6ons  with  Camel     JMS  and  JDBC  alone     Fuse  ESB  Tx  Manager     Using  Global  Transac6on  Manager  (XA)     Persistence  with  EIPs   • Idempotent  processor   • Aggregator     Summary   37   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
  • 38. Global  Tx  Manager  -­‐  XA     Using  a  Global  Transac6on  Manager  on  Fuse  ESB  just   requires  that  we  use  JTA  and  configure  XA  resources     Verify  careful  regarding  to  the  choice  of  the  "drivers"  or   "datasource"  that  you  will  use  (XA  aware)     You  do  not  need  to  use  Spring  JDBC,  JPA,  JMS,   Hibernate  Transac6on  Manager    Aries  Tx  Manager     38   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
  • 39. Global  Tx  Manager  -­‐  XA     Use  Case   39   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
  • 40. Global  Tx  Manager  -­‐  XA  (1)     What  will  change  :  Datasource  (JDBC)   Add a XA Datasource Export XA and non XA Datasource as OSGI services (will be used by JPA container) 40   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
  • 41. Global  Tx  Manager  -­‐  XA  (2)     JPA  -­‐  persistence.xml     Use JTA instead of RESOURCE-LOCAL Configure JTA and non-JTA datasource 41   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
  • 42. Global  Tx  Manager  -­‐  XA  (3)     JPA  -­‐  spring   We call OSGI Service to retrieve the PlatformTransactionManager object managed by Aries TX Manager 42   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
  • 43. Global  Tx  Manager  -­‐  XA  (4)     JMS  –  XA  Connec6on  Pool  /  Resource  Manager     ActiveMQ requires JTA Manager and XAPooledConnectionFactory 43   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
  • 44. Global  Tx  Manager  -­‐  XA  (4)     JMS  –  Ac6veMQ  component   Transacted is false in this configuration as Aries Tx xManager will take care ! 44   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
  • 45. Global  Tx  Manager  -­‐  XA  (1)     Apache  Camel  Route   We use the Global Tx Manager exposed as OSGI Service through Spring TransactionManager to get it for JPA Service 45   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
  • 46. Global  Tx  Manager  -­‐  XA  (1)   Nothing has changed except that   Apache  Camel  Route   you could use XA and non XA connection pool for JMS 46   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
  • 47. Demo   Transac6ons  in  Ac6on  on  Fuse  ESB  !   47   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
  • 48. Table  of  contents     Transac6ons  with  Camel     JMS  and  JDBC  alone     Fuse  ESB  Tx  Manager     Using  a  Global  Transac6on  Manager  (XA)     Persistence  with  EIPs   • Idempotent  processor   • Aggregator     Summary   48   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
  • 49. Idempotent  processor     Filter  out  duplicate  messages     Uses  an  Expression  to  calculate  a  unique  message  ID,   which  is  looked  up  in  the  repository     By  default,  memory  based     Supports  several  persistent  mode   •  FileIdempotentRepository   •  HazelcastIdempotentRepository  (Available  as  of  Camel  2.8)   •  JdbcMessageIdRepository  (Available  as  of  Camel  2.7)   •  JpaMessageIdRepository   49   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
  • 50. Idempotent  processor  (1)     To  use  JPA  Repository,  simply  configure  a  persistence   file     We  use  as  Model  MessageProcessed   50   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
  • 51. Idempotent  processor  (2)     Model  contains   info  about   propre6es  that   we  will  store   into  the  DB   MessageID = key used to filter out messages 51   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
  • 52. Idempotent  processor  (3)     Spring  Tx  and  JPA  Template  must  be  configured   Spring Template 52   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
  • 53. Idempotent  processor  (3)     Setup  JpaMessageIdRepository   Reference to the JPA template Ref for the Spring bean jpaStore 53   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
  • 54. Demo   Idempotent  Consumer  with  JPA  repo   54   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
  • 55. Table  of  contents     Transac6ons  with  Camel     JMS  and  JDBC  alone     Fuse  ESB  Tx  Manager     Using  a  Global  Transac6on  Manager  (XA)     Persistence  with  EIPs   • Idempotent  processor   • Aggregator     Summary   55   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
  • 56. Aggregator     Allows  to  combine  messages  together  into  a  single   message     Support  :   •  JdbcAggregatorRepository  (Available  as  of  Camel  2.7)   •  HawtDBAggregatorRepository  (in-­‐memory  DB)     We  keep  in  DB  the  aggregated  object  as  blob     Allows  to  restart  aggrega6on  process  from  where  it   stops  ! 56   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
  • 57. Aggregator  (1)     How  agregator  works   57   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
  • 58. Aggregator  (2)     Configura6on  of  the  Persistent  Repository   Configure Repo with DataSource and Tx Manager   And  DB   58   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
  • 59. Aggregator  (3)     MyAggrega6onstrategy  simply  concatenates  the  Body  using  old   and  new  exchange   59   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
  • 60. Aggregator  (4)     Class  contains   Users  and  set   the  Key  id  =   FUSE  that  the   aggregator  will   use  on  the   Exchange   Id = key used 60   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
  • 61. Aggregator  (5)     Apache  Camel  route  refers  to  the  Persistent  Repository   Persistent repository 61   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
  • 62. Demo   Aggrega6on  with  JDBC  repository   62   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
  • 63. Table  of  contents     Transac6ons  with  Camel     Fuse  ESB  Tx  Manager     JMS  and  JDBC  alone     Using  a  Global  Transac6on  Manager  (XA)     Persistence  with  EIPs   • Idempotent  processor   • Aggregator     Summary   63   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
  • 64. Summary     Transac6ons  in  more  detail   •  Transac6onal  client  <-­‐>  Transacted  /  Policy  mode   •  Propaga6onPolicy   •  Rollback  strategies   •  UnitOfWork  to  synchronise     Present  a  configura6on  with  JDBC,  JMS  Tx  managers     Introduce  Fuse  ESB  Tx  Manager     Global  Transac6on  Manager     EIPs  persistent   •  Idempotent  processor/Consumer   •  Aggregator   64   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
  • 65. For  More  Informa6on     fusesource.com   •  Free  downloads   •  Documenta6on   •  Geyng  Star6ng    demo,  tools  and  advice   •  Webinars  on    beginner  and  advanced  topics   •  White  papers   •  Customer  case  studies     Get  Help   •  Forums   •  Virtual  training   •  Consul6ng   •  Enterprise  subscrip6ons   65   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company  
  • 66. Useful  references     Transac6ons  with  camel  /  Fuse  ESB   • hLp://fusesource.com/docs/router/2.8/ transac6ons/index.html     EIPs  paLerns   • hLp://fusesource.com/docs/router/2.8/eip/ MsgEnd-­‐Idempotent.html     • hLp://fusesource.com/docs/router/2.8/eip/ MsgRout-­‐Aggregator.html     Use  Case  –  Devoxx  Hands  on  Lab   • hLps://github.com/cmoulliard/Devoxx-­‐2011-­‐ HandsOnLab   66   Copyright  ©  2011  Progress  So3ware  Corpora6on  and/or  its  subsidiaries  or  affiliates.  All  rights  reserved.     A  Progress  So3ware  Company