#1 Calicut MuleSoft Meetup - Introduction to Enterprise Integration and MuleSoft
- 1. 19th June 2021 Calicut MuleSoft Meetup Group Introduction to Enterprise Integration and MuleSoft
- 2. Organizers Fathima Farzana John Mathew Philip NJC Labs NJC Labs MuleSoft / Integration Developer MuleSoft / Integration Developer 2
- 3. 3 ● Introductions ● Understanding System Integration ● Challenges in Integration ● History and Various approaches in Integration ● Modern Approach with API Led Connectivity ● Introduction to Anypoint Platform ● Opportunities in Anypoint Platform Agenda
- 4. ● Trivia Quiz ● Wrap-Up 4
- 5. Speakers ○ Senior MuleSoft Instructor ○ Senior Integration Architect ○ 20+ yrs of experience in IT ○ MuleSoft Certified Architect ○ MuleSoft Senior Instructor APAC 5 Sivadas K Ramdas
- 6. What is System Integration for Beginners Understanding System Integration
- 7. 7 What is integration? ● Moving Data from Point A to Point B Messaging Patterns » Integration Styles » File Transfer https://www.enterpriseintegrationpatterns.com/patterns/messaging/FileTransferIntegration.html
- 8. Thats Easy Right ? ● Moving Data Physically from Point A to Point B ● Common use case Backup & Data Migration Floppy Disks DVD Pendrive Portable Hard Disks Magnetic Tapes 1.44 MB 4.7 GB 8 GB to 64 GB+ 16 TB HDD 15 TB TO Petabytes ( Library )
- 9. Much Easier ? ● With Cloud Storage Systems Petabytes of Storage
- 10. When Data is Really Large ? Let’s do the Math? 100 PB = 10,48,57,600 GB Network Speed 10 GB / second Approximate Time to Transmit the Data from Point A to Point B on a 10 GB Per Second Network ? 3 Months 10,48,57,600 GB / = 10,485,760 Seconds / 86400 = 121.362 Days 10 GB / Sec Consider Reliability, Security
- 11. What about a Data center ? ● When the Data is Really Large. AWS Snowball AWS Snowmobile 80 Terabytes 100 Petabyte
- 12. 12 The File Based Integration ● Oldest of the Integration Styles, Still Relevant ○ Commonly used in Data Migration ○ Energy Efficient when Its just Storing Data for Long Duration of Time ○ Backup & Restore data ○ ETL ( Extract, Transform, Load ) ○ Logs, Analytics, Machine Learning, Big Data ● Drawbacks ○ Searching a Record in a thousands of files is like, Searching a Needle in Haystack ○ Reliability ○ Performance ○ Limitations with concurrent access to files for Read / Write Operations ○ Dependency on Hardware and complexities of big-endian (BE) or little-endian (LE) ○ Cost ○ File Size
- 13. Is really good but we need Translators ! ● File formats, Hardware Dependencies, Software Dependencies, Incompatible Standards ● Realtime data requirements ● https://en.wikipedia.org/wiki/List_of_file_formats 13 Messaging Patterns » Messaging Systems » Message Translator
- 14. But Files Needed to be Shared! ● Remote Terminals / Mainframes 14
- 15. But Processed Locally, Stored Remotely! 15
- 16. Better, Structured, Organised, CRUD 16 ● Relational Database Management Systems
- 17. Little User Friendly, Shared, Distributed? Copies of Same Application, Accessing Same Database Different Applications, Accessing Same Database 17 Messaging Patterns » Integration Styles » Shared Database
- 18. We need more Control on Data Rise of ERP Systems Stored Procedures 18 Messaging Patterns » Integration Styles » Shared Database
- 19. Internet, WWW and Web Applications ● Access Information from Anywhere ● JSP, ASP, PHP, Perl 19 Messaging Patterns » Integration Styles » Shared Database
- 20. Rise of Cloud & Containerization ● Let's put it all in the Cloud ● Scalability ● Availability ● Cost 20
- 21. Challenges the Past, Present and Future Enterprise Integration
- 22. 22 ● Different Systems ● Different Architectural Styles ● Different Data Formats ● Different Interfaces But ● Data Need to be Consistent ● Data Need to be Synchronised ● Data Needs to be Available ● Data Needs to be Accessible Now ● Information needs to be inferred from Data (Machine Learning) Its Complex
- 23. 23 ● 65 Patterns Connecting Systems Integration Patterns https://www.enterpriseintegrationpatterns.com/patterns/messaging/
- 24. Technologies, Architecture Pros and Cons A Brief History of Integration approaches
- 25. 25 Point to Point ● Hard to Maintain ● Tight Coupling ● Breaks with Even Small Changes
- 26. 26 SOA - Service Oriented Architecture https://www.cio.com/article/2434865/top-10-reasons-why-people-are-making-soa-fail.html Software provides or enables or support a Service
- 27. 27 Microservices Break it down to Smaller Services ● Governance ● Visibility ● Dependencies https://www.youtube.com/watch?v=CZ3wIuvmHeM Mastering Chaos - A Netflix Guide to Microservices
- 28. API Led Connectivity A Better Approach with API
- 30. 30 API Led Connectivity ● A Simple Combination of API’s in Layers ● An Architectural Style, ○ API’s First ● System Layer API’s Abstract Backend Systems ● Process Layer API’s Orchestrate Business Logic ● Experience Layer API’s Exposes Service ● Easy to Govern, Maintain and Scale ● Easy to build with Anypoint Platform & Toolings
- 32. Opportunities & Careers in Anypoint Platform
- 34. 34 Free Self Paced Training Resources for Getting You Started. ● https://training.mulesoft.com/course-catalog?results=true&courseFormat=Self-paced Instructor Led Training Programs ● https://training.mulesoft.com/course-catalog?results=true&courseFormat=Instructor-led Learn & Get Certified
- 35. Trivia Quiz
- 36. Who is the Founder of MuleSoft ? A - David Duffield B - Parker Harris C - Ross Mason D - Tim Berglund 36
- 37. Which of the following is not the default port of a Database? A - 3306 - MySQL B - 1423 - Microsoft SQL C - 5432 - PostgreSQL D - 27017 -MongoDB 37
- 38. Maximum no of records that can be upserted in a go using SFDC UPSERT connector? A - 200 B - 350 C - 400 D - 300 38
- 39. 39 ● Share: ○ Tweet using the hashtag #MuleSoftMeetups and #CalicutMuleSoftMeetups ○ Invite your network to join: https://meetups.mulesoft.com/calicut/ ● Feedback: ○ Fill out the survey feedback and suggest topics for upcoming events ○ Contact MuleSoft at meetups@mulesoft.com for ways to improve the program What’s next?
- 40. Thank you