The Enterprise Architecture you always wanted: A Billion Transactions Per Month - Using the Web for Enterprise Heavy Lifting
2 likes573 views
The document describes an enterprise architecture for a telecoms service provider that was struggling with scalability and system resilience issues. A previous consultancy had proposed a complex and expensive solution, but ThoughtWorks was tasked with delivering the same capabilities more cheaply. They prioritized building a storage manager service to offload storage responsibilities from the integration database. This improved performance and allowed other parts of the system to be simplified, delivering business value by resolving customers' issues.
The Enterprise Architecture you always wanted: A Billion Transactions Per Month - Using the Web for Enterprise Heavy Lifting
- 1. The Enterprise Architecture you always wanted has been hiding in plain sight since 1991 Jim Webber h<p://jim.webber.name Twi<er: @jimwebber
- 2. Or: A Billion TransacDons Per Month Using the Web for Enterprise Heavy LiLing Jim Webber h<p://jim.webber.name Twi<er: @jimwebber
- 6. “SOA: Principles of Service Design underwent a thorough technical review involving over 60 reviewers from different vendors, organiza3ons, and professions across North America, Europe, and Asia. The book has been formally endorsed by members of major SOA vendors, including IBM, MicrosoC, Oracle, BEA, and Intel.” -‐-‐ Thomas Erl
- 7. Tomorrow’s Enterprise Architecture BPM Services Business Service Data Service Business Service Data Service Data Service Business Service Data Service Data Service
- 8. Nirvana Enterprise Architecture, or… BPM Service Business Service Business Service ESB Basic Service Basic Service Basic Service Basic Service Basic Service Business Service
- 9. ESB -‐ Erroneous SpagheU Box? Enterprise Service Bus
- 13. But we sDll do it.
- 14. Why? Because it’s “less risky”
- 15. Why? Because that’s what the market does
- 16. Why? Because we need the -‐iliDes
- 17. So let’s talk about those -‐iliDes
- 20. Web Scale!
- 21. Tradi'onal Enterprise Security
- 22. !"#$%&'"!( )*%%#+*(&"',*%%-$+( .*/(0*"1-,*(2'+-,( "*%'3",*%( %*,3"-!4( -$!*")*5-#"4( %*"1-,*( !"#$%&'"!( )*%%#+*(&"',*%%-$+( .*/(0*"1-,*(2'+-,( "*%'3",*%( %*"1-,*( 2'+-,#2( &'-$!6!'6&'-$!( )*%%#+*(!"#$%7*"( %*,3"-!4( -$!*")*5-#"4( !"#$%&"' !"#$%&"' ()*+,-%).'!"&/#%*0'123"4'524*"6*' )"&/#"'&24*"6*' !%74"89"4�:*"8';)7'*#+4)<"#' ="4">9+;"48')"&/#%*0'&24*"6*'*23"4' !"&/#%*0'123"4'!"#$%&"' ?@!A1#/)*B' !%74"89"4�:*"8';)7'*#+4)<"#' 5+4&"-9"6:%#"')"&/#%*0'&24*"6*'*23"4' End to End Secure Messaging End to End Secure ConversaDons
- 23. !"#$%&'(' !"#$%&')' *+',$-%.$/0'120.0&3$-4' 5+'62$&4702'401820'#044$90' :0;8043&9' 402<%10' :0;8043&9' 402<%10' =.0&3/>' ?2"<%.02'@A6AB' =.0&3/>' C2"<%.02'@A6AB' D+'E0/'6"F0&' G+',$-%.$/0' 120.0&3$-4' !"#$%&'()*+,"-)!"%.&#") /0!1*%$2'3) 4+5&#() !"#$%&'() *+,"-) 657&8) 657&8) 657&8) !"#$%&'()*+,"-)!"%.&#") /0!1*%$2'3) 4+5&#() !"#$%&'() *+,"-) 657&8) 657&8) 657&8) !"#$%&'()*+,"-)!"%.&#") /0!1*%$2'3) 4+5&#() !"#$%&'() *+,"-) 657&8) 657&8) 657&8) Security Tokens and claims FederaDng access with tokens
- 25. …you wouldn’t use it at home!
- 31. <?xml version="1.0" encoding="UTF-8"?> <definitions name="HelloService" targetNamespace="http://www.ecerami.com/wsdl/HelloService.wsdl" xmlns="http://schemas.xmlsoap.org/wsdl/" xmlns:soap="http://schemas.xmlsoap.org/wsdl/soap/" xmlns:tns="http://www.ecerami.com/wsdl/HelloService.wsdl" xmlns:xsd="http://www.w3.org/2001/XMLSchema"> <message name="SayHelloRequest"> <part name="firstName" type="xsd:string"/> </message> <message name="SayHelloResponse"> <part name="greeting" type="xsd:string"/> </message> <portType name="Hello_PortType"> <operation name="sayHello"> <input message="tns:SayHelloRequest"/> <output message="tns:SayHelloResponse"/> </operation> </portType> <binding name="Hello_Binding" type="tns:Hello_PortType"> <soap:binding style="rpc" transport="http://schemas.xmlsoap.org/soap/http"/> <operation name="sayHello"> <soap:operation soapAction="sayHello"/> <input> <soap:body encodingStyle="http://schemas.xmlsoap.org/soap/encoding/" namespace="urn:examples:helloservice" use="encoded"/> </input> <output> <soap:body encodingStyle="http://schemas.xmlsoap.org/soap/encoding/" namespace="urn:examples:helloservice" use="encoded"/> </output> </operation> </binding> <service name="Hello_Service"> <documentation>WSDL File for HelloService</documentation> <port binding="tns:Hello_Binding" name="Hello_Port"> <soap:address location="http://localhost:8080/soap/servlet/rpcrouter"/> </port> </service> </definitions> Hello World!
- 32. The Web is a coordina'on pla<orm Status codes Verbs Media Types
- 34. A Case Study Client • UK-‐based telecoms service provider • Global customers (no easy downDme) Problem • Scalability and system resilience issues • Huge growth curve to from a million to a billion messages per month • Costs
- 35. Plaaorm Architecture Carrier Carrier Carrier Carrier Gateway Voice to Text Algorithms Integration Database Post Processing Shared Filesystem Bottleneck Nightmare! Where’s my file gone? Shoehorn it in that other program Fix things up here
- 37. The £10 Million SoluDon Carrier Carrier Carrier Carrier Gateway Voice to Text Algorithms “Queue” Database Post Processing Shared Filesystem Enterprise Service Bus * * SoluDon does not include actual implementaDon
- 39. ThoughtWorks was given the output from a previous enterprise consultancy… …and told to “do that, but cheaper”
- 41. Think differently! (or even just stop and think)
- 42. Architecture is still important
- 43. Agile EA: PrioriDse Service Delivery Carrier Carrier Carrier Carrier Gateway Voice to Text Algorithms Integration Database Post Processing Shared Filesystem Start by fixing storage
- 48. Storage Manager Project Delivery Small team 3 Week Incep'on 14 itera'ons Java solu'on Performance tes'ng throughout – See Jones and Kua paper, Agile 2009 Con'nuously built and deployed for tes'ng
- 49. Web-‐friendly Architecture (mostly wallet-‐friendly too!) Storage Manager Jboss/Tomcat GPFS SAN Cacheable! Optimised disk access! Optimised server config Free! Encapsulates storage detail! Fast! Spend £ on the right Infrastructure
- 52. What is going on here? What is going on with these peaks?
- 53. Hypothesis Directories are becoming full, slowing random access to files
- 54. PredicDon A single directory will result in linearly degrading performance
- 56. Outcome Adapt the directory structure to take advantage of the underlying file system
- 57. Improving Enterprise Architecture Carrier Carrier Carrier Carrier Gateway Voice to Text Algorithms Integration Database Post Processing Storage Manager Reduced Load Just shoehorn it in that other program “She’ll be right” Scalable!
- 58. Storage Manager Benefits • Immediate reduced load on integraDon database • Enabled removal of code from systems • Delivered business value by keeping customers happy • “The best soLware we have ever deployed” – OperaDons director I’ll come back to this
- 59. What’s wrong with this picture? Voice to Text Algorithms! Storage Manager! Just shoehorn it in that other program! Scalable!!
- 60. What if… We took our inspiraDon from successful Web-‐scale companies?
- 61. What if… And took the Dme to understand our SLAs?
- 62. What if… And picked the right technology soluDon? Not just the one we’re being sold?
- 63. What if… We built a scalable compute plaaorm?
- 65. Grid Project Delivery Larger team 3.5 Week Incep'on 18 itera'ons Java solu'on Performance tes'ng throughout Con'nuously built and deployed for tes'ng
- 66. Web-‐friendly Architecture (very wallet-‐friendly!) Grid Manager Embedded Jetty Grid Manager Embedded Jetty Grid Manager Embedded Jetty Grid Manager Embedded Jetty Grid Manager Embedded Jetty ASR ASR ASR ASR Grid Pipeline ASR ASR ASR ASR Grid Pipeline Just HTTP Fault Tolerant Fault Tolerant Just HTTP Sustainable container for business logic £0 Software Infrastructure
- 67. Improving Enterprise Architecture Carrier Carrier Carrier Carrier Gateway Grid Integration Database Post Processing Storage Manager Massively Reduced Load “She’ll be right” Scalable! Scalable, sustainable! Scalable Processing Platform
- 68. Grid Benefits • Scalable, resilient plaaorm • Aligned with business goals • Further reduced load on integraDon database • Set architectural pa<erns • Deliver business value by processing more messages at lower cost than ever before • “The best soLware we have ever deployed” – OperaDons director Be<er every Dme!
- 69. £10,000,000 Up-Front Cost of Bus Architecture
- 70. £1,000,000 Actual Cost of Completed Project
- 72. The Web works And its economies of scale eclipse your vendors’