Enterprise Orchestration at UT (via Stonebranch) FINAL VERSION v3
- 1. B2B GATEWAY: MANAGED FILE TRANSFERS AT UT (VIA STONEBRANCH™ ) ITS SERVICE OFFERING FOR THE UT ADMINISTRATIVE IT COMMUNITY
- 2. WHAT IS FILE TRANSFER JOB SCHEDULING? Think of automating an Airport Baggage Claim System…. Complex, repetitive, or ordered tasks that can gain efficiencies with automation • Online banking • Executing online bill payments or delivering credit card transactions for processing • Financial Data Management • Automatic financial transaction transfer into sales or accounting software
- 3. UT TECH ARCH BACKGROUND • Mainframe retiring & all applications need to find or develop a technology replacement (200+ applications) • “Task Manager” application retired • Replaced by Enterprise Orchestration Service (Stonebranch™)
- 4. PROBLEMS TO SOLVE File Transfer functionality often coupled with Job Processing • Consumers are relying on old technology; “Transfer” Service for unmanaged, (fault tolerant) file transfer workflows • Consumers need managed, (fault intolerant), internal & external file transfers • Opportunity to modernize with B2B Gateway
- 6. ASSUMPTIONS • Consumers will reduce use of old technology once new technology is available • Consumers want B2B Gateway for External (3rd party cloud) file transfers (i.e. Workday, Box, etc.)
- 7. ASSUMPTIO N
- 8. REALITY • Consumers have not reduced use of old technology, uses new service pieces • Consumers will need External (Cloud) B2B file transfer for 3rd parties later • Consumers want Internal (on premise) managed file transfer
- 10. B2B GATEWAY TO REPLACE TRANSFER SERVICE Replace Transfer with B2B Gateway • B2B Gateway • Managed (fault tolerant) file transfers • Phase 1: Internal jobs , replace Transfer • Phase 2: External jobs, integration with 3rd parties Benefits • Supports current (internal) and future (external) file transfer needs • Streamlines IT Services; Remove legacy/outdated systems with duplicate functionality • Saves “Transfer” Service operating costs • Provides improved functionality
- 12. TRANSFER • SFTP Server • No Agent Intelligence • Unmanaged (fault intolerant) File Transfers • Internal (on premise) • CLI
- 13. B2B GATEWAY • Reliable and compliant movement of files • Protocol Requirements • Agent intelligence • Managed (fault tolerant) File Transfers • Internal (on premise) • External • GUI
- 14. B2B GATEWAY - WORKFLOW Sample File transfer Workflow
- 15. MARKET UT Administrative IT Community • 400+ total potential users / 40+ CSU’s Federated environment that is non-standard in the industry • Enterprise scaling with individual business unit adoption Competition – New Technology • Enterprise Service Bus (ESB) – 7 Applications Existing Technology • Transfer – 15 CSU’s
- 16. PERSONAS William - Sr. Software Developer, Consumer Goals: - He’s tasked with modernizing their processes while needing to “keep the lights on” and operate processes the existing way (which he prefers). - He has been in the department for so long he knows all the processes inside out, but with existing IT tools. He will need to help his new manager and energetic team capture their business processes and move them off the mainframe. This task is a challenge for William, he’s looking for software to make this task easier. Characteristics: •54 years old, Baby boomer •Has been at UT 30 + years •Familiar with mainframe, likes and uses Natural and Adabase UT languages •Influencer to IT administrative and developer community •William began working at the University after attending college at UT and began in the software developer program. He has remained and is looking forward to his near retirement to spend time with his grandchildren. •Generally a late adopter •Familiar with development silo’s, not with DevOps •He prefers CLI to a GUI
- 17. PERSONAS Karen - Sr. Software Developer / Analyst Consumer Goals: - Karen is working on Critical path ASMP Workday integration projects to automate ETL processes for the Institutional Data Store. - She is working on finding new solutions to automate their mainframe ETL processes outside of the mainframe, and integrating with other ASMP provided services. - She is a reliable, hard worker but isn’t available during standard office hours - and isn’t happy when her job fails and is called at 3am to restart a job. She wants a reliable job scheduler/file transfer tool. Characteristics: • 34 years old • Has been at the university 5+ years • Karen worked in fast-paced Tech Industry after college in various coding roles • Karen joined the university for the work-life balance and flexibility to start a family • High affinity for problem solving • Early adopter of new solutions and technology • Moderate understanding of UT mainframe based processes • Familiar and utilizes ITS central services (PyPE and Transfer) • Multi-tasker, voices problems and concerns but also solutions
- 18. SUCCESS METRICS New Consumers • 1 CSU every six months Existing Enterprise Orchestration Consumers • Increase average task instances in production by 10%. Service Usage • # of Jobs executed • Task instances over time Reliability • Failure Rate (defined as failure without automatic restart) will be less than 20% with B2B Gateway. • Service uptime
- 19. FEATURES Rank Feature Theme 1 Managed Internal (Fault Tolerant) File Transfers Enable better user experiences with Managed Fault Tolerant File Transfers 2 Familiar Protocol integration support (FTP, FTPS, HTTPS) Enable better user experiences with Managed Fault Tolerant File Transfers 3 API Based Job Scheduling Improve IT Service, Delivery or features by incorporating user feedback and enhancement requests. 4 Consumer Automation and processes mapping consultation Improve IT Service, Delivery or features by incorporating user feedback and enhancement requests. 5 Managed External (Fault Tolerant) File Transfers. (1 Trading Partner available every six months up to 5 partners) Enable better user experiences with managed external 3rd party cloud File Transfer Integrations 6 Advanced Protocols: (AFTP, Web API Protocols) Enable better user experiences with managed external 3rd party cloud File Transfer Integrations 7 Consolidated control for 3rd party management Enable better user experiences with managed external 3rd party cloud File Transfer Integrations 8 Pre-configured Templates Enable better user experiences with Managed Fault Tolerant File Transfers 9 Customized Templates Enable better user experiences with Managed Fault Tolerant File Transfers
- 20. PRODUCT ROADMAP
Editor's Notes
- #2: “Offering” / Enhancement of the Enterprise Orchestration (service sponsoring development)
- #3: Good for - Repetitive or manual task that involves data that can be automated to save time, reduce errors and remain compliant with sensitive information
- #4: Task manager was retired, Enterprise Orchestration was developed with Stonebranch to replace Task manager. We’ve modernized job scheduling, next we can modernize file transfers as the functionality is usually coupled with job processing and the existing functionality provided by the “Transfer” Service isn’t adequate
- #6: Current Architecture - Background The “Transfer” Service is a SFTP Server and is utilized for internal, unmanaged file transfers. External file transfers are not a standard feature and requires a high amount of effort for low value results if supported. Customers frequently used “Transfer” along with mainframe application “Task Manager” together to execute workflows including file transfers. Stonebranch Enterprise Orchestration Service is a recently released, mainframe independent application for task and workflow processing that replaced the mainframe application “Task manager” for task and workflow processing. When “Task Manager” was retired some consumers adopted Stonebranch, and others found or developed their own solutions for job scheduling, but kept using “Transfer” for unmanaged file transfers.
- #8: Stakeholder - Management / Assumption Architecture It was assumed consumers wanted managed External file transfers and B2B Gateway would be built on top of existing IT Services. Consumers would continue to use “Transfer” for Internal unmanaged file transfers and B2B Gateway would be for external managed file transfers.
- #10: Stakeholder - Consumer Need Architecture Consumers want Managed (Fault tolerant), Internal file transfers. The “Transfer” Service offers Internal unmanaged (Fault Intolerant) File Transfers but consumers want want better functionality. Managed enables workflows to restart if interrupted, so consumers aren’t called at 3 am to manually restart a critical job that failed. Future consumers will need/want managed External File Transfers to 3rd party cloud applications and data sources. B2B Gateway can support both Internal and External Managed file transfers and can be implemented in phases to satisfy all stakeholders and consumer needs to provide improved file transfer functionality for the University Administrative IT community Service consumers.
- #12: Proposal: B2B Gateway to Replace Transfer B2B Gateway will provide Managed Internal (on premise) and Managed External (3rd party cloud) File Transfers. B2B Gateway will offer better Managed File Transfer functionality to consumers, reduce redundancy across IT services, and save “Transfer” Service operating costs. B2B Gateway aligns with IT application modernization and reduces mainframe dependencies, improves upon managed file transfer Service in the mainframe architecture, and considers future adoption by developing 3rd party cloud integrations.
- #16: The video shows what it looks like to be a user launching a task workflow in Stonebranch. The demo shows the process of a file being created on one host, the file being edited on the same host, the application monitoring for a file with a certain file name and moving that file to another host once detected.
- #21: Major Features start with Internal, followed by feedback and enhancement features including consulting time, and then External managed file transfers and associated enhancement ability features
- #22: Backlog, Quarters are this year 2017, major releases split through the year – first major release internal file transfers, second major release external managed file transfers. Minor releases of smaller features/enhancements
- #23: Phase 1: Internal File Transfers The Development of B2B Gateway will be phased. Phase 1 will be the development of Managed, Internal File Transfers. The “Transfer” Service will need to be retired ideally 6 months to a year after Internal File Transfers are released to allow consumers time to transition and attend training. It is possible Transfer could remain past phase 2 until mainframe retirement, this decision is subject to management.
- #24: Phase 2: External File Transfers Phase 2 will be the development of managed, External File Transfers. This will allow consumers to integrate with external 3rd party hosts (1 Trading Partner available every six months up to 5 partners or until demand is required). Consumers will now be able to execute internal and external fault tolerant file transfer jobs as a part of the B2B Gateway Offering.
- #25: Transfer Retired The dependency on the Mainframe and it’s architected Services for File Transfer job scheduling has been removed as B2B Gateway has been implemented and Transfer retired. Consumers have an improved functionality File Transfer Service B2B Gateway as a replacement option that satisfies future integration needs. “Transfer” is retired and the mainframe is retired.