Deploying and Maximizing FME Server
0 likes724 views
The document outlines a webinar focused on deploying and maximizing FME Server to enhance enterprise productivity by streamlining data workflows. It details various deployment options including self-hosted, cloud-hosted, and containerization, as well as processing methods like dynamic and standard engines. Attendees will learn about the value and benefits of FME Server, see actual deployments in action, and receive guidance on choosing the best deployment strategy for their needs.
Deploying and Maximizing FME Server
- 1. Deploying and Maximizing FME Server With Jen Luther Thomas and Don Murray
- 2. Improve enterprise productivity by enabling data to move smoothly across your organization.
- 3. Meet the Presenters Jen Luther Thomas Don Murray
- 4. Agenda ● Safe Software and FME Platform ● Understanding your workflow ● Understanding processing options ● Understanding deployment options. ● Deployments in Action
- 5. Company Profile Safe Software maximizing the value of data 25+ years 10,000+ Organizations trusting us worldwide delivering FME Expertise worldwide 150+ Partners 128 Countries having deployed FME
- 6. FME® Integration Platform Connect. Transform. Automate. All with no code. FME Desktop FME Server FME Cloud Build & Run Data Workflows Automate Data Workflows (Cloud and on-premises) Automate Data Workflows Get a free trial of FME Desktop and FME Server at safe.com
- 7. FME Desktop Transform data of any type and volume. ● Access 500+ powerful transformers ● Data cleaning and validation capabilities. ● Combine, move, and restructure data using by building streamlined and reusable data flows.
- 8. Build Create schedules, web applications and automations in a GUI. Scale Process massive amounts of data as needed. Control Cost effectively deploy processing close to the source. FME Server Connects more than just data and applications, it connects teams.
- 9. Save time by automating both simple and complex tasks. Save money with one tool to automate the entire enterprise. Improve data quality with a well-organized and secure system for managing data. Make the impossible possible by gaining insights thru combining data and applications in new ways. With FME Server you can:
- 10. Goals for Today ● Understand the value, benefits and differences of FME Server deployments ● See deployments in action ○ Dynamic Engines ○ Kubernetes ○ FME Cloud ● Get your questions answered Whether you currently have FME Server or are considering it, this webinar is for you to:
- 11. Which FME Server We will show options for you to: ● Deploy in the cloud ● Deploy on premises ● Tackle Large Processing Tasks ● Prototype, learn and test latest features of FME Server Whether you currently have FME Server or are considering it, this webinar is for you!
- 12. Remain in control of your data. Our deployment options enables you to deploy wherever is best. ● Self-hosted ● Cloud-hosted with FME Cloud ● Cloud Marketplaces ○ Google Cloud ○ Azure ● Containerization ○ Docker ○ Kubernetes
- 13. Maximizing Deployment depends on Location of your Data and the applications you are connecting. Understanding your workflows present and planned Understanding the FME Server Processing Options Get FME Server | Live Chat
- 14. Understanding your workflows is key to maximizing your deployment
- 15. Understanding Workflows What Existing Workflows do you have? Real-Time Events: Event triggers processing such as data arrival, or alarm event. Real-Time Data Streams: From devices, IoT streams, applications, or any data streaming system Application Integration: Connect applications together, reducing manual work Scheduled Tasks: Simple and complex tasks that are done on a periodic schedule. FME Server Apps: “no code” applications to support users. Mobile Apps: data and processing requirements of mobile applications such as FME AR, and FME DX.
- 16. Understanding Workflows Different deployment options support different workflows. Are you processing real-time data? ● Using Automation and triggers? ● Using Data Streams? Are you leveraging FME Server Apps? ● Do these apps have busy times? Do you periodically have big processing tasks? ● These can put a big load on your system. OS or 3rd party library dependencies ● Do your workspaces have OS or library dependencies? ● This will limit deployment options
- 17. If your systems and data are on premises then FME Server should be on premises, if in the cloud then FME Server should be in the cloud. Google Cloud Platformʼs locations and network Data Location is also key
- 18. Understanding the different processing options.
- 20. Both have exactly the same capability. It is the billing model that is different. You choose. FME Server Processing Options Dynamic Engines ● Flexible FME Server processing sold in blocks of CPU hours, billed by the second. ● Ideal for unpredictable, variable, or periodic heavy workloads Standard Engines ● Fixed FME Server processing power sold by engine ● Ideal for stable and consistent workloads
- 21. Dynamic Engines Dynamic Engines deliver processing with usage-based pricing. You purchase CPU time. Benefits: ● Pay only for work that is done. ● Supports all deployments. ● Worth a serious look.
- 22. Summary You only pay when a Dynamic Engine is doing work. You can have as many Dynamic Engines idle ready for work. No charge for this.
- 23. Understanding the different deployment options.
- 24. Self-hosted Install FME Server directly onto your own hardware, cloud, or virtual machine. With this option, you look after everything like manual security updates, scalability, and performance. Benefits: ● You are in complete control to customize as you want. ● Leverage existing hardware/Virtual machine investment
- 25. Cloud-hosted with FME Cloud. Deploy FME Server in the cloud with FME Cloud. Benefits: ● Get FME Server running and ready for your team to use in minutes. ● FME Cloud does the server maintenance, backups, and ensure uptime for you.
- 26. Cloud Marketplaces Launch FME Server in just a few clicks. With this option, you should ensure that you understand and plan for manual security updates, scalability, and performance. Benefits: ● Easy installation ● Launch within your own private network. ● Leverage Dynamic Engines.
- 28. Containerization
- 30. There is an FME Server deployment that can meet all your needs.
- 31. FME Cloud
- 32. FME Cloud FME Cloud is a hosted deployment option for FME Server. The easiest way to get started! Benefits: ● Quick installation ● No hardware requirements ● Unlimited engines ● Flexible pricing ● Security
- 33. FME Cloud Demo The Goal Simplest way to launch FME Server in the Cloud The High Points Load is predictable Data is mostly in the cloud. Easy vertical scaling as load increases. The Solution Deploy FME Cloud to the location you need. The Result FME Server is up and running in minutes. You can build your solutions reaping all the benefits of FME Server.
- 34. FME Cloud Demo
- 35. Containerization
- 36. Docker Compose Simple container-based deployment means it is isolated from rest of machine. Common Uses: ● Simple one machine supported deployment ● Great for testing, pilots, proof of concepts, learning, and prototyping ● Multiple machine production deployment is also supported. ● Easy way to experiment and understand dynamic engines
- 37. Docker Compose Demo The Goal Create an easy to deploy multi-engine FME Server on a single machine or distributed across several. Production or for quick testing, learning, and prototyping. The Obstacles Installing and configuring an FME Server onto your machine takes time and cpu resources. The Solution Deploy FME Server using Docker Compose. All components are there including dynamic Engines. The Result A quick and easy launch for production or a“test” environment. Evaluation license gives you 100 hours of dynamic engine time.
- 39. Kubernetes Container orchestration tool. Solves problems with manual container management. Benefits: ● Pool resources and abstract hardware - multiple nodes managed from a single place ● Maintains desired state where possible ● Smarter resource management ● (Auto)scaling
- 40. Kubernetes Container orchestration tool. Solves problems with manual container management. Common Uses: ● Pool resources and abstract hardware - multiple nodes managed from a single place ● Maintains desired state where possible ● Smarter resource management ● Autoscaling
- 41. Kubernetes Demo The Goal Show an FME Server deployment running on Kubernetes that installed and upgraded with low effort* and consistency on premise or into any cloud. The Obstacles To automate deployment, I need to script my own logic using a combination of cloud-specific tooling. The Solution Deploy FME Server with Kubernetes. The Result FME Server is deployed and you donʼt need to worry about planning the architecture, installation, or upgrading. *Low effort because the cluster was set up beforehand
- 42. Kubernetes Demo
- 43. Dynamic Engines Demo The Goal To process data whenever you want, as fast as you want, and pay only for work that is done. The Obstacles Your data workflows are variable with processing demand spikes. The Solution Launch Dynamic Engines, harness the power of parallel processing, and pay only for the cpu you use. The Result FME Engines are used when needed and no costs when they are idle.
- 45. Kubernetes + Dynamic Engines (1 year of processing in 1 hour)
- 46. 1 Engine vs. 1,000 Engines
- 47. Dynamic Engines Cost Comparison Standard Engines Number of standard engines 1,000 Cost per additional engine $6,500 USD AWS infrastructure cost $100 Total Cost ~$6.5 million Dynamic Engines Number of dynamic engines 1,000 Number of hours each engine runs 1 hour Processing hourly rate $1.50/hr USD AWS infrastructure cost $100 Total Cost $1,600 Prior to dynamic engines, big data lifts required a special contract.
- 48. Get Started Select your FME Server Deployment (or get expert advice from Safe Software) Determine your organizationʼs needs for data processing and budget. Save time and money on data processing and workflow automation. Get FME Server | Live Chat
- 49. When choosing deployment, use the following questions to guide you to the best solution: ● If you have big data lifts or spikes in demand - use dynamic engines! ● Do you need the ability to scale? ● Where is your data located? ● Do you have any OS or library dependencies? ● What skills does your team have? ● Are you already invested in a solution or cloud provider? Key Takeaways
- 50. Do you want to experiment with a deployment? Contact us to learn more and to try a new deployment of Dynamic Engines. Get 1:1 support with Live Chat at www.safe.com
- 51. Claim Your Community Badge Get community badges for watching webinars! fme.ly/WebinarBadge Todayʼs Code: LSCBF
- 52. Q&A
- 53. The Peak of Data Integration 2022 UC August 24-26, 2022 Vancouver, Canada Register now
- 54. FME World Tour 2022 March 22 - June 24 | 45+ Events View the Tour Schedule & Register Now
- 55. Check out our upcoming & on-demand webinars: safe.com/webinars
- 56. Thank you! We are always happy to talk to you about anything. Connect with us at info@safe.com Connect with us for more FME