5 Data Integration Techniques to Improve Your Excel Data
0 likes645 views
The document outlines five techniques for improving Excel data using FME, focusing on efficiency, automation, and data integration. It covers methods such as formatting, validation, and creating pivot tables, along with demos on how to restructure data and automate reports. Resources for further learning and community engagement are also provided.
5 Data Integration Techniques to Improve Your Excel Data
- 1. 5 Data Integration Techniques to Improve Your Excel Data
- 2. Kailin Opaleychuk Technical Support Specialist, FME Form Sara Mak Technical Support Specialist, FME Form
- 3. Welcome to Livestorm. A few ways to engage with us during the webinar: Audio issues? Click this for 4 simple troubleshooting steps.
- 4. How to download slides 1. Hover over the slide deck in the webinar room 2. Click this button
- 5. Agenda 1 Why Excel & FME? 2 Excel vs. FME Vocabulary 3 Demos: 5 Ways to Improve Your Excel Data 4 Resources 5 Q&A Agenda
- 7. Prepare, integrate and automate your Excel data in a fraction of the time with FME. Why Excel & FME?
- 8. Flash Demo Split A Spreadsheet Into Multiple Worksheets Why Excel & FME?
- 9. Thanks to the City of Vancouver for the data!
- 10. Most people are comfortable in Excel, however, repeatedly working with multiple large datasets can be time consuming. Why Excel & FME?
- 11. One platform, two technologies FME Form FME Flow Data Movement and transformations (“ETL”) workflows are built here. Brings life to FME Form workflows FME Flow Hosted Safe Software managed FME Flow fme.safe.com/platform FME Enterprise Integration Platform Safe & FME
- 12. 29+ 27K+ 128 190 20K+ years of solving data challenges FME Community members countries with FME customers organizations worldwide global partners with FME services 30+ 29K+ 128 140+ 25K+ years of solving data challenges FME Community members countries with FME customers organizations worldwide global partners with FME services 200K+ users worldwide Safe & FME
- 13. Number of supported data types in FME 1995 2000 2005 2010 2015 2020 2023… 10 100 300 500 GIS CAD Database XML Raster 3D BIM Web Point Cloud Cloud Big Data IOT Gaming BI Indoor Mapping AR/VR Generative AI Cloud Native Tabular Unrivalled Data Support
- 14. How does FME Enhance Excel Data? Reusable FME helps organizations improve efficiency by automating repeatable, mundane Excel tasks Visual FME helps users visually document each step taken in the data transformation process Shareable Reduce requests! FME Server Apps allow users to easily build shareable web apps with no code Why Excel & FME? 1 2 3
- 15. Excel vs. FME Vocabulary Spreadsheet or Workbook Reader or Writer Dataset
- 16. Excel vs. FME Vocabulary Worksheet or Named Range Feature Type
- 17. Excel vs. FME Vocabulary Column in Worksheet Attribute
- 18. Excel vs. FME Vocabulary Row in Worksheet Feature
- 19. 5 Ways to ImproveYour Excel Data The Basics Formatting & Validation Integrating Multiple Datasets Pivot Tables & Reports Automating Your Reports 1 2 3 4 5
- 20. 2 5 Ways to ImproveYour Excel Data
- 22. Goal Block Key Result Restructure and summarize incoming spreadsheets The Basics Data exists within the same excel file, but different sheets Use transformers to combine, filter and sort A restructured spreadsheet summarizing license information
- 23. Demo
- 24. Demo 1: Summary 1. FeatureJoiner: Merge data with unique identifier 2. TestFilter: Refine data into different feature streams 3. StatisticsCalculator: Summarize data 4. Restructure data: Use a feature type fanout to create multiple sheets
- 25. Demo 1: Tips ● FeatureJoiner, FeatureMerger, DatabaseJoiner ○ Vlookup in Excel ● Feature Type fanout ○ Use an attribute to split data systematically to different sheets Data Attribution The data used here originates from open data made available by the City of Vancouver
- 27. Slide Title Stylize spreadsheet and share to SharePoint Online Goal Block Key Formatting & Validating Result Attributes need to be validated, color coded, & categorized AttributeValidator to validate, ExcelStyler to style & color code Comprehensible spreadsheet uploaded to SharePoint Online
- 28. Demo
- 29. Demo 2: Summary 1. AttributeValidator: create validation rules for attributes 2. Hyperlinks: create a hyperlink text attribute 3. Style and emphasize your data by row or cell 4. Write an Excel file and upload to SharePoint Online
- 30. Demo 2: Tips ● ExcelStyler ○ Highlight data depending on the data value ● Validation to preserve data integrity ● Web Connectors ○ easily share your data with your organization Data Attribution The data used here originates from open data made available by the City of Vancouver
- 32. Goal Block Key Result Integrate Excel data with other datasets Integrating Multiple Datasets Data doesn’t have geometry to do spatial analysis with Create geometry & attach spatial information using other data as references More holistic view of nearby businesses
- 33. Demo
- 34. Demo 3: Summary 1. Extract data from Sharepoint 2. Extract data from websites (URLs) 3. Geocode the data 4. Spatial join to add more detail to the Excel data 5. Nearest neighbour 6. Set an attribute using a conditional expression 7. Write to a database
- 35. Demo 3: Tips ● FME has great support for location or spatial data ● Easy to download data from Sharepoint or other web sources ● Conditional tests are easy in FME Data Attribution The data used here originates from open data made available by the City of Vancouver
- 36. Demo 4: Pivot Tables & Reports
- 37. Slide Title Leverage an excel template file Goal Block Key Demo 4: Pivots and More Result Current spreadsheet has raw data with no structure Avoid cutting and pasting in large spreadsheets A new report with summarized statistics and graphs
- 38. Demo
- 39. Demo 4: Summary 1. Leverage your existing knowledge of Excel a. Charts b. Pivots 2. Use an Excel template file to configure the output the way you want 3. Update data without having to cut n’ paste
- 40. Demo 4: Tips Use the StatisticsCalculator to summarize mass amounts of raw data. Create charts within FME and Excel Data Attribution The data used here originates from open data made available by the Government of Canada - Environment and Natural Resources
- 41. Demo 4: More ideas... Excel 3D Maps Images in Excel
- 43. Slide Title Create a self-serve or automated mini BI report Goal Block Key AutomatingYour Reporting Result Users may not have the know-how to run FME Form FME Flow’s automation capabilities Mini BI reports in an instant
- 44. Demo
- 45. Demo 5: Summary 1. Automate repetitive tasks 2. Make your Automations easily available to others to use 3. Combine the power of both FME & Excel to get the reports you want
- 46. Demo 5: Tips Automations are very easy You can use Excel for simple BI reporting
- 47. What About Google Sheets? ● Google Sheets Reader & Writer can be installed straight from FME Form ● Fully supported as of FME b21261+ ● Web connection required
- 48. 4 Conclusion
- 49. 5 Ways to ImproveYour Excel Data The Basics Formatting & Validation Integrating Multiple Datasets Pivot Tables & Reports Automating Your Reports 1 2 3 4 5
- 50. You can achieve amazing things with Excel. By using workflow based environments, you can manage your Excel data in less time and gain greater results.
- 51. 8 Resources
- 52. Resources: ● Tutorial: Getting Started with Excel and FME ● Knowledge Article: Excel & Pivot Tables ● Blog: 5 Excel Tasks You Did Not Know You Could Automate ● Tutorial: Using a Template File when Writing Excel Data
- 53. Get our Ebook Spatial Data for the Enterprise fme.ly/gzc Guided learning experiences at your fingertips academy.safe.com FME Academy Resources Check out how-to’s & demos in the knowledge base support.safe.com Knowledge Base Webinars Upcoming & on-demand webinars safe.com/webinars
- 54. Check out our podcasts on-demand. featuring special guest speakers over at EM360 Resources
- 55. Peak of Data Integration 2025 - Call for Presentations Now Open ● Abstracts due Nov 29th, 2024 ● All levels FME proficiency welcome ● 15 & 25 min options (incl. Q&A) ● Special speaker rate for accepted talks ● Registration opens Sept 17th! peakofdataintegration.com/call-for-presentations
- 56. 9 Next Steps
- 57. We’d love to help you get started. Get in touch with us at info@safe.com Experience the FME Accelerator Contact Us A world where data is not just a commodity but a catalyst for real change. fme.safe.com/accelerator Next Steps
- 58. ClaimYour Community Badge & Dive into the new Community! ● Get community badges for watching webinars ● community.safe.com ● Today’s code: AS9STJ Join the Community today! Next Steps
- 59. 10 Q&A
- 60. ThankYou Recap of Next Steps 1 Join the FME Community 2 Contact us 3 Experience the FME Accelerator Please fill out our webinar survey