SlideShare a Scribd company logo
Features Made Easy




Brent Porter
Java, GIS/SDE and Interface programmer
Outline


    Introduction
    Domain Problem Breakdown
    Solution
    Detailed Discussion
    Demo!
Introduction


  Brent Porter
    Java, GIS/SDE and Interface Programmer at TCEQ
    Masters degree, Geography & Oceanography specializations
    “Lots” of ESRI experience
        12 years with ArcGIS
        10 Years with ArcIMS
        6 years with ArcSDE
        4 years with ArcGIS Server
    First started working with FME Spatial Direct in 2003-2004.
     Installed FME Server at TCEQ in early 2009.
    11 years experience with Java & Javascript
    Sun/Oracle Certified Programmer
    4 years experience with C Sharp
Outline


    Introduction
    Domain Problem Breakdown
    Solution
    Detailed Discussion
    Demo!
Domain Problem


  Water Utility District (WUD) Spatial Viewer
    WUD program at TCEQ handles requests for data
     about Water Utility Districts.
    Districts digitized off of old paper maps originally
     or handed down in a semi secret ritual. :)
    Data was shared on a large file server and
     individual copies were created by each analyst
     that needed to edit, create or amend the data.
    New data was also manually reconciled when
     discrepancies occurred between different
     editors.
Domain Problem – cont.


  Water Utility District (WUD) Spatial Viewer
    Data requests required the team to extract out
    the area of interest, manually.
    If the data type was an available export format, the
     staff would manually translate the data into the new
     format.
    This manual process wasn't speedy. Although it
     satisfied the mandate of the team, it was not providing
     the best return on investment for the effort. Not only
     were the data updates and new data creation being
     done in a silo, but only a manual process was available
     for extracting the data.
Domain Problem – cont.


  Water Utility District (WUD) Spatial Viewer
    Just for fun – the spatial viewer needed to
     integrate with a legacy web application that
     displayed non spatial data in a typical/
     traditional form view.
Outline


    Introduction
    Domain Problem Breakdown
    Solution
    Detailed Discussion
    Demo!
Solution


  Water Utility District (WUD) Spatial Viewer
    The solution consisted of a complete rework of
     the entire business process for creating,
     editing and warehousing of the WUD data.
Solution – cont.


  At the end of the process, to achieve success
   we would do several things:
    #1- On the persistence tier, we would be
     providing a centralized, versioned geodatabase
     through which multiple clients, both desktop
     and web based would be able to access the
     most timely data possible.
    #2- At the business tier we would be
     integrating the spatial viewer into the
     traditional legacy web application through a
     'loose-coupling' process.
Solution – cont.


  Success Benchmarks, continued
    #3 - At the presentation tier we would be
     actually creating a set of self service processes
     which would completely remove the need to
     contact WUD team members except in cases of
     errors or exceptional items.
    In conjunction with this final goal, the
     application needed to:
       Print cartographic quality products
       Export data from one of four spatially defined
        units and into one of three spatial formats
Outline


    Introduction
    Domain Problem Breakdown
    Solution
    Detailed Discussion
    Demo!
Detailed Discussion


  In the details…
    For the extract services we needed to provide
     access to each of the different extract formats
     for the self service data store.
    FME Desktop Workbench and Visualizer were
     used to create the processes that were then
     uploaded to FME Server 2009.
Detailed Discussion


  In the details…
  •  To create the extraction, we needed data for
     spatial 'cookie-cutters'
  •  We chose several ‘base’ or core layers
     •  City, State and County boundaries Layers, preloaded
        into ArcSDE and Oracle as our spatial for clipping the
        WUD layers (4 different layers).
Detailed Discussion – cont.


  In the details…
    We also needed a fourth spatial layer - a
     dynamic rectangle based on the extent of the
     map 'window' in the map application.
       The presentation tier for this application was a
        custom ajax-based ArcIMS application, using
        javascript extensively. By using a proxy pattern, I
        created a java application with a Java Servlet for
        handling http requests. Then by capturing the user
        requirements for their custom data extraction (city or
        county, map view, etc. and download format) we
        could post or get the results to the servlet.
Detailed Discussion – cont.


  In the details…
    A JSON Emitter module that would take the
     extent values from the HTTP requests and
     generate JSON that would be used as a data
     source for FME Server for clipping the WUD
     datasets.
Detailed Discussion – cont.
Detailed Discussion – cont.
Outline


    Introduction
    Domain Problem Breakdown
    Solution
    Detailed Discussion
    Demo!
Demo


  Demo
    WUD Spatial Viewer
Summary


  WUD Spatial Application was first deployed in
   November of 2008
    Phase 2 which enabled the spatial ETL functions
     with FME Server were deployed June 2009
    The number of calls to the WUD program has
     decreased dramatically
    The data, now centralized has begun to be
     integrated with other areas who need timely
     access to WUD data
    All of the stakeholders have declared it a success!
Thank You!


  Questions?

  For more information:
    Brent Porter – brent@c4geo.com
    Texas Commission on Environmental Quality

More Related Content

PDF
Spatialware_2_Sql08
PDF
ParcelMap BC: Enterprise Cadastral Workflow Integrated from Capture through D...
PPTX
Using FME for the City of Palo Alto Topobase Implentation
PDF
FME Spatial Querying in a CAD-Driven GIS
PPTX
FME Applications in New York City GIS
PPTX
Using FME to Automate Region-Wide Data Sharing
PPTX
FME & Governement
PDF
Open Source GIS Workshop
Spatialware_2_Sql08
ParcelMap BC: Enterprise Cadastral Workflow Integrated from Capture through D...
Using FME for the City of Palo Alto Topobase Implentation
FME Spatial Querying in a CAD-Driven GIS
FME Applications in New York City GIS
Using FME to Automate Region-Wide Data Sharing
FME & Governement
Open Source GIS Workshop

What's hot (14)

PPT
Floodmap Desktop for ArcGIS
PDF
Database Comparison and ArcMap Data Driven Pages
PPTX
Using FME to Transform and Integrate Optical Connection Data Between Systems
PDF
EU 2016 - FME Around the World
PDF
Finns Using FME Like Crazy
PPT
The Best Come from Fresh Ingredients: Creating CAD Files from an Enterprise S...
PPTX
Integrating Utility Data into a SCADA Dashboard
PDF
FME Around the World
PPTX
Under the hood of the Altalis Platform
PPTX
Using FME to Automate Data Integration in a City
PPTX
GIS - CAD Data Integration
PDF
Meridian_Award
PDF
5 deus leaflet wp4-deel2
PDF
Solving LRS Challenges with Custom Transformers for Transportation Professionals
Floodmap Desktop for ArcGIS
Database Comparison and ArcMap Data Driven Pages
Using FME to Transform and Integrate Optical Connection Data Between Systems
EU 2016 - FME Around the World
Finns Using FME Like Crazy
The Best Come from Fresh Ingredients: Creating CAD Files from an Enterprise S...
Integrating Utility Data into a SCADA Dashboard
FME Around the World
Under the hood of the Altalis Platform
Using FME to Automate Data Integration in a City
GIS - CAD Data Integration
Meridian_Award
5 deus leaflet wp4-deel2
Solving LRS Challenges with Custom Transformers for Transportation Professionals
Ad

Viewers also liked (6)

PDF
Slide garlaschelli
PDF
Potential_effects_of_a_major_hurricane_o
PDF
Engr. Gee-Jay Basallo Rivera
PDF
Processing Of Social And Monetary Rewards In The Human Striatum
PPT
Evalution
PDF
A roadmap to developing a best in class health website
Slide garlaschelli
Potential_effects_of_a_major_hurricane_o
Engr. Gee-Jay Basallo Rivera
Processing Of Social And Monetary Rewards In The Human Striatum
Evalution
A roadmap to developing a best in class health website
Ad

Similar to FME = Features Made Easy (20)

PDF
Geo-referenced human-activity-data; access, processing and knowledge extraction
PPTX
Network Mapping - Esri UK Annual Conference 2016
PPTX
FME User Stories from Around the World
PPTX
Strategies for Integrating Utility System Operational Data into ArcGIS Server...
PPTX
FME World Tour 2015 - Curing Migration Flu or: How I Learned to Stop Worrying...
PDF
Curing Migration Flu or: How I Learned to Stop Worrying and Love the LGIM
PDF
Automating ArcGIS Content Discovery with FME: A Real World Use Case
PPTX
No pressure, but the Workspace needs fixing so the coworker can go have her b...
PDF
Geospatial Options in Apache Spark
PPTX
Kettemann, Rainer, Track 5
PDF
Web Mapping 101: Creating Dynamic Web Maps with Geospatial Data
PDF
FME Around the World (FME Trek Part 1): Ken Bragg - Safe Software FME World T...
PDF
Automating ArcGIS Content Discovery with FME
PDF
A Web-Based, Federated, Marine Use Management System for Small Communities
PPTX
ESRI ERUC 2014 - Easy Automation for Process Efficiencies
PPTX
Using Dynamic FME Workspaces to Build an ETL Solution For a Spatial Asset Vis...
PPTX
The Power of a Single Transformer
PPTX
fmewt19 - Around the world stories master deck
PDF
A WebML-Based Approach For The Development Of Web GIS Applications
Geo-referenced human-activity-data; access, processing and knowledge extraction
Network Mapping - Esri UK Annual Conference 2016
FME User Stories from Around the World
Strategies for Integrating Utility System Operational Data into ArcGIS Server...
FME World Tour 2015 - Curing Migration Flu or: How I Learned to Stop Worrying...
Curing Migration Flu or: How I Learned to Stop Worrying and Love the LGIM
Automating ArcGIS Content Discovery with FME: A Real World Use Case
No pressure, but the Workspace needs fixing so the coworker can go have her b...
Geospatial Options in Apache Spark
Kettemann, Rainer, Track 5
Web Mapping 101: Creating Dynamic Web Maps with Geospatial Data
FME Around the World (FME Trek Part 1): Ken Bragg - Safe Software FME World T...
Automating ArcGIS Content Discovery with FME
A Web-Based, Federated, Marine Use Management System for Small Communities
ESRI ERUC 2014 - Easy Automation for Process Efficiencies
Using Dynamic FME Workspaces to Build an ETL Solution For a Spatial Asset Vis...
The Power of a Single Transformer
fmewt19 - Around the world stories master deck
A WebML-Based Approach For The Development Of Web GIS Applications

More from Safe Software (20)

PDF
Getting Started with Data Integration: FME Form 101
PDF
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
PDF
Peak of Data & AI Encore - Real-Time Insights & Scalable Editing with ArcGIS
PDF
Infrastructure planning and resilience - Keith Hastings.pptx.pdf
PDF
Notification System for Construction Logistics Application
PDF
Building Real-Time Digital Twins with IBM Maximo & ArcGIS Indoors
PDF
Using FME to Develop Self-Service CAD Applications for a Major UK Police Force
PDF
Transforming Utility Networks: Large-scale Data Migrations with FME
PDF
Peak of Data & AI Encore AI-Enhanced Workflows for the Real World
PDF
Automating Feature Enrichment and Station Creation in Natural Gas Utility Net...
PDF
FME in Overdrive - Peak of Data & AI 2025
PDF
Powering GIS with FME and VertiGIS - Peak of Data & AI 2025
PDF
Pipeline Industry IoT - Real Time Data Monitoring
PDF
FME in Overdrive: Unleashing the Power of Parallel Processing
PDF
Fiber to the People! By Deutsche Telekom
PDF
Governing Geospatial Data at Scale: Optimizing ArcGIS Online with FME in Envi...
PDF
Enhancing Environmental Monitoring with Real-Time Data Integration: Leveragin...
PDF
Introducing and Operating FME Flow for Kubernetes in a Large Enterprise: Expe...
PDF
5 Things to Consider When Deploying AI in Your Enterprise
PDF
Automating Feature Enrichment and Station Creation in Natural Gas Utility Net...
Getting Started with Data Integration: FME Form 101
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
Peak of Data & AI Encore - Real-Time Insights & Scalable Editing with ArcGIS
Infrastructure planning and resilience - Keith Hastings.pptx.pdf
Notification System for Construction Logistics Application
Building Real-Time Digital Twins with IBM Maximo & ArcGIS Indoors
Using FME to Develop Self-Service CAD Applications for a Major UK Police Force
Transforming Utility Networks: Large-scale Data Migrations with FME
Peak of Data & AI Encore AI-Enhanced Workflows for the Real World
Automating Feature Enrichment and Station Creation in Natural Gas Utility Net...
FME in Overdrive - Peak of Data & AI 2025
Powering GIS with FME and VertiGIS - Peak of Data & AI 2025
Pipeline Industry IoT - Real Time Data Monitoring
FME in Overdrive: Unleashing the Power of Parallel Processing
Fiber to the People! By Deutsche Telekom
Governing Geospatial Data at Scale: Optimizing ArcGIS Online with FME in Envi...
Enhancing Environmental Monitoring with Real-Time Data Integration: Leveragin...
Introducing and Operating FME Flow for Kubernetes in a Large Enterprise: Expe...
5 Things to Consider When Deploying AI in Your Enterprise
Automating Feature Enrichment and Station Creation in Natural Gas Utility Net...

Recently uploaded (20)

PDF
August Patch Tuesday
PDF
Agricultural_Statistics_at_a_Glance_2022_0.pdf
PPTX
cloud_computing_Infrastucture_as_cloud_p
PDF
Assigned Numbers - 2025 - Bluetooth® Document
PPTX
A Presentation on Artificial Intelligence
PDF
Microsoft Solutions Partner Drive Digital Transformation with D365.pdf
PDF
Encapsulation_ Review paper, used for researhc scholars
PDF
A comparative analysis of optical character recognition models for extracting...
PDF
NewMind AI Weekly Chronicles - August'25-Week II
PDF
From MVP to Full-Scale Product A Startup’s Software Journey.pdf
PPTX
Tartificialntelligence_presentation.pptx
PDF
1 - Historical Antecedents, Social Consideration.pdf
PPTX
Group 1 Presentation -Planning and Decision Making .pptx
PPTX
A Presentation on Touch Screen Technology
PDF
Zenith AI: Advanced Artificial Intelligence
PDF
Profit Center Accounting in SAP S/4HANA, S4F28 Col11
PDF
Encapsulation theory and applications.pdf
PDF
Accuracy of neural networks in brain wave diagnosis of schizophrenia
PPTX
TechTalks-8-2019-Service-Management-ITIL-Refresh-ITIL-4-Framework-Supports-Ou...
PPTX
TLE Review Electricity (Electricity).pptx
August Patch Tuesday
Agricultural_Statistics_at_a_Glance_2022_0.pdf
cloud_computing_Infrastucture_as_cloud_p
Assigned Numbers - 2025 - Bluetooth® Document
A Presentation on Artificial Intelligence
Microsoft Solutions Partner Drive Digital Transformation with D365.pdf
Encapsulation_ Review paper, used for researhc scholars
A comparative analysis of optical character recognition models for extracting...
NewMind AI Weekly Chronicles - August'25-Week II
From MVP to Full-Scale Product A Startup’s Software Journey.pdf
Tartificialntelligence_presentation.pptx
1 - Historical Antecedents, Social Consideration.pdf
Group 1 Presentation -Planning and Decision Making .pptx
A Presentation on Touch Screen Technology
Zenith AI: Advanced Artificial Intelligence
Profit Center Accounting in SAP S/4HANA, S4F28 Col11
Encapsulation theory and applications.pdf
Accuracy of neural networks in brain wave diagnosis of schizophrenia
TechTalks-8-2019-Service-Management-ITIL-Refresh-ITIL-4-Framework-Supports-Ou...
TLE Review Electricity (Electricity).pptx

FME = Features Made Easy

  • 1. Features Made Easy Brent Porter Java, GIS/SDE and Interface programmer
  • 2. Outline   Introduction   Domain Problem Breakdown   Solution   Detailed Discussion   Demo!
  • 3. Introduction   Brent Porter   Java, GIS/SDE and Interface Programmer at TCEQ   Masters degree, Geography & Oceanography specializations   “Lots” of ESRI experience   12 years with ArcGIS   10 Years with ArcIMS   6 years with ArcSDE   4 years with ArcGIS Server   First started working with FME Spatial Direct in 2003-2004. Installed FME Server at TCEQ in early 2009.   11 years experience with Java & Javascript   Sun/Oracle Certified Programmer   4 years experience with C Sharp
  • 4. Outline   Introduction   Domain Problem Breakdown   Solution   Detailed Discussion   Demo!
  • 5. Domain Problem   Water Utility District (WUD) Spatial Viewer   WUD program at TCEQ handles requests for data about Water Utility Districts.   Districts digitized off of old paper maps originally or handed down in a semi secret ritual. :)   Data was shared on a large file server and individual copies were created by each analyst that needed to edit, create or amend the data.   New data was also manually reconciled when discrepancies occurred between different editors.
  • 6. Domain Problem – cont.   Water Utility District (WUD) Spatial Viewer   Data requests required the team to extract out the area of interest, manually.   If the data type was an available export format, the staff would manually translate the data into the new format.   This manual process wasn't speedy. Although it satisfied the mandate of the team, it was not providing the best return on investment for the effort. Not only were the data updates and new data creation being done in a silo, but only a manual process was available for extracting the data.
  • 7. Domain Problem – cont.   Water Utility District (WUD) Spatial Viewer   Just for fun – the spatial viewer needed to integrate with a legacy web application that displayed non spatial data in a typical/ traditional form view.
  • 8. Outline   Introduction   Domain Problem Breakdown   Solution   Detailed Discussion   Demo!
  • 9. Solution   Water Utility District (WUD) Spatial Viewer   The solution consisted of a complete rework of the entire business process for creating, editing and warehousing of the WUD data.
  • 10. Solution – cont.   At the end of the process, to achieve success we would do several things:   #1- On the persistence tier, we would be providing a centralized, versioned geodatabase through which multiple clients, both desktop and web based would be able to access the most timely data possible.   #2- At the business tier we would be integrating the spatial viewer into the traditional legacy web application through a 'loose-coupling' process.
  • 11. Solution – cont.   Success Benchmarks, continued   #3 - At the presentation tier we would be actually creating a set of self service processes which would completely remove the need to contact WUD team members except in cases of errors or exceptional items.   In conjunction with this final goal, the application needed to:   Print cartographic quality products   Export data from one of four spatially defined units and into one of three spatial formats
  • 12. Outline   Introduction   Domain Problem Breakdown   Solution   Detailed Discussion   Demo!
  • 13. Detailed Discussion   In the details…   For the extract services we needed to provide access to each of the different extract formats for the self service data store.   FME Desktop Workbench and Visualizer were used to create the processes that were then uploaded to FME Server 2009.
  • 14. Detailed Discussion   In the details… •  To create the extraction, we needed data for spatial 'cookie-cutters' •  We chose several ‘base’ or core layers •  City, State and County boundaries Layers, preloaded into ArcSDE and Oracle as our spatial for clipping the WUD layers (4 different layers).
  • 15. Detailed Discussion – cont.   In the details…   We also needed a fourth spatial layer - a dynamic rectangle based on the extent of the map 'window' in the map application.   The presentation tier for this application was a custom ajax-based ArcIMS application, using javascript extensively. By using a proxy pattern, I created a java application with a Java Servlet for handling http requests. Then by capturing the user requirements for their custom data extraction (city or county, map view, etc. and download format) we could post or get the results to the servlet.
  • 16. Detailed Discussion – cont.   In the details…   A JSON Emitter module that would take the extent values from the HTTP requests and generate JSON that would be used as a data source for FME Server for clipping the WUD datasets.
  • 19. Outline   Introduction   Domain Problem Breakdown   Solution   Detailed Discussion   Demo!
  • 20. Demo   Demo   WUD Spatial Viewer
  • 21. Summary   WUD Spatial Application was first deployed in November of 2008   Phase 2 which enabled the spatial ETL functions with FME Server were deployed June 2009   The number of calls to the WUD program has decreased dramatically   The data, now centralized has begun to be integrated with other areas who need timely access to WUD data   All of the stakeholders have declared it a success!
  • 22. Thank You!   Questions?   For more information:   Brent Porter – brent@c4geo.com   Texas Commission on Environmental Quality