Loading Parcels Into Smallworld GIS via FME
Download as PPTX, PDF1 like1,475 views
This document discusses Puget Sound Energy's process for loading parcel data into their GE Smallworld GIS system using FME software. It covers PSE's history with parcel data, the current process of obtaining data from counties and transforming it using FME workbenches to address issues before loading it into Smallworld. Examples are provided of data issues from different counties and the FME solutions used to successfully load the data. Common data problems and future plans to streamline the interim parcel update process are also outlined.
Loading Parcels Into Smallworld GIS via FME
- 1. LOADING PARCELS INTO SMALLWORLD GIS VIA FME Gamze Cetken Sr. GIS Technical Systems Analyst
- 2. Before 2012 Raster Data AutoCAD After 2012 Vector Data GE Smallworld – EO/GDO 4.2 2 PSE GIS HISTORY
- 3. University of Washington Forestry Department Advantages Statewide Normalized Data Free Disadvantages Not the latest County Parcel Data Takes long time between the updates Risk – Funding Issues 3 PARCELS…FIRST ATTEMPT
- 4. Direct Download/Purchase from Counties Advantages Latest Updates whenever required Disadvantages Data not normalized Not just different fields but different data capturing techniques as well 4 PARCELS…CURRENT PROCESS
- 5. Getting Data from Counties • Shapefile • Shapefile with Assessor Table FME (SAFE Software) • Workbenches specific for each county • Field to Field Mapping GE Smallworld • Parcel and Address • 1: many relationship 5 THE BIG PLAN EXTRACT TRANSFORM LOAD
- 6. EXTRACT • Easy • Which fields do we need in GIS? TRANSFORM • Hard • Data Analysis, Data Manipulation, Data Reprojection • Right tools need to be selected – otherwise no Load LOAD • Medium • All mandatory fields need to be populated including hidden fields 6 ETL – EXTRACT TRANSFORM LOAD
- 7. 7 WHY TRANSFORM AND FME TOOLS ARE SO IMPORTANT? “System of Record” as-is FME Tools addressing each county’s data issues Successful Load into GIS
- 8. 8 A SIMPLE PROCESS IN FME
- 9. 9 Different Parcel IDs Same Polygon Area Different Addresses • Data: Parcel Shapefile • Use : Multi Family Residence EXAMPLE-1 SNOHOMISH COUNTY DATA
- 10. Result: • 6 Parcel and Parcel Annotation entries at the same location 10 EXAMPLE-1 SNOHOMISH COUNTY 23709 and 23711 placed on top of each other ISSUE
- 11. 11 EXAMPLE-1 SNOHOMISH COUNTY FME WORKBENCH
- 12. Result: • Successful load of parcels and addresses • Successful Parcel Annotation 12 EXAMPLE-1 SNOHOMISH COUNTY RESULT
- 13. 13 EXAMPLE-2 THURSTON COUNTY DATA • Data: Parcel Shapefile • Use : Multi Family Residence Different Parcel IDs Different Unit Numbers Address: 1700 Cooper Point Rd SW
- 16. 16 EXAMPLE-3 KITTITAS COUNTY • Data : Parcel Shapefile and Assessor Data in MS Access DATA
- 17. 17 EXAMPLE-3 KITTITAS COUNTY 02602 N Columbia St Ellensburg Issue #1: • House Number is not stored in a separate field. • In GIS House Number is a mandatory field Issue #2: • In some addresses house numbers do not exist ISSUE House# Prefix Street Name Type City Evergreen Way EastonStreet Name Type City
- 18. 18 EXAMPLE-3 KITTITAS COUNTY FME WORKBENCH
- 21. 21 EXAMPLE-4 KITSAP COUNTY • Data: Parcel Shapefile and Address Point Shapefile DATA
- 22. 22 EXAMPLE-4 KITSAP COUNTY ISSUE One or more address points per parcel
- 23. 23 EXAMPLE-4 KITSAP COUNTY FME WORKBENCH
- 25. 25 EXAMPLE-4 KITSAP COUNTY RESULT ESRI SW GIS
- 26. FME Different Data Capturing Methods Parcel IDs missing Full Address lines Empty Address fields Using “XXX” when house numbers are not available House Numbers missing 26 COMMON DATA PROBLEMS
- 27. White Space Management Script run after parcels are inserted House Numbers with “0” values are not shown 27 PARCEL ANNOTATION
- 28. 28 INTERIM PARCEL UPDATE PROCESS • All County Parcels • Source: County • Source Data = CountyGIS (e.g. KitsapGIS) Existing • All New Development Area Parcels • Source: CAD Files, County (new additions) • Source Data = PSE Temporary • Placeholder Status for newly inserted county parcels • Insert all new parcels as “Planned” • Delete “Existing” old version of County Parcels • Then change all parcels with “Planned” status to “Existing” Planned Parcel Status Parcel Update Process
- 29. 29 HOW LONG DOES IT TAKE? Parcel Update Process Insert Parcel Data into GIS via FME 45 min to 6 hrs Delete “Existing” Parcels 6 to 12 hours Change “Planned” Parcels’ Status to “Existing” 25 min to 1 hr Place Parcel Annotation 2 to 10 days Merge and Post to Top 12 to 18 hours Min Time : 2 days 19 hrs Max Time : 11 days 13 hrs
- 30. UpdateDetector Transform Tool We will focus only on Updates/Deletes and New Inserts It will save us time (weeks) by omitting the duplicated effort 30 WHAT’S NEXT?
- 32. 32BAKER RIVER HYDROELECTRIC PUGET SOUND ENERGY Gamze Cetken Sr. GIS Systems Analyst gamze.cetken@pse.com For more information visit www.fme.com www.spatialbiz.com Contact: Ryan Cauffman Email: ryan@spatialbiz.com Phone: (303) 847-4525 Special Thanks to Andy Street from SpatialBiz for helping out with all the FME workbenches! CONTACT INFO
Editor's Notes
- #8: We will accept you as is but in the meantime we want to have a load the way we want it. We are trying to create unique workbenches for each county that would work perfectly at every time with min effort. That’s the goal.