FME Lightning Talk: Multiprocessing
Download as PPTX, PDF0 likes2,631 views
The document discusses multiprocessing in FME software. Multiprocessing uses multiple CPUs to increase throughput by processing tasks in parallel. FME allows setting different levels of multiprocessing from no parallelism to extreme parallelism. Demonstrations show multiprocessing can significantly reduce processing times for tasks like DEM generation, buffering, and clipping. The level of parallelism and group-by settings control how FME leverages multiple CPU cores for improved performance.
FME Lightning Talk: Multiprocessing
- 1. Multiprocessing in FME April 2012
- 2. Multiprocessing: Definition Multiprocessing is the use of two or more central processing units (CPUs) within a single computer system - Wikipedia
- 4. Multiprocessing: Motivation Multi-Core and HyperThreaded CPUs Very common Potential to increase compute-bound throughput
- 5. Multiprocessing & FME Option on Many Transformers Multiprocesses Groups
- 6. Multiprocessing & FME Option on All Custom Transformers
- 7. Multiprocessing: Levels Of Parallelism None Minimal Moderate Aggressive Extreme
- 8. Multiprocessing: Levels Of Parallelism Parameter Processes No Parallelism 1 License Cap Minimal Cores / 2 Base 4 Moderate Cores Professional 8 Aggressive Cores * 1.5 Other 16 Extreme Cores * 2
- 9. Demonstration – DEM Generation Parameter Time No Parallelism 1’ 10” Minimal 44” Moderate 33” Aggressive 37” Extreme 37”
- 10. Demonstration - Buffering Parameter Time No Parallelism 2’ 51” Moderate (4) 1’ 29” Moderate (8) 1’ 30” Moderate (16) 1’ 33” Moderate (50) 1’ 54”
- 11. Demonstration - Clipping Parameter Time No Parallelism 27’ 01” Moderate 7’ 33”
- 12. Multiprocessing: Summary New for 2012 Leverages Multi-Core and HyperThreading CPUs Controlled by: Levels of Parallelism Group-By Can give significant performance boost http://fmeevangelist.com/fmeevangelist94 http://fme.ly/parallel (FMEpedia Article)