byteLAKE's Alveo FPGA Solutions
0 likes369 views
The document discusses Bytelake's expertise in FPGA programming for Alveo products, emphasizing the customization and parallel processing capabilities of FPGAs for various applications, particularly in computational fluid dynamics (CFD). It details their optimized CFD kernels and algorithms, showcasing their applications across multiple industries, including weather simulation, oil and gas, and agriculture. Additionally, Bytelake highlights their AI and HPC solutions for accelerating complex algorithms and reducing total cost of ownership (TCO) in computational tasks.
![• Xilinx pioneered C to FPGA compilation technology (aka “HLS”) in 2011
3
Source code in C, C++ or OpenCL
loop_main:for(int j=0;j<NUM_SIMGROUPS;j+=2) {
loop_share:for(uint k=0;k<NUM_SIMS;k++) {
loop_parallel:for(int i=0;i<NUM_RNGS;i++) {
mt_rng[i].BOX_MULLER(&num1[i][k],&num2[i][k],ratio4,ratio3);
float payoff1 = expf(num1[i][k])-1.0f;
float payoff2 = expf(num2[i][k])-1.0f;
if(num1[i][k]>0.0f)
pCall1[i][k]+= payoff1;
else
pPut1[i][k]-=payoff1;
if(num2[i][k]>0.0f)
pCall2[i][k]+=payoff2;
else
pPut2[i][k]-=payoff2;
}
}
}
FPGACompile](https://image.slidesharecdn.com/bytelakesalveofpgasolutionsv1-200603224258/85/byteLAKE-s-Alveo-FPGA-Solutions-3-320.jpg)
byteLAKE's Alveo FPGA Solutions
- 1. Alveo Products Marketplace Expertise Software Services Alveo Solutions
- 2. Expertise in Alveo FPGA programming PCIe x86 CPU Host Application Runtime and Drivers Acceleration API FPGA Accelerated Functions DMA Engine AXI Interfaces byteLAKE’s Solutions Xilinx Acceleration Platform C/C++ code with OpenCL API calls C/C++ or OpenCL C FPGACPU 2 More at: byteLAKE.com/en/Alveo
- 3. • Xilinx pioneered C to FPGA compilation technology (aka “HLS”) in 2011 3 Source code in C, C++ or OpenCL loop_main:for(int j=0;j<NUM_SIMGROUPS;j+=2) { loop_share:for(uint k=0;k<NUM_SIMS;k++) { loop_parallel:for(int i=0;i<NUM_RNGS;i++) { mt_rng[i].BOX_MULLER(&num1[i][k],&num2[i][k],ratio4,ratio3); float payoff1 = expf(num1[i][k])-1.0f; float payoff2 = expf(num2[i][k])-1.0f; if(num1[i][k]>0.0f) pCall1[i][k]+= payoff1; else pPut1[i][k]-=payoff1; if(num2[i][k]>0.0f) pCall2[i][k]+=payoff2; else pPut2[i][k]-=payoff2; } } } FPGACompile
- 4. Xilinx FPGAs highlights 4 • No predefined instruction set or underlying architecture • Developers customize the architecture to their needs – Custom data paths – Custom bit-width – Custom memory hierarchies • Excels at all types of parallelism – Deeply pipelined (e.g. Video codecs) – Bit manipulations (e.g. AES, SHA) – Wide data path (e.g. DNN) – Custom memory hierarchy (e.g. Data analytics) • Adapts to evolving algorithms and workload needs FPGAs - the Ultimate Parallel Processing Device
- 5. • Compute domain divided into sub-domains • Host sends data to the FPGA global memory • Host calls kernels to execute them on FPGA (kernel is called many times) • Each kernel call represents a single time step • FPGA sends the output array back to the host Typical Architecture More at: byteLAKE.com/en/PPAM19
- 6. • Kernel is distributed into 4 SLRs • Each sub-domain is allocated in different memory bank • Data transfer occurs between neighboring memory banks Example processing SLR0 Kernel_A SLR1 Kernel_B SLR2 Kernel_C SLR3 Kernel_D Kernel Bank0 Bank1 Bank2 Bank3 Sub-domain Sub-domain Sub-domain Sub-domain 19
- 7. Case study: CFD Kernels adaptation Typical CFD workflow From CAD to MESH… (meshing) Image source: https://www.openfoam.com/products/visualcfd.php …to CFD simulation and visualization. • MESH conversion (input) • byteLAKE’s CFD Kernels • Data output for visualization upto5% ofsimulationtime major workload OPENFOAM® is a registered trademark of ESI Group. This offering is not approved or endorsed by ESI Group, the producer of the OpenFOAM software and owner of the OPENFOAM® and OpenCFD® trademarks.
- 8. byteLAKE created set of highly optimized CFD kernels for Xilinx Alveo Datacentre accelerator cards –Advection (movement of some material, dissolved or suspended in the fluid) –Pseudo velocity (approximation of the relative velocity) –Divergence (measures how much of fluid is flowing into/ out of a certain point in a vector field) –Thomas algorithm (simplified form of Gaussian elimination for tridiagonal system of equations) 8Download solution description: bytelake.com/en/download/2716/ CFD Kernels
- 9. CFD acceleration with Alveo FPGA 9 More at: byteLAKE.com/en/FPGA
- 10. MPDATA Accelerated CFD / Advection algorithm optimized for heterogeneous computing.
- 11. CFD Computational Fluid Dynamics • Numerical analysis and algorithms to solve fluid flows problems –how liquids and gases flow and interact with surfaces • Widely used across industries: –automotive, chemical, aerospace, biomedical, power and energy, and construction etc. • Typical applications –weather simulations, –aerodynamic characteristics modelling and optimization, –petroleum mass flow rate assessment 11
- 12. • MPDATA (Multidimensional Positive Definite Advection Transport Algorithm) – main part of the dynamic core of the Eulerian/ semi-Lagrangian (EULAG) model – EULAG (MPDATA+elliptic solver) is the established computational model, developed for simulating thermo-fluid flows across a wide range of scales and physical scenarios – currently, this model is being implemented as the new dynamic core of the COSMO (Consortium for Small-scale Modeling) weather prediction framework – advection (together with the elliptic solver) is a key part of many frameworks that allow users to implement their simulations • Advection – movement of some material (dissolved or suspended) in the fluid. Algorithm: Advection (MPDATA) General Information
- 13. • Easy to integrate – Can work as a standalone application or be called as a function via our dedicated interface (e.g. can be called as a function with input and output arrays) – Compatible with frameworks like TensorFlow for integrating deep learning with CFD codes • Easy to visualize the results – Results can be stored in a raw format as a binary file of the output arrays or converted via byteLAKE tools to a ParaView format • See benefits already in 1-node HPC configurations – Strongly adapted to Alveo U250, were single card supports the max size of arrays: 2,1 Gcells (max compute domain: 1264 x 1264 x 1264) ~ 60 GB • Scalable to many cards per node and many nodes Algorithm: Advection (MPDATA) byteLAKE’s implementation compatibility
- 14. • First-order-accurate step of the advection scheme. Second-order is an option. • Input data – Array X – non-diffusive quantity (e.g. temperature of water vapor, ice, precipitation, etc.) – Arrays V1, V2, V3 - each of them stores the velocity vectors in one direction – (optional) Arrays Fi, Fe - implosion and explosion forces acting on a structure of X – (optional) Array D with density – (optional) Array rho which defines an interface for the coupling of COSMO and EULAG dynamic core (used to provide the transformation of the X variable) – DT – time step (scalar) • Output data – single X array that was updated in the given time step Algorithm: Advection (MPDATA) Technical Information
- 15. • Applications include – To characterize the sub-grid scales effect in global numerical simulations of turbulent stellar interiors – To compare anelastic and compressible convection-permitting weather forecasts for the Alpine region – Modeling the prediction of forest fire spread – Flood simulations – Biomechanical modeling of brain injuries within the Voigt model (a linear system of differential equations where the motion of the brain tissue depends merely on the balance between viscous and elastic forces) – Simulation gravity wave turbulence in the Earth's atmosphere – Simulation of geophysical turbulence in the Earth's atmosphere – Ocean modeling: simulation of three-dimensional solitary wave generation and propagation using EULAG coupled to the barotropic NCOM (Navy Coastal Ocean Model) tidal model 15 Applications of Advection (MPDATA)
- 16. • Applications include cont. – Oil and Gas: provides a significant return on investment (ROI) in seismic analysis, reservoir modelling and basin modelling. Used also to monitor drilling and seismic data to optimize drilling trajectories and minimize environmental risk. – AgriTech: models to track and predict various environmental impacts on crop yield such as weather changes. For example, daily weather predictions can be customized based on the needs of each client and range from hyperlocal to global. • Example adopters – Poznan Supercomputing and Networking Center, Poland: prognosis of air pollution – European Centre for Medium-Range Weather Forecasts, UK: weather forecast – Institute of Meteorology and Water Management, Poland: weather forecasts – German Aerospace Center: aeronautics, transport and energy areas – University of Cape Town, RPA: weather simulation – Montreal University: weather simulation – Warsaw University: ocean simulation Applications of Advection (MPDATA), cont. Full list
- 17. Algorithm: Advection (MPDATA) Alveo FPGA Benchmark INTEL XEON E5-2995 INTEL XEON E5-2995 INTEL XEON GOLD 6148 INTEL XEON PLATINUM 8168 XILINX ALVEO U250 Performance (the higher the better) INTEL XEON E5-2995 INTEL XEON E5-2995 INTEL XEON GOLD 6148 INTEL XEON PLATINUM 8168 XILINX ALVEO U250 Energy (the lower the better) INTEL XEON E5-2995 INTEL XEON E5-2995 INTEL XEON GOLD 6148 INTEL XEON PLATINUM 8168 XILINX ALVEO U250 Performance/W (the higher the better) More at: byteLAKE.com/en/FPGA
- 18. Explore byteLAKE’s CFD Suite www.byteLAKE.com/en/CFDSuite byteLAKE’s CFD Suite AI for CFD
- 19. AI • highly optimized AI engines to analyze text, image, video, sound and time series data. • Detecting shapes & patterns. • Complex tasks automation. • IoT/ edge, Cloud, on-premise. HPC • accelerating time to results and adapting complex algorithms to GPU, FPGA, many-CPU architectures. • From single nodes to clusters. Meet byteLAKE AI and HPC Experts Your software partner for AI & HPC projects Experts in adapting & optimizing software for Select Products AI for CFD. Ultra fast results, radically lower TCO. New possibilities. Objects Detection Edge AI and real time computer vision. 56x faster AI training. R&I • R&D • Licensing
- 20. HPC at byteLAKE Accelerating time to results and adapting complex algorithms to GPU, FPGA, many-CPU architectures. Unleashing the power: • selecting the right programming model to a given problem (task parallelism, data parallelism, mixture of these two) • providing the right balance between CPUs and GPUs/FPGAs • optimizing data transfers between host memory and accelerators • code adaptation to a variety of computing platforms Bottom line: lowering TCO thru various optimizations (performance, energy efficiency, accuracy of calculations) More at: byteLAKE.com/en/HPC Making the most of the hardware: • Speedup: accelerating time to results for complex algorithms • Green Computing: optimizing algorithms to reduce energy consumption • Scalability: from single nodes to clusters
- 21. Products and Services Cognitive AutomationEdge AI Services HPC Products CFD Suite brainello Ewa Guard Federated Learning Green Computing (FPGA, GPU) Intelligent Restaurant Incubation
- 22. byteLAKE among top AI companies in Poland! "It contains information on practically all meaningful companies operating in Poland which offer services or products in the field of modern technologies. We believe this map will be necessary to help both domestic and international investors looking for interesting projects in Poland.", Aleksander Kutela, President of Digital Poland Foundation