deep learning for fluid mechanics using PINNs

Abstract:
• To simulate fluid dynamics problems we use mostly experimental methods and
numerical simulating software.
• Numerical simulation methods are sensitive to mesh size, therefore , the cost
involved is also very high.
• Physics-Informed Neural Networks (PINNs) is used to solve any supervised
machine learning problems.
• PINNs is used to solve any PDEs/ODEs which may be of either a linear or
nonlinear form.
• There are two categories of problems that we encounter in practice:
a) Data-driven solution of PDEs
b) Data-driven discovery of PDEs
• Based on the availability of the data, there are mainly two types of models, which
are continuous-time models and discrete-time models.

Introduction:
• Recent advancements in machine learning algorithms and data sciences have produced
significant results for various scientific fields such as image recognition.
• Computational fluid dynamics (CFD) approaches like finite element methods (FEM), finite
volume methods (FVM), and finite difference methods (FDM) are used to solve any fluid
flow simulation problems.
• The above discretization schemes usually computes the values of a PDE at a set of grid
points which are distributed over spatial and temporal domain.
• PINNs together with automatic differentiation (autodiff) do not require mesh generation to
solve fluid dynamics problems.
• PINNs incorporate the governing equation loss, initial condition loss, and boundary
condition loss into the Loss function.
• Different optimization schemes like ADAM or SGD is used to optimize the loss function.
• Training of PINNs is time-consuming and prone to errors because we have to tune the
weights and biases.
• It is possible to obtain a locally optimal solution if we use Gradient Descent to optimize
the loss function.

Problem Set Up:
We model the fluid dynamics by the three-dimensional NS equations with the Newtonian
assumption:
𝜕 𝒖
𝜕 𝑡
+(𝒖· 𝛻 ) 𝒖=− 𝛻 𝑝 +
1
𝑅𝑒
𝛻
2
𝒖,∈Ω ,
, Continuity equation ,
where x = [x,y, z] Ω and t [0,T] denote space and time coordinates. The scalar
∈ ∈
h(x) is the initial constraints. u(x,y, z,t), v(x,y, z,t), and w(x,y, z,t) represent the x,y, and
z component of the velocity field. p(x,y, z,t) represents the pressure.

• The solution of Navier-Stokes equations could be approximated by neural network
û(x,t;θ). We consider the feed-forward fully connected neural network of depth M,
which takes the input x,y, z,t and denote the output of the m−th layer as û[m]
. The neural
network can be defined as:
where σ is the activation function including sigmoid, relu, and tanh. W[m]
and
b[m]
represent the weights and biases at m−th layer.

• The residual is defined as :
• We use automatic differentiation to find the partial derivatives.
• Different types of loss term are calculated as follows:

• Then the total loss term is calculated as follows:
where ω = {ωf ,ωb ,ωi ,ωd
} are the hyperparameters which is tuned during training of neural
network.
LPDE penalizes the residual for the loss in the governing equations.
Ldata penalizes the loss in the data.
and LIC and LBC implies the loss in the initial condition and boundary condition
respectively.
The parameters Nf ,Nb ,Ni ,Ndata are the total number of points.
• The best parameter collection θ∗
is identified by minimizing multiple loss functions as
given above.

• PINNs for the incompressible Navier-Stokes equations algorithm is summarized as follows:
Fig. 1 A schematic diagram of PINNs for solving N-S equation

Example:
I have used following conditions to solve N-S
equation using PINNs:
Viscosity of fluid: µ = 0.02kg · (m · sec)-1;
Density if
fluid: ρ = 1kg /m3
; At Inlet u(0,y) = u(inlet) = y(H −
y)*( 4/H2) and v(0, y) = 0 ; No slip Condition @
wall and cylinder surface ; Pressure of outlet equals to
zero i.e. p(1,y) = 0
Continuity Equation (for incompressible flow): · V
∇
= 0
Steady N-S equation : ρ. (V · )V = − p + µ
∇ ∇ ∇2
V
Or it can be expressed as Cauchy momentum equation
ρ(V · )V = · σ ; where σ = −p*I+ µ( V+ ( V)
∇ ∇ ∇ ∇ T
)
Fig. 2 A Schematic Diagram of Flow over a Cylinder

• After solving the Navier- Stokes equation, for the given case, using PINNs we have found the variation of
u(x,y) , v(x,y) and p(x,y) as follows:
Model 1:
Fig. 3 Variation of
velocity and pressure
with x direction for
model 1.

Model 2:
Fig. 4 Variation of
model 2.

Model 3:
Fig. 5 Variation of
model 3.

Model 4:
Fig. 6 Variation of
model 4

References:
 Jin, X., Cai, S., Li, H., Karniadakis, G.E.: NSFnets (Navier-Stokes flow nets): Physics-
informed neural networks for the incompressible Navier-Stokes equations. Journal of
Computational Physics 426, 109951 (2021)
 Raissi, M., Perdikaris, P., Karniadakis, G.E.: Physics informed learning machine (2021).
US Patent 10,963,540
 Raissi, M., Perdikaris, P., Karniadakis, G.E.: Machine learning of linear differential
equations using Gaussian processes. Journal of Computational Physics 348, 683–693
(2017)
 Raissi, M., Perdikaris, P., Karniadakis, G.E.: Numerical Gaussian processes for time-
dependent and nonlinear partial differential equations. SIAM Journal on Scientific
Computing 40(1), A172– A198 (2018)

deep learning for fluid mechanics using PINNs

More Related Content

What's hot (20)

Similar to deep learning for fluid mechanics using PINNs (20)

Recently uploaded (20)

deep learning for fluid mechanics using PINNs