SlideShare a Scribd company logo
Robust Multi-objective
Iterative Learning Control
Tong Duy Son
Promoters
Prof. Jan Swevers
Prof. Goele Pipeleers
September 2016
1st try
2nd
try
3rd
try
1. perform
2. analyze
3. do again
(and better)
3rd
try
6
Repetitions 1. perform
2. analyze
3. do again
(and better)
7
Repetitions in industry
vehicle testing
batch processes
industrial robots
semiconductor
8
Repetitions in industry
vehicle testing
batch processes
industrial robots
semiconductor
control system
9
Challenges
Goal of this thesis
• Improve the control system
• Exploit ‘repetition’
Improvements in
• Robustness
• Precision
• Fast
• Energy efficiency
10
Desired output: pick an object from A to B
Question: What input should you apply?
input desired output
Consider a robot arm in a factory
Sketch of Control
11
Desired output: pick an object from A to B
Question: What input should you apply?
input desired output
knowledge of the system!
Sketch of Control
𝑦= 𝑓 (𝑥 ,𝑢)
12
Sketch of Control
Feedback
Controller
𝑦= 𝑓 (𝑥 ,𝑢)
Feedforward
Controller
Feedback
Feedforward
13
Sketch of Control
• Model uncertainty
• Disturbance
• Transient response, lag
• Non-minimum phase
• Highly dependent on accuracy of the model
• Disturbance has to be known
Feedback
Feedforward
14
Sketch of Control
• Model uncertainty
• Disturbance
• Transient response, lag
• Non-minimum phase
• Highly dependent on accuracy of the model
• Disturbance has to be known
Feedback
Feedforward
feedforward
feedback
no control
feedforward
feedback
no control
15
Sketch of Control
• Model uncertainty
• Disturbance
• Transient response, lag
• Non-minimum phase
• Highly dependent on accuracy of the model
• Disturbance has to be known
Feedback
Feedforward
feedforward
feedback
no control
16
Repetitions in industry
same task and same performance
hundreds to thousands times a day
17
Revisit: Challenges
Goal of this thesis
• Improve the control system
• Exploit ‘repetition’
Iterative learning control (ILC): improves control
performance by incorporating information from previous
trials
18
Iterative Learning Control (ILC)
Iterative learning control (ILC): improves control
performance by incorporating information from previous
trials
)
19
Main contributions
1. Multi-objective frequency domain ILC
2. Lifted system ILC: analysis and synthesis
3. Robust norm-optimal ILC
20
Main contributions
1. Multi-objective frequency domain ILC
2. Lifted system ILC: analysis and synthesis
3. Robust norm-optimal ILC
21
Introduction (1)
Most ILC designs reply on a two-step sequential problem formulation and the
design procedures are usually heuristic:
• Design L then design Q:
1. L as model-inversion or phase-lead type
2. Q as a low-pass filter: depends on designed
• Design Q then design L:
1. design Q
2. find L that optimize the learning speed
• Iterate the previous 2 designs
The design is not optimal while costly and time consuming!
)
designed controller: (Q,L)
22
Introduction (2)
Hard to incorporate multi-objective intuitively
• Robustness (unmodeled dynamics, uncertain parameter…)
1. Robustness vs tracking performance
2. Unknown: robustness and tracking performance vs learning speed
have 1 month training have 4 year training (i.e. for Olympic): more difficult attempts
• Input constraints
• Trade-offs between the objectives
23
Methodology
• Design Q, L simultaneously using optimization
• Accounts for the trade-off designs
Approach:
First, specify the desired performance, input constraints, and robustness conditions.
Next, design ILC controller (Q, L) to optimize the convergence (learning) speed
with the given specifications
minimize convergence speed
Q,L
subject to robust performance
robust convergence
input constraints
24
Methodology
• Design Q, L simultaneously using optimization
• Accounts for the trade-off designs
Approach:
First, specify the desired performance, input constraints, and robustness conditions.
Next, design ILC controller (Q, L) to optimize the convergence (learning) speed
with the given specifications
minimize convergence speed
Q,L
subject to robust performance
robust convergence
input constraints
non-convex,
hard to solve!
25
Methodology
• Design Q, L simultaneously using optimization
• Accounts for the trade-off designs
Approach:
First, specify the desired performance, input constraints, and robustness conditions.
Next, design ILC controller (Q, L) to optimize the convergence (learning) speed
with the given specifications
minimize convergence speed
Q,L
subject to robust performance
robust convergence
input constraints
non-convex,
hard to solve!
reformulated as
a linear program
26
Advantages (1)
Multi-objective
optimality
computation
flexibility
intuition
multi-objective
Advantages (1)
Multi-objective
and their trade-offs:
 convergence speed
 input constraints
 robust convergence
 robust performance
optimality
computation
flexibility
intuition
multi-objective
28
Advantages (2)
Optimality
• no 2-step and heuristic design
• (Q, L) is simultaneously
generated using optimization
• noncausal ILC controller
optimality
computation
flexibility
intuition
multi-objective
• reliable as a result of a linear program
Computation
29
Advantages (4)
Flexibility
• controller type: FIR, IIR, PID...
• different objectives:
minimize tracking performance
Q,L
subject to convergence speed
robust convergence
input constraints
• no parametric model is required, only FRFs
• continuous and discrete
• selecting interested frequencies: i.e. for noise and disturbance
rejection.
optimality
computation
flexibility
intuition
multi-objective
30
Advantages (5)
Intuition
• Use conventional control system
terminologies: sensitivity
function, bandwidth
optimality
computation
flexibility
intuition
multi-objective
31
Advantages (5)
Intuition
• Use conventional control system
terminologies: sensitivity
function, bandwidth
optimality
computation
flexibility
intuition
multi-objective
• Automated design possible
Multi-
objective
ILC
algorithm
system model (FRFs)
performance
specs. (bandwidth)
ILC controller
(and learning speed)
32
Validation
• Validate the proposed ILC designs: simulations and experiments
• Validate the multi-objective trade-offs
• Compare with existing designs
Control
Development
Simulation &
Experimental
Validation
33
Validation
Control
Development
Simulation &
Experimental
Validation
tracking performance function
(sensitivity function)
convergence (learning)
speed function
34
Validation
Control
Development
Simulation &
Experimental
Validation
convergence speed vs
tracking performance with
2 different designs
convergence speed vs
input constraints
red: no constraint
Validation: trade-off designs Control
Development
Simulation &
Experimental
Validation
35
Select the desired controller:
 desired tracking performance
 desired learning speed
 level of uncertainty
36
Main contributions
1. Multi-objective frequency domain ILC
2. Lifted system ILC: analysis and synthesis
3. Robust norm-optimal ILC
37
Introduction
• Consider multiple objectives as previous,
but investigate time domain using lifted system representation
of finite trial length.
• (Q,L) are matrix variables
• Study robust analyses
• Proposes ILC syntheses (designs)
)
designed controller: (Q,L)
38
Robustness
• Robust monotonic convergence and robust performance analyses
an LMI (or BMI) problem
i.e.
• Both unstructured and structured uncertainty are considered
39
Synthesis
(for short/moderate trial lengths)
• Synthesis I: Optimize convergence speed
• Synthesis II: Optimize tracking error
)
designed controller: (Q,L)
minimize convergence speed
L
subject to an LMI problem
minimize tracking error
Q
subject to an LMI problem
40
Validation
Control
Development
Simulation &
Experimental
Validation
XY-wafer stage with linear motor
41
Main contributions
1. Multi-objective frequency domain ILC
2. Lifted system ILC: analysis and synthesis
3. Robust norm-optimal ILC
42
Introduction
Norm-optimal ILC is an efficient way to design the optimal ILC input:
is the cost function w.r.t the nominal model (no uncertainty model is
accounted)
 analytical solution (noncausal, time-varying controller)
× has to sacrifice a lot tracking performance to obtain robustness
𝐽 (𝑢 𝑗 +1
❑
)
minimize
𝑢𝑗+1
❑
43
Methodology
• obtain both robustness and high tracking performance
• deal with input constraints
• efficient computation
Approach:
optimize the worst-case cost function:
𝐽 (𝑢 𝑗 +1
❑
, ∆)
minimize sup
𝑢𝑗+1
❑
∆∈ ℬ∆
subject to input constraints
𝐽 ( ∆ )
∆
𝐽 wc
𝐽 nom
44
Methodology
• obtain both robustness and high tracking performance
• deal with input constraints
• efficient computation
Approach:
optimize the worst-case cost function:
𝐽 (𝑢 𝑗 +1
❑
, ∆)
minimize sup
𝑢𝑗+1
❑
∆∈ ℬ∆
subject to input constraints
non-convex
problem
𝐽 ( ∆ )
∆
𝐽 wc
𝐽 nom
45
Methodology
• obtain both robustness and high tracking performance
• deal with input constraints
• efficient computation
Approach:
optimize the worst-case cost function:
𝐽 (𝑢 𝑗 +1
❑
, ∆)
minimize sup
𝑢𝑗+1
❑
∆∈ ℬ∆
subject to input constraints
𝐽dual (𝑢 𝑗 +1
❑
, 𝛾 𝑗 +1
❑
)
minimize
,
subject to input constraints
non-convex
problem
reformulated as
a convex problem
46
Advantages
 obtain robustness w.r.t. cost function (proved):
 deal with input constraints
 efficient computation
 high tracking performance?
𝐽 ( ∆ )
∆
𝐽 wc
𝐽 nom
47
Advantages
 obtain robustness w.r.t. cost function (proved):
high tracking performance?
Considering the same cost function:
• if the classical norm-optimal ILC diverges, the proposed robust ILC
still converges.
• if the classical norm-optimal ILC converges, the robust ILC also
converges to similar tracking performance but with lower
convergence speed
48
Advantages (cont.)
 deal with input constraints
 efficient computation
 the selection of weight matrices is not critical as other norm-
optimal ILC designs.
 the proof of the equivalence to an adaptive norm-optimal ILC (trial-
varying controller) can be used to avoid solving optimization if
needed (i.e. when convergence is already obtained).
49
Validation
Control
Development
Simulation &
Experimental
Validation
• Validate the proposed ILC designs: simulations and experiments
• Compare with classical (robust and non-robust) norm-optimal ILC:
accurate model, inaccurate model
50
Validation
Control
Development
Simulation &
Experimental
Validation
• Validate the proposed ILC designs: simulations and experiments
• Compare with classical (robust and non-robust) norm-optimal ILC:
accurate model, inaccurate model
accurate model
inaccurate model
red: classical norm-
optimal ILC
blue: proposed ILC
black: other robust
design
51
Validation
Control
Development
Simulation &
Experimental
Validation
• Validate the proposed ILC designs: simulations and experiments
• Compare with classical (robust and non-robust) norm-optimal ILC:
accurate model, inaccurate model
accurate model
52
Main contributions
1. Multi-objective frequency domain ILC
2. Lifted system ILC: analysis and synthesis
3. Robust norm-optimal ILC
53
Summary
1. Robust ILC: robustness and high tracking performance, frequency and
time domain
2. Multiple objectives and their trade-offs
3. Efficient computation
4. Extensive simulation and experimental validations:
guideline to select the suitable controller
54
Future works
1. Multivariable (MIMO) systems
2. Different classes of uncertainty modelling
3. Robust ILC nonlinear optimization
4. ILC for different purposes: energy optimal, time-optimal…
5. Applications (human in the loop, distributed systems…)
55
Thank you!
More detailed information:
https://tongduyson.github.io/publication.html
56
Conservative: small
Evaluate the original constraints:
and
using both simulation and
experiments for different system
models)
The differences are small hence
small conservative.
page 69 (thesis)
57
(near) Future works
Multivariable (MIMO) systems
performance condition:
58
(near) Future works
2-order controllers generated from
the optimization problem:

More Related Content

DOCX
Se unit 4
PPTX
Software engineering module 4 notes for btech and mca
PPTX
01-Introduction_to_Optimization-v2021.2-Sept23-2021.pptx
PDF
Start MPC
PPTX
PDF
Testing of Cyber-Physical Systems: Diversity-driven Strategies
PDF
ScilabTEC 2015 - Noesis Solutions
PDF
Testing Dynamic Behavior in Executable Software Models - Making Cyber-physica...
Se unit 4
Software engineering module 4 notes for btech and mca
01-Introduction_to_Optimization-v2021.2-Sept23-2021.pptx
Start MPC
Testing of Cyber-Physical Systems: Diversity-driven Strategies
ScilabTEC 2015 - Noesis Solutions
Testing Dynamic Behavior in Executable Software Models - Making Cyber-physica...

Similar to Robust Multi-objective Iterative Learning Control 13553323.ppt (20)

PPTX
Intro to LV in 3 Hours for Control and Sim 8_5.pptx
PDF
MiL Testing of Highly Configurable Continuous Controllers
PPTX
Constraint Programming in Compiler Optimization: Lessons Learned
PPTX
Self tuning, Optimal MPC, DMC.pptx
PPTX
1 Introduction to C Programming.pptx
PDF
Mit16 30 f10_lec01
PPT
Dealing with the Three Horrible Problems in Verification
PDF
Willump: Optimizing Feature Computation in ML Inference
PPTX
Introduction to Deep Learning
PPTX
An Introduction to Deep Learning
PDF
Master defence 2020 - Oleh Lukianykhin - Reinforcement Learning for Voltage C...
PPT
2. Life Cycle Models for Software Engineeting
PDF
CompEng - Lec01 - Introduction To Optimum Design.pdf
PPT
Unit 6
PPT
softwareengineeringlpufeasibilitystudyca
PPT
2.Basic Introduction of SDLC Phases and explanation of SDLC Models (1).ppt
PPT
2.Basic Introduction of SDLC Phases and explanation of SDLC Models.ppt
PPT
2.Basic Introduction of SDLC Phases and explanation of SDLC Models.ppt
PPTX
Verhaert Innovation Day 2011 – Joris Vanderschrick (VERHAERT) - System Requir...
PPT
Lec3 Computer Architecture by Hsien-Hsin Sean Lee Georgia Tech -- Performance
Intro to LV in 3 Hours for Control and Sim 8_5.pptx
MiL Testing of Highly Configurable Continuous Controllers
Constraint Programming in Compiler Optimization: Lessons Learned
Self tuning, Optimal MPC, DMC.pptx
1 Introduction to C Programming.pptx
Mit16 30 f10_lec01
Dealing with the Three Horrible Problems in Verification
Willump: Optimizing Feature Computation in ML Inference
Introduction to Deep Learning
An Introduction to Deep Learning
Master defence 2020 - Oleh Lukianykhin - Reinforcement Learning for Voltage C...
2. Life Cycle Models for Software Engineeting
CompEng - Lec01 - Introduction To Optimum Design.pdf
Unit 6
softwareengineeringlpufeasibilitystudyca
2.Basic Introduction of SDLC Phases and explanation of SDLC Models (1).ppt
2.Basic Introduction of SDLC Phases and explanation of SDLC Models.ppt
2.Basic Introduction of SDLC Phases and explanation of SDLC Models.ppt
Verhaert Innovation Day 2011 – Joris Vanderschrick (VERHAERT) - System Requir...
Lec3 Computer Architecture by Hsien-Hsin Sean Lee Georgia Tech -- Performance
Ad

More from MazinAlsaedi1 (20)

PPTX
Mechatronics - Ch-4-th- unit_valves.pptx
PPTX
Mechatronics - Pneumatics _ unit -5.pptx
PPT
Linear and Nonlinear Multivariable_GUI_ControlSysCAD_Part_2.ppt
PPT
Linear and Nonlinear Multivariable_GUI_ControlSysCAD_Part_1.ppt
PPT
SIMOTION D410 Single Axis Industrial Motion Controller _ SIEMENS .ppt
PPT
Steer-by-Wire _ Implications for Vehicle Handling and Safety.ppt
PPT
Introduction to Neural Networks and Fuzzy Logic.ppt
PPT
Fluid Power System Electrical Control_.ppt
PPTX
Theory of Machine course _ Principles _ I.pptx
PPT
Electronic Throttle Control _ 17397474.ppt
PPT
Tire Pressure Monitoring TPMS _ 885221.ppt
PPT
fuzzy logic controllers and PD controllers.ppt
PPT
Mechanical Sensors _ Force _ acceleration_ chapter 6.ppt
PPTX
Introduction to Neural Networks and Fuzzy Logicnnfl-1002.pptx
PPT
Linear and Nonlinear Multivariable GUI_ControlSysCAD_Part_2.ppt
PPT
Linear and Nonlinear Multivariable Feedback Control_GUI_ControlSysCAD_Part_1.ppt
PPT
planindynenvs_meam620_v8_Maxim Likhachev.ppt
PPT
introtomotionplanI_meam620_v9_Maxim Likhachev.ppt
PPT
ComputerVision4_Howie Choset_Renata Melamud.ppt
PPT
INS3_ Inertial Navigation Systems _ 4 sensors.ppt
Mechatronics - Ch-4-th- unit_valves.pptx
Mechatronics - Pneumatics _ unit -5.pptx
Linear and Nonlinear Multivariable_GUI_ControlSysCAD_Part_2.ppt
Linear and Nonlinear Multivariable_GUI_ControlSysCAD_Part_1.ppt
SIMOTION D410 Single Axis Industrial Motion Controller _ SIEMENS .ppt
Steer-by-Wire _ Implications for Vehicle Handling and Safety.ppt
Introduction to Neural Networks and Fuzzy Logic.ppt
Fluid Power System Electrical Control_.ppt
Theory of Machine course _ Principles _ I.pptx
Electronic Throttle Control _ 17397474.ppt
Tire Pressure Monitoring TPMS _ 885221.ppt
fuzzy logic controllers and PD controllers.ppt
Mechanical Sensors _ Force _ acceleration_ chapter 6.ppt
Introduction to Neural Networks and Fuzzy Logicnnfl-1002.pptx
Linear and Nonlinear Multivariable GUI_ControlSysCAD_Part_2.ppt
Linear and Nonlinear Multivariable Feedback Control_GUI_ControlSysCAD_Part_1.ppt
planindynenvs_meam620_v8_Maxim Likhachev.ppt
introtomotionplanI_meam620_v9_Maxim Likhachev.ppt
ComputerVision4_Howie Choset_Renata Melamud.ppt
INS3_ Inertial Navigation Systems _ 4 sensors.ppt
Ad

Recently uploaded (20)

PPTX
CYBER-CRIMES AND SECURITY A guide to understanding
PDF
Automation-in-Manufacturing-Chapter-Introduction.pdf
PPTX
UNIT 4 Total Quality Management .pptx
PDF
Embodied AI: Ushering in the Next Era of Intelligent Systems
PDF
Enhancing Cyber Defense Against Zero-Day Attacks using Ensemble Neural Networks
PPTX
M Tech Sem 1 Civil Engineering Environmental Sciences.pptx
PPTX
MCN 401 KTU-2019-PPE KITS-MODULE 2.pptx
PPT
Project quality management in manufacturing
PDF
composite construction of structures.pdf
PDF
Mohammad Mahdi Farshadian CV - Prospective PhD Student 2026
DOCX
ASol_English-Language-Literature-Set-1-27-02-2023-converted.docx
PDF
Operating System & Kernel Study Guide-1 - converted.pdf
PPT
Mechanical Engineering MATERIALS Selection
PPTX
Sustainable Sites - Green Building Construction
PPTX
OOP with Java - Java Introduction (Basics)
PDF
keyrequirementskkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk
PPTX
CH1 Production IntroductoryConcepts.pptx
PPTX
web development for engineering and engineering
PPTX
KTU 2019 -S7-MCN 401 MODULE 2-VINAY.pptx
PPTX
additive manufacturing of ss316l using mig welding
CYBER-CRIMES AND SECURITY A guide to understanding
Automation-in-Manufacturing-Chapter-Introduction.pdf
UNIT 4 Total Quality Management .pptx
Embodied AI: Ushering in the Next Era of Intelligent Systems
Enhancing Cyber Defense Against Zero-Day Attacks using Ensemble Neural Networks
M Tech Sem 1 Civil Engineering Environmental Sciences.pptx
MCN 401 KTU-2019-PPE KITS-MODULE 2.pptx
Project quality management in manufacturing
composite construction of structures.pdf
Mohammad Mahdi Farshadian CV - Prospective PhD Student 2026
ASol_English-Language-Literature-Set-1-27-02-2023-converted.docx
Operating System & Kernel Study Guide-1 - converted.pdf
Mechanical Engineering MATERIALS Selection
Sustainable Sites - Green Building Construction
OOP with Java - Java Introduction (Basics)
keyrequirementskkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk
CH1 Production IntroductoryConcepts.pptx
web development for engineering and engineering
KTU 2019 -S7-MCN 401 MODULE 2-VINAY.pptx
additive manufacturing of ss316l using mig welding

Robust Multi-objective Iterative Learning Control 13553323.ppt

  • 1. Robust Multi-objective Iterative Learning Control Tong Duy Son Promoters Prof. Jan Swevers Prof. Goele Pipeleers September 2016
  • 5. 1. perform 2. analyze 3. do again (and better) 3rd try
  • 6. 6 Repetitions 1. perform 2. analyze 3. do again (and better)
  • 7. 7 Repetitions in industry vehicle testing batch processes industrial robots semiconductor
  • 8. 8 Repetitions in industry vehicle testing batch processes industrial robots semiconductor control system
  • 9. 9 Challenges Goal of this thesis • Improve the control system • Exploit ‘repetition’ Improvements in • Robustness • Precision • Fast • Energy efficiency
  • 10. 10 Desired output: pick an object from A to B Question: What input should you apply? input desired output Consider a robot arm in a factory Sketch of Control
  • 11. 11 Desired output: pick an object from A to B Question: What input should you apply? input desired output knowledge of the system! Sketch of Control 𝑦= 𝑓 (𝑥 ,𝑢)
  • 12. 12 Sketch of Control Feedback Controller 𝑦= 𝑓 (𝑥 ,𝑢) Feedforward Controller Feedback Feedforward
  • 13. 13 Sketch of Control • Model uncertainty • Disturbance • Transient response, lag • Non-minimum phase • Highly dependent on accuracy of the model • Disturbance has to be known Feedback Feedforward
  • 14. 14 Sketch of Control • Model uncertainty • Disturbance • Transient response, lag • Non-minimum phase • Highly dependent on accuracy of the model • Disturbance has to be known Feedback Feedforward feedforward feedback no control feedforward feedback no control
  • 15. 15 Sketch of Control • Model uncertainty • Disturbance • Transient response, lag • Non-minimum phase • Highly dependent on accuracy of the model • Disturbance has to be known Feedback Feedforward feedforward feedback no control
  • 16. 16 Repetitions in industry same task and same performance hundreds to thousands times a day
  • 17. 17 Revisit: Challenges Goal of this thesis • Improve the control system • Exploit ‘repetition’ Iterative learning control (ILC): improves control performance by incorporating information from previous trials
  • 18. 18 Iterative Learning Control (ILC) Iterative learning control (ILC): improves control performance by incorporating information from previous trials )
  • 19. 19 Main contributions 1. Multi-objective frequency domain ILC 2. Lifted system ILC: analysis and synthesis 3. Robust norm-optimal ILC
  • 20. 20 Main contributions 1. Multi-objective frequency domain ILC 2. Lifted system ILC: analysis and synthesis 3. Robust norm-optimal ILC
  • 21. 21 Introduction (1) Most ILC designs reply on a two-step sequential problem formulation and the design procedures are usually heuristic: • Design L then design Q: 1. L as model-inversion or phase-lead type 2. Q as a low-pass filter: depends on designed • Design Q then design L: 1. design Q 2. find L that optimize the learning speed • Iterate the previous 2 designs The design is not optimal while costly and time consuming! ) designed controller: (Q,L)
  • 22. 22 Introduction (2) Hard to incorporate multi-objective intuitively • Robustness (unmodeled dynamics, uncertain parameter…) 1. Robustness vs tracking performance 2. Unknown: robustness and tracking performance vs learning speed have 1 month training have 4 year training (i.e. for Olympic): more difficult attempts • Input constraints • Trade-offs between the objectives
  • 23. 23 Methodology • Design Q, L simultaneously using optimization • Accounts for the trade-off designs Approach: First, specify the desired performance, input constraints, and robustness conditions. Next, design ILC controller (Q, L) to optimize the convergence (learning) speed with the given specifications minimize convergence speed Q,L subject to robust performance robust convergence input constraints
  • 24. 24 Methodology • Design Q, L simultaneously using optimization • Accounts for the trade-off designs Approach: First, specify the desired performance, input constraints, and robustness conditions. Next, design ILC controller (Q, L) to optimize the convergence (learning) speed with the given specifications minimize convergence speed Q,L subject to robust performance robust convergence input constraints non-convex, hard to solve!
  • 25. 25 Methodology • Design Q, L simultaneously using optimization • Accounts for the trade-off designs Approach: First, specify the desired performance, input constraints, and robustness conditions. Next, design ILC controller (Q, L) to optimize the convergence (learning) speed with the given specifications minimize convergence speed Q,L subject to robust performance robust convergence input constraints non-convex, hard to solve! reformulated as a linear program
  • 27. Advantages (1) Multi-objective and their trade-offs:  convergence speed  input constraints  robust convergence  robust performance optimality computation flexibility intuition multi-objective
  • 28. 28 Advantages (2) Optimality • no 2-step and heuristic design • (Q, L) is simultaneously generated using optimization • noncausal ILC controller optimality computation flexibility intuition multi-objective • reliable as a result of a linear program Computation
  • 29. 29 Advantages (4) Flexibility • controller type: FIR, IIR, PID... • different objectives: minimize tracking performance Q,L subject to convergence speed robust convergence input constraints • no parametric model is required, only FRFs • continuous and discrete • selecting interested frequencies: i.e. for noise and disturbance rejection. optimality computation flexibility intuition multi-objective
  • 30. 30 Advantages (5) Intuition • Use conventional control system terminologies: sensitivity function, bandwidth optimality computation flexibility intuition multi-objective
  • 31. 31 Advantages (5) Intuition • Use conventional control system terminologies: sensitivity function, bandwidth optimality computation flexibility intuition multi-objective • Automated design possible Multi- objective ILC algorithm system model (FRFs) performance specs. (bandwidth) ILC controller (and learning speed)
  • 32. 32 Validation • Validate the proposed ILC designs: simulations and experiments • Validate the multi-objective trade-offs • Compare with existing designs Control Development Simulation & Experimental Validation
  • 33. 33 Validation Control Development Simulation & Experimental Validation tracking performance function (sensitivity function) convergence (learning) speed function
  • 34. 34 Validation Control Development Simulation & Experimental Validation convergence speed vs tracking performance with 2 different designs convergence speed vs input constraints red: no constraint
  • 35. Validation: trade-off designs Control Development Simulation & Experimental Validation 35 Select the desired controller:  desired tracking performance  desired learning speed  level of uncertainty
  • 36. 36 Main contributions 1. Multi-objective frequency domain ILC 2. Lifted system ILC: analysis and synthesis 3. Robust norm-optimal ILC
  • 37. 37 Introduction • Consider multiple objectives as previous, but investigate time domain using lifted system representation of finite trial length. • (Q,L) are matrix variables • Study robust analyses • Proposes ILC syntheses (designs) ) designed controller: (Q,L)
  • 38. 38 Robustness • Robust monotonic convergence and robust performance analyses an LMI (or BMI) problem i.e. • Both unstructured and structured uncertainty are considered
  • 39. 39 Synthesis (for short/moderate trial lengths) • Synthesis I: Optimize convergence speed • Synthesis II: Optimize tracking error ) designed controller: (Q,L) minimize convergence speed L subject to an LMI problem minimize tracking error Q subject to an LMI problem
  • 41. 41 Main contributions 1. Multi-objective frequency domain ILC 2. Lifted system ILC: analysis and synthesis 3. Robust norm-optimal ILC
  • 42. 42 Introduction Norm-optimal ILC is an efficient way to design the optimal ILC input: is the cost function w.r.t the nominal model (no uncertainty model is accounted)  analytical solution (noncausal, time-varying controller) × has to sacrifice a lot tracking performance to obtain robustness 𝐽 (𝑢 𝑗 +1 ❑ ) minimize 𝑢𝑗+1 ❑
  • 43. 43 Methodology • obtain both robustness and high tracking performance • deal with input constraints • efficient computation Approach: optimize the worst-case cost function: 𝐽 (𝑢 𝑗 +1 ❑ , ∆) minimize sup 𝑢𝑗+1 ❑ ∆∈ ℬ∆ subject to input constraints 𝐽 ( ∆ ) ∆ 𝐽 wc 𝐽 nom
  • 44. 44 Methodology • obtain both robustness and high tracking performance • deal with input constraints • efficient computation Approach: optimize the worst-case cost function: 𝐽 (𝑢 𝑗 +1 ❑ , ∆) minimize sup 𝑢𝑗+1 ❑ ∆∈ ℬ∆ subject to input constraints non-convex problem 𝐽 ( ∆ ) ∆ 𝐽 wc 𝐽 nom
  • 45. 45 Methodology • obtain both robustness and high tracking performance • deal with input constraints • efficient computation Approach: optimize the worst-case cost function: 𝐽 (𝑢 𝑗 +1 ❑ , ∆) minimize sup 𝑢𝑗+1 ❑ ∆∈ ℬ∆ subject to input constraints 𝐽dual (𝑢 𝑗 +1 ❑ , 𝛾 𝑗 +1 ❑ ) minimize , subject to input constraints non-convex problem reformulated as a convex problem
  • 46. 46 Advantages  obtain robustness w.r.t. cost function (proved):  deal with input constraints  efficient computation  high tracking performance? 𝐽 ( ∆ ) ∆ 𝐽 wc 𝐽 nom
  • 47. 47 Advantages  obtain robustness w.r.t. cost function (proved): high tracking performance? Considering the same cost function: • if the classical norm-optimal ILC diverges, the proposed robust ILC still converges. • if the classical norm-optimal ILC converges, the robust ILC also converges to similar tracking performance but with lower convergence speed
  • 48. 48 Advantages (cont.)  deal with input constraints  efficient computation  the selection of weight matrices is not critical as other norm- optimal ILC designs.  the proof of the equivalence to an adaptive norm-optimal ILC (trial- varying controller) can be used to avoid solving optimization if needed (i.e. when convergence is already obtained).
  • 49. 49 Validation Control Development Simulation & Experimental Validation • Validate the proposed ILC designs: simulations and experiments • Compare with classical (robust and non-robust) norm-optimal ILC: accurate model, inaccurate model
  • 50. 50 Validation Control Development Simulation & Experimental Validation • Validate the proposed ILC designs: simulations and experiments • Compare with classical (robust and non-robust) norm-optimal ILC: accurate model, inaccurate model accurate model inaccurate model red: classical norm- optimal ILC blue: proposed ILC black: other robust design
  • 51. 51 Validation Control Development Simulation & Experimental Validation • Validate the proposed ILC designs: simulations and experiments • Compare with classical (robust and non-robust) norm-optimal ILC: accurate model, inaccurate model accurate model
  • 52. 52 Main contributions 1. Multi-objective frequency domain ILC 2. Lifted system ILC: analysis and synthesis 3. Robust norm-optimal ILC
  • 53. 53 Summary 1. Robust ILC: robustness and high tracking performance, frequency and time domain 2. Multiple objectives and their trade-offs 3. Efficient computation 4. Extensive simulation and experimental validations: guideline to select the suitable controller
  • 54. 54 Future works 1. Multivariable (MIMO) systems 2. Different classes of uncertainty modelling 3. Robust ILC nonlinear optimization 4. ILC for different purposes: energy optimal, time-optimal… 5. Applications (human in the loop, distributed systems…)
  • 55. 55 Thank you! More detailed information: https://tongduyson.github.io/publication.html
  • 56. 56 Conservative: small Evaluate the original constraints: and using both simulation and experiments for different system models) The differences are small hence small conservative. page 69 (thesis)
  • 57. 57 (near) Future works Multivariable (MIMO) systems performance condition:
  • 58. 58 (near) Future works 2-order controllers generated from the optimization problem:

Editor's Notes