SlideShare a Scribd company logo
Searching for Dynamical Resemblance Between Time Series - A Method Based on Nonlinear AutoRegressive Models Gladstone Barbosa Alves ¥ Viviane Cota Silva ¥ Marcelo Vieira Corrêa §   ¥  Laboratório de Modelagem, Análise e Controle de Sistemas Não-Lineares Centro de Pesquisa e Desenvolvimento em Engenharia Elétrica – CPDEE Universidade Federal de Minas Gerais – UFMG Av. Antônio Carlos 6627, 31270-901 Belo Horizonte, M.G., Brasil §  Centro Universitário do Leste de Minas Gerais – UnilesteMG  Av. Tancredo Neves, 3500, 35170-056 Coronel Fabriciano, M.G., Brasil [email_address] ,  vivianne@cpdee.ufmg.br,   [email_address] XIV Congresso Brasileiro de Automática Natal/RN  02-05/setembro, 2002
Summary Introduction; Background:  the polynomial NARMAX representation; recovering the eigenvalue function from polynomial NARX models; The procedure to search for dynamical resemblance based on polynomial NARMAX models;  Example: data from a monthly average river flow; Concluding remarks.
Introduction    Methods for time series analysis:  linear systems theory;  nonlinear dynamics theory. NARMAX:    a suggestion for the nonstationary and short time series analysis problem;  an advantageous tool to detect dynamical closeness.
Background The polynomial NARMAX model representation First-order NARX model
Background Recovering the eigenvalue function from a first-order polynomial NARX model: linearization For models with  the eigenvalues will be determined as the roots of a polynomial with degree
The procedure to search for dynamical resemblance based on polynomial NARX models    Definition of a model input: correlated time series/a sine wave with period similar to that present in the time series;     Structure selection(using the entire data set) of the NARMAX model which will be kept fixed during all the procedure: ERR;    Selection of appropriate data windows to be used in the parameter estimation of the chosen model structure: prior knowledge;    Parameter estimation of the selected structure: a single model for each data window;    Determination of the eigenvalues variation of the estimated models and comparison of the recovered configurations.  Steps:
Application: a case study The data: monthly average river flow  Monthly average flow of Doce river at the State of Minas Gerais. Horizontal axis is the monthly samples from 1939 to 1989 and vertical axis is the average flow in mm/s (annual period).  Linear autocorrelation function of the original flow data, for the first 200 lags. The lags are measured in months. The dashed lines represent a confidence interval. The signal is auto-correlated with periodicity of approximately twelve samples (annual period).
   Investigation based on linear autoregressive models: assessing dynamical properties using forecasts    Linear models were obtained using the window 1;    Forecasts of 1, 2 and 3 steps ahead over all data windows;     AR models;    AR-MA models;    It seems that the dynamics of window 1 is very similar to that of the window 6. Application: a case study    Time series empirically divided into 6 windows of 100 samples each;
Analysis of the AR and AR-MA models performance along 6 windows of data Results of the linear models’ one step ahead forecasts Application: a case study
Results of the linear models’ two step ahead forecasts Results of the linear models’ three step ahead forecasts Application: a case study
Investigation based on polynomial NARMAX models    Input: a 12-samples period sine wave signal, with unitary amplitude;    NARX model structure selected by the ERR:  Application: a case study
Eigenvalues associated with the “stationary states” of the models obtained for each selected data window . From left to right and from top to bottom Window 1 - Window 6. Application: a case study
Concluding Remarks    Case study results:  U nderlying dynamics of windows 1 and 6 are somewhat closed (prelimary conclusion obtained by the linear model forecasts and by proposed NARMAX approach);  Suggests the existence of a “hidden” periodic cycle, implicit in the data (different of the annual one).    Proposed scheme:  It is believed that the NARMAX approach suggested here has a more consistent dynamical character than just using forecasts.

More Related Content

PDF
Penggunaan regresi kuadrat terkecil parsial abstract
PDF
CAD -- CUSUM Anomaly Detection
PDF
Aristotle boyd martin-peci_poster_2017
PPTX
PPTX
WolframAlpha Examples part 3
PPTX
WolframAlpha Examples part 4
PPT
Vldb14
PDF
Paper Poster presented at 10th GCPS 2014 - Liquid Fuels Release Rate Calculat...
Penggunaan regresi kuadrat terkecil parsial abstract
CAD -- CUSUM Anomaly Detection
Aristotle boyd martin-peci_poster_2017
WolframAlpha Examples part 3
WolframAlpha Examples part 4
Vldb14
Paper Poster presented at 10th GCPS 2014 - Liquid Fuels Release Rate Calculat...

Viewers also liked (20)

PDF
Anderson Manuscript
PPT
Providing Individualized Student Assessment Feedback
PPT
Student Searches
PDF
Merzer H
PPTX
Master programs
PDF
ENT3 Kingdom of God
PPT
Дом народной дружины
ZIP
Osseo Apps: Introduction
PPT
Harvest Fast Day 09 parish Powerpoint
PPT
CSIS 138 JavaScript Class3
DOCX
Vivian Gunn Morris and Curtis Morris, NATIONAL FORUM JOURNALS, Dr. William Al...
ODP
Control I RobòTica
PPTX
Beaver-Results Austria
PPT
No Child Left Behind
PPS
Income Tax National Language
PDF
A pilot study of effectiveness of homoeopathic treatment in management of alc...
PPT
Libguide
PPT
Keyphrase analysis tools for Search Engine Marketing
PPT
Biograf
PDF
Christmas: Light Shines Through Darkness
Anderson Manuscript
Providing Individualized Student Assessment Feedback
Student Searches
Merzer H
Master programs
ENT3 Kingdom of God
Дом народной дружины
Osseo Apps: Introduction
Harvest Fast Day 09 parish Powerpoint
CSIS 138 JavaScript Class3
Vivian Gunn Morris and Curtis Morris, NATIONAL FORUM JOURNALS, Dr. William Al...
Control I RobòTica
Beaver-Results Austria
No Child Left Behind
Income Tax National Language
A pilot study of effectiveness of homoeopathic treatment in management of alc...
Libguide
Keyphrase analysis tools for Search Engine Marketing
Biograf
Christmas: Light Shines Through Darkness
Ad

Similar to Searching for Dynamical Resemblance Between Time Series: A Method Based on Nonlinear Autoregressive Models (20)

PPTX
Determining reservoir outflow using machine learning techniques.pptx
PDF
J0342054059
PDF
Disaggregation of Annual to daily Streamflows: A lineardeterministic method
PDF
Different Models Used In Time Series - InsideAIML
PPTX
PDF
Non-Temporal ARIMA Models in Statistical Research
PDF
H0331043046
PDF
WATERSHED MODELING USING ARTIFICIAL NEURAL NETWORKS
PDF
Performance improvement of a Rainfall Prediction Model using Particle Swarm O...
PDF
Ax4301259274
PPTX
FINAL [Autosaved]
PDF
ANN Modeling of Monthly and Weekly Behaviour of the Runoff of Kali River Catc...
DOCX
Optimizing Numerical Weather Prediction Model Performance Using Machine Learn...
PDF
AnnualAutomobileSalesPredictionusingARIMAModel (2).pdf
PDF
1 s2.0-s0309170811002351-main
PDF
Multi-task learning using non-linear autoregressive models and recurrent neur...
PPTX
Ali asgher slides copy
PDF
timeseries cheat sheet with example code for R
PPTX
Time Series Analysis - 2 | Time Series in R | ARIMA Model Forecasting | Data ...
PDF
Program on Mathematical and Statistical Methods for Climate and the Earth Sys...
Determining reservoir outflow using machine learning techniques.pptx
J0342054059
Disaggregation of Annual to daily Streamflows: A lineardeterministic method
Different Models Used In Time Series - InsideAIML
Non-Temporal ARIMA Models in Statistical Research
H0331043046
WATERSHED MODELING USING ARTIFICIAL NEURAL NETWORKS
Performance improvement of a Rainfall Prediction Model using Particle Swarm O...
Ax4301259274
FINAL [Autosaved]
ANN Modeling of Monthly and Weekly Behaviour of the Runoff of Kali River Catc...
Optimizing Numerical Weather Prediction Model Performance Using Machine Learn...
AnnualAutomobileSalesPredictionusingARIMAModel (2).pdf
1 s2.0-s0309170811002351-main
Multi-task learning using non-linear autoregressive models and recurrent neur...
Ali asgher slides copy
timeseries cheat sheet with example code for R
Time Series Analysis - 2 | Time Series in R | ARIMA Model Forecasting | Data ...
Program on Mathematical and Statistical Methods for Climate and the Earth Sys...
Ad

More from Gladstone Alves (7)

PDF
Planejamento Estratégico em Ambiente de Incerteza
PPT
Fuzzy Basis Functions for Modeling Nonlinear Dynamics
PPT
Forward Contracting and Investment in Electrical Generation Capacity
PPT
Biomimicry of Bacterial Chemotaxis for Optimization
PPT
Basis Functions in Radial Basis Function Network Models
PDF
Radial Basis Function Networks and Systems Identification
PDF
Gladstone's tentative resume
Planejamento Estratégico em Ambiente de Incerteza
Fuzzy Basis Functions for Modeling Nonlinear Dynamics
Forward Contracting and Investment in Electrical Generation Capacity
Biomimicry of Bacterial Chemotaxis for Optimization
Basis Functions in Radial Basis Function Network Models
Radial Basis Function Networks and Systems Identification
Gladstone's tentative resume

Recently uploaded (20)

PDF
Profit Center Accounting in SAP S/4HANA, S4F28 Col11
PPTX
Machine Learning_overview_presentation.pptx
PPTX
20250228 LYD VKU AI Blended-Learning.pptx
PDF
Mobile App Security Testing_ A Comprehensive Guide.pdf
PPTX
Big Data Technologies - Introduction.pptx
PPTX
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
PDF
Optimiser vos workloads AI/ML sur Amazon EC2 et AWS Graviton
PPTX
Cloud computing and distributed systems.
PPTX
A Presentation on Artificial Intelligence
PDF
Encapsulation_ Review paper, used for researhc scholars
PDF
Per capita expenditure prediction using model stacking based on satellite ima...
PDF
Machine learning based COVID-19 study performance prediction
PDF
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
PDF
Chapter 3 Spatial Domain Image Processing.pdf
PDF
Encapsulation theory and applications.pdf
PDF
Review of recent advances in non-invasive hemoglobin estimation
PPTX
Programs and apps: productivity, graphics, security and other tools
PDF
Approach and Philosophy of On baking technology
PDF
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
PPTX
Spectroscopy.pptx food analysis technology
Profit Center Accounting in SAP S/4HANA, S4F28 Col11
Machine Learning_overview_presentation.pptx
20250228 LYD VKU AI Blended-Learning.pptx
Mobile App Security Testing_ A Comprehensive Guide.pdf
Big Data Technologies - Introduction.pptx
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
Optimiser vos workloads AI/ML sur Amazon EC2 et AWS Graviton
Cloud computing and distributed systems.
A Presentation on Artificial Intelligence
Encapsulation_ Review paper, used for researhc scholars
Per capita expenditure prediction using model stacking based on satellite ima...
Machine learning based COVID-19 study performance prediction
Build a system with the filesystem maintained by OSTree @ COSCUP 2025
Chapter 3 Spatial Domain Image Processing.pdf
Encapsulation theory and applications.pdf
Review of recent advances in non-invasive hemoglobin estimation
Programs and apps: productivity, graphics, security and other tools
Approach and Philosophy of On baking technology
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
Spectroscopy.pptx food analysis technology

Searching for Dynamical Resemblance Between Time Series: A Method Based on Nonlinear Autoregressive Models

  • 1. Searching for Dynamical Resemblance Between Time Series - A Method Based on Nonlinear AutoRegressive Models Gladstone Barbosa Alves ¥ Viviane Cota Silva ¥ Marcelo Vieira Corrêa § ¥ Laboratório de Modelagem, Análise e Controle de Sistemas Não-Lineares Centro de Pesquisa e Desenvolvimento em Engenharia Elétrica – CPDEE Universidade Federal de Minas Gerais – UFMG Av. Antônio Carlos 6627, 31270-901 Belo Horizonte, M.G., Brasil § Centro Universitário do Leste de Minas Gerais – UnilesteMG Av. Tancredo Neves, 3500, 35170-056 Coronel Fabriciano, M.G., Brasil [email_address] , vivianne@cpdee.ufmg.br, [email_address] XIV Congresso Brasileiro de Automática Natal/RN 02-05/setembro, 2002
  • 2. Summary Introduction; Background: the polynomial NARMAX representation; recovering the eigenvalue function from polynomial NARX models; The procedure to search for dynamical resemblance based on polynomial NARMAX models; Example: data from a monthly average river flow; Concluding remarks.
  • 3. Introduction  Methods for time series analysis:  linear systems theory;  nonlinear dynamics theory. NARMAX:  a suggestion for the nonstationary and short time series analysis problem;  an advantageous tool to detect dynamical closeness.
  • 4. Background The polynomial NARMAX model representation First-order NARX model
  • 5. Background Recovering the eigenvalue function from a first-order polynomial NARX model: linearization For models with the eigenvalues will be determined as the roots of a polynomial with degree
  • 6. The procedure to search for dynamical resemblance based on polynomial NARX models  Definition of a model input: correlated time series/a sine wave with period similar to that present in the time series;  Structure selection(using the entire data set) of the NARMAX model which will be kept fixed during all the procedure: ERR;  Selection of appropriate data windows to be used in the parameter estimation of the chosen model structure: prior knowledge;  Parameter estimation of the selected structure: a single model for each data window;  Determination of the eigenvalues variation of the estimated models and comparison of the recovered configurations. Steps:
  • 7. Application: a case study The data: monthly average river flow Monthly average flow of Doce river at the State of Minas Gerais. Horizontal axis is the monthly samples from 1939 to 1989 and vertical axis is the average flow in mm/s (annual period). Linear autocorrelation function of the original flow data, for the first 200 lags. The lags are measured in months. The dashed lines represent a confidence interval. The signal is auto-correlated with periodicity of approximately twelve samples (annual period).
  • 8. Investigation based on linear autoregressive models: assessing dynamical properties using forecasts  Linear models were obtained using the window 1;  Forecasts of 1, 2 and 3 steps ahead over all data windows;  AR models;  AR-MA models;  It seems that the dynamics of window 1 is very similar to that of the window 6. Application: a case study  Time series empirically divided into 6 windows of 100 samples each;
  • 9. Analysis of the AR and AR-MA models performance along 6 windows of data Results of the linear models’ one step ahead forecasts Application: a case study
  • 10. Results of the linear models’ two step ahead forecasts Results of the linear models’ three step ahead forecasts Application: a case study
  • 11. Investigation based on polynomial NARMAX models  Input: a 12-samples period sine wave signal, with unitary amplitude;  NARX model structure selected by the ERR: Application: a case study
  • 12. Eigenvalues associated with the “stationary states” of the models obtained for each selected data window . From left to right and from top to bottom Window 1 - Window 6. Application: a case study
  • 13. Concluding Remarks  Case study results:  U nderlying dynamics of windows 1 and 6 are somewhat closed (prelimary conclusion obtained by the linear model forecasts and by proposed NARMAX approach);  Suggests the existence of a “hidden” periodic cycle, implicit in the data (different of the annual one).  Proposed scheme:  It is believed that the NARMAX approach suggested here has a more consistent dynamical character than just using forecasts.