SlideShare a Scribd company logo
Wavelet Multi-resolution Analysis of High Frequency FX Rates Department of Computing University of Surrey, Guildford, UK August 27, 2004 Intelligent Data Engineering and Automated Learning - IDEAL 2004 5th International Conference, Exeter, UK
Talk Outline Describing Time Series Data Financial Time Series Data Characteristics  Wavelet Multiscale Analysis Our Time Series Analysis Approach - Algorithms - Prototype System - Case Study - Conclusions Questions
What Is a Time Series? A chronologically arranged sequence of data on a particular variable Obtained at regular time interval Assumes that factors influencing past and present will continue
U.S. Retail Sales Quarterly Data
Time Series Components Trend Seasonal Cyclical Irregular TS Data
Trend Component Indicates the very long-term behavior of the time series Typically as a straight line or an exponential curve This is useful in seeing the overall picture
Cyclical Component A non-seasonal component which varies in a recognizable period Peak Contraction Trough Expansion Due to interactions of economic factors The cyclic variation is especially difficult to forecast beyond the immediate future    more of a local phenomenon Time
Seasonal Component Regular pattern of up and down fluctuations within a fixed time Due to weather, customs etc. Periods of fluctuations more regular, hence more profitable for forecasting Time
Irregular Component Random, unsystematic, “residual” fluctuations Due to random variation or unforeseen events Short duration and non-repeating A forecast, even in the best situation, can be no closer (on average) than the typical size of the irregular variation
Time Series Data Broken-Down* Trend Seasonal  Index Cyclic Behavior Irregular TS Data *For illustration purposes only.
Financial Time Series  Data Characteristics Evolve in a  nonlinear  fashion over time Exhibit quite complicated patterns, like  trends ,  abrupt changes , and  volatility clustering , which appear, disappear, and re-appear over time     nonstationary  There may be purely  local changes  in  time  domain,  global changes  in  frequency  domain, and there may be  changes  in the  variance parameters
Financial Time Series  Data Characteristics IBM Prices IBM Volatility Nonstationary Time Varying Volatility
The nonlinearities and nostationarities  do  contain  certain  regularities or  patterns Therefore, an analysis of nonlinear time series data would involve quantitatively  capturing  such regularities or  patterns   effectively Financial Time Series  Data Characteristics Having said that… How and Why?
Wavelet Multiscale Analysis Wavelets are mathematical functions that cut up data into different frequency components and then study each component with a resolution matched to its scale Wavelets are treated as a ‘lens’ that enables the researcher to explore relationships that were previously unobservable Provides a unique decomposition (deconstruction) of a time series in ways that are potentially revealing Overview
Step I:  Take a wavelet and compare it to a section at the start of the  original signal. Calculate  C  to measure closeness ( correlation ) of wavelet with signal Wavelet Multiscale Analysis Signal Wavelet C = C1
Signal Step II:  Keep shifting the wavelet to the right and repeating Step I until whole signal is covered Wavelet Multiscale Analysis Wavelet C = C2
Signal Wavelet Multiscale Analysis Wavelet C = C3 Step III:  Scale ( stretch ) the wavelet and repeat Steps I & II Step IV:  Repeat Steps I to III for all scales
Wavelet Multiscale Analysis Discrete Convolution:   The original signal is  convolved  with a set of high or low pass filters corresponding to the  prototype  wavelet X t    Original Signal W    High or low pass filters Filter Bank Approach
Wavelet Multiscale Analysis Filter Bank Approach H (f) G (f) G* (f) 2 H* (f) X t D 1 A 1 H : Bank of High Pass filters G : Bank of Low Pass filters H (f) – high-pass decomposition filter H* (f) – high-pass reconstruction filter G (f) – low-pass decomposition filter G* (f) – low-pass reconstruction filter Up arrow with 2 – upsampling by 2 Down arrow with 2 – downsampling by 2   2 2 2 X t A 1 D 1 A 1 A 2 D 2 A 2 A 3 D 3 L Level 1 X t  = A 1  + D 1 Level 2 Level 3 L L H H L X t  = A 2  + D 1 + D 2 X t  = A 3  + D 1 + D 2  + D 3 Level N Frequency X t  = A N  + D 1 + D 2  + … D N Iteration gives scaling effect  at each level Mallat’s Pyramidal Filtering Approach
Wavelet Multiscale Analysis Wavelet Decompositions   Fourier Power Spectrum  Level - 1 Level - 2 Level - 3 FTSE 100 FFT (1) FFT (2) FFT (3) FFT (FTSE)
Analyzing High-frequency Financial Data: Our Approach Tick Data Preprocessing Transformation Knowledge Discovery Forecast Data  Compression Multiscale  Analysis Prediction Summarization Aggregate  the  movement in the  dataset over a  certain  period of time Use the DWT  to  deconstruct   the series Describe market  dynamics at  different scales  (time horizons) with  chief features Use the  extracted  ‘ chief features’  to  predict   Cycle Trend Turning Points Variance Change
Analyzing High-frequency Financial Data: Our Approach Generalized Algorithm:  Summarization I. Compress  the tick data to get Open (O), High (H), Low (L) and Close (C) value for a given compression period (for example, one minute or five minutes).  II. Calculate the level L of the DWT needed based on number of samples N in C of Step I, L = floor [log (N)/log (2)]. III. Perform a  level-L DWT  on  C  based on results of Step I and Step II to get, D i , i = 1, . . ., L, and  A L .   III-1. Compute  trend  by performing linear regression on  A L . III-2. Extract  cycle  (seasonality) by performing a Fourier power spectrum analysis on each  D i  and choosing the  D i  with maximum power as  D S . III-3. Extract  turning points  by choosing extremas of each  D i .   IV. Locate a single  variance change  in the series by using the NCSS index on  C . V. Generate a graphical and verbal  summary  for results of Steps III-1 to III-3 and IV.
Analyzing High-frequency Financial Data: Our Approach Generalized Algorithm:  Prediction I. Summarize  the tick data using the time series summarization algorithm. II. For a N-step ahead  forecast ,  extend the seasonal  component  D S   symmetrically  N points to the right to get  D S, forecast . III. For a N-step ahead  forecast ,  extend the trend component   A N   linearly  N points to the right to get  A N, forecast .   IV. Add the results of Steps II and III to get an  aggregate  N-step ahead  forecast ,  Forecast  = D S, forecast  + A N, forecast .
Analyzing High-frequency Financial Data: Our Approach A  prototype system  has been implemented that  automatically extracts “chief features” from a time series and give a prediction based on the extracted features, namely  trend  and  seasonality Raw Signal Volatility DWT Statistic NCSS DWT FFT Detect Turning Points and Trends Detect Inherent Cycles Detect Variance Change Summarization Prediction
Analyzing High-frequency Financial Data: Our Approach A Case Study Consider the five minutes compressed tick data for the £/$ exchange rate on March 18, 2004   Input Data System Output Feature Phrases Details Trend 1 st  Phase 2 nd  Phase Turning Points Downturns 108, 132, 164, and 178 Upturns 5, 12, 20 36, 68, and 201 Variance Change Location 164 Cycle Period 42 Peaks at 21, 54, 117, 181, 215, and 278
Analyzing High-frequency Financial Data: Our Approach A Case Study For  prediction , we use the ‘chief features’ of the previous day (March 18, 2004), information about the  dominant cycle and trend (summarization), to reproduce the elements of the series for the following  day (March 19, 2004): System Output Actual March 19, 2004 Predicted (seasonal + trend) March 19, 2004 Root Means Square Error =  0.0000381   Correlation =  + 62.4 %
Analyzing High-frequency Financial Data: Our Approach Conclusions We have  presented  a time series summarization, annotation, and prediction framework based on the multiscale wavelet analysis to deal with nonstationary, volatile and high frequency financial data   Multiscale analysis  can effectively  deconstruct  the total series into its constituent time scales: specific forecasting techniques can be applied to each timescale series to gain  efficiency in forecast Results   of experiments performed on Intraday exchange data  show promise  for summarizing and predicting highly volatile time series   Continuously evolving  and randomly shocked  economic systems  demand for a  more rigorous  and extended  analysis , which is being planned   Successful analysis of  agents   operating  on  several scales  simultaneously and of  modeling these components  could result in more  exact forecasts
Questions / Comments

More Related Content

PPT
Cryptography and Network Security William Stallings Lawrie Brown
PPTX
2.3 criptografia
PPTX
Trusted systems1
PPTX
Identity Theft
PPTX
Chapter- I introduction
PPTX
Cyber Security Workshop Presentation.pptx
PPT
ch01.ppt
PDF
Database forensics
Cryptography and Network Security William Stallings Lawrie Brown
2.3 criptografia
Trusted systems1
Identity Theft
Chapter- I introduction
Cyber Security Workshop Presentation.pptx
ch01.ppt
Database forensics

Similar to Wavelet Multi-resolution Analysis of High Frequency FX Rates (20)

PPTX
Thinkport meets Frankfurt | "Financial Time Series Analysis using Wavelets" -...
PPT
Stock market trading simulator multiagent based-2009-Cadiz-Spain
PDF
IRJET-Forecasting of Time Series Data using Hybrid ARIMA Model with the Wavel...
PDF
Time series
PPT
Lec11.ppt
PDF
Time Series Analysis in R: A Beginner-Friendly Guide for Economics and Financ...
PPT
Time Series Analysis and Forecasting.ppt
PPT
Time Series Analysis and Forecasting.ppt
PDF
Financial Forecasting Using Wavelet Analysis
PDF
Data Science - Part XVI - Fourier Analysis
PDF
6-130914140240-phpapp01.pdf
PPTX
timeseries_analysis.pptx a unique approach to solve the time related data
PDF
Timeseries forecasting
PDF
Time series and forecasting from wikipedia
PPT
Time Series Analysis and Forecasting.ppt
PPTX
Presentation On Time Series Analysis in Mechine Learning
PPTX
Spectral analysis methods
PPTX
Time series data analysis - Introduction to
PDF
MFx_Module_3_Properties_of_Time_Series.pdf
Thinkport meets Frankfurt | "Financial Time Series Analysis using Wavelets" -...
Stock market trading simulator multiagent based-2009-Cadiz-Spain
IRJET-Forecasting of Time Series Data using Hybrid ARIMA Model with the Wavel...
Time series
Lec11.ppt
Time Series Analysis in R: A Beginner-Friendly Guide for Economics and Financ...
Time Series Analysis and Forecasting.ppt
Time Series Analysis and Forecasting.ppt
Financial Forecasting Using Wavelet Analysis
Data Science - Part XVI - Fourier Analysis
6-130914140240-phpapp01.pdf
timeseries_analysis.pptx a unique approach to solve the time related data
Timeseries forecasting
Time series and forecasting from wikipedia
Time Series Analysis and Forecasting.ppt
Presentation On Time Series Analysis in Mechine Learning
Spectral analysis methods
Time series data analysis - Introduction to
MFx_Module_3_Properties_of_Time_Series.pdf
Ad

More from aiQUANT (10)

PDF
Finding the Best Liquidity in Dark Pools
PDF
FIX Protocol Overview.
PDF
FIX Protocol Overview.
PDF
Multirate
PPT
Wavelet
PPT
Spline Interpolation
PPT
Philip Genetic Programming In Statistical Arbitrage
PPT
Stock Market Data Analysis Using Rescaled Range
PPT
Cgo2007 P3 3 Birkbeck
PPT
A Dimension Abstraction Approach to Vectorization in Matlab
Finding the Best Liquidity in Dark Pools
FIX Protocol Overview.
FIX Protocol Overview.
Multirate
Wavelet
Spline Interpolation
Philip Genetic Programming In Statistical Arbitrage
Stock Market Data Analysis Using Rescaled Range
Cgo2007 P3 3 Birkbeck
A Dimension Abstraction Approach to Vectorization in Matlab
Ad

Recently uploaded (20)

PDF
Reconciliation AND MEMORANDUM RECONCILATION
DOCX
unit 2 cost accounting- Tender and Quotation & Reconciliation Statement
PDF
IFRS Notes in your pocket for study all the time
PPT
Chapter four Project-Preparation material
PDF
Stem Cell Market Report | Trends, Growth & Forecast 2025-2034
PPTX
5 Stages of group development guide.pptx
PDF
Elevate Cleaning Efficiency Using Tallfly Hair Remover Roller Factory Expertise
PDF
Business model innovation report 2022.pdf
PPTX
ICG2025_ICG 6th steering committee 30-8-24.pptx
PDF
Unit 1 Cost Accounting - Cost sheet
PDF
BsN 7th Sem Course GridNNNNNNNN CCN.pdf
PPTX
Principles of Marketing, Industrial, Consumers,
PPTX
Dragon_Fruit_Cultivation_in Nepal ppt.pptx
PDF
Laughter Yoga Basic Learning Workshop Manual
PDF
pdfcoffee.com-opt-b1plus-sb-answers.pdfvi
PPTX
Probability Distribution, binomial distribution, poisson distribution
PPT
340036916-American-Literature-Literary-Period-Overview.ppt
PPTX
job Avenue by vinith.pptxvnbvnvnvbnvbnbmnbmbh
PDF
COST SHEET- Tender and Quotation unit 2.pdf
PPTX
AI-assistance in Knowledge Collection and Curation supporting Safe and Sustai...
Reconciliation AND MEMORANDUM RECONCILATION
unit 2 cost accounting- Tender and Quotation & Reconciliation Statement
IFRS Notes in your pocket for study all the time
Chapter four Project-Preparation material
Stem Cell Market Report | Trends, Growth & Forecast 2025-2034
5 Stages of group development guide.pptx
Elevate Cleaning Efficiency Using Tallfly Hair Remover Roller Factory Expertise
Business model innovation report 2022.pdf
ICG2025_ICG 6th steering committee 30-8-24.pptx
Unit 1 Cost Accounting - Cost sheet
BsN 7th Sem Course GridNNNNNNNN CCN.pdf
Principles of Marketing, Industrial, Consumers,
Dragon_Fruit_Cultivation_in Nepal ppt.pptx
Laughter Yoga Basic Learning Workshop Manual
pdfcoffee.com-opt-b1plus-sb-answers.pdfvi
Probability Distribution, binomial distribution, poisson distribution
340036916-American-Literature-Literary-Period-Overview.ppt
job Avenue by vinith.pptxvnbvnvnvbnvbnbmnbmbh
COST SHEET- Tender and Quotation unit 2.pdf
AI-assistance in Knowledge Collection and Curation supporting Safe and Sustai...

Wavelet Multi-resolution Analysis of High Frequency FX Rates

  • 1. Wavelet Multi-resolution Analysis of High Frequency FX Rates Department of Computing University of Surrey, Guildford, UK August 27, 2004 Intelligent Data Engineering and Automated Learning - IDEAL 2004 5th International Conference, Exeter, UK
  • 2. Talk Outline Describing Time Series Data Financial Time Series Data Characteristics Wavelet Multiscale Analysis Our Time Series Analysis Approach - Algorithms - Prototype System - Case Study - Conclusions Questions
  • 3. What Is a Time Series? A chronologically arranged sequence of data on a particular variable Obtained at regular time interval Assumes that factors influencing past and present will continue
  • 4. U.S. Retail Sales Quarterly Data
  • 5. Time Series Components Trend Seasonal Cyclical Irregular TS Data
  • 6. Trend Component Indicates the very long-term behavior of the time series Typically as a straight line or an exponential curve This is useful in seeing the overall picture
  • 7. Cyclical Component A non-seasonal component which varies in a recognizable period Peak Contraction Trough Expansion Due to interactions of economic factors The cyclic variation is especially difficult to forecast beyond the immediate future  more of a local phenomenon Time
  • 8. Seasonal Component Regular pattern of up and down fluctuations within a fixed time Due to weather, customs etc. Periods of fluctuations more regular, hence more profitable for forecasting Time
  • 9. Irregular Component Random, unsystematic, “residual” fluctuations Due to random variation or unforeseen events Short duration and non-repeating A forecast, even in the best situation, can be no closer (on average) than the typical size of the irregular variation
  • 10. Time Series Data Broken-Down* Trend Seasonal Index Cyclic Behavior Irregular TS Data *For illustration purposes only.
  • 11. Financial Time Series Data Characteristics Evolve in a nonlinear fashion over time Exhibit quite complicated patterns, like trends , abrupt changes , and volatility clustering , which appear, disappear, and re-appear over time  nonstationary There may be purely local changes in time domain, global changes in frequency domain, and there may be changes in the variance parameters
  • 12. Financial Time Series Data Characteristics IBM Prices IBM Volatility Nonstationary Time Varying Volatility
  • 13. The nonlinearities and nostationarities do contain certain regularities or patterns Therefore, an analysis of nonlinear time series data would involve quantitatively capturing such regularities or patterns effectively Financial Time Series Data Characteristics Having said that… How and Why?
  • 14. Wavelet Multiscale Analysis Wavelets are mathematical functions that cut up data into different frequency components and then study each component with a resolution matched to its scale Wavelets are treated as a ‘lens’ that enables the researcher to explore relationships that were previously unobservable Provides a unique decomposition (deconstruction) of a time series in ways that are potentially revealing Overview
  • 15. Step I: Take a wavelet and compare it to a section at the start of the original signal. Calculate C to measure closeness ( correlation ) of wavelet with signal Wavelet Multiscale Analysis Signal Wavelet C = C1
  • 16. Signal Step II: Keep shifting the wavelet to the right and repeating Step I until whole signal is covered Wavelet Multiscale Analysis Wavelet C = C2
  • 17. Signal Wavelet Multiscale Analysis Wavelet C = C3 Step III: Scale ( stretch ) the wavelet and repeat Steps I & II Step IV: Repeat Steps I to III for all scales
  • 18. Wavelet Multiscale Analysis Discrete Convolution: The original signal is convolved with a set of high or low pass filters corresponding to the prototype wavelet X t  Original Signal W  High or low pass filters Filter Bank Approach
  • 19. Wavelet Multiscale Analysis Filter Bank Approach H (f) G (f) G* (f) 2 H* (f) X t D 1 A 1 H : Bank of High Pass filters G : Bank of Low Pass filters H (f) – high-pass decomposition filter H* (f) – high-pass reconstruction filter G (f) – low-pass decomposition filter G* (f) – low-pass reconstruction filter Up arrow with 2 – upsampling by 2 Down arrow with 2 – downsampling by 2 2 2 2 X t A 1 D 1 A 1 A 2 D 2 A 2 A 3 D 3 L Level 1 X t = A 1 + D 1 Level 2 Level 3 L L H H L X t = A 2 + D 1 + D 2 X t = A 3 + D 1 + D 2 + D 3 Level N Frequency X t = A N + D 1 + D 2 + … D N Iteration gives scaling effect at each level Mallat’s Pyramidal Filtering Approach
  • 20. Wavelet Multiscale Analysis Wavelet Decompositions Fourier Power Spectrum Level - 1 Level - 2 Level - 3 FTSE 100 FFT (1) FFT (2) FFT (3) FFT (FTSE)
  • 21. Analyzing High-frequency Financial Data: Our Approach Tick Data Preprocessing Transformation Knowledge Discovery Forecast Data Compression Multiscale Analysis Prediction Summarization Aggregate the movement in the dataset over a certain period of time Use the DWT to deconstruct the series Describe market dynamics at different scales (time horizons) with chief features Use the extracted ‘ chief features’ to predict Cycle Trend Turning Points Variance Change
  • 22. Analyzing High-frequency Financial Data: Our Approach Generalized Algorithm: Summarization I. Compress the tick data to get Open (O), High (H), Low (L) and Close (C) value for a given compression period (for example, one minute or five minutes). II. Calculate the level L of the DWT needed based on number of samples N in C of Step I, L = floor [log (N)/log (2)]. III. Perform a level-L DWT on C based on results of Step I and Step II to get, D i , i = 1, . . ., L, and A L . III-1. Compute trend by performing linear regression on A L . III-2. Extract cycle (seasonality) by performing a Fourier power spectrum analysis on each D i and choosing the D i with maximum power as D S . III-3. Extract turning points by choosing extremas of each D i . IV. Locate a single variance change in the series by using the NCSS index on C . V. Generate a graphical and verbal summary for results of Steps III-1 to III-3 and IV.
  • 23. Analyzing High-frequency Financial Data: Our Approach Generalized Algorithm: Prediction I. Summarize the tick data using the time series summarization algorithm. II. For a N-step ahead forecast , extend the seasonal component D S symmetrically N points to the right to get D S, forecast . III. For a N-step ahead forecast , extend the trend component A N linearly N points to the right to get A N, forecast . IV. Add the results of Steps II and III to get an aggregate N-step ahead forecast , Forecast = D S, forecast + A N, forecast .
  • 24. Analyzing High-frequency Financial Data: Our Approach A prototype system has been implemented that automatically extracts “chief features” from a time series and give a prediction based on the extracted features, namely trend and seasonality Raw Signal Volatility DWT Statistic NCSS DWT FFT Detect Turning Points and Trends Detect Inherent Cycles Detect Variance Change Summarization Prediction
  • 25. Analyzing High-frequency Financial Data: Our Approach A Case Study Consider the five minutes compressed tick data for the £/$ exchange rate on March 18, 2004 Input Data System Output Feature Phrases Details Trend 1 st Phase 2 nd Phase Turning Points Downturns 108, 132, 164, and 178 Upturns 5, 12, 20 36, 68, and 201 Variance Change Location 164 Cycle Period 42 Peaks at 21, 54, 117, 181, 215, and 278
  • 26. Analyzing High-frequency Financial Data: Our Approach A Case Study For prediction , we use the ‘chief features’ of the previous day (March 18, 2004), information about the dominant cycle and trend (summarization), to reproduce the elements of the series for the following day (March 19, 2004): System Output Actual March 19, 2004 Predicted (seasonal + trend) March 19, 2004 Root Means Square Error = 0.0000381 Correlation = + 62.4 %
  • 27. Analyzing High-frequency Financial Data: Our Approach Conclusions We have presented a time series summarization, annotation, and prediction framework based on the multiscale wavelet analysis to deal with nonstationary, volatile and high frequency financial data Multiscale analysis can effectively deconstruct the total series into its constituent time scales: specific forecasting techniques can be applied to each timescale series to gain efficiency in forecast Results of experiments performed on Intraday exchange data show promise for summarizing and predicting highly volatile time series Continuously evolving and randomly shocked economic systems demand for a more rigorous and extended analysis , which is being planned Successful analysis of agents operating on several scales simultaneously and of modeling these components could result in more exact forecasts