SlideShare a Scribd company logo
1
Finding, Exploring, and Refining Trading
Strategies: A Case Study
QuantCon, New York, 3.14.15
Presented by Matthew Granade and Yoshiki Obayashi
2	

FROM IDEA TO EXECUTION
QUANTCON, NEWYORK, 3.14.15	

  What makes a good idea? (And where do good ideas come from?)
  How to decide if an idea is worth researching?
  How to move from idea to a trading strategy
  How to move from a trading strategy into execution
As a researcher, your most valuable asset is your time.
Invest it like you invest your money: thoughtfully and carefully.
3	

GOOD IDEAS
QUANTCON, NEWYORK, 3.14.15	

  Usually some nub, often non-linear
  An ounce or two of evidence that it might actually work
  Plus some logic / some believable story for why it working would make sense
Here’s the story of Eido as a trading strategy …
4	

EIDOSEARCH AT A GLANCE
  A web-based tool
for facilitating
historical pattern
searches
  Looks for similar
patterns in the
past to generate a
distribution of
future returns
  A generalized
expression of
technical analysis
QUANTCON, NEWYORK, 3.14.15
5	

HOW DO WE KNOW IF THE CONCEPT WORKS?
QUANTCON, NEWYORK, 3.14.15	

  Jump right into back-testing trading rules incorporating the signals?
•  A common but mostly suboptimal practice
  Establish a precise mathematical definition of the “concept”
•  What are the parameters and inputs (what’s the difference?)
•  What are the outputs?
  Articulate what it means for the concept to “work”
•  In the strictest sense:
•  In a less strict sense, the empirical distribution may be usable even with
certain biases
•  Even if is the true distribution, we won’t make money on every signal
6	

A STRINGENT CHI-SQURE TEST
QUANTCON, NEWYORK, 3.14.15	

  Estimate the parameters and fix the domain of inputs
  For each pattern window and forecast horizon, generate the empirical
distribution for every ticker each day.
  Calculate the cumulative probabilities
  Count the number of observations falling into
  For each pattern window and forecast horizon, calculate where
. Under the null hypothesis: , hence
  Penalize p-values for multiple testing across numerous pattern windows and
forecast horizons (FWER, FDR, etc.)
  Analyze the times series of correlated p-values and draw conclusions
7	

A GRAPHICAL INTERPRETATION
QUANTCON, NEWYORK, 3.14.15
8	

ANYTHING-BUT-U-SHAPE! TEST DESIGN
QUANTCON, NEWYORK, 3.14.15	

  Repeat the first four steps of the Stringent Chi-Square Test
  On each day, fit a beta(a,b) distribution using maximum likelihood
  … and test the loosened null hypothesis: a < 0.95 and b < 0.95
9	

ANYTHING-BUT-U-SHAPE! TEST RESULTS
QUANTCON, NEWYORK, 3.14.15	

  COOL! But, what now?
10	

FROM SIGNAL TO STRATEGY
QUANTCON, NEWYORK, 3.14.15	

  You’ve decided to invest further in an idea; next step is to find a sensible trading
strategy
  Dimensions to think about:
  Whether to go long, short, or both
  What basket of assets to trade
  How strong a signal to require
  How many trades to make
  What time horizon to hold over
  What performance criteria to prioritize
  Almost always wrong to test everything; possible strategies should be driven by
a deep understanding of why you think the strategy works
11	

FIRST LET’S JUST GO WILD!
QUANTCON, NEWYORK, 3.14.15	

  Set the base case for portfolio optimization: long-short unconstrained
  Transaction costs, market frictions, and shattered dreams
12	

BACK-TESTING SHORT SELLING IS DICEY…
QUANTCON, NEWYORK, 3.14.15	

  Without reliable securities-lending data, it’s difficult to estimate P&L of shorts
  The easiest workaround is to restrict all portfolio weights to be non-negative
  … or only allow shorts in the most liquid securities like benchmark index ETFs
13	

BACK TO REALITY: CONTROL TURNOVER
QUANTCON, NEWYORK, 3.14.15	

  Many ways to penalize turnover and slippage
  Either model slippage roughly and conservatively or very meticulously
14	

IMPORTANCE OF INTUITION
QUANTCON, NEWYORK, 3.14.15	

  Equivalent expression:
15	

MOMENT OF TRUTH: TOP 500 MARKET CAP ONLY!
QUANTCON, NEWYORK, 3.14.15	

  Restricting the universe to the most liquid securities makes for the smoothest
transition from back-testing to live trading
  But the more liquid a securities is, the more difficult it is to eek out an edge.
Mounds of fool’s gold to be found in back-tests with illiquid securities.
16	

IMPLEMENTING THE STRATEGY
QUANTCON, NEWYORK, 3.14.15	

  This is where we are now …
  In honor of our host, I will tell you that we are using Fetcher to pull our signals
into Quantopian and then execute in IB.
  As a principle it’s always good to get to this stage as quickly as possible …
nothing matters until you’re touching the money

More Related Content

PPTX
"Bayesian Deep Learning: Dealing with Uncertainty and Non-Stationarity" by Dr...
PDF
"Fundamental Forecasts: Methods and Timing" by Vinesh Jha, CEO of ExtractAlpha
PPTX
Tearsheet feedback webinar 10.10.18
PPTX
"Quant Trading for a Living – Lessons from a Life in the Trenches" by Andreas...
PDF
"Three Dimensional Time: Working with Alternative Data" by Kathryn Glowinski,...
PPTX
Stauth common pitfalls_stock_market_modeling_pqtc_fall2018
PDF
"Quantitative Trading as a Mathematical Science" by Dr. Haksun Li, Founder an...
PDF
"Trading Strategies That Are Designed Not Fitted" by Robert Carver, Independe...
"Bayesian Deep Learning: Dealing with Uncertainty and Non-Stationarity" by Dr...
"Fundamental Forecasts: Methods and Timing" by Vinesh Jha, CEO of ExtractAlpha
Tearsheet feedback webinar 10.10.18
"Quant Trading for a Living – Lessons from a Life in the Trenches" by Andreas...
"Three Dimensional Time: Working with Alternative Data" by Kathryn Glowinski,...
Stauth common pitfalls_stock_market_modeling_pqtc_fall2018
"Quantitative Trading as a Mathematical Science" by Dr. Haksun Li, Founder an...
"Trading Strategies That Are Designed Not Fitted" by Robert Carver, Independe...

What's hot (20)

PDF
10 Ways Backtests Lie by Tucker Balch
PPTX
DIY Quant Strategies on Quantopian
PPTX
"Making the Grade: A Look Inside the Algorithm Evaluation Process" by Dr. Jes...
PPTX
"From Trading Strategy to Becoming an Industry Professional – How to Break in...
PDF
"Portfolio Optimisation When You Don’t Know the Future (or the Past)" by Rob...
PDF
"Build Effective Risk Management on Top of Your Trading Strategy" by Danielle...
PDF
Taking on Wall Street: A Comparative Study of Strategies Sourced from "The Pr...
PPTX
Modeling the Stock Market: Common pitfalls and how to avoid them!
PDF
Empowering Quants in the Data Economy by Napoleon Hernandez at QuantCon 2016
PPTX
"Enhancing Statistical Significance of Backtests" by Dr. Ernest Chan, Managin...
PPTX
Being open (source) in the traditionally secretive field of quant finance.
PPTX
PyData NYC 2015
PPTX
Magically predictable software delivery ralf westphal
PPTX
Pairs Trading from NYC Algorithmic Trading Meetup November '13
PPTX
Algorithmic Finance Meetup: Starmine Short Interest Talk
PDF
"A Framework-Based Approach to Building Quantitative Trading Systems" by Dr. ...
PDF
"Quantum Hierarchical Risk Parity - A Quantum-Inspired Approach to Portfolio ...
PPTX
"From Alpha Discovery to Portfolio Construction: Pitfalls and Solutions" by D...
PDF
“Real Time Machine Learning Architecture and Sentiment Analysis Applied to Fi...
10 Ways Backtests Lie by Tucker Balch
DIY Quant Strategies on Quantopian
"Making the Grade: A Look Inside the Algorithm Evaluation Process" by Dr. Jes...
"From Trading Strategy to Becoming an Industry Professional – How to Break in...
"Portfolio Optimisation When You Don’t Know the Future (or the Past)" by Rob...
"Build Effective Risk Management on Top of Your Trading Strategy" by Danielle...
Taking on Wall Street: A Comparative Study of Strategies Sourced from "The Pr...
Modeling the Stock Market: Common pitfalls and how to avoid them!
Empowering Quants in the Data Economy by Napoleon Hernandez at QuantCon 2016
"Enhancing Statistical Significance of Backtests" by Dr. Ernest Chan, Managin...
Being open (source) in the traditionally secretive field of quant finance.
PyData NYC 2015
Magically predictable software delivery ralf westphal
Pairs Trading from NYC Algorithmic Trading Meetup November '13
Algorithmic Finance Meetup: Starmine Short Interest Talk
"A Framework-Based Approach to Building Quantitative Trading Systems" by Dr. ...
"Quantum Hierarchical Risk Parity - A Quantum-Inspired Approach to Portfolio ...
"From Alpha Discovery to Portfolio Construction: Pitfalls and Solutions" by D...
“Real Time Machine Learning Architecture and Sentiment Analysis Applied to Fi...
Ad

Viewers also liked (10)

DOCX
CV- Subaida Ibno
PPT
Oplæg til gruppearbejde af Michael B. Skov, AAU
PDF
Careers in Systematic Investing: Advice and Perspective at the End by Matthew...
PPTX
Training and Development
PPT
The atomic bomb (slideshare version)
DOC
Event study on the impact of mergers and acquisitions
PPT
Dynamite fishing
PDF
Academic Internship Project on Performance management System
DOC
Project report on baroda dairy
PPT
Nuclear weapons
CV- Subaida Ibno
Oplæg til gruppearbejde af Michael B. Skov, AAU
Careers in Systematic Investing: Advice and Perspective at the End by Matthew...
Training and Development
The atomic bomb (slideshare version)
Event study on the impact of mergers and acquisitions
Dynamite fishing
Academic Internship Project on Performance management System
Project report on baroda dairy
Nuclear weapons
Ad

Similar to Finding, Exploring, and Refining Trading Strategies: A Case Study by Matthew Granade and Yoshiki Obayashi (20)

PDF
28 ijcse-01238-6 sowmiya
PPT
Ch14 slides
PDF
Fail Well, Pivot Fast: Product Experimentation for Continuous Discovery
PDF
Calculating Your Customer Lifetime Value - Dawn of the Data Age Lecture Series
DOCX
Concept paper Blockchain AML platform
PPT
Bundledarrows150 bit.ly/teamcaptainsmanagementcampsv
PDF
Iterate. Calculate. Communicate.
PDF
Portfolio Rebalancer which was build during Bunq hackathon
PPT
Value at risk
PDF
Channel surfing riding the waves of channels to profitable trading ( pdf d...
PPT
Top Five Ideas -- Statistics for Project Management
DOCX
Independent Study Thesis_Jai Kedia
PPTX
Estimating IT projects - VU Amsterdam
PDF
5 Myths that Stop you from running more experiments
 
PPTX
Simplified Forecasting masterclass CPA Australia Congress 2016 udpate
PDF
The legacy of modern portfolio theory academic essay assignment - www.topgr...
PPTX
Evolution of the Loyalty Economy Worldwide
PDF
LectureNoteCAPM
PDF
Dissertation laura reis books - Portuguez
28 ijcse-01238-6 sowmiya
Ch14 slides
Fail Well, Pivot Fast: Product Experimentation for Continuous Discovery
Calculating Your Customer Lifetime Value - Dawn of the Data Age Lecture Series
Concept paper Blockchain AML platform
Bundledarrows150 bit.ly/teamcaptainsmanagementcampsv
Iterate. Calculate. Communicate.
Portfolio Rebalancer which was build during Bunq hackathon
Value at risk
Channel surfing riding the waves of channels to profitable trading ( pdf d...
Top Five Ideas -- Statistics for Project Management
Independent Study Thesis_Jai Kedia
Estimating IT projects - VU Amsterdam
5 Myths that Stop you from running more experiments
 
Simplified Forecasting masterclass CPA Australia Congress 2016 udpate
The legacy of modern portfolio theory academic essay assignment - www.topgr...
Evolution of the Loyalty Economy Worldwide
LectureNoteCAPM
Dissertation laura reis books - Portuguez

More from Quantopian (14)

PPTX
"Alpha from Alternative Data" by Emmett Kilduff, Founder and CEO of Eagle Alpha
PPTX
"Supply Chain Earnings Diffusion" by Josh Holcroft, Head of Quantitative Rese...
PDF
“Market Insights Through the Lens of a Risk Model” by Olivier d'Assier, Head ...
PDF
"Maximize Alpha with Systematic Factor Testing" by Cheng Peng, Software Engin...
PPTX
"How to Run a Quantitative Trading Business in China with Python" by Xiaoyou ...
PDF
"Deep Reinforcement Learning for Optimal Order Placement in a Limit Order Boo...
PDF
"Building Diversified Portfolios that Outperform Out-of-Sample" by Dr. Marcos...
PPTX
"From Insufficient Economic data to Economic Big Data – How Trade Data is red...
PDF
"Machine Learning Approaches to Regime-aware Portfolio Management" by Michael...
PDF
"Don't Lose Your Shirt Trading Mean-Reversion" by Edith Mandel, Principal at ...
PDF
"Deep Q-Learning for Trading" by Dr. Tucker Balch, Professor of Interactive C...
PDF
"Snake Oil, Swamp Land, and Factor-Based Investing" by Gary Antonacci, author...
PDF
"On the Bayesian Interpretation of Black–Litterman" by Dr. Gordon Ritter, Sen...
PDF
"Correlated Volatility Shocks" by Dr. Xiao Qiao, Researcher at SummerHaven In...
"Alpha from Alternative Data" by Emmett Kilduff, Founder and CEO of Eagle Alpha
"Supply Chain Earnings Diffusion" by Josh Holcroft, Head of Quantitative Rese...
“Market Insights Through the Lens of a Risk Model” by Olivier d'Assier, Head ...
"Maximize Alpha with Systematic Factor Testing" by Cheng Peng, Software Engin...
"How to Run a Quantitative Trading Business in China with Python" by Xiaoyou ...
"Deep Reinforcement Learning for Optimal Order Placement in a Limit Order Boo...
"Building Diversified Portfolios that Outperform Out-of-Sample" by Dr. Marcos...
"From Insufficient Economic data to Economic Big Data – How Trade Data is red...
"Machine Learning Approaches to Regime-aware Portfolio Management" by Michael...
"Don't Lose Your Shirt Trading Mean-Reversion" by Edith Mandel, Principal at ...
"Deep Q-Learning for Trading" by Dr. Tucker Balch, Professor of Interactive C...
"Snake Oil, Swamp Land, and Factor-Based Investing" by Gary Antonacci, author...
"On the Bayesian Interpretation of Black–Litterman" by Dr. Gordon Ritter, Sen...
"Correlated Volatility Shocks" by Dr. Xiao Qiao, Researcher at SummerHaven In...

Recently uploaded (20)

PPTX
introuction to banking- Types of Payment Methods
PPTX
social-studies-subject-for-high-school-globalization.pptx
PDF
Buy Verified Stripe Accounts for Sale - Secure and.pdf
PDF
Why Ignoring Passive Income for Retirees Could Cost You Big.pdf
PPT
KPMG FA Benefits Report_FINAL_Jan 27_2010.ppt
PDF
THE EFFECT OF FOREIGN AID ON ECONOMIC GROWTH IN ETHIOPIA
PPTX
OAT_ORI_Fed Independence_August 2025.pptx
PPTX
Maths science sst hindi english cucumber
PDF
The Right Social Media Strategy Can Transform Your Business
PPTX
Introduction to Customs (June 2025) v1.pptx
PDF
Statistics for Management and Economics Keller 10th Edition by Gerald Keller ...
PPTX
ML Credit Scoring of Thin-File Borrowers
DOCX
BUSINESS PERFORMANCE SITUATION AND PERFORMANCE EVALUATION OF FELIX HOTEL IN H...
PDF
Unkipdf.pdf of work in the economy we are
PPT
Fundamentals of Financial Management Chapter 3
PDF
Pitch Deck.pdf .pdf all about finance in
PDF
CLIMATE CHANGE AS A THREAT MULTIPLIER: ASSESSING ITS IMPACT ON RESOURCE SCARC...
PDF
discourse-2025-02-building-a-trillion-dollar-dream.pdf
PPTX
IGCSE ECONOMICS 0455 Foreign Exchange Rate
PPTX
2. RBI.pptx202029291023i38039013i92292992
introuction to banking- Types of Payment Methods
social-studies-subject-for-high-school-globalization.pptx
Buy Verified Stripe Accounts for Sale - Secure and.pdf
Why Ignoring Passive Income for Retirees Could Cost You Big.pdf
KPMG FA Benefits Report_FINAL_Jan 27_2010.ppt
THE EFFECT OF FOREIGN AID ON ECONOMIC GROWTH IN ETHIOPIA
OAT_ORI_Fed Independence_August 2025.pptx
Maths science sst hindi english cucumber
The Right Social Media Strategy Can Transform Your Business
Introduction to Customs (June 2025) v1.pptx
Statistics for Management and Economics Keller 10th Edition by Gerald Keller ...
ML Credit Scoring of Thin-File Borrowers
BUSINESS PERFORMANCE SITUATION AND PERFORMANCE EVALUATION OF FELIX HOTEL IN H...
Unkipdf.pdf of work in the economy we are
Fundamentals of Financial Management Chapter 3
Pitch Deck.pdf .pdf all about finance in
CLIMATE CHANGE AS A THREAT MULTIPLIER: ASSESSING ITS IMPACT ON RESOURCE SCARC...
discourse-2025-02-building-a-trillion-dollar-dream.pdf
IGCSE ECONOMICS 0455 Foreign Exchange Rate
2. RBI.pptx202029291023i38039013i92292992

Finding, Exploring, and Refining Trading Strategies: A Case Study by Matthew Granade and Yoshiki Obayashi

  • 1. 1 Finding, Exploring, and Refining Trading Strategies: A Case Study QuantCon, New York, 3.14.15 Presented by Matthew Granade and Yoshiki Obayashi
  • 2. 2 FROM IDEA TO EXECUTION QUANTCON, NEWYORK, 3.14.15   What makes a good idea? (And where do good ideas come from?)   How to decide if an idea is worth researching?   How to move from idea to a trading strategy   How to move from a trading strategy into execution As a researcher, your most valuable asset is your time. Invest it like you invest your money: thoughtfully and carefully.
  • 3. 3 GOOD IDEAS QUANTCON, NEWYORK, 3.14.15   Usually some nub, often non-linear   An ounce or two of evidence that it might actually work   Plus some logic / some believable story for why it working would make sense Here’s the story of Eido as a trading strategy …
  • 4. 4 EIDOSEARCH AT A GLANCE   A web-based tool for facilitating historical pattern searches   Looks for similar patterns in the past to generate a distribution of future returns   A generalized expression of technical analysis QUANTCON, NEWYORK, 3.14.15
  • 5. 5 HOW DO WE KNOW IF THE CONCEPT WORKS? QUANTCON, NEWYORK, 3.14.15   Jump right into back-testing trading rules incorporating the signals? •  A common but mostly suboptimal practice   Establish a precise mathematical definition of the “concept” •  What are the parameters and inputs (what’s the difference?) •  What are the outputs?   Articulate what it means for the concept to “work” •  In the strictest sense: •  In a less strict sense, the empirical distribution may be usable even with certain biases •  Even if is the true distribution, we won’t make money on every signal
  • 6. 6 A STRINGENT CHI-SQURE TEST QUANTCON, NEWYORK, 3.14.15   Estimate the parameters and fix the domain of inputs   For each pattern window and forecast horizon, generate the empirical distribution for every ticker each day.   Calculate the cumulative probabilities   Count the number of observations falling into   For each pattern window and forecast horizon, calculate where . Under the null hypothesis: , hence   Penalize p-values for multiple testing across numerous pattern windows and forecast horizons (FWER, FDR, etc.)   Analyze the times series of correlated p-values and draw conclusions
  • 8. 8 ANYTHING-BUT-U-SHAPE! TEST DESIGN QUANTCON, NEWYORK, 3.14.15   Repeat the first four steps of the Stringent Chi-Square Test   On each day, fit a beta(a,b) distribution using maximum likelihood   … and test the loosened null hypothesis: a < 0.95 and b < 0.95
  • 9. 9 ANYTHING-BUT-U-SHAPE! TEST RESULTS QUANTCON, NEWYORK, 3.14.15   COOL! But, what now?
  • 10. 10 FROM SIGNAL TO STRATEGY QUANTCON, NEWYORK, 3.14.15   You’ve decided to invest further in an idea; next step is to find a sensible trading strategy   Dimensions to think about:   Whether to go long, short, or both   What basket of assets to trade   How strong a signal to require   How many trades to make   What time horizon to hold over   What performance criteria to prioritize   Almost always wrong to test everything; possible strategies should be driven by a deep understanding of why you think the strategy works
  • 11. 11 FIRST LET’S JUST GO WILD! QUANTCON, NEWYORK, 3.14.15   Set the base case for portfolio optimization: long-short unconstrained   Transaction costs, market frictions, and shattered dreams
  • 12. 12 BACK-TESTING SHORT SELLING IS DICEY… QUANTCON, NEWYORK, 3.14.15   Without reliable securities-lending data, it’s difficult to estimate P&L of shorts   The easiest workaround is to restrict all portfolio weights to be non-negative   … or only allow shorts in the most liquid securities like benchmark index ETFs
  • 13. 13 BACK TO REALITY: CONTROL TURNOVER QUANTCON, NEWYORK, 3.14.15   Many ways to penalize turnover and slippage   Either model slippage roughly and conservatively or very meticulously
  • 14. 14 IMPORTANCE OF INTUITION QUANTCON, NEWYORK, 3.14.15   Equivalent expression:
  • 15. 15 MOMENT OF TRUTH: TOP 500 MARKET CAP ONLY! QUANTCON, NEWYORK, 3.14.15   Restricting the universe to the most liquid securities makes for the smoothest transition from back-testing to live trading   But the more liquid a securities is, the more difficult it is to eek out an edge. Mounds of fool’s gold to be found in back-tests with illiquid securities.
  • 16. 16 IMPLEMENTING THE STRATEGY QUANTCON, NEWYORK, 3.14.15   This is where we are now …   In honor of our host, I will tell you that we are using Fetcher to pull our signals into Quantopian and then execute in IB.   As a principle it’s always good to get to this stage as quickly as possible … nothing matters until you’re touching the money