Sentiment-Driven Financial Intelligence
By John Liu, Ph.D, CFA
1
• Introduction
• Financial Intelligence
• Behavioral Approach
• Key Takeaways
• Questions
2/9/2017 2
2/9/2017 3
Machine Learning
platform that
understands
human
communication
Nashville
Washington
New York
London
Goldman Sachs
Credit Suisse
In-Q-Tel
Silver Lake
(individuals)
National Security
Financial Services
Health Analytics
Data Science
CONFIDENTIAL 3
DIGITAL REASONING |
CONFIDENTIAL
Prepared Exclusively for
Intel Capital
Digital Reasoning
Trusted Cognitive Computing For A Better World
DR Platform
2/9/2017 4
• Scalable platform designed to analyze human communications
What is Financial Intelligence?
2/9/2017 5
Customer
Insight
Market
Intelligence
Investment
Research
Risk &
Compliance
Predict client interests
and behavior from
communications and
interactions
Uncover investment
opportunities through
insights derived from
public and private
data
Extract key market
themes and monitor
risk metrics from
structured and
unstructured data
Monitor AML, SAR,
misconduct,
manipulation and
unauthorized trading,
trade reconstruction
Customer Insight
• Goal: leverage client communications to predict client
preferences and behavior, extract client holdings
• CRM data, emails, documents, phone calls, chat
• Example:
• Banking chat mining:
2/9/2017 6
*
*
Bid/Offer
* *
Financial Product Financial Product
*
Bid/Offer
*
*
*
Financial Entity
Financial Benchmark
Financial Benchmark
Financial Benchmark Financial Model Financial Benchmark Bid/Offer
*
Financial Level
Financial Benchmark
** *
*
Risk & Compliance
• Goal: Monitor AML, SAR, misconduct, manipulation and
unauthorized trading, trade reconstruction
2/9/2017 7
Electronic Communications Surveillance
FX Rate
Manipulation
• Reveal collusion and
market manipulation
• "Quid-pro-
quo” exchanges
• Clustered Bid/Ask
quotes
• Order execution
around the benchmark
• Indentify trading
abuse
• Deal related
language
• Abusive/dirty
references
• Improper placement
and execution
Wall Cross Violations
• Uncover insider
trading
• M & A terminology
• Personal trade
execution
• Discussing
Companies on
Restricted list
• Email from/to
sensitive countries
• Bribery & gift
language
• Presence of
attachments
• Deal related language
& order execution
• Use public information
to enhance KYC profiles
• Email to/from
economically sanctioned
countries
• Deal related language
& order execution
• Analyze wire instruction
fields for hidden risks
Conduct Risk / Anti-Bribery Anti-Money LaunderingUnauthorized Trading
Useful Analyst Sentiment?
“The stable outlook reflects our expectations that Apple will
continue to maintain and defend its strong market position
in mobile devices and tablets despite seeing an contraction
in its addressable market.”
2/9/2017 8
Source: Yahoo
Investment Intelligence
• Goal: identify persistent sources of alpha through
sentiment analysis
• Key is “persistent” as sentiment is widely viewed as
transitory and unstable over long-term
• Current approaches incorporate emotional, affect
psychology and intent models that aggregate individual
sentiment to identify short-term group trends
• Incorporate models of investor behavior?
2/9/2017 9
Alpha: the active return above that of a
passive benchmark
2/9/2017 10
Investments
& Finance
Behavioral
Science
Computer
Science Sentiment
Analysis
Algorithmic
Trading
Behavioral
Economics
Cognitive
Alpha
Investment
Intelligence
Traditional vs. Behavioral
Economics
Traditional
• Perfect rationality
• Expected utility theory
• Risk aversion
• Efficient market
hypothesis
• CAPM and APT
Behavioral
• Bounded rationality
• Prospect theory
• Loss aversion
• Adaptive market
hypothesis
• Behavioral Asset Pricing
• Market anomalies
2/9/2017 11
Empirical evidence diverges greatly from classic theory
Why do market anomalies exist?
Drivers of Anomalies
Cognitive Biases
• Conservatism
• Overweight Bayesian priors
• Confirmation
• Selection bias
• Gambler’s Fallacy
• Mean reversion
• Representativeness
• Overweight recent evidence
• Availability
• Familiarity premium
Emotional Biases
• Loss aversion
• Pain > Gain
• Overconfidence
• Underestimate risk
• Endowment
• Sentimental value premium
• Status-Quo
• Regret-aversion
• Herd behavior
2/9/2017 12
Anomalies are drivers of excess return (alpha)
Studies of Market Anomalies
2/9/2017 13
Year Authors Anomaly
1968 Ball & Brown Earnings announcement effect
1975 Haugen & Heins Low volatility effect
1976 Rozeff &Kinney January effect
1977 Basu Low P/E effect
1981 Gibbons &Hess Monday effect
1981 Shiller Excess volatility effect
1981 Banz Size effect
1985 Rosenberg, Reid, Lanstein Value effect
1987 DeBondt & Thaler Over-reaction to bad news
1993 Jegadeesh & Titman Momentum investing
Quantitative Behavioral Finance
• Behavioral asset pricing model:
• This is a linear factor model that includes behavioral
bias sentiment factors
• Exposure to behavioral biases given by weights gi
2/9/2017 14
E r[ ] = rf + bj
j=1
k
å (rj -rf )+ gi
i=1
m
å bi
Expected
Return
Risk-free
Rate
Factor
Beta
Bias
Sentiment
Premium
Risk
Factor
Premiu
m
In Search of Alpha
2/9/2017 15
NLP
Sentiment
Analysis
Behavioral
Bias Factors
Factor
Portfolios
Alpha
1. Context-based sentiment analysis to extract features of
behavioral biases observed in investor commentary
2. Combine these features with structured data to
formulate behavioral bias factors
3. Use the factors to fit regression models for asset returns
4. Construct factor portfolios to monetize market
anomalies by overweight/underweight exposure to
specific behavioral biases
Deep-Learning Sentiment Pipeline
NLP Pipeline
Our Methodology at DR
• Data: public and private investor commentary
2/9/2017 16
TOK
docs
POS
Shallow
Parse
Extract
or
NER
W2V LRDBOWDM Agg
Synthesys Studio
Factor
Constructio
n
Facts
Context
Some Results
Standard Fama-French model (MKT, SMB, HML)
regression with two behavioral factors (UMO, ITF):
2/9/2017 17
Factor
Premium
Standard
Deviation
P-value
Sharpe
Ratio
Corr. Vs.
MKT
MKT 0.47 4.66 0.0262 0.10 1.00
SMB 0.19 3.16 0.1942 0.06 0.28
HML 0.42 3.04 0.0022 0.14 -0.33
UMO 0.32 1.57 0.0001 0.20 -0.12
ITF 0.91 3.06 0.0001 0.30 -0.50
Sun 2014
Key Takeaways
• Intersection between sentiment analysis and behavioral
economics is opening up new opportunities for
investment alpha generation
• DR’s context-based sentiment analysis methodology is
useful for extracting behavioral bias features from public
and private data
• Behavioral bias feature extraction yields factor portfolios
that can take advantage of anomalies manifested from
these biases
• Open research field
2/9/2017 18
Final Words
• We at DR are actively exploring neural embedding and
deep learning methods to enhance feature extraction of
behavioral biases
• Toolbox: Synthesys Studio
• Text analytics
• Model training
• Open platform
• Q4 2015 release
• Freeware
2/9/2017 19
Investments
& Finance
Behavioral
Science
Computer
Science Sentiment
Analysis
Algorithmic
Trading
Behavioral
Economic
s
Cognitive
Alpha

More Related Content

PPT
Crowdsourced hedge funds
PPTX
Machine learning prediction of stock markets
PDF
Stock Market Analysis Markov Models
PDF
Using Domain Expertise to Improve Text Analysis, Evan Schnidman, Founder and ...
PDF
Fundamental_Technical_2_29_16
PPTX
157590592109 2110
PDF
157590592109 2110
PDF
IJCS_37_4_06
Crowdsourced hedge funds
Machine learning prediction of stock markets
Stock Market Analysis Markov Models
Using Domain Expertise to Improve Text Analysis, Evan Schnidman, Founder and ...
Fundamental_Technical_2_29_16
157590592109 2110
157590592109 2110
IJCS_37_4_06

Viewers also liked (12)

PPTX
A Way Forward
PDF
Naive Bayes for the Superbowl
PDF
My Vote My Right Campaign
PPT
My vote,my right awareness ppt
PPTX
Voting, Your Right, Your Responsibility
PPT
Voting powerpoint
PDF
Neural Networks in the Wild: Handwriting Recognition
PPTX
Artificial Neural Network / Hand written character Recognition
PPTX
Handwritten character recognition using artificial neural network
PPTX
Machine Learning and Real-World Applications
PPTX
Text Detection and Recognition
DOCX
Hand Written Character Recognition Using Neural Networks
A Way Forward
Naive Bayes for the Superbowl
My Vote My Right Campaign
My vote,my right awareness ppt
Voting, Your Right, Your Responsibility
Voting powerpoint
Neural Networks in the Wild: Handwriting Recognition
Artificial Neural Network / Hand written character Recognition
Handwritten character recognition using artificial neural network
Machine Learning and Real-World Applications
Text Detection and Recognition
Hand Written Character Recognition Using Neural Networks
Ad

Similar to Sentiment-Driven Financial Intelligence (20)

PDF
Behavioral Analytics for Financial Intelligence
PPTX
Ричард Петерсон для Knowledge Stream
PPTX
Behavioural Finance in Business Management
PPTX
Behavioral finance summary
PPTX
Behavioral finance summary
PPTX
behavioral finance and technical analysis
PDF
The Missing Piece in Stock Market Predictions (Everyone Overlooks This)
PPTX
Section 8 - Chapter 1 - Market Sentiment & Technical Analysis
PDF
Behavioural Finance Applied
PPT
Presentation.ppt
PDF
Does optimism distort stock prices?
PDF
Market Perspective - June 2016
PDF
Monthly Market Perspective - June 2016
PPTX
Mind sharecomfortindicesmarch30th2018finalversion abridged
PDF
Market Behavior Analysis White Paper
PPTX
Behavioural Porfolio Theory (BPT), Limits to Arbitage and more
PDF
Behavioral Finance and Your Portfolio 1st Edition Michael M Pompian
PDF
Unit 1.pdf
PPTX
Behavioral finance
PPTX
BF Unit-1.1.pptx
Behavioral Analytics for Financial Intelligence
Ричард Петерсон для Knowledge Stream
Behavioural Finance in Business Management
Behavioral finance summary
Behavioral finance summary
behavioral finance and technical analysis
The Missing Piece in Stock Market Predictions (Everyone Overlooks This)
Section 8 - Chapter 1 - Market Sentiment & Technical Analysis
Behavioural Finance Applied
Presentation.ppt
Does optimism distort stock prices?
Market Perspective - June 2016
Monthly Market Perspective - June 2016
Mind sharecomfortindicesmarch30th2018finalversion abridged
Market Behavior Analysis White Paper
Behavioural Porfolio Theory (BPT), Limits to Arbitage and more
Behavioral Finance and Your Portfolio 1st Edition Michael M Pompian
Unit 1.pdf
Behavioral finance
BF Unit-1.1.pptx
Ad

More from John Liu (11)

PDF
Kubeflow and Data Science in Kubernetes
PPTX
Artificial Intelligence As a Service
PPTX
Machine Learning with Small Data
PDF
Data Analytics in Computational Law
PDF
AI & Machine Learning: Business Transformation
PDF
DeepREM
PDF
Social Network Analysis for Healthcare
PDF
Healthy Competition: How Adversarial Reasoning is Leading the Next Wave of In...
PDF
I2P and the Dark Web
PPTX
Beyond Machine Learning: The New Generation of Learning Algorithms Coming to ...
PDF
Role of Data Science in ERM @ Nashville Analytics Summit Sep 2014
Kubeflow and Data Science in Kubernetes
Artificial Intelligence As a Service
Machine Learning with Small Data
Data Analytics in Computational Law
AI & Machine Learning: Business Transformation
DeepREM
Social Network Analysis for Healthcare
Healthy Competition: How Adversarial Reasoning is Leading the Next Wave of In...
I2P and the Dark Web
Beyond Machine Learning: The New Generation of Learning Algorithms Coming to ...
Role of Data Science in ERM @ Nashville Analytics Summit Sep 2014

Recently uploaded (20)

PPTX
SAP 2 completion done . PRESENTATION.pptx
PPTX
Business_Capability_Map_Collection__pptx
PDF
Transcultural that can help you someday.
PPTX
Topic 5 Presentation 5 Lesson 5 Corporate Fin
PPT
statistic analysis for study - data collection
PPTX
retention in jsjsksksksnbsndjddjdnFPD.pptx
PDF
Microsoft Core Cloud Services powerpoint
PDF
[EN] Industrial Machine Downtime Prediction
PPTX
(Ali Hamza) Roll No: (F24-BSCS-1103).pptx
PDF
Introduction to Data Science and Data Analysis
PPTX
Leprosy and NLEP programme community medicine
PDF
Optimise Shopper Experiences with a Strong Data Estate.pdf
PPT
Predictive modeling basics in data cleaning process
PPTX
A Complete Guide to Streamlining Business Processes
PDF
OneRead_20250728_1808.pdfhdhddhshahwhwwjjaaja
PDF
Data Engineering Interview Questions & Answers Data Modeling (3NF, Star, Vaul...
PPTX
Pilar Kemerdekaan dan Identi Bangsa.pptx
PDF
Microsoft 365 products and services descrption
PPTX
FMIS 108 and AISlaudon_mis17_ppt_ch11.pptx
PDF
Systems Analysis and Design, 12th Edition by Scott Tilley Test Bank.pdf
SAP 2 completion done . PRESENTATION.pptx
Business_Capability_Map_Collection__pptx
Transcultural that can help you someday.
Topic 5 Presentation 5 Lesson 5 Corporate Fin
statistic analysis for study - data collection
retention in jsjsksksksnbsndjddjdnFPD.pptx
Microsoft Core Cloud Services powerpoint
[EN] Industrial Machine Downtime Prediction
(Ali Hamza) Roll No: (F24-BSCS-1103).pptx
Introduction to Data Science and Data Analysis
Leprosy and NLEP programme community medicine
Optimise Shopper Experiences with a Strong Data Estate.pdf
Predictive modeling basics in data cleaning process
A Complete Guide to Streamlining Business Processes
OneRead_20250728_1808.pdfhdhddhshahwhwwjjaaja
Data Engineering Interview Questions & Answers Data Modeling (3NF, Star, Vaul...
Pilar Kemerdekaan dan Identi Bangsa.pptx
Microsoft 365 products and services descrption
FMIS 108 and AISlaudon_mis17_ppt_ch11.pptx
Systems Analysis and Design, 12th Edition by Scott Tilley Test Bank.pdf

Sentiment-Driven Financial Intelligence

  • 2. • Introduction • Financial Intelligence • Behavioral Approach • Key Takeaways • Questions 2/9/2017 2
  • 3. 2/9/2017 3 Machine Learning platform that understands human communication Nashville Washington New York London Goldman Sachs Credit Suisse In-Q-Tel Silver Lake (individuals) National Security Financial Services Health Analytics Data Science CONFIDENTIAL 3 DIGITAL REASONING | CONFIDENTIAL Prepared Exclusively for Intel Capital Digital Reasoning Trusted Cognitive Computing For A Better World
  • 4. DR Platform 2/9/2017 4 • Scalable platform designed to analyze human communications
  • 5. What is Financial Intelligence? 2/9/2017 5 Customer Insight Market Intelligence Investment Research Risk & Compliance Predict client interests and behavior from communications and interactions Uncover investment opportunities through insights derived from public and private data Extract key market themes and monitor risk metrics from structured and unstructured data Monitor AML, SAR, misconduct, manipulation and unauthorized trading, trade reconstruction
  • 6. Customer Insight • Goal: leverage client communications to predict client preferences and behavior, extract client holdings • CRM data, emails, documents, phone calls, chat • Example: • Banking chat mining: 2/9/2017 6 * * Bid/Offer * * Financial Product Financial Product * Bid/Offer * * * Financial Entity Financial Benchmark Financial Benchmark Financial Benchmark Financial Model Financial Benchmark Bid/Offer * Financial Level Financial Benchmark ** * *
  • 7. Risk & Compliance • Goal: Monitor AML, SAR, misconduct, manipulation and unauthorized trading, trade reconstruction 2/9/2017 7 Electronic Communications Surveillance FX Rate Manipulation • Reveal collusion and market manipulation • "Quid-pro- quo” exchanges • Clustered Bid/Ask quotes • Order execution around the benchmark • Indentify trading abuse • Deal related language • Abusive/dirty references • Improper placement and execution Wall Cross Violations • Uncover insider trading • M & A terminology • Personal trade execution • Discussing Companies on Restricted list • Email from/to sensitive countries • Bribery & gift language • Presence of attachments • Deal related language & order execution • Use public information to enhance KYC profiles • Email to/from economically sanctioned countries • Deal related language & order execution • Analyze wire instruction fields for hidden risks Conduct Risk / Anti-Bribery Anti-Money LaunderingUnauthorized Trading
  • 8. Useful Analyst Sentiment? “The stable outlook reflects our expectations that Apple will continue to maintain and defend its strong market position in mobile devices and tablets despite seeing an contraction in its addressable market.” 2/9/2017 8 Source: Yahoo
  • 9. Investment Intelligence • Goal: identify persistent sources of alpha through sentiment analysis • Key is “persistent” as sentiment is widely viewed as transitory and unstable over long-term • Current approaches incorporate emotional, affect psychology and intent models that aggregate individual sentiment to identify short-term group trends • Incorporate models of investor behavior? 2/9/2017 9 Alpha: the active return above that of a passive benchmark
  • 10. 2/9/2017 10 Investments & Finance Behavioral Science Computer Science Sentiment Analysis Algorithmic Trading Behavioral Economics Cognitive Alpha Investment Intelligence
  • 11. Traditional vs. Behavioral Economics Traditional • Perfect rationality • Expected utility theory • Risk aversion • Efficient market hypothesis • CAPM and APT Behavioral • Bounded rationality • Prospect theory • Loss aversion • Adaptive market hypothesis • Behavioral Asset Pricing • Market anomalies 2/9/2017 11 Empirical evidence diverges greatly from classic theory Why do market anomalies exist?
  • 12. Drivers of Anomalies Cognitive Biases • Conservatism • Overweight Bayesian priors • Confirmation • Selection bias • Gambler’s Fallacy • Mean reversion • Representativeness • Overweight recent evidence • Availability • Familiarity premium Emotional Biases • Loss aversion • Pain > Gain • Overconfidence • Underestimate risk • Endowment • Sentimental value premium • Status-Quo • Regret-aversion • Herd behavior 2/9/2017 12 Anomalies are drivers of excess return (alpha)
  • 13. Studies of Market Anomalies 2/9/2017 13 Year Authors Anomaly 1968 Ball & Brown Earnings announcement effect 1975 Haugen & Heins Low volatility effect 1976 Rozeff &Kinney January effect 1977 Basu Low P/E effect 1981 Gibbons &Hess Monday effect 1981 Shiller Excess volatility effect 1981 Banz Size effect 1985 Rosenberg, Reid, Lanstein Value effect 1987 DeBondt & Thaler Over-reaction to bad news 1993 Jegadeesh & Titman Momentum investing
  • 14. Quantitative Behavioral Finance • Behavioral asset pricing model: • This is a linear factor model that includes behavioral bias sentiment factors • Exposure to behavioral biases given by weights gi 2/9/2017 14 E r[ ] = rf + bj j=1 k å (rj -rf )+ gi i=1 m å bi Expected Return Risk-free Rate Factor Beta Bias Sentiment Premium Risk Factor Premiu m
  • 15. In Search of Alpha 2/9/2017 15 NLP Sentiment Analysis Behavioral Bias Factors Factor Portfolios Alpha 1. Context-based sentiment analysis to extract features of behavioral biases observed in investor commentary 2. Combine these features with structured data to formulate behavioral bias factors 3. Use the factors to fit regression models for asset returns 4. Construct factor portfolios to monetize market anomalies by overweight/underweight exposure to specific behavioral biases
  • 16. Deep-Learning Sentiment Pipeline NLP Pipeline Our Methodology at DR • Data: public and private investor commentary 2/9/2017 16 TOK docs POS Shallow Parse Extract or NER W2V LRDBOWDM Agg Synthesys Studio Factor Constructio n Facts Context
  • 17. Some Results Standard Fama-French model (MKT, SMB, HML) regression with two behavioral factors (UMO, ITF): 2/9/2017 17 Factor Premium Standard Deviation P-value Sharpe Ratio Corr. Vs. MKT MKT 0.47 4.66 0.0262 0.10 1.00 SMB 0.19 3.16 0.1942 0.06 0.28 HML 0.42 3.04 0.0022 0.14 -0.33 UMO 0.32 1.57 0.0001 0.20 -0.12 ITF 0.91 3.06 0.0001 0.30 -0.50 Sun 2014
  • 18. Key Takeaways • Intersection between sentiment analysis and behavioral economics is opening up new opportunities for investment alpha generation • DR’s context-based sentiment analysis methodology is useful for extracting behavioral bias features from public and private data • Behavioral bias feature extraction yields factor portfolios that can take advantage of anomalies manifested from these biases • Open research field 2/9/2017 18
  • 19. Final Words • We at DR are actively exploring neural embedding and deep learning methods to enhance feature extraction of behavioral biases • Toolbox: Synthesys Studio • Text analytics • Model training • Open platform • Q4 2015 release • Freeware 2/9/2017 19 Investments & Finance Behavioral Science Computer Science Sentiment Analysis Algorithmic Trading Behavioral Economic s Cognitive Alpha