SlideShare a Scribd company logo
@deanmalmgren
@DsAtweet
2014 august
nyc algorithmic trading
quant skillz beyond wall st
deriving value from large, non-financial datasets
@deanmalmgren | bit.ly/design-data
data scientists thrive with ambiguity
solve for x
x = 5 + 2
projectevolution
@deanmalmgren | bit.ly/design-data
data scientists thrive with ambiguity
solve for x
x = 5 + 2
projectevolution
A x = b
@deanmalmgren | bit.ly/design-data
data scientists thrive with ambiguity
solve for x
x = 5 + 2
projectevolution
A x = b
optimize
A x = b
subject to
f(x) > 0
@deanmalmgren | bit.ly/design-data
data scientists thrive with ambiguity
solve for x
x = 5 + 2
projectevolution
A x = b optimize
f(x)
optimize
A x = b
subject to
f(x) > 0
@deanmalmgren | bit.ly/design-data
data scientists thrive with ambiguity
solve for x
x = 5 + 2
projectevolution
A x = b optimize
f(x)
optimize
A x = b
subject to
f(x) > 0
optimize
“our profitability”
@deanmalmgren | bit.ly/design-data
origins of ambiguity
many feasible approaches
@deanmalmgren | bit.ly/design-data
origins of ambiguity
unclear problems
identify the best locations to plant new trees
@deanmalmgren | bit.ly/design-data
origins of ambiguity
unclear problems
@deanmalmgren | bit.ly/design-data
identify the best locations to plant new trees
how many?
what kinds of trees?
move old trees?
replace old trees?
@deanmalmgren | bit.ly/design-data
origins of ambiguity
unclear problems
identify the best locations to plant new trees
how many?
what kinds of trees?
move old trees?
replace old trees?
aesthetically pleasing?
maximize growth?
increase foliage?
offset CO2 emissions?
@deanmalmgren | bit.ly/design-data
@deanmalmgren | bit.ly/design-data
generate
hypotheses
build
prototype
evaluate
feedback
“design process” is used everywhere
anticipate failure
1-4 week
iterations
@deanmalmgren | bit.ly/design-data
generate
hypotheses
build
prototype
evaluate
feedback
surveys, interviews, focus groups
split testing, A/B testing
QA; requirements churn
personas, scenarios, use
cases
business/product
requirements
story/user cards
build device prototypes
minimum viable product
write code
human-centered design
lean startup
agile programming
“design process” is used everywhere
anticipate failure
1-4 week
iterations
@deanmalmgren | bit.ly/design-data
generate
hypotheses
build
prototype
evaluate
feedback
design and data science
challenges in practice
1-4 week
iterations
@deanmalmgren | bit.ly/design-data
generate
hypotheses
build
prototype
evaluate
feedback
problem lost in translation
design and data science
challenges in practice
1-4 week
iterations
@deanmalmgren | bit.ly/design-data
generate
hypotheses
build
prototype
evaluate
feedback
problem lost in translation
takes a long time to
collect data, analyze, and
build visualization
design and data science
challenges in practice
1-4 week
iterations
@deanmalmgren | bit.ly/design-data
generate
hypotheses
build
prototype
evaluate
feedback
proof is in the pudding
problem lost in translation
takes a long time to
collect data, analyze, and
build visualization
design and data science
challenges in practice
1-4 week
iterations
@deanmalmgren | bit.ly/design-data
how do projects start?
@deanmalmgren | bit.ly/design-data
how do projects start?
@deanmalmgren | bit.ly/design-data
how do projects start?
@deanmalmgren | bit.ly/design-data
how do projects start?
@deanmalmgren | bit.ly/design-data
how do projects start?
@deanmalmgren | bit.ly/design-data
informal conversation to stated goals
mostly bad ideas, but a few good ones
@deanmalmgren | bit.ly/design-data@deanmalmgren | bit.ly/design-data
mostly bad ideas, but a few good ones
informal conversation to stated goals
@deanmalmgren | bit.ly/design-data@deanmalmgren | bit.ly/design-data
mostly bad ideas, but a few good ones
Lorem Ipsum: a narrative about blankets.
Author: Charlie Brown
Date: 31 Jan 2012
!
Lorem Ipsum is a dummy text used when typesetting or marking up documents. It has a
long history starting from the 1500s and is still used in digital millennium for typesetting
electronic documents, page designs, etc.
!
In itself, the original text of Lorem Ipsum might have been taken from an ancient Latin
book that was written about 50 BC. Nevertheless, Lorem Ipsum’s words have been
changed so they don’t read as a proper text.
!
Naturally, page designs that are made for text documents must contain some text rather
than placeholder dots or something else. However, should they contain proper English
words and sentences almost every reader will deliberately try to interpret it eventually,
missing the design itself.
!
However, a placeholder text must have a natural distribution of letters and punctuation
or otherwise the markup will look strange and unnatural. That’s what Lorem Ipsum helps
to achieve.
!
I would like to thank Peppermint Pattyfor her support on studying
Lorem Ipsum as well as the infinite wisdom of Linus van Peltand his
willingness to use his blanket in my experiments.
informal conversation to stated goals
@deanmalmgren | bit.ly/design-data@deanmalmgren | bit.ly/design-data
mostly bad ideas, but a few good ones
Lorem Ipsum: a narrative about blankets.
Author: Charlie Brown
Date: 31 Jan 2012
!
Lorem Ipsum is a dummy text used when typesetting or marking up documents. It has a
long history starting from the 1500s and is still used in digital millennium for typesetting
electronic documents, page designs, etc.
!
In itself, the original text of Lorem Ipsum might have been taken from an ancient Latin
book that was written about 50 BC. Nevertheless, Lorem Ipsum’s words have been
changed so they don’t read as a proper text.
!
Naturally, page designs that are made for text documents must contain some text rather
than placeholder dots or something else. However, should they contain proper English
words and sentences almost every reader will deliberately try to interpret it eventually,
missing the design itself.
!
However, a placeholder text must have a natural distribution of letters and punctuation
or otherwise the markup will look strange and unnatural. That’s what Lorem Ipsum helps
to achieve.
!
I would like to thank Peppermint Pattyfor her support on studying
Lorem Ipsum as well as the infinite wisdom of Linus van Peltand his
willingness to use his blanket in my experiments.
informal conversation to stated goals
@deanmalmgren | bit.ly/design-data@deanmalmgren | bit.ly/design-data
mostly bad ideas, but a few good ones
informal conversation to stated goals
@deanmalmgren | bit.ly/design-data
concept sketch comparisons
qualitative a/b testing
@deanmalmgren | bit.ly/design-data
concept sketch comparisons
qualitative a/b testing
@deanmalmgren | bit.ly/design-data
concept sketch comparisons
qualitative a/b testing
@deanmalmgren | bit.ly/design-data
concept sketch comparisons
qualitative a/b testing
@deanmalmgren | bit.ly/design-data
concept sketch comparisons
qualitative a/b testing
@deanmalmgren | bit.ly/design-data
concept sketch comparisons
qualitative a/b testing
@deanmalmgren | bit.ly/design-data
concept sketch comparisons
qualitative a/b testing
@deanmalmgren | bit.ly/design-data
concept sketch comparisons
qualitative a/b testing
@deanmalmgren | bit.ly/design-data
concept sketch comparisons
qualitative a/b testing
@deanmalmgren | bit.ly/design-data
concept sketch comparisons
qualitative a/b testing
@deanmalmgren | bit.ly/design-data
concept sketch comparisons
qualitative a/b testing
@deanmalmgren | bit.ly/design-data
concept sketch comparisons
qualitative a/b testing
@deanmalmgren | bit.ly/design-data
concept sketch comparisons
qualitative a/b testing
@deanmalmgren | bit.ly/design-data
concept sketch comparisons
qualitative a/b testing
@deanmalmgren | bit.ly/design-data
concept sketch comparisons
qualitative a/b testing
@deanmalmgren | bit.ly/design-data
concept sketch comparisons
qualitative a/b testing
search engine
with relevance metrics
demographics human readable
expertise summary
@deanmalmgren | bit.ly/design-data
from sketch to blue print to prototype
add detail to get feedback (while building)
@deanmalmgren | bit.ly/design-data
from sketch to blue print to prototype
add detail to get feedback (while building)
@deanmalmgren | bit.ly/design-data
from sketch to blue print to prototype
add detail to get feedback (while building)
@deanmalmgren | bit.ly/design-data
from sketch to blue print to prototype
add detail to get feedback (while building)
@deanmalmgren | bit.ly/design-data
motorola
data-driven consumer feedback
@deanmalmgren | bit.ly/design-data
motorola
new product
announcement
data-driven consumer feedback
@deanmalmgren | bit.ly/design-data
motorola
new product
announcement
first versions
from manufacturer
data-driven consumer feedback
@deanmalmgren | bit.ly/design-data
motorola
new product
announcement
first versions
from manufacturer
available
in stores
data-driven consumer feedback
@deanmalmgren | bit.ly/design-data
motorola
new product
announcement
first versions
from manufacturer
available
in stores
next generation
to manufacturer
data-driven consumer feedback
@deanmalmgren | bit.ly/design-data
motorola
new product
announcement
first versions
from manufacturer
available
in stores
next generation
to manufacturer
product defects
from consumers
data-driven consumer feedback
@deanmalmgren | bit.ly/design-data
motorola
data-driven consumer feedback
@deanmalmgren | bit.ly/design-data
motorola
data-driven consumer feedback
@deanmalmgren | bit.ly/design-data
motorola
data-driven consumer feedback
@deanmalmgren | bit.ly/design-data
motorola
data-driven consumer feedback
@deanmalmgren | bit.ly/design-data
data-driven e-discovery
daegis
@deanmalmgren | bit.ly/design-data
data-driven e-discovery
daegis
@deanmalmgren | bit.ly/design-data
data-driven e-discovery
daegis
@deanmalmgren | bit.ly/design-data
data-driven e-discovery
daegis
aboutpatent
not
aboutpatent
@deanmalmgren | bit.ly/design-data
data-driven e-discovery
daegis
aboutpatent
not
aboutpatent
turn over to plaintiff
don’t
turn over to plaintiff
adverse inference
@deanmalmgren | bit.ly/design-data
data-driven e-discovery
daegis
aboutpatent
not
aboutpatent
turn over to plaintiff
don’t
turn over to plaintiff
adverse inference
give away trade secrets
@deanmalmgren | bit.ly/design-data
data-driven e-discovery
daegis
aboutpatent
not
aboutpatent
turn over to plaintiff
don’t
turn over to plaintiff
adverse inference
give away trade secrets
@deanmalmgren | bit.ly/design-data
data-driven e-discovery
daegis
turn over to plaintiff
don’t
turn over to plaintiff
@deanmalmgren | bit.ly/design-data
data-driven e-discovery
daegis
@deanmalmgren | bit.ly/design-data
data-driven e-discovery
daegis
@deanmalmgren | bit.ly/design-data
data-driven e-discovery
daegis
algorithm design
patents
@deanmalmgren | bit.ly/design-data
data-driven e-discovery
daegis
algorithm design
patents
fantasy football
lunch
coffee
@deanmalmgren | bit.ly/design-data
data-driven e-discovery
daegis
algorithm design
patents
marketing
finances
fantasy football
lunch
coffee
@deanmalmgren | bit.ly/design-data
data-driven e-discovery
daegis
create a “document map”
algorithm design
patents
marketing
finances
fantasy football
lunch
coffee
@deanmalmgren | bit.ly/design-data
data-driven e-discovery
daegis
create a “document map”
fantasy football
algorithm design
patents
lunch
marketing
finances
coffee
@deanmalmgren | bit.ly/design-data
data-driven e-discovery
daegis
create a “document map”
fantasy football
algorithm design
patents
lunch
marketing
finances
coffee
@deanmalmgren | bit.ly/design-data
data-driven e-discovery
daegis
create a “document map”
fantasy football
algorithm design
patents
lunch
marketing
finances
coffee
@deanmalmgren | bit.ly/design-data
data-driven e-discovery
daegis
create a “document map”
fantasy football
algorithm design
patents
lunch
marketing
finances
coffee
@deanmalmgren | bit.ly/design-data
data-driven e-discovery
daegis
create a “document map”
fantasy football
algorithm design
patents
lunch
marketing
finances
coffee
@deanmalmgren | bit.ly/design-data
data-driven e-discovery
daegis
create a “document map”
fantasy football
algorithm design
patents
lunch
marketing
finances
coffee
@deanmalmgren | bit.ly/design-data
data-driven e-discovery
daegis
create a “document map”
fantasy football
algorithm design
patents
lunch
marketing
finances
coffee
@deanmalmgren | bit.ly/design-data
data-driven e-discovery
daegis
create a “document map”
fantasy football
algorithm design
patents
lunch
marketing
finances
coffee
review away shades of grey
@deanmalmgren | bit.ly/design-data
data-driven e-discovery
daegis
create a “document map”
fantasy football
algorithm design
patents
lunch
marketing
finances
coffee
review away shades of grey
reduce reviews by 90-99%
@deanmalmgren | bit.ly/design-data
data-driven e-discovery
daegis
@deanmalmgren | bit.ly/design-data
data-driven e-discovery
daegis
awesome!
@deanmalmgren | bit.ly/design-data
data-driven e-discovery
daegis
who cares?
awesome!
@deanmalmgren | bit.ly/design-data
data-driven e-discovery
daegis
who cares?
awesome!
<lots of iteration/>
@deanmalmgren | bit.ly/design-data
data-driven e-discovery
daegis
@deanmalmgren | bit.ly/design-data
quant skillz to data science?
bit.ly/metis-ds
generate
hypotheses
build
prototype
evaluate
feedback
1-4 week
iterations
@deanmalmgren | bit.ly/design-data
quant skillz to data science?
bit.ly/metis-ds
http://bit.ly/design-data
http://bit.ly/metis-ds
!
@deanmalmgren
dean.malmgren@datascopeanalytics.com
solve ambiguous problems with
quantitative, iterative approach

More Related Content

PDF
20150409 nuvention analytics
PDF
Solving for ambiguity: what the data literate can learn from the design process
PDF
20151020 Metis
PDF
You've Got (Big) Data! Now What?
PPTX
SEO Success Factors - SMX Advanced 2014
PDF
NLP Powered Outreach Link Building
PDF
Making Websites Talk: the rise of Voice Search and Conversational Interfaces
PDF
What I Learned Building a Toy Example to Crawl & Render like Google
20150409 nuvention analytics
Solving for ambiguity: what the data literate can learn from the design process
20151020 Metis
You've Got (Big) Data! Now What?
SEO Success Factors - SMX Advanced 2014
NLP Powered Outreach Link Building
Making Websites Talk: the rise of Voice Search and Conversational Interfaces
What I Learned Building a Toy Example to Crawl & Render like Google

Similar to quant skillz beyond wall st: deriving value from large, non-financial datasets (20)

PDF
Datascope: Designing your Data Viz - The (Iterative) Process
PDF
Leveraging Unusual Data Sources
PDF
Effective Data Science: The Art of Delivering and Demonstrating Value
PDF
Data Science and Design: Fickleness and How We Solve It
PDF
BrightTALK quick talk: Data Science and the Design Process
PDF
20131212 BrightTALK: design and data science
PDF
Making an Impact: UX Team of One
PDF
Designing with Big Data
PDF
UX Therapy - Don't Jump
PPT
Middle Out Design
PDF
Can invisible also be amazing? Designing fluid and connected experiences
PDF
Can Kilicbay: Feeding on change | UX Riga 2018
PDF
Designer vs Developer: BE THE UNICORN
PPTX
What is design?
PDF
The Death of Lorem Ipsum and Pixel-Perfect Content (MinneWebCon version)
PDF
Webinar on DataUp: Describe, Manage, and Share Data
PDF
Greener Gadgets
PDF
UX and Machine Learning
PDF
Pausefest: Solve your own damn problem
PPSX
User Experience Design [UXD]
Datascope: Designing your Data Viz - The (Iterative) Process
Leveraging Unusual Data Sources
Effective Data Science: The Art of Delivering and Demonstrating Value
Data Science and Design: Fickleness and How We Solve It
BrightTALK quick talk: Data Science and the Design Process
20131212 BrightTALK: design and data science
Making an Impact: UX Team of One
Designing with Big Data
UX Therapy - Don't Jump
Middle Out Design
Can invisible also be amazing? Designing fluid and connected experiences
Can Kilicbay: Feeding on change | UX Riga 2018
Designer vs Developer: BE THE UNICORN
What is design?
The Death of Lorem Ipsum and Pixel-Perfect Content (MinneWebCon version)
Webinar on DataUp: Describe, Manage, and Share Data
Greener Gadgets
UX and Machine Learning
Pausefest: Solve your own damn problem
User Experience Design [UXD]
Ad

More from Dean Malmgren (7)

PDF
20160504 scrubadub
PDF
20160419 CCASA
PDF
Design thinking for dummies (data scientists)
PDF
Strata preview 2014: Design thinking for dummies (data scientists)
PDF
Fledgling ideas to useful dashboard
PDF
20130411 nu lecture
PDF
20120223 um cfe
20160504 scrubadub
20160419 CCASA
Design thinking for dummies (data scientists)
Strata preview 2014: Design thinking for dummies (data scientists)
Fledgling ideas to useful dashboard
20130411 nu lecture
20120223 um cfe
Ad

Recently uploaded (20)

PPTX
Supervised vs unsupervised machine learning algorithms
PDF
Capcut Pro Crack For PC Latest Version {Fully Unlocked 2025}
PPTX
Data_Analytics_and_PowerBI_Presentation.pptx
PPTX
Managing Community Partner Relationships
PDF
Mega Projects Data Mega Projects Data
PPTX
SAP 2 completion done . PRESENTATION.pptx
PPTX
Introduction to Firewall Analytics - Interfirewall and Transfirewall.pptx
PPTX
climate analysis of Dhaka ,Banglades.pptx
PPT
Predictive modeling basics in data cleaning process
PPT
Quality review (1)_presentation of this 21
PPTX
Introduction-to-Cloud-ComputingFinal.pptx
PPTX
modul_python (1).pptx for professional and student
PPTX
01_intro xxxxxxxxxxfffffffffffaaaaaaaaaaafg
PPTX
Leprosy and NLEP programme community medicine
PDF
.pdf is not working space design for the following data for the following dat...
PPT
Miokarditis (Inflamasi pada Otot Jantung)
PDF
[EN] Industrial Machine Downtime Prediction
PPTX
mbdjdhjjodule 5-1 rhfhhfjtjjhafbrhfnfbbfnb
PPTX
Microsoft-Fabric-Unifying-Analytics-for-the-Modern-Enterprise Solution.pptx
Supervised vs unsupervised machine learning algorithms
Capcut Pro Crack For PC Latest Version {Fully Unlocked 2025}
Data_Analytics_and_PowerBI_Presentation.pptx
Managing Community Partner Relationships
Mega Projects Data Mega Projects Data
SAP 2 completion done . PRESENTATION.pptx
Introduction to Firewall Analytics - Interfirewall and Transfirewall.pptx
climate analysis of Dhaka ,Banglades.pptx
Predictive modeling basics in data cleaning process
Quality review (1)_presentation of this 21
Introduction-to-Cloud-ComputingFinal.pptx
modul_python (1).pptx for professional and student
01_intro xxxxxxxxxxfffffffffffaaaaaaaaaaafg
Leprosy and NLEP programme community medicine
.pdf is not working space design for the following data for the following dat...
Miokarditis (Inflamasi pada Otot Jantung)
[EN] Industrial Machine Downtime Prediction
mbdjdhjjodule 5-1 rhfhhfjtjjhafbrhfnfbbfnb
Microsoft-Fabric-Unifying-Analytics-for-the-Modern-Enterprise Solution.pptx

quant skillz beyond wall st: deriving value from large, non-financial datasets