SlideShare a Scribd company logo
The Inside Scoop on Trulia’s
Best-in-Class Optimization
Strategy
(And how to apply it to your business)
Gaurav Hardikar
Sr. Product Manager
@truliarentals

Chris Neumann
Founder/Principal
@CROmetrics

Cara Harshman
Content Marketing Manager
@caraharshman 

Meet Our SpeakersNeed talking points to introduce each of
you
Webinar Format
An interview w/ Chris, Gaurav, and You!
Ask Questions!
•Tweet @optimizely
•Use the chat or questions panel
…and we’ll ask them live
• One-stop-shop for
consumers searching for
real estate.
• Millions of Page Views per
day.
• Monetizes by lead
generation.
• Best-in-class in
optimization.
About Trulia
About CROmetrics
•Full service CRO – 10 person
team, half engineers.
•Won 3 Opties this year for our
work with Trulia & 99designs.
•CEO/GM, VP Marketing, VP
Product typically call on
CROmetrics as a partner.
There’s Chris
Setting the Stage: Trulia’s Success
•Awards
•Better Together Award for a
custom integration between
Optimizely + Omniture
•Developer Extraordinaire
•Experience of the Year
•100 tests/year
I’ll give a short blurb about why we’re
having this webinar with Trulia of all
companies, explain their success with
testing backed by the Optie Awards
The Inside Scoop on Trulia’s Best-in-Class
Optimization Strategy
• Achievements in testing
• Optimization team structure
• Company culture
• Testing process
• Sharing results & executive buy-in
Trulia’s Testing
Team & Program
Trulia’s Optimization Team
Trulia’s Optimization Tech Stack
•Optimizely
•Desktop web
•mWeb
•Omniture
What does the testing program and
process look like at a high level?
•Using Optimizely and CROmetrics for 1 year
•New test every 2-3 weeks; 100+ tests per year
•Test on staging, deploy to live using an audience cookie
•Test again, then deploy to full audience.
How does Trulia’s company culture
foster optimization?
•Internal culture is very data driven
•Lack of ego
•True meritocracy - No HiPPOs
•If data shows it works, we will build it
•Focus testing on search results page, rental PDP pages
(this is where all the traffic is)
•Review key business results from testing
•Lead Conversion, Reg, Saves
How does Trulia use testing to achieve
business results?
How are results communicated to senior
management?
•C-level: Overall metrics improvements, details on an ad-
hoc basis
•VP Level: Overall metrics on each test cycle, highlighting
on successful tests
•Manager Level: Involved in the outcome of every test
How does Trulia come up with
ideas to test?
•Good ideas come from everywhere: Upper management,
design, product management, engineering, support, etc.
•CROmetrics provides industry level learnings and “gut
check” on inbound ideas
•Product manager coordinates through data, intuition
How does Trulia share the
results of completed tests?
•Central page for completed tests
•Weekly A/B testing meeting to share across consumer
products
•What is running
•What is coming up
•What is getting normalized
•Optimization Champion coordinates this
Examples of Testing Wins
Infinite Scroll Test
15% leads
increase
60% pageview
increase
Mad Libs Form Test
15%
leads
increase
Email Assurance
5%
increase
•Nimble team that isn’t afraid to make a decision.
•Right metrics to align and optimize for.
•A company culture with an appetite for rapid
experimentation.
Keys to Success
Q&A
Thank You!
Contact chris@CROmetrics.com with any follow-up
questions

More Related Content

PPTX
Personalization Tips That Will Make Your Business More Money
PDF
Under the Hood Webinar Series: B2B Experimentation & Personalization at Optim...
PPTX
Data driven prioritization & roadmap planning
PPTX
The Pathway Advantage Programme: FASTER, STRONGER, LEANER
PDF
The CS (R)evolution Democratizing Customer Success
PDF
Cultivating a Culture of Experimentation
PPTX
From drawing board to delivery - How to effectively manage change within your...
PPTX
Knowledge is Power! - Best practices for leveraging Knowledge in your contact...
Personalization Tips That Will Make Your Business More Money
Under the Hood Webinar Series: B2B Experimentation & Personalization at Optim...
Data driven prioritization & roadmap planning
The Pathway Advantage Programme: FASTER, STRONGER, LEANER
The CS (R)evolution Democratizing Customer Success
Cultivating a Culture of Experimentation
From drawing board to delivery - How to effectively manage change within your...
Knowledge is Power! - Best practices for leveraging Knowledge in your contact...

What's hot (18)

PDF
Who Owns Upsells? Creating a Cohesive Relationship Between Sales and Customer...
PPTX
Learning Insights Live Nov 14 - Gamification - Good For The Blend?
PPTX
[WEBINAR] Make Blended Learning Work for Sales Training
PPT
Driving Product Adoption with Insight-driven Playbooks
PPTX
inSided + Usabilla: Product Adoption Strategies for CSMs
PPTX
Game On: How McDonald's Designed A Successful, Addictive Learning Game | Lear...
PDF
BPM for dummies
PPTX
Multi-Channel Experimentation & Personalization
PDF
Segmenting Customers
PPTX
The New State of Personalization
PDF
Define Testing Goals that Influence Conversion
PDF
The Fundamentals of User Adoption
PPTX
How To Build a Winning Experimentation Program & Team | Optimizely ANZ Webinar 8
PDF
Thinking tools for solving three Agile adoption problems
PPTX
McDonald's 'Demonstrating the Value of Learning' | Learning Insights Live 2014
PPTX
Losing is the New Winning
PPTX
The How, Why and What of Metrics?
PDF
SaaStock East Coast 2019 - Patrick Campbell, Founder & CEO, Profitwell
Who Owns Upsells? Creating a Cohesive Relationship Between Sales and Customer...
Learning Insights Live Nov 14 - Gamification - Good For The Blend?
[WEBINAR] Make Blended Learning Work for Sales Training
Driving Product Adoption with Insight-driven Playbooks
inSided + Usabilla: Product Adoption Strategies for CSMs
Game On: How McDonald's Designed A Successful, Addictive Learning Game | Lear...
BPM for dummies
Multi-Channel Experimentation & Personalization
Segmenting Customers
The New State of Personalization
Define Testing Goals that Influence Conversion
The Fundamentals of User Adoption
How To Build a Winning Experimentation Program & Team | Optimizely ANZ Webinar 8
Thinking tools for solving three Agile adoption problems
McDonald's 'Demonstrating the Value of Learning' | Learning Insights Live 2014
Losing is the New Winning
The How, Why and What of Metrics?
SaaStock East Coast 2019 - Patrick Campbell, Founder & CEO, Profitwell
Ad

Viewers also liked (20)

PDF
Mig33 brand partner engagement presentation
PPTX
Astronomy big bang theory
PDF
Bitmark and Hyperledger Workshop: the Digital Assets and Property
PDF
OfficeCentral User Manual HRMS (Bahasa Melayu) V3R2
PPTX
UX Design for Wearables: BMW i8 INNOVATION LIVE. for Google Glass
PPTX
Cohesion and coupling
PPS
Windows Movie Maker Tutorial
PDF
Autonomy, Connection, and Excellence; The Building Blocks of a DevOps Culture
PPTX
Big Bang Theory Astronomy Lesson PowerPoint
PDF
5 Biometrics Usability Lessons
PPTX
Visual Computing: The Road Ahead, NVIDIA CEO Jen-Hsun Huang at CES 2015
PPTX
google glass
PDF
What's New in Office 2016
PPTX
GOOGLE BIGTABLE
PPTX
Google Glass
PDF
The New CSS Layout - dotCSS
PDF
Your Future HTML: The Evolution of Site Design with Web Components
PDF
Google glass ppt
PDF
A call to JS Developers - Let’s stop trying to impress each other and start b...
PDF
Measuring Agile: A Disciplined Approach To Metrics
Mig33 brand partner engagement presentation
Astronomy big bang theory
Bitmark and Hyperledger Workshop: the Digital Assets and Property
OfficeCentral User Manual HRMS (Bahasa Melayu) V3R2
UX Design for Wearables: BMW i8 INNOVATION LIVE. for Google Glass
Cohesion and coupling
Windows Movie Maker Tutorial
Autonomy, Connection, and Excellence; The Building Blocks of a DevOps Culture
Big Bang Theory Astronomy Lesson PowerPoint
5 Biometrics Usability Lessons
Visual Computing: The Road Ahead, NVIDIA CEO Jen-Hsun Huang at CES 2015
google glass
What's New in Office 2016
GOOGLE BIGTABLE
Google Glass
The New CSS Layout - dotCSS
Your Future HTML: The Evolution of Site Design with Web Components
Google glass ppt
A call to JS Developers - Let’s stop trying to impress each other and start b...
Measuring Agile: A Disciplined Approach To Metrics
Ad

Similar to The Inside Scoop on Trulia's Best-in-Class Optimization Strategy (20)

PPTX
The 2015 Optie Award Winners
PDF
Conversion Optimization: Fighting the Most Common Roadblocks
PDF
Trade up from cube to corner office - OpenText TeamSite Optimost
PDF
Trade up from cube to corner office - OpenText Optimost
PPTX
Myths, Lies and Illusions of AB and Split Testing
PDF
Case Study by Jon Warden and Shruti Ahuja of Haymarket - Optimizely Experienc...
PDF
A/B Mythbusters: Common Optimization Objections Debunked
PPTX
Boost Your Conversion Rate
PDF
Build a Winning Conversion Optimization Strategy
PDF
The state of conversion rate optimisation 2019 [updated]
PPTX
Conversion rate optimization CRO breakfast seminar Stockholm, August 2015
PDF
10 Tactics for Building an Optimization Culture
PPTX
Interact London - 21 Oct 2015 - Scaling Stupidity
PDF
Opticon 2015- Benchmark Your Optimization Program
PPTX
The State of Conversion Rate Optimisation (CRO) 2019
PPTX
eMetrics London - The AB Testing Hype Cycle
PDF
From $0 to $200MM in 2 Years: How a Fast-Growing D2C Brand Used CRO to Scale ...
 
PDF
Optimizely's Optimization Benchmark Findings Webinar Slides
PPTX
Slideshare 3: Master the Essentials of Conversion Optimization
PDF
State of Conversion Optimization Report 2016 - ConversionXL
 
The 2015 Optie Award Winners
Conversion Optimization: Fighting the Most Common Roadblocks
Trade up from cube to corner office - OpenText TeamSite Optimost
Trade up from cube to corner office - OpenText Optimost
Myths, Lies and Illusions of AB and Split Testing
Case Study by Jon Warden and Shruti Ahuja of Haymarket - Optimizely Experienc...
A/B Mythbusters: Common Optimization Objections Debunked
Boost Your Conversion Rate
Build a Winning Conversion Optimization Strategy
The state of conversion rate optimisation 2019 [updated]
Conversion rate optimization CRO breakfast seminar Stockholm, August 2015
10 Tactics for Building an Optimization Culture
Interact London - 21 Oct 2015 - Scaling Stupidity
Opticon 2015- Benchmark Your Optimization Program
The State of Conversion Rate Optimisation (CRO) 2019
eMetrics London - The AB Testing Hype Cycle
From $0 to $200MM in 2 Years: How a Fast-Growing D2C Brand Used CRO to Scale ...
 
Optimizely's Optimization Benchmark Findings Webinar Slides
Slideshare 3: Master the Essentials of Conversion Optimization
State of Conversion Optimization Report 2016 - ConversionXL
 

More from Optimizely (20)

PDF
Clover Rings Up Digital Growth to Drive Experimentation
PPTX
Make Every Touchpoint Count: How to Drive Revenue in an Increasingly Online W...
PPTX
The Science of Getting Testing Right
PDF
Atlassian's Mystique CLI, Minimizing the Experiment Development Cycle
PPTX
Autotrader Case Study: Migrating from Home-Grown Testing to Best-in-Class Too...
PPTX
Zillow + Optimizely: Building the Bridge to $20 Billion Revenue
PDF
The Future of Optimizely for Technical Teams
PPTX
Empowering Agents to Provide Service from Anywhere: Contact Centers in the Ti...
PPTX
Experimentation Everywhere: Create Exceptional Online Shopping Experiences an...
PDF
Building an Experiment Pipeline for GitHub’s New Free Team Offering
PPTX
AMC Networks Experiments Faster on the Server Side
PDF
Evolving Experimentation from CRO to Product Development
PDF
Overcoming the Challenges of Experimentation on a Service Oriented Architecture
PPTX
How The Zebra Utilized Feature Experiments To Increase Carrier Card Engagemen...
PPTX
Making Your Hypothesis Work Harder to Inform Future Product Strategy
PPTX
Kick Your Assumptions: How Scholl's Test-Everything Culture Drives Revenue
PPTX
Experimentation through Clients' Eyes
PPTX
Shipping to Learn and Accelerate Growth with GitHub
PPTX
Test Everything: TrustRadius Delivers Customer Value with Experimentation
PDF
Optimizely Agent: Scaling Resilient Feature Delivery
Clover Rings Up Digital Growth to Drive Experimentation
Make Every Touchpoint Count: How to Drive Revenue in an Increasingly Online W...
The Science of Getting Testing Right
Atlassian's Mystique CLI, Minimizing the Experiment Development Cycle
Autotrader Case Study: Migrating from Home-Grown Testing to Best-in-Class Too...
Zillow + Optimizely: Building the Bridge to $20 Billion Revenue
The Future of Optimizely for Technical Teams
Empowering Agents to Provide Service from Anywhere: Contact Centers in the Ti...
Experimentation Everywhere: Create Exceptional Online Shopping Experiences an...
Building an Experiment Pipeline for GitHub’s New Free Team Offering
AMC Networks Experiments Faster on the Server Side
Evolving Experimentation from CRO to Product Development
Overcoming the Challenges of Experimentation on a Service Oriented Architecture
How The Zebra Utilized Feature Experiments To Increase Carrier Card Engagemen...
Making Your Hypothesis Work Harder to Inform Future Product Strategy
Kick Your Assumptions: How Scholl's Test-Everything Culture Drives Revenue
Experimentation through Clients' Eyes
Shipping to Learn and Accelerate Growth with GitHub
Test Everything: TrustRadius Delivers Customer Value with Experimentation
Optimizely Agent: Scaling Resilient Feature Delivery

Recently uploaded (20)

PDF
Galatica Smart Energy Infrastructure Startup Pitch Deck
PPTX
The THESIS FINAL-DEFENSE-PRESENTATION.pptx
PPTX
IBA_Chapter_11_Slides_Final_Accessible.pptx
PPT
Chapter 2 METAL FORMINGhhhhhhhjjjjmmmmmmmmm
PDF
Mega Projects Data Mega Projects Data
PPTX
Introduction to Knowledge Engineering Part 1
PPT
Quality review (1)_presentation of this 21
PDF
Foundation of Data Science unit number two notes
PPTX
IB Computer Science - Internal Assessment.pptx
PPTX
iec ppt-1 pptx icmr ppt on rehabilitation.pptx
PDF
168300704-gasification-ppt.pdfhghhhsjsjhsuxush
PDF
Recruitment and Placement PPT.pdfbjfibjdfbjfobj
PPTX
Acceptance and paychological effects of mandatory extra coach I classes.pptx
PDF
“Getting Started with Data Analytics Using R – Concepts, Tools & Case Studies”
PPTX
Major-Components-ofNKJNNKNKNKNKronment.pptx
PPTX
advance b rammar.pptxfdgdfgdfsgdfgsdgfdfgdfgsdfgdfgdfg
PDF
.pdf is not working space design for the following data for the following dat...
PDF
Lecture1 pattern recognition............
PDF
Clinical guidelines as a resource for EBP(1).pdf
Galatica Smart Energy Infrastructure Startup Pitch Deck
The THESIS FINAL-DEFENSE-PRESENTATION.pptx
IBA_Chapter_11_Slides_Final_Accessible.pptx
Chapter 2 METAL FORMINGhhhhhhhjjjjmmmmmmmmm
Mega Projects Data Mega Projects Data
Introduction to Knowledge Engineering Part 1
Quality review (1)_presentation of this 21
Foundation of Data Science unit number two notes
IB Computer Science - Internal Assessment.pptx
iec ppt-1 pptx icmr ppt on rehabilitation.pptx
168300704-gasification-ppt.pdfhghhhsjsjhsuxush
Recruitment and Placement PPT.pdfbjfibjdfbjfobj
Acceptance and paychological effects of mandatory extra coach I classes.pptx
“Getting Started with Data Analytics Using R – Concepts, Tools & Case Studies”
Major-Components-ofNKJNNKNKNKNKronment.pptx
advance b rammar.pptxfdgdfgdfsgdfgsdgfdfgdfgsdfgdfgdfg
.pdf is not working space design for the following data for the following dat...
Lecture1 pattern recognition............
Clinical guidelines as a resource for EBP(1).pdf

The Inside Scoop on Trulia's Best-in-Class Optimization Strategy

  • 1. The Inside Scoop on Trulia’s Best-in-Class Optimization Strategy (And how to apply it to your business)
  • 2. Gaurav Hardikar Sr. Product Manager @truliarentals
 Chris Neumann Founder/Principal @CROmetrics
 Cara Harshman Content Marketing Manager @caraharshman 
 Meet Our SpeakersNeed talking points to introduce each of you
  • 3. Webinar Format An interview w/ Chris, Gaurav, and You! Ask Questions! •Tweet @optimizely •Use the chat or questions panel …and we’ll ask them live
  • 4. • One-stop-shop for consumers searching for real estate. • Millions of Page Views per day. • Monetizes by lead generation. • Best-in-class in optimization. About Trulia
  • 5. About CROmetrics •Full service CRO – 10 person team, half engineers. •Won 3 Opties this year for our work with Trulia & 99designs. •CEO/GM, VP Marketing, VP Product typically call on CROmetrics as a partner. There’s Chris
  • 6. Setting the Stage: Trulia’s Success •Awards •Better Together Award for a custom integration between Optimizely + Omniture •Developer Extraordinaire •Experience of the Year •100 tests/year I’ll give a short blurb about why we’re having this webinar with Trulia of all companies, explain their success with testing backed by the Optie Awards
  • 7. The Inside Scoop on Trulia’s Best-in-Class Optimization Strategy • Achievements in testing • Optimization team structure • Company culture • Testing process • Sharing results & executive buy-in
  • 10. Trulia’s Optimization Tech Stack •Optimizely •Desktop web •mWeb •Omniture
  • 11. What does the testing program and process look like at a high level? •Using Optimizely and CROmetrics for 1 year •New test every 2-3 weeks; 100+ tests per year •Test on staging, deploy to live using an audience cookie •Test again, then deploy to full audience.
  • 12. How does Trulia’s company culture foster optimization? •Internal culture is very data driven •Lack of ego •True meritocracy - No HiPPOs •If data shows it works, we will build it
  • 13. •Focus testing on search results page, rental PDP pages (this is where all the traffic is) •Review key business results from testing •Lead Conversion, Reg, Saves How does Trulia use testing to achieve business results?
  • 14. How are results communicated to senior management? •C-level: Overall metrics improvements, details on an ad- hoc basis •VP Level: Overall metrics on each test cycle, highlighting on successful tests •Manager Level: Involved in the outcome of every test
  • 15. How does Trulia come up with ideas to test? •Good ideas come from everywhere: Upper management, design, product management, engineering, support, etc. •CROmetrics provides industry level learnings and “gut check” on inbound ideas •Product manager coordinates through data, intuition
  • 16. How does Trulia share the results of completed tests? •Central page for completed tests •Weekly A/B testing meeting to share across consumer products •What is running •What is coming up •What is getting normalized •Optimization Champion coordinates this
  • 18. Infinite Scroll Test 15% leads increase 60% pageview increase
  • 19. Mad Libs Form Test 15% leads increase
  • 21. •Nimble team that isn’t afraid to make a decision. •Right metrics to align and optimize for. •A company culture with an appetite for rapid experimentation. Keys to Success
  • 22. Q&A
  • 23. Thank You! Contact chris@CROmetrics.com with any follow-up questions