SlideShare a Scribd company logo
Testing & targeting toolsJiriBrazdaFebruary 2010
Multivariate testing
Market overviewYounger than web analytics and not as widely adopted by marketersCurrently only 26 % use A/B or MVT 1However, there is a clear synergy because optimization is logical next step after measurementSeveral sophisticated tools on the market but no vendor is clear market leaderTesting & targeting tools | www.optimics.cz3
ImplementationImplementation difficulty driven by chosen technologyJavascript enabled (requires changes to website content)Tested elements encapsulated in javascript (eg. Google Website Optimizer)Tested elements identified automatically through DOM (eg. Vertster)DNS routing (no changes to website content)Tested elements identified and served by a proxy server (eg. SiteSpect)Testing & targeting tools | www.optimics.cz4
SegmentationSimple tools presume that a single content combination works best across all visitor segmentsMore sophisticated tools can test and find best content combinations for different visitor segmentsSegments can be defined by dimensions & metrics usually found in web analytics toolsTesting & targeting tools | www.optimics.cz5
TargetingTargeting means that web content is no longer the same for every visitorAfter the test is finished targeting is a means of serving winning content combinations to different visitor segmentsTargeting follows testingTesting & targeting tools | www.optimics.cz6
StatisticsStatistical models serve to determine winning content combinationSimple tools use full factorial modelMore sophisticated tools use optimized, and therefore faster models, eg. TaguchiTesting & targeting tools | www.optimics.cz7
Success metricsWinning content combinations can only be calculated if a success metric is definedSimple tools work only with conversionMore sophisticated tools provide engagement and revenue related metrics – this can also be done through integration with web analytics toolsTesting & targeting tools | www.optimics.cz8
The toolsAmadesa (www.amadesa.com) Google Website Optimizer (www.google.com/websiteoptimizer) Maxymiser (www.maxymiser.com)  Omniture (www.omniture.com) Optimost (www.optimost.com) SiteSpect (www.sitespect.com) Vertster (www.vertster.com) Webtrends (www.webtrends.com) Testing & targeting tools | www.optimics.cz9
Vertster vs. Google Website OptimizerSince 2005Testing & targeting tools | www.optimics.cz10Disclosure: comparison of two MVT tools that I’m familiar with.  Other tools may have more sophisticated features that differentiate them from the rest of the market.
Research & further reading The Online Testing Vendor Landscape (Forrester Research)http://j.mp/forrester-testingTesting & targeting tools | www.optimics.cz11
Behavioral re/target/market/ing
Emerging technologyThere is a variety of emerging technology tools positioning themselves asBehavioral targetingRetargetingRemarketingetc.These tools primarily utilize knowledge of past individual visitor behavior but they can also involve some degree of testingTesting & targeting tools | www.optimics.cz13
The toolsBTBuckets (www.btbuckets.com) Onsite behavioral targeting, freeCognitive Match (www.cognitivematch.com) Content targeting using artificial intelligencePerformable (www.performable.com) Currently brewing in betaSeeWhy (www.seewhy.com) Remarketing shopping cart abandoners, freeSitebrand (www.sitebrand.com) Segmentation, targeting, personalizationTesting & targeting tools | www.optimics.cz14
Assessing your capability >Where are you?
Testing & targeting tools | www.optimics.cz16TestingMASSSEGMENTSINDIVIDUALPricingCampaignsProductsContentAre you here?No testingTargeting
twitter.com/jiribrazdajiri.brazda@optimics.cz(+420) 602 345 620www.optimics.cz

More Related Content

PPTX
Technical introduction to website tracking
PDF
Using Simple Machine Learning Models in a New Ads Manager
PPTX
Presentazione Frosmo in italiano Nov2015
PPTX
Module5 other analytics
PPTX
Condensed testing syrup - @OptimiseorDie @sydney sep 2011 - 4 years of testin...
PPTX
How to Segment Your Customers and Target Their Needs
PPT
Web Analytics: A Measurement System of Website
PPTX
BOLO2010 Portugal
Technical introduction to website tracking
Using Simple Machine Learning Models in a New Ads Manager
Presentazione Frosmo in italiano Nov2015
Module5 other analytics
Condensed testing syrup - @OptimiseorDie @sydney sep 2011 - 4 years of testin...
How to Segment Your Customers and Target Their Needs
Web Analytics: A Measurement System of Website
BOLO2010 Portugal

Similar to Testing & Targeting Tools (20)

PDF
Intellignos brochure
PPT
Multiplica.Webanalyticstrends
PPTX
marketing analytics.pptx
PPTX
Beyond Page Views: Modern Analytics for Online Marketing
PPTX
Display Ad Landscape : Evolution, Terminology, Technologies and Players
PPTX
Marketing analytics
PPTX
Analytics tool comparison
DOCX
A Practitioner’s Guide to Web Analytics: Designed for the B-to-B Marketer
PPTX
Conversion Rate Optimisation and the art of Testing
PPT
Benchmarking Your Online Impact: From Stats to Reputation Management
PDF
Leveraging video marketing analytics - for brands
PPT
Web analyticsandbigdata techweek2011
PPTX
Web Analytics Unraveled
PPTX
7 Habits of Best B2B Digital Marketers
PPT
Data Driven Website Decisions for SEO and CRO
PPT
The World of Measurement and Analytics
PDF
Digital & Beyond
PPTX
Make it Personal: Accelerating Your Personalization Game Plan
PPTX
Toolkits and tips of the conversion pros v 1.6
PDF
Digital Marketing Guide For Industries
Intellignos brochure
Multiplica.Webanalyticstrends
marketing analytics.pptx
Beyond Page Views: Modern Analytics for Online Marketing
Display Ad Landscape : Evolution, Terminology, Technologies and Players
Marketing analytics
Analytics tool comparison
A Practitioner’s Guide to Web Analytics: Designed for the B-to-B Marketer
Conversion Rate Optimisation and the art of Testing
Benchmarking Your Online Impact: From Stats to Reputation Management
Leveraging video marketing analytics - for brands
Web analyticsandbigdata techweek2011
Web Analytics Unraveled
7 Habits of Best B2B Digital Marketers
Data Driven Website Decisions for SEO and CRO
The World of Measurement and Analytics
Digital & Beyond
Make it Personal: Accelerating Your Personalization Game Plan
Toolkits and tips of the conversion pros v 1.6
Digital Marketing Guide For Industries
Ad

More from Optimics s.r.o. (20)

PPTX
Let’s make web analytics more customer centric!
PPTX
Integrace zákaznických dat skrz napříč
PPTX
Universal Analytics & optimalizace konverzí
PPTX
Efektivita PPC kampani ve vyhledavacich
PPTX
Analytics Challenge
PPTX
Jak zvýšit výkon a konverzní poměr vašeho webu
PPTX
Real-time prediktivni analytika na webu
PPTX
Zakaznicka analytika – kompas pro strategicka rozhodnuti
PPTX
Email ve sluzbach retence
PPTX
Fakta a mýty o vyhodnocování online kampaní
PPTX
Nejdůlezitejsi metrika v zivote startupu
PPTX
Pragmatický návrh webu aneb co dělá UX špatně
PPTX
Kam driv skocit: konverze nebo retence?
PPTX
Jak nastartovat program optimalizace webu
PPTX
Pripadova studie implementace Omniture v CSOB Pojistovne
PPTX
Analytics + optimization = data driven website
PPTX
Education, training and career development in online analytics
PPTX
Jak na optimalizaci webu
PPTX
Mereni socialnich medii
PPTX
Vyhody pokrocilych nastroju webove analytiky
Let’s make web analytics more customer centric!
Integrace zákaznických dat skrz napříč
Universal Analytics & optimalizace konverzí
Efektivita PPC kampani ve vyhledavacich
Analytics Challenge
Jak zvýšit výkon a konverzní poměr vašeho webu
Real-time prediktivni analytika na webu
Zakaznicka analytika – kompas pro strategicka rozhodnuti
Email ve sluzbach retence
Fakta a mýty o vyhodnocování online kampaní
Nejdůlezitejsi metrika v zivote startupu
Pragmatický návrh webu aneb co dělá UX špatně
Kam driv skocit: konverze nebo retence?
Jak nastartovat program optimalizace webu
Pripadova studie implementace Omniture v CSOB Pojistovne
Analytics + optimization = data driven website
Education, training and career development in online analytics
Jak na optimalizaci webu
Mereni socialnich medii
Vyhody pokrocilych nastroju webove analytiky
Ad

Recently uploaded (20)

PDF
Approach and Philosophy of On baking technology
PDF
Optimiser vos workloads AI/ML sur Amazon EC2 et AWS Graviton
PDF
Advanced methodologies resolving dimensionality complications for autism neur...
PPTX
Big Data Technologies - Introduction.pptx
PPTX
Understanding_Digital_Forensics_Presentation.pptx
PDF
Encapsulation theory and applications.pdf
PDF
MIND Revenue Release Quarter 2 2025 Press Release
PDF
Unlocking AI with Model Context Protocol (MCP)
PDF
Encapsulation_ Review paper, used for researhc scholars
PDF
Review of recent advances in non-invasive hemoglobin estimation
PPTX
Programs and apps: productivity, graphics, security and other tools
PDF
Spectral efficient network and resource selection model in 5G networks
PPTX
Effective Security Operations Center (SOC) A Modern, Strategic, and Threat-In...
PDF
KodekX | Application Modernization Development
PDF
Network Security Unit 5.pdf for BCA BBA.
PPTX
MYSQL Presentation for SQL database connectivity
DOCX
The AUB Centre for AI in Media Proposal.docx
PDF
Chapter 3 Spatial Domain Image Processing.pdf
PDF
Mobile App Security Testing_ A Comprehensive Guide.pdf
PDF
cuic standard and advanced reporting.pdf
Approach and Philosophy of On baking technology
Optimiser vos workloads AI/ML sur Amazon EC2 et AWS Graviton
Advanced methodologies resolving dimensionality complications for autism neur...
Big Data Technologies - Introduction.pptx
Understanding_Digital_Forensics_Presentation.pptx
Encapsulation theory and applications.pdf
MIND Revenue Release Quarter 2 2025 Press Release
Unlocking AI with Model Context Protocol (MCP)
Encapsulation_ Review paper, used for researhc scholars
Review of recent advances in non-invasive hemoglobin estimation
Programs and apps: productivity, graphics, security and other tools
Spectral efficient network and resource selection model in 5G networks
Effective Security Operations Center (SOC) A Modern, Strategic, and Threat-In...
KodekX | Application Modernization Development
Network Security Unit 5.pdf for BCA BBA.
MYSQL Presentation for SQL database connectivity
The AUB Centre for AI in Media Proposal.docx
Chapter 3 Spatial Domain Image Processing.pdf
Mobile App Security Testing_ A Comprehensive Guide.pdf
cuic standard and advanced reporting.pdf

Testing & Targeting Tools

  • 1. Testing & targeting toolsJiriBrazdaFebruary 2010
  • 3. Market overviewYounger than web analytics and not as widely adopted by marketersCurrently only 26 % use A/B or MVT 1However, there is a clear synergy because optimization is logical next step after measurementSeveral sophisticated tools on the market but no vendor is clear market leaderTesting & targeting tools | www.optimics.cz3
  • 4. ImplementationImplementation difficulty driven by chosen technologyJavascript enabled (requires changes to website content)Tested elements encapsulated in javascript (eg. Google Website Optimizer)Tested elements identified automatically through DOM (eg. Vertster)DNS routing (no changes to website content)Tested elements identified and served by a proxy server (eg. SiteSpect)Testing & targeting tools | www.optimics.cz4
  • 5. SegmentationSimple tools presume that a single content combination works best across all visitor segmentsMore sophisticated tools can test and find best content combinations for different visitor segmentsSegments can be defined by dimensions & metrics usually found in web analytics toolsTesting & targeting tools | www.optimics.cz5
  • 6. TargetingTargeting means that web content is no longer the same for every visitorAfter the test is finished targeting is a means of serving winning content combinations to different visitor segmentsTargeting follows testingTesting & targeting tools | www.optimics.cz6
  • 7. StatisticsStatistical models serve to determine winning content combinationSimple tools use full factorial modelMore sophisticated tools use optimized, and therefore faster models, eg. TaguchiTesting & targeting tools | www.optimics.cz7
  • 8. Success metricsWinning content combinations can only be calculated if a success metric is definedSimple tools work only with conversionMore sophisticated tools provide engagement and revenue related metrics – this can also be done through integration with web analytics toolsTesting & targeting tools | www.optimics.cz8
  • 9. The toolsAmadesa (www.amadesa.com) Google Website Optimizer (www.google.com/websiteoptimizer) Maxymiser (www.maxymiser.com) Omniture (www.omniture.com) Optimost (www.optimost.com) SiteSpect (www.sitespect.com) Vertster (www.vertster.com) Webtrends (www.webtrends.com) Testing & targeting tools | www.optimics.cz9
  • 10. Vertster vs. Google Website OptimizerSince 2005Testing & targeting tools | www.optimics.cz10Disclosure: comparison of two MVT tools that I’m familiar with. Other tools may have more sophisticated features that differentiate them from the rest of the market.
  • 11. Research & further reading The Online Testing Vendor Landscape (Forrester Research)http://j.mp/forrester-testingTesting & targeting tools | www.optimics.cz11
  • 13. Emerging technologyThere is a variety of emerging technology tools positioning themselves asBehavioral targetingRetargetingRemarketingetc.These tools primarily utilize knowledge of past individual visitor behavior but they can also involve some degree of testingTesting & targeting tools | www.optimics.cz13
  • 14. The toolsBTBuckets (www.btbuckets.com) Onsite behavioral targeting, freeCognitive Match (www.cognitivematch.com) Content targeting using artificial intelligencePerformable (www.performable.com) Currently brewing in betaSeeWhy (www.seewhy.com) Remarketing shopping cart abandoners, freeSitebrand (www.sitebrand.com) Segmentation, targeting, personalizationTesting & targeting tools | www.optimics.cz14
  • 15. Assessing your capability >Where are you?
  • 16. Testing & targeting tools | www.optimics.cz16TestingMASSSEGMENTSINDIVIDUALPricingCampaignsProductsContentAre you here?No testingTargeting