.conf2011: Web Analytics Throwdown: with NPR and Intuit
Download as PPT, PDF0 likes540 views
The document outlines a keynote presentation on web analytics, focusing on using Splunk for data analysis. It includes techniques for processing raw logs, tracking user engagement through audio and video, and generating reports on podcast performance and story popularity. The presentation features tools for filtering user access data, analyzing upgrade rates, and identifying trending stories based on social media engagement.
![Audio and Video Tracking: The Basic Setup MP3 Downloads On Demand Flash Live Streams ProgramID (?P<ProgramID>[^\/]*)(?=\/) UserAgent (?P<UserAgent>[^\"]*)(?=\" ) AppVersion “ *(? =\/) ” Ingest Raw Data Extract Fields Define Transactions > sourcetype = download AND status < 300 AND Method=Get | transaction IPAddress UserAgent maxspan=120… Create Summary Indexes 08/08/2011=>31800 08/09/2011=>29655 08/10/2011=>29903 08/11/2011=>53443 08/12/2011=>32593 08/13/2011=>88654 08/14/2011=>11231 1 2 3 4](https://image.slidesharecdn.com/finalnprrusselsuh-1-110928001511-phpapp02/85/conf2011-Web-Analytics-Throwdown-with-NPR-and-Intuit-4-320.jpg)
![> * | rex field=_raw "Darwin\/(?<Version>[0-9\.]*)\"“ | top Version “ What percentage of our users have upgraded?” Uses regex to extract element from raw log "NPRMusic/2.7 CFNetwork/459 Darwin/10.0.0d3"](https://image.slidesharecdn.com/finalnprrusselsuh-1-110928001511-phpapp02/85/conf2011-Web-Analytics-Throwdown-with-NPR-and-Intuit-7-320.jpg)
.conf2011: Web Analytics Throwdown: with NPR and Intuit
- 1. .conf 2011 Keynote Outline August 15, 2011 Web Analytics Throwdown with NPR and Intuit Sondra Russell and Tim Suh
- 2. 24/7
- 3. Why Splunk? I started using Splunk because I could… I fell in love because I could…. Crunch raw logs Make pretty reports Still go back into the raw data Easily group scattered log lines into single transactions Slice and dice in new ways Actually use data to inform decisions
- 4. Audio and Video Tracking: The Basic Setup MP3 Downloads On Demand Flash Live Streams ProgramID (?P<ProgramID>[^\/]*)(?=\/) UserAgent (?P<UserAgent>[^\"]*)(?=\" ) AppVersion “ *(? =\/) ” Ingest Raw Data Extract Fields Define Transactions > sourcetype = download AND status < 300 AND Method=Get | transaction IPAddress UserAgent maxspan=120… Create Summary Indexes 08/08/2011=>31800 08/09/2011=>29655 08/10/2011=>29903 08/11/2011=>53443 08/12/2011=>32593 08/13/2011=>88654 08/14/2011=>11231 1 2 3 4
- 5. > index=“summary” search_name=“ si_download_programID ” ProgramName= “ All Songs Considered ” “ How has my podcast been doing?” pulls from the summary index maps ProgramID to lookup table
- 6. > * | eval Platform = mvfilter(match(eventtype,"plat*")) | timechart span=1w count by Platform “ What platforms are people using to access our show?” Filters for eventtypes that include “plat” plat_iphone_browser UserAgent="*iPhone*" AND UserAgent!="*NPRRadio*" AND UserAgent!="*iPod*“ AND sc!=18
- 7. > * | rex field=_raw "Darwin\/(?<Version>[0-9\.]*)\"“ | top Version “ What percentage of our users have upgraded?” Uses regex to extract element from raw log "NPRMusic/2.7 CFNetwork/459 Darwin/10.0.0d3"
- 8. > index=“twitter” | stats count by story_url “ Which stories are getting Tweeted the most?” timestamp ="2011-07-18T15:40:34Z", author ="drpdtapp (Dr. P. D Tapp)", tweet ="Tinnitus: Why Won't My Ears Stop Ringing?”, story_url ="http://www.npr.org/2011/07/18/138163304/tinnitus-why-wont-my-ears-stop-ringing?sc=tw", Creates reports from a custom log
- 9. .conf 2011 Keynote Outline August 15, 2011 Questions? Sondra Russell and Tim Suh