SlideShare a Scribd company logo

Making sense of users' Web activities

Download as PPTX, PDF
Mathieu d'Aquin, profile picture
Mathieu d'Aquin

1) The document discusses monitoring and logging a user's web activities and information exchanges over time to gain a better understanding of what personal information is known by various websites. 2) It proposes locally logging HTTP requests and responses to collect data on a user's web browsing over a period of 2.5 months, which generated around 3 million requests and 100 million RDF triples of log data. 3) The log data is formatted in RDF to represent information about each web request and response such as the URL, headers, response code, and cookies in a structured format.

Technology
1 of 29
Downloaded 23 times
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
Making sense of Users’ Web activitiesMathieu d'AquinKnowledge Media Institute, The Open University, UK
A bit of sci-fi to start with“… from people who are afraid that someone else knows information that they don’t and is gaining an unfair advantage by it. For all the claims one hears about the liberating impact of the data-net, the truth is that it whished on most of us a brand-new reason for paranoia” John Brunner, The Shockwave Rider, 1975
What we don’t know that they knowSimple important things:And more complex important things…What are all the websites that know my e-mail address?What does amazon.co.uk or the website of my favorite airline know about me?
Is this Personal Information Management?Yes, but…Looking at individual user’s information exchange and more generally activities on the WebThis is :BigHeterogeneousDistributedFragmentedSometimes implicitAnd hard to collect!
So, what do we do?Unrestricted monitoring of information exchange on the Web by an individual user
Local LoggingProxyHTTP RequestsHTTP RequestsLocal Web Agents (e.g., browser)External Web SitesHTTP ResponsesHTTP ResponsesWeb Exchange RDF Logs
<Request rdf:about="#request-1257949232709-1257949233757"> <startedAt>1257949232709</startedAt> <endedAt>1257949233757</endedAt> <origin rdf:resource="127.0.0.1" /> <onPort>80</onPort> <toHostrdf:resource="api.facebook.com" /> <method rdf:resource="POST"/> <toURLrdf:resource="http://api.facebook.com/restserver.php" /> <HTTPVersionrdf:resource="HTTP-1.1" /> <Host rdf:resource="api.facebook.com" /> <Content-Type rdf:resource="application--x-www-form-urlencoded" /> <User-Agent rdf:resource="Mozilla--5.0_(Macintosh;_U;_Intel_Mac_OS_X;_en)_AppleWebKit--526.9+_(KHTML._like_Gecko)_AdobeAIR--1.5.2" /> <Refererrdf:resource="app:--TweetDeck.swf" /> <X-Flash-Version rdf:resource="10.0.32.18" /> <Accept rdf:resource="*--*" /> <Accept-Language rdf:resource="en-us" /> <Accept-Encoding rdf:resource="gzip._deflate" /> <Cookie rdf:resource= "__qca=1239783354-42963995-12118014;___utma=87286159.357565716.1239892196.1252686326.1257582307.16;___utmz=87286159.1257582307.16.16.utmccn= (referral)|utmcsr=facebook.com|utmcct=--tos.php|utmcmd=referral;_c_user=605559235;_cur_max_lag=2;_datr=1239398136-0711bf1215821a9c58848bf0ffd0020ec8450cfa7154b9e228c29;_lsd=P3Zpn;_lxe=metm.daquin%40virgin.net;_lxs=3;_s_vsn_facebookpoc_1=9874874320812" /> <Content-Length rdf:resource="984" /> <Connection rdf:resource="keep-alive" /> <Proxy-Connection rdf:resource="keep-alive" /> <data rdf:resource="data_c22b691f691dabd5ae893b9cb2f8add7" /> <response> <Response rdf:about="#response-1257949232709--1257949233757"> <HTTPVersionrdf:resource="HTTP--1.0" /> <responseCoderdf:resource="200_OK" /> <Cache-Control rdf:resource="private._no-store._no-cache._must-revalidate._post-check=0._pre-check=0" /> <Content-Type rdf:resource="application--json" /> <Expires rdf:resource="Mon._26_Jul_1997_05:00:00_GMT" /> <Pragmardf:resource="no-cache" /> <Content-Encoding rdf:resource="gzip" /> <Content-Length rdf:resource="5943" /> <X-Cache rdf:resource="MISS_from_roeburn.open.ac.uk" /> <Proxy-Connection rdf:resource="keep-alive" /> <data rdf:resource="data_5ccf6054fd0fba3ee7eb444e178eaf19" /> </Response></response></Request><Request rdf:about="#request-1257949232709-1257949233757"> <startedAt>1257949232709</startedAt> <endedAt>1257949233757</endedAt> <origin rdf:resource="127.0.0.1" /> <onPort>80</onPort> <toHostrdf:resource="api.facebook.com" /> <method rdf:resource="POST"/> <toURLrdf:resource="http://api.facebook.com/restserver.php" /> <HTTPVersionrdf:resource="HTTP-1.1" /> <Host rdf:resource="api.facebook.com" /> <Content-Type rdf:resource="application--x-www-form-urlencoded" /> <User-Agent rdf:resource="Mozilla--5.0_(Macintosh;_U;_Intel_Mac_OS_X;_en)_AppleWebKit--526.9+_(KHTML._like_Gecko)_AdobeAIR--1.5.2" /> <Refererrdf:resource="app:--TweetDeck.swf" /> <X-Flash-Version rdf:resource="10.0.32.18" /> <Accept rdf:resource="*--*" /> <Accept-Language rdf:resource="en-us" /> <Accept-Encoding rdf:resource="gzip._deflate" /> <Cookie rdf:resource= "__qca=1239783354-42963995-12118014;___utma=87286159.357565716.1239892196.1252686326.1257582307.16;___utmz=87286159.1257582307.16.16.utmccn= (referral)|utmcsr=facebook.com|utmcct=--tos.php|utmcmd=referral;_c_user=605559235;_cur_max_lag=2;_datr=1239398136-0711bf1215821a9c58848bf0ffd0020ec8450cfa7154b9e228c29;_lsd=P3Zpn;_lxe=metm.daquin%40virgin.net;_lxs=3;_s_vsn_facebookpoc_1=9874874320812" /> <Content-Length rdf:resource="984" /> <Connection rdf:resource="keep-alive" /> <Proxy-Connection rdf:resource="keep-alive" /> <data rdf:resource="data_c22b691f691dabd5ae893b9cb2f8add7" /> <response> <Response rdf:about="#response-1257949232709--1257949233757"> <HTTPVersionrdf:resource="HTTP--1.0" /> <responseCoderdf:resource="200_OK" /> <Cache-Control rdf:resource="private._no-store._no-cache._must-revalidate._post-check=0._pre-check=0" /> <Content-Type rdf:resource="application--json" /> <Expires rdf:resource="Mon._26_Jul_1997_05:00:00_GMT" /> <Pragmardf:resource="no-cache" /> <Content-Encoding rdf:resource="gzip" /> <Content-Length rdf:resource="5943" /> <X-Cache rdf:resource="MISS_from_roeburn.open.ac.uk" /> <Proxy-Connection rdf:resource="keep-alive" /> <data rdf:resource="data_5ccf6054fd0fba3ee7eb444e178eaf19" /> </Response></response></Request><Request rdf:about="#request-1257949232709-1257949233757"> <startedAt>1257949232709</startedAt> <endedAt>1257949233757</endedAt> <origin rdf:resource="127.0.0.1" /> <onPort>80</onPort> <toHostrdf:resource="api.facebook.com" /> <method rdf:resource="POST"/> <toURLrdf:resource="http://api.facebook.com/restserver.php" /> <HTTPVersionrdf:resource="HTTP-1.1" /> <Host rdf:resource="api.facebook.com" /> <Content-Type rdf:resource="application--x-www-form-urlencoded" /> <User-Agent rdf:resource="Mozilla--5.0_(Macintosh;_U;_Intel_Mac_OS_X;_en)_AppleWebKit--526.9+_(KHTML._like_Gecko)_AdobeAIR--1.5.2" /> <Refererrdf:resource="app:--TweetDeck.swf" /> <X-Flash-Version rdf:resource="10.0.32.18" /> <Accept rdf:resource="*--*" /> <Accept-Language rdf:resource="en-us" /> <Accept-Encoding rdf:resource="gzip._deflate" /> <Cookie rdf:resource= "__qca=1239783354-42963995-12118014;___utma=87286159.357565716.1239892196.1252686326.1257582307.16;___utmz=87286159.1257582307.16.16.utmccn= (referral)|utmcsr=facebook.com|utmcct=--tos.php|utmcmd=referral;_c_user=605559235;_cur_max_lag=2;_datr=1239398136-0711bf1215821a9c58848bf0ffd0020ec8450cfa7154b9e228c29;_lsd=P3Zpn;_lxe=metm.daquin%40virgin.net;_lxs=3;_s_vsn_facebookpoc_1=9874874320812" /> <Content-Length rdf:resource="984" /> <Connection rdf:resource="keep-alive" /> <Proxy-Connection rdf:resource="keep-alive" /> <data rdf:resource="data_c22b691f691dabd5ae893b9cb2f8add7" /> <response> <Response rdf:about="#response-1257949232709--1257949233757"> <HTTPVersionrdf:resource="HTTP--1.0" /> <responseCoderdf:resource="200_OK" /> <Cache-Control rdf:resource="private._no-store._no-cache._must-revalidate._post-check=0._pre-check=0" /> <Content-Type rdf:resource="application--json" /> <Expires rdf:resource="Mon._26_Jul_1997_05:00:00_GMT" /> <Pragmardf:resource="no-cache" /> <Content-Encoding rdf:resource="gzip" /> <Content-Length rdf:resource="5943" /> <X-Cache rdf:resource="MISS_from_roeburn.open.ac.uk" /> <Proxy-Connection rdf:resource="keep-alive" /> <data rdf:resource="data_5ccf6054fd0fba3ee7eb444e178eaf19" /> </Response></response></Request>2.5 months = 3 Million HTTP Requests100 Million RDF Triples<Request rdf:about="#request-1257949232709-1257949233757"> <startedAt>1257949232709</startedAt> <endedAt>1257949233757</endedAt> <origin rdf:resource="127.0.0.1" /> <onPort>80</onPort> <toHostrdf:resource="api.facebook.com" /> <method rdf:resource="POST"/> <toURLrdf:resource="http://api.facebook.com/restserver.php" /> <HTTPVersionrdf:resource="HTTP-1.1" /> <Host rdf:resource="api.facebook.com" /> <Content-Type rdf:resource="application--x-www-form-urlencoded" /> <User-Agent rdf:resource="Mozilla--5.0_(Macintosh;_U;_Intel_Mac_OS_X;_en)_AppleWebKit--526.9+_(KHTML._like_Gecko)_AdobeAIR--1.5.2" /> <Refererrdf:resource="app:--TweetDeck.swf" /> <X-Flash-Version rdf:resource="10.0.32.18" /> <Accept rdf:resource="*--*" /> <Accept-Language rdf:resource="en-us" /> <Accept-Encoding rdf:resource="gzip._deflate" /> <Cookie rdf:resource= "__qca=1239783354-42963995-12118014;___utma=87286159.357565716.1239892196.1252686326.1257582307.16;___utmz=87286159.1257582307.16.16.utmccn= (referral)|utmcsr=facebook.com|utmcct=--tos.php|utmcmd=referral;_c_user=605559235;_cur_max_lag=2;_datr=1239398136-0711bf1215821a9c58848bf0ffd0020ec8450cfa7154b9e228c29;_lsd=P3Zpn;_lxe=metm.daquin%40virgin.net;_lxs=3;_s_vsn_facebookpoc_1=9874874320812" /> <Content-Length rdf:resource="984" /> <Connection rdf:resource="keep-alive" /> <Proxy-Connection rdf:resource="keep-alive" /> <data rdf:resource="data_c22b691f691dabd5ae893b9cb2f8add7" /> <response> <Response rdf:about="#response-1257949232709--1257949233757"> <HTTPVersionrdf:resource="HTTP--1.0" /> <responseCoderdf:resource="200_OK" /> <Cache-Control rdf:resource="private._no-store._no-cache._must-revalidate._post-check=0._pre-check=0" /> <Content-Type rdf:resource="application--json" /> <Expires rdf:resource="Mon._26_Jul_1997_05:00:00_GMT" /> <Pragmardf:resource="no-cache" /> <Content-Encoding rdf:resource="gzip" /> <Content-Length rdf:resource="5943" /> <X-Cache rdf:resource="MISS_from_roeburn.open.ac.uk" /> <Proxy-Connection rdf:resource="keep-alive" /> <data rdf:resource="data_5ccf6054fd0fba3ee7eb444e178eaf19" /> </Response></response></Request><Request rdf:about="#request-1257949232709-1257949233757"> <startedAt>1257949232709</startedAt> <endedAt>1257949233757</endedAt> <origin rdf:resource="127.0.0.1" /> <onPort>80</onPort> <toHostrdf:resource="api.facebook.com" /> <method rdf:resource="POST"/> <toURLrdf:resource="http://api.facebook.com/restserver.php" /> <HTTPVersionrdf:resource="HTTP-1.1" /> <Host rdf:resource="api.facebook.com" /> <Content-Type rdf:resource="application--x-www-form-urlencoded" /> <User-Agent rdf:resource="Mozilla--5.0_(Macintosh;_U;_Intel_Mac_OS_X;_en)_AppleWebKit--526.9+_(KHTML._like_Gecko)_AdobeAIR--1.5.2" /> <Refererrdf:resource="app:--TweetDeck.swf" /> <X-Flash-Version rdf:resource="10.0.32.18" /> <Accept rdf:resource="*--*" /> <Accept-Language rdf:resource="en-us" /> <Accept-Encoding rdf:resource="gzip._deflate" /> <Cookie rdf:resource= "__qca=1239783354-42963995-12118014;___utma=87286159.357565716.1239892196.1252686326.1257582307.16;___utmz=87286159.1257582307.16.16.utmccn= (referral)|utmcsr=facebook.com|utmcct=--tos.php|utmcmd=referral;_c_user=605559235;_cur_max_lag=2;_datr=1239398136-0711bf1215821a9c58848bf0ffd0020ec8450cfa7154b9e228c29;_lsd=P3Zpn;_lxe=metm.daquin%40virgin.net;_lxs=3;_s_vsn_facebookpoc_1=9874874320812" /> <Content-Length rdf:resource="984" /> <Connection rdf:resource="keep-alive" /> <Proxy-Connection rdf:resource="keep-alive" /> <data rdf:resource="data_c22b691f691dabd5ae893b9cb2f8add7" /> <response> <Response rdf:about="#response-1257949232709--1257949233757"> <HTTPVersionrdf:resource="HTTP--1.0" /> <responseCoderdf:resource="200_OK" /> <Cache-Control rdf:resource="private._no-store._no-cache._must-revalidate._post-check=0._pre-check=0" /> <Content-Type rdf:resource="application--json" /> <Expires rdf:resource="Mon._26_Jul_1997_05:00:00_GMT" /> <Pragmardf:resource="no-cache" /> <Content-Encoding rdf:resource="gzip" /> <Content-Length rdf:resource="5943" /> <X-Cache rdf:resource="MISS_from_roeburn.open.ac.uk" /> <Proxy-Connection rdf:resource="keep-alive" /> <data rdf:resource="data_5ccf6054fd0fba3ee7eb444e178eaf19" /> </Response></response></Request>
What this talk is aboutUsing ontologies and external datasets to Generate abstractions of this low level dataEnrich it with external knowledge and modelsInterpret to give back useful information to the user
Online Activities Ontology HTTP Ontology Parameters and Website info.Personal InformationWeb Site InformationTrust ModelLocation Information
HTTP OntologyBuilt bottom-up from the dataCan help inferring simple things from itAnd answer questions through SPARQL queriesInternetPoint time: DateTimeorigineRequest time: DateTimetoURL: URLreferer: URLtoHostWebHost domain: StringUser-AgentWebAgent ID: StringhasResponseContentContent-TypeResponse time: DateTimeresponseCode: intDataFile ID: StringContentContent-TypeDataFormatMineID: String
Simple examplesRequests per time of dayRequests per User AgentsRequests per Host
Integrating basic infoDomain nameIPLocation“What!? What requests have I made to websites in Nigeria? What Data did I send?”Can be answered in a SPARQL query
More information about websitesThe linked data cloud is full of it.Using the domain name to address this information.CONSTRUCT {<domain_name> ?p ?y}WHERE {{{?xdbpedia:homepage <http://domain_name>}. {?x ?p ?y}}UNION {{?xowl:sameAs ?z}. {?xdbpedia:homepage <http://domain_name>}. {?x ?p ?y}}}
ExamplesGoogle ServicesEntertainment WebsitesWeb AnalyticsInternet Search Enginesubject/categoryVideo sharingVideo Hostingwww.google-analytics.comCompanydeveloperWeb Search EngineSearch Enginetypesubject/categorygoogleownersubsediaryOfwww.youtube.comwww.google.comparentDBpediafreebase
ActivitiesCan we now understand the user activities?Based on website categories and on their parameters:GET http://uk.search.yahoo.com/beacon/module?p=idiocracy&url=http%3A%2F%2Fwww.imdb.com%2Ftitle%2Ftt0387808%2FPOST format=JSON&method=fql%2Emultiquery&api%5Fkey=51d350e8d92da1f5623512a9e801da2b&v =1%2E0&queries=%7B%22query2%22%3A%22SELECT%20app%5Fid%2C%20display%5Fname%20FROM %20application%20WHERE%20app%5Fid%20IN%20%28SELECT%20app%5Fid%20FROM%20%23query1 %29%22%2C%22query1%22%3A%22SELECT%20post%5Fid%2C%20source%5Fid%2C%20created%5Ftime%2C%20updated%5Ftime%2C%20actor%5Fid%2C%20target%5Fid%2C%20app%5Fid%2C%20message%2C%20attachment%2C%20comments%2C%20likes%2C%20permalink%2C%20attribution%2C%20type%20FROM%20stream%20WHERE%20filter%5Fkey%20IN%20%28SELECT%20filter%5Fkey%20FROM%20stream%5Ffilter%20WHERE%20uid%20%3D%20605559235%20AND%20type%20%3D%20%27newsfeed%27%29%20AND%20%28created%5Ftime%20%3E%3D%201257443596%29%20AND%20%28%28created%5Ftime%20%3E%201257945423%29%20OR%20%28updated%5Ftime%20%21%3D%20created%5Ftime%29%29%20ORDER%20BY%20created%5Ftime%20DESC%20LIMIT%20200%22%7D&call%5Fid=12565739074246102&sig=01a13a72825ed83ed6d23bdf2791ad1a&session%5Fkey=be312ffdf9b9e1a5ec6c5768%2D605559235
Activities in an OntologyDerived in a bottom-up way from categories of activities/requestCan be used to characterize overall activities, individual activities or correlations between activities ActivityBasedRequestImplicitActivityExplicitActivityReportToAnalyticsSearchCheckStatusFeedSearchVideoSearchImageAutoCheckStatusFeedFollowLinkManualCheckStatusFeedFollowSearchResult
Example Activity: SearchSearch keywords
Example Activity: SearchinverseOf(linked-followed, referer)InformationalSearch= SearchRequest and min 2 link-followedNavigationalSearch= SearchRequest and =1 link-followedProminence of Navigational SearchesIndexedSite= exists refererNavigationalSearchIndexedSite(?x), NavigationalSearch(?y), referer(?x, ?y), searchTerm(?y, ?z) IndexedWithKeyword(?x, ?z)
Example Activity: SearchSearch KeywordsOpenCalaisTopics of interest
Personal data exchangeRequest ParametersPersonal Information (Profile)Trust Model
Tool used to create mappings between data sent to websites (from logs on the right) with the user profile (left). Effectively reconstructing the profile from the data
User profile re-constructed from Web activities36 attributes, 1,080 values, to 123 domainsA model of what piece of personal information was sent where (can answer the questions)
What that tells us about trustTaking the point of view of an external observer, we can derive an observed model of trust and criticality of dataIf this piece of data is critical to you and you give it to bob, you must trust bobIf you give this piece of data to many untrusted people, you probably don’t consider it critical
FormallyTrust in a domain = max of criticality of data it receivedCriticality of a piece of data= 1 / 1 + Σ (1- trust in websites that received the data)Obviously, these 2 formulas are interdependent. Treating them as a sequence, with initial values at 0.5
Interacting with the modelExpose the user to his own observed behavior has observed, so that he can try to align it to his intended behavior
Demo
ConclusionFirst set tools exploiting logs of personal Web activity Demonstrate the need for ways to abstract and interpreter activity data, to support Web UsersDemonstrate the ability of semantic technologies, ontologies and the enrichment through external data, to provide such abilities
So much more to doCan I collect this tweet? From HTTPS? From my mobile phone?Can I link it to where I am?To what I’m doing? To what I have been doing?To the abstract of the presentation? To the slides on SlideShare.net? To blogs mentioning it?Can I cope with the scale of all this information? Can I decide what to share? Can I store all this securely? Can I get usable access to it? Can I learn something from it?
Thank youm.daquin@open.ac.uk@mdaquin

More Related Content

PPT
Advanced SEO for Web Developers
Nathan Buggia
 
PPT
Getting More Traffic From Search Advanced Seo For Developers Presentation
Seo Indonesia
 
PPTX
The internet for SEOs by Roxana Stingu
Roxana Stingu
 
PPTX
.htaccess for SEOs - A presentation by Roxana Stingu
Roxana Stingu
 
PDF
CITEC #CON2-Dirty Attack with Google Hacking
Prathan Phongthiproek
 
ODP
Web Browser Basics, Tips & Tricks - Draft 20 (Revised 5/18/17)
msz
 
PDF
20190516 web security-basic
MksYi
 
PDF
Impact of HTTP Cookie Violations in Web Archives
Sawood Alam
 
Advanced SEO for Web Developers
Nathan Buggia
 
Getting More Traffic From Search Advanced Seo For Developers Presentation
Seo Indonesia
 
The internet for SEOs by Roxana Stingu
Roxana Stingu
 
.htaccess for SEOs - A presentation by Roxana Stingu
Roxana Stingu
 
CITEC #CON2-Dirty Attack with Google Hacking
Prathan Phongthiproek
 
Web Browser Basics, Tips & Tricks - Draft 20 (Revised 5/18/17)
msz
 
20190516 web security-basic
MksYi
 
Impact of HTTP Cookie Violations in Web Archives
Sawood Alam
 

What's hot (20)

PDF
Scraping with Python for Fun and Profit - PyCon India 2010
Abhishek Mishra
 
PDF
How I learned to stop worrying and love the .htaccess file
Roxana Stingu
 
PDF
The Case for HTTP/2
Andy Davies
 
PPT
courts circuits : l'innovation dans le luxe 'mon idendité de luxe" (partie 3)
nous sommes vivants
 
PDF
Supporting Web Archiving via Web Packaging
Sawood Alam
 
PPTX
Introduction to google hacking database
imthebeginner
 
PPT
Web Browsers And Other Mistakes
kuza55
 
PDF
Google Hacking 101
Sais Abdelkrim
 
PDF
Readying Web Archives to Consume and Leverage Web Bundles
Sawood Alam
 
PPTX
Maven Plugins
Evgeny Goldin
 
PPT
Web Browsers And Other Mistakes
guest2821a2
 
PDF
Mobile Web Performance - Getting and Staying Fast
Andy Davies
 
PPTX
"RDFa - what, why and how?" by Mike Hewett and Shamod Lacoul
Shamod Lacoul
 
PDF
RDFa: introduction, comparison with microdata and microformats and how to use it
Jose Luis Lopez Pino
 
PDF
Web Page Test - Beyond the Basics
Andy Davies
 
PDF
HTTP cookie hijacking in the wild: security and privacy implications
Priyanka Aash
 
PDF
Asp.Net difference faqs- 4
Umar Ali
 
PDF
Google Hack
mukundcpilankar
 
PPT
Phpvsjsp
guest5b4d24
 
PPTX
Google Dorks
Andrea D'Ubaldo
 
Scraping with Python for Fun and Profit - PyCon India 2010
Abhishek Mishra
 
How I learned to stop worrying and love the .htaccess file
Roxana Stingu
 
The Case for HTTP/2
Andy Davies
 
courts circuits : l'innovation dans le luxe 'mon idendité de luxe" (partie 3)
nous sommes vivants
 
Supporting Web Archiving via Web Packaging
Sawood Alam
 
Introduction to google hacking database
imthebeginner
 
Web Browsers And Other Mistakes
kuza55
 
Google Hacking 101
Sais Abdelkrim
 
Readying Web Archives to Consume and Leverage Web Bundles
Sawood Alam
 
Maven Plugins
Evgeny Goldin
 
Web Browsers And Other Mistakes
guest2821a2
 
Mobile Web Performance - Getting and Staying Fast
Andy Davies
 
"RDFa - what, why and how?" by Mike Hewett and Shamod Lacoul
Shamod Lacoul
 
RDFa: introduction, comparison with microdata and microformats and how to use it
Jose Luis Lopez Pino
 
Web Page Test - Beyond the Basics
Andy Davies
 
HTTP cookie hijacking in the wild: security and privacy implications
Priyanka Aash
 
Asp.Net difference faqs- 4
Umar Ali
 
Google Hack
mukundcpilankar
 
Phpvsjsp
guest5b4d24
 
Google Dorks
Andrea D'Ubaldo
 
Ad

Viewers also liked (8)

PDF
OpenData in OpenEd (beyond OERs)
Mathieu d'Aquin
 
PPTX
How much Semantic Data on Small Devices?
Mathieu d'Aquin
 
PPTX
Building the Open University's Web of Linked Data
Mathieu d'Aquin
 
PPTX
NeOn Tool Support for Building Ontologies By Reuse - ICBO 09
Mathieu d'Aquin
 
PPT
Using Linked Data in Learning Analytics tutorial - Introduction and basics of...
Mathieu d'Aquin
 
PPT
Referendum Oosterweelverbinding - Doe mee!
Stedelijke Jeugdraad
 
PPTX
Quick overview of the use of linked data in sociallearn
Mathieu d'Aquin
 
PPT
Linked Data as a new environment for Learning Analytics and education
Mathieu d'Aquin
 
OpenData in OpenEd (beyond OERs)
Mathieu d'Aquin
 
How much Semantic Data on Small Devices?
Mathieu d'Aquin
 
Building the Open University's Web of Linked Data
Mathieu d'Aquin
 
NeOn Tool Support for Building Ontologies By Reuse - ICBO 09
Mathieu d'Aquin
 
Using Linked Data in Learning Analytics tutorial - Introduction and basics of...
Mathieu d'Aquin
 
Referendum Oosterweelverbinding - Doe mee!
Stedelijke Jeugdraad
 
Quick overview of the use of linked data in sociallearn
Mathieu d'Aquin
 
Linked Data as a new environment for Learning Analytics and education
Mathieu d'Aquin
 
Ad

Similar to Making sense of users' Web activities (20)

ODP
Sword v2 at UKCoRR
SWORD Project
 
PDF
Google Devfest Singapore - OpenSocial
Patrick Chanezon
 
ODP
Moving from Web 1.0 to Web 2.0
Estelle Weyl
 
PPT
Agile Descriptions
Tony Hammond
 
ODP
Clustering Made Easier: Using Terracotta with Hibernate and/or EHCache
Cris Holdorph
 
PPT
The Semantic Web An Introduction
shaouy
 
PPT
BarCamp KL H20 Open Social Hackathon
marvin337
 
PDF
REST Introduction (PHP London)
Paul James
 
PPT
Semantic Web, an introduction for bioscientists
Emanuele Della Valle
 
PPT
IMS Learning Tools Interoperability @ UCLA
Charles Severance
 
PPT
CrossRef How-to: A Technical Introduction to the Basics of CrossRef, Chuck Ko...
Crossref
 
PDF
Computer Networks: An Introduction
sanand0
 
PPTX
WWW and HTTP
BG Java EE Course
 
ODP
Web Scraping with PHP
Matthew Turland
 
PPT
Linked Data and Search: Thomas Steiner (Google Inc, Germany)
FIA2010
 
PPT
Incorporating Web Services in Mobile Applications - Web 2.0 San Fran 2009
Aduci
 
PPT
SearchMonkey
Paul Tarjan
 
PPTX
Building high performance web apps.
Arshak Movsisyan
 
PDF
The secret web performance metric no one is talking about
Anna Migas
 
PDF
HTTP2
Mateus Prado
 
Sword v2 at UKCoRR
SWORD Project
 
Google Devfest Singapore - OpenSocial
Patrick Chanezon
 
Moving from Web 1.0 to Web 2.0
Estelle Weyl
 
Agile Descriptions
Tony Hammond
 
Clustering Made Easier: Using Terracotta with Hibernate and/or EHCache
Cris Holdorph
 
The Semantic Web An Introduction
shaouy
 
BarCamp KL H20 Open Social Hackathon
marvin337
 
REST Introduction (PHP London)
Paul James
 
Semantic Web, an introduction for bioscientists
Emanuele Della Valle
 
IMS Learning Tools Interoperability @ UCLA
Charles Severance
 
CrossRef How-to: A Technical Introduction to the Basics of CrossRef, Chuck Ko...
Crossref
 
Computer Networks: An Introduction
sanand0
 
WWW and HTTP
BG Java EE Course
 
Web Scraping with PHP
Matthew Turland
 
Linked Data and Search: Thomas Steiner (Google Inc, Germany)
FIA2010
 
Incorporating Web Services in Mobile Applications - Web 2.0 San Fran 2009
Aduci
 
SearchMonkey
Paul Tarjan
 
Building high performance web apps.
Arshak Movsisyan
 
The secret web performance metric no one is talking about
Anna Migas
 
HTTP2
Mateus Prado
 

More from Mathieu d'Aquin (20)

PDF
A factorial study of neural network learning from differences for regression
Mathieu d'Aquin
 
PDF
Recentrer l'intelligence artificielle sur les connaissances
Mathieu d'Aquin
 
PDF
Data and Knowledge as Commodities
Mathieu d'Aquin
 
PDF
Unsupervised learning approach for identifying sub-genres in music scores
Mathieu d'Aquin
 
PDF
Is knowledge engineering still relevant?
Mathieu d'Aquin
 
PDF
A data view of the data science process
Mathieu d'Aquin
 
PDF
Dealing with Open Domain Data
Mathieu d'Aquin
 
PDF
Web Analytics for Everyday Learning
Mathieu d'Aquin
 
PDF
Presentation a in ovive montpellier - 26%2 f06%2f2018 (1)
Mathieu d'Aquin
 
PDF
Learning Analytics: understand learning and support the learner
Mathieu d'Aquin
 
PDF
The AFEL Project
Mathieu d'Aquin
 
PDF
Assessing the Readability of Policy Documents: The Case of Terms of Use of On...
Mathieu d'Aquin
 
PDF
Data ethics
Mathieu d'Aquin
 
PDF
Data for Learning and Learning with Data
Mathieu d'Aquin
 
PDF
Towards an “Ethics in Design” methodology for AI research projects
Mathieu d'Aquin
 
PDF
AFEL: Towards Measuring Online Activities Contributions to Self-Directed Lear...
Mathieu d'Aquin
 
PDF
Profiling information sources and services for discovery
Mathieu d'Aquin
 
PDF
Analyse de données et de réseaux sociaux pour l’aide à l’apprentissage infor...
Mathieu d'Aquin
 
PDF
From Knowledge Bases to Knowledge Infrastructures for Intelligent Systems
Mathieu d'Aquin
 
PDF
Data analytics beyond data processing and how it affects Industry 4.0
Mathieu d'Aquin
 
A factorial study of neural network learning from differences for regression
Mathieu d'Aquin
 
Recentrer l'intelligence artificielle sur les connaissances
Mathieu d'Aquin
 
Data and Knowledge as Commodities
Mathieu d'Aquin
 
Unsupervised learning approach for identifying sub-genres in music scores
Mathieu d'Aquin
 
Is knowledge engineering still relevant?
Mathieu d'Aquin
 
A data view of the data science process
Mathieu d'Aquin
 
Dealing with Open Domain Data
Mathieu d'Aquin
 
Web Analytics for Everyday Learning
Mathieu d'Aquin
 
Presentation a in ovive montpellier - 26%2 f06%2f2018 (1)
Mathieu d'Aquin
 
Learning Analytics: understand learning and support the learner
Mathieu d'Aquin
 
The AFEL Project
Mathieu d'Aquin
 
Assessing the Readability of Policy Documents: The Case of Terms of Use of On...
Mathieu d'Aquin
 
Data ethics
Mathieu d'Aquin
 
Data for Learning and Learning with Data
Mathieu d'Aquin
 
Towards an “Ethics in Design” methodology for AI research projects
Mathieu d'Aquin
 
AFEL: Towards Measuring Online Activities Contributions to Self-Directed Lear...
Mathieu d'Aquin
 
Profiling information sources and services for discovery
Mathieu d'Aquin
 
Analyse de données et de réseaux sociaux pour l’aide à l’apprentissage infor...
Mathieu d'Aquin
 
From Knowledge Bases to Knowledge Infrastructures for Intelligent Systems
Mathieu d'Aquin
 
Data analytics beyond data processing and how it affects Industry 4.0
Mathieu d'Aquin
 

Recently uploaded (20)

PDF
Spectral efficient network and resource selection model in 5G networks
IAESIJAI
 
PPTX
Detection-First SIEM: Rule Types, Dashboards, and Threat-Informed Strategy
ReZa AdineH
 
PDF
Unlocking AI with Model Context Protocol (MCP)
Brian McKeiver
 
PPTX
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
blackmambaettijean
 
PDF
Empathic Computing: Creating Shared Understanding
Mark Billinghurst
 
PDF
Modernizing your data center with Dell and AMD
Principled Technologies
 
PPTX
Digital-Transformation-Roadmap-for-Companies.pptx
David Malick Dieng
 
PPTX
Cloud computing and distributed systems.
kkkkkhan
 
PDF
Advanced methodologies resolving dimensionality complications for autism neur...
IAESIJAI
 
PDF
Approach and Philosophy of On baking technology
30anthuong17
 
PDF
NewMind AI Weekly Chronicles - August'25 Week I
NewMind AI
 
PDF
Shreyas Phanse Resume: Experienced Backend Engineer | Java • Spring Boot • Ka...
SHREYAS PHANSE
 
PDF
Reach Out and Touch Someone: Haptics and Empathic Computing
Mark Billinghurst
 
PPTX
20250228 LYD VKU AI Blended-Learning.pptx
DatVoNgoc
 
PDF
KodekX | Application Modernization Development
KodekX
 
PPTX
A Presentation on Artificial Intelligence
memembruh336
 
PPTX
Effective Security Operations Center (SOC) A Modern, Strategic, and Threat-In...
ReZa AdineH
 
PDF
Network Security Unit 5.pdf for BCA BBA.
Serpent6
 
PDF
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
SOFTTECHHUB
 
PPTX
Understanding_Digital_Forensics_Presentation.pptx
ImranKhan423233
 
Spectral efficient network and resource selection model in 5G networks
IAESIJAI
 
Detection-First SIEM: Rule Types, Dashboards, and Threat-Informed Strategy
ReZa AdineH
 
Unlocking AI with Model Context Protocol (MCP)
Brian McKeiver
 
VMware vSphere Foundation How to Sell Presentation-Ver1.4-2-14-2024.pptx
blackmambaettijean
 
Empathic Computing: Creating Shared Understanding
Mark Billinghurst
 
Modernizing your data center with Dell and AMD
Principled Technologies
 
Digital-Transformation-Roadmap-for-Companies.pptx
David Malick Dieng
 
Cloud computing and distributed systems.
kkkkkhan
 
Advanced methodologies resolving dimensionality complications for autism neur...
IAESIJAI
 
Approach and Philosophy of On baking technology
30anthuong17
 
NewMind AI Weekly Chronicles - August'25 Week I
NewMind AI
 
Shreyas Phanse Resume: Experienced Backend Engineer | Java • Spring Boot • Ka...
SHREYAS PHANSE
 
Reach Out and Touch Someone: Haptics and Empathic Computing
Mark Billinghurst
 
20250228 LYD VKU AI Blended-Learning.pptx
DatVoNgoc
 
KodekX | Application Modernization Development
KodekX
 
A Presentation on Artificial Intelligence
memembruh336
 
Effective Security Operations Center (SOC) A Modern, Strategic, and Threat-In...
ReZa AdineH
 
Network Security Unit 5.pdf for BCA BBA.
Serpent6
 
7 ChatGPT Prompts to Help You Define Your Ideal Customer Profile.pdf
SOFTTECHHUB
 
Understanding_Digital_Forensics_Presentation.pptx
ImranKhan423233
 

Making sense of users' Web activities

  • 1. Making sense of Users’ Web activitiesMathieu d'AquinKnowledge Media Institute, The Open University, UK
  • 2. A bit of sci-fi to start with“… from people who are afraid that someone else knows information that they don’t and is gaining an unfair advantage by it. For all the claims one hears about the liberating impact of the data-net, the truth is that it whished on most of us a brand-new reason for paranoia” John Brunner, The Shockwave Rider, 1975
  • 3. What we don’t know that they knowSimple important things:And more complex important things…What are all the websites that know my e-mail address?What does amazon.co.uk or the website of my favorite airline know about me?
  • 4. Is this Personal Information Management?Yes, but…Looking at individual user’s information exchange and more generally activities on the WebThis is :BigHeterogeneousDistributedFragmentedSometimes implicitAnd hard to collect!
  • 5. So, what do we do?Unrestricted monitoring of information exchange on the Web by an individual user
  • 6. Local LoggingProxyHTTP RequestsHTTP RequestsLocal Web Agents (e.g., browser)External Web SitesHTTP ResponsesHTTP ResponsesWeb Exchange RDF Logs
  • 7. <Request rdf:about="#request-1257949232709-1257949233757"> <startedAt>1257949232709</startedAt> <endedAt>1257949233757</endedAt> <origin rdf:resource="127.0.0.1" /> <onPort>80</onPort> <toHostrdf:resource="api.facebook.com" /> <method rdf:resource="POST"/> <toURLrdf:resource="http://api.facebook.com/restserver.php" /> <HTTPVersionrdf:resource="HTTP-1.1" /> <Host rdf:resource="api.facebook.com" /> <Content-Type rdf:resource="application--x-www-form-urlencoded" /> <User-Agent rdf:resource="Mozilla--5.0_(Macintosh;_U;_Intel_Mac_OS_X;_en)_AppleWebKit--526.9+_(KHTML._like_Gecko)_AdobeAIR--1.5.2" /> <Refererrdf:resource="app:--TweetDeck.swf" /> <X-Flash-Version rdf:resource="10.0.32.18" /> <Accept rdf:resource="*--*" /> <Accept-Language rdf:resource="en-us" /> <Accept-Encoding rdf:resource="gzip._deflate" /> <Cookie rdf:resource= "__qca=1239783354-42963995-12118014;___utma=87286159.357565716.1239892196.1252686326.1257582307.16;___utmz=87286159.1257582307.16.16.utmccn= (referral)|utmcsr=facebook.com|utmcct=--tos.php|utmcmd=referral;_c_user=605559235;_cur_max_lag=2;_datr=1239398136-0711bf1215821a9c58848bf0ffd0020ec8450cfa7154b9e228c29;_lsd=P3Zpn;_lxe=metm.daquin%40virgin.net;_lxs=3;_s_vsn_facebookpoc_1=9874874320812" /> <Content-Length rdf:resource="984" /> <Connection rdf:resource="keep-alive" /> <Proxy-Connection rdf:resource="keep-alive" /> <data rdf:resource="data_c22b691f691dabd5ae893b9cb2f8add7" /> <response> <Response rdf:about="#response-1257949232709--1257949233757"> <HTTPVersionrdf:resource="HTTP--1.0" /> <responseCoderdf:resource="200_OK" /> <Cache-Control rdf:resource="private._no-store._no-cache._must-revalidate._post-check=0._pre-check=0" /> <Content-Type rdf:resource="application--json" /> <Expires rdf:resource="Mon._26_Jul_1997_05:00:00_GMT" /> <Pragmardf:resource="no-cache" /> <Content-Encoding rdf:resource="gzip" /> <Content-Length rdf:resource="5943" /> <X-Cache rdf:resource="MISS_from_roeburn.open.ac.uk" /> <Proxy-Connection rdf:resource="keep-alive" /> <data rdf:resource="data_5ccf6054fd0fba3ee7eb444e178eaf19" /> </Response></response></Request><Request rdf:about="#request-1257949232709-1257949233757"> <startedAt>1257949232709</startedAt> <endedAt>1257949233757</endedAt> <origin rdf:resource="127.0.0.1" /> <onPort>80</onPort> <toHostrdf:resource="api.facebook.com" /> <method rdf:resource="POST"/> <toURLrdf:resource="http://api.facebook.com/restserver.php" /> <HTTPVersionrdf:resource="HTTP-1.1" /> <Host rdf:resource="api.facebook.com" /> <Content-Type rdf:resource="application--x-www-form-urlencoded" /> <User-Agent rdf:resource="Mozilla--5.0_(Macintosh;_U;_Intel_Mac_OS_X;_en)_AppleWebKit--526.9+_(KHTML._like_Gecko)_AdobeAIR--1.5.2" /> <Refererrdf:resource="app:--TweetDeck.swf" /> <X-Flash-Version rdf:resource="10.0.32.18" /> <Accept rdf:resource="*--*" /> <Accept-Language rdf:resource="en-us" /> <Accept-Encoding rdf:resource="gzip._deflate" /> <Cookie rdf:resource= "__qca=1239783354-42963995-12118014;___utma=87286159.357565716.1239892196.1252686326.1257582307.16;___utmz=87286159.1257582307.16.16.utmccn= (referral)|utmcsr=facebook.com|utmcct=--tos.php|utmcmd=referral;_c_user=605559235;_cur_max_lag=2;_datr=1239398136-0711bf1215821a9c58848bf0ffd0020ec8450cfa7154b9e228c29;_lsd=P3Zpn;_lxe=metm.daquin%40virgin.net;_lxs=3;_s_vsn_facebookpoc_1=9874874320812" /> <Content-Length rdf:resource="984" /> <Connection rdf:resource="keep-alive" /> <Proxy-Connection rdf:resource="keep-alive" /> <data rdf:resource="data_c22b691f691dabd5ae893b9cb2f8add7" /> <response> <Response rdf:about="#response-1257949232709--1257949233757"> <HTTPVersionrdf:resource="HTTP--1.0" /> <responseCoderdf:resource="200_OK" /> <Cache-Control rdf:resource="private._no-store._no-cache._must-revalidate._post-check=0._pre-check=0" /> <Content-Type rdf:resource="application--json" /> <Expires rdf:resource="Mon._26_Jul_1997_05:00:00_GMT" /> <Pragmardf:resource="no-cache" /> <Content-Encoding rdf:resource="gzip" /> <Content-Length rdf:resource="5943" /> <X-Cache rdf:resource="MISS_from_roeburn.open.ac.uk" /> <Proxy-Connection rdf:resource="keep-alive" /> <data rdf:resource="data_5ccf6054fd0fba3ee7eb444e178eaf19" /> </Response></response></Request><Request rdf:about="#request-1257949232709-1257949233757"> <startedAt>1257949232709</startedAt> <endedAt>1257949233757</endedAt> <origin rdf:resource="127.0.0.1" /> <onPort>80</onPort> <toHostrdf:resource="api.facebook.com" /> <method rdf:resource="POST"/> <toURLrdf:resource="http://api.facebook.com/restserver.php" /> <HTTPVersionrdf:resource="HTTP-1.1" /> <Host rdf:resource="api.facebook.com" /> <Content-Type rdf:resource="application--x-www-form-urlencoded" /> <User-Agent rdf:resource="Mozilla--5.0_(Macintosh;_U;_Intel_Mac_OS_X;_en)_AppleWebKit--526.9+_(KHTML._like_Gecko)_AdobeAIR--1.5.2" /> <Refererrdf:resource="app:--TweetDeck.swf" /> <X-Flash-Version rdf:resource="10.0.32.18" /> <Accept rdf:resource="*--*" /> <Accept-Language rdf:resource="en-us" /> <Accept-Encoding rdf:resource="gzip._deflate" /> <Cookie rdf:resource= "__qca=1239783354-42963995-12118014;___utma=87286159.357565716.1239892196.1252686326.1257582307.16;___utmz=87286159.1257582307.16.16.utmccn= (referral)|utmcsr=facebook.com|utmcct=--tos.php|utmcmd=referral;_c_user=605559235;_cur_max_lag=2;_datr=1239398136-0711bf1215821a9c58848bf0ffd0020ec8450cfa7154b9e228c29;_lsd=P3Zpn;_lxe=metm.daquin%40virgin.net;_lxs=3;_s_vsn_facebookpoc_1=9874874320812" /> <Content-Length rdf:resource="984" /> <Connection rdf:resource="keep-alive" /> <Proxy-Connection rdf:resource="keep-alive" /> <data rdf:resource="data_c22b691f691dabd5ae893b9cb2f8add7" /> <response> <Response rdf:about="#response-1257949232709--1257949233757"> <HTTPVersionrdf:resource="HTTP--1.0" /> <responseCoderdf:resource="200_OK" /> <Cache-Control rdf:resource="private._no-store._no-cache._must-revalidate._post-check=0._pre-check=0" /> <Content-Type rdf:resource="application--json" /> <Expires rdf:resource="Mon._26_Jul_1997_05:00:00_GMT" /> <Pragmardf:resource="no-cache" /> <Content-Encoding rdf:resource="gzip" /> <Content-Length rdf:resource="5943" /> <X-Cache rdf:resource="MISS_from_roeburn.open.ac.uk" /> <Proxy-Connection rdf:resource="keep-alive" /> <data rdf:resource="data_5ccf6054fd0fba3ee7eb444e178eaf19" /> </Response></response></Request>2.5 months = 3 Million HTTP Requests100 Million RDF Triples<Request rdf:about="#request-1257949232709-1257949233757"> <startedAt>1257949232709</startedAt> <endedAt>1257949233757</endedAt> <origin rdf:resource="127.0.0.1" /> <onPort>80</onPort> <toHostrdf:resource="api.facebook.com" /> <method rdf:resource="POST"/> <toURLrdf:resource="http://api.facebook.com/restserver.php" /> <HTTPVersionrdf:resource="HTTP-1.1" /> <Host rdf:resource="api.facebook.com" /> <Content-Type rdf:resource="application--x-www-form-urlencoded" /> <User-Agent rdf:resource="Mozilla--5.0_(Macintosh;_U;_Intel_Mac_OS_X;_en)_AppleWebKit--526.9+_(KHTML._like_Gecko)_AdobeAIR--1.5.2" /> <Refererrdf:resource="app:--TweetDeck.swf" /> <X-Flash-Version rdf:resource="10.0.32.18" /> <Accept rdf:resource="*--*" /> <Accept-Language rdf:resource="en-us" /> <Accept-Encoding rdf:resource="gzip._deflate" /> <Cookie rdf:resource= "__qca=1239783354-42963995-12118014;___utma=87286159.357565716.1239892196.1252686326.1257582307.16;___utmz=87286159.1257582307.16.16.utmccn= (referral)|utmcsr=facebook.com|utmcct=--tos.php|utmcmd=referral;_c_user=605559235;_cur_max_lag=2;_datr=1239398136-0711bf1215821a9c58848bf0ffd0020ec8450cfa7154b9e228c29;_lsd=P3Zpn;_lxe=metm.daquin%40virgin.net;_lxs=3;_s_vsn_facebookpoc_1=9874874320812" /> <Content-Length rdf:resource="984" /> <Connection rdf:resource="keep-alive" /> <Proxy-Connection rdf:resource="keep-alive" /> <data rdf:resource="data_c22b691f691dabd5ae893b9cb2f8add7" /> <response> <Response rdf:about="#response-1257949232709--1257949233757"> <HTTPVersionrdf:resource="HTTP--1.0" /> <responseCoderdf:resource="200_OK" /> <Cache-Control rdf:resource="private._no-store._no-cache._must-revalidate._post-check=0._pre-check=0" /> <Content-Type rdf:resource="application--json" /> <Expires rdf:resource="Mon._26_Jul_1997_05:00:00_GMT" /> <Pragmardf:resource="no-cache" /> <Content-Encoding rdf:resource="gzip" /> <Content-Length rdf:resource="5943" /> <X-Cache rdf:resource="MISS_from_roeburn.open.ac.uk" /> <Proxy-Connection rdf:resource="keep-alive" /> <data rdf:resource="data_5ccf6054fd0fba3ee7eb444e178eaf19" /> </Response></response></Request><Request rdf:about="#request-1257949232709-1257949233757"> <startedAt>1257949232709</startedAt> <endedAt>1257949233757</endedAt> <origin rdf:resource="127.0.0.1" /> <onPort>80</onPort> <toHostrdf:resource="api.facebook.com" /> <method rdf:resource="POST"/> <toURLrdf:resource="http://api.facebook.com/restserver.php" /> <HTTPVersionrdf:resource="HTTP-1.1" /> <Host rdf:resource="api.facebook.com" /> <Content-Type rdf:resource="application--x-www-form-urlencoded" /> <User-Agent rdf:resource="Mozilla--5.0_(Macintosh;_U;_Intel_Mac_OS_X;_en)_AppleWebKit--526.9+_(KHTML._like_Gecko)_AdobeAIR--1.5.2" /> <Refererrdf:resource="app:--TweetDeck.swf" /> <X-Flash-Version rdf:resource="10.0.32.18" /> <Accept rdf:resource="*--*" /> <Accept-Language rdf:resource="en-us" /> <Accept-Encoding rdf:resource="gzip._deflate" /> <Cookie rdf:resource= "__qca=1239783354-42963995-12118014;___utma=87286159.357565716.1239892196.1252686326.1257582307.16;___utmz=87286159.1257582307.16.16.utmccn= (referral)|utmcsr=facebook.com|utmcct=--tos.php|utmcmd=referral;_c_user=605559235;_cur_max_lag=2;_datr=1239398136-0711bf1215821a9c58848bf0ffd0020ec8450cfa7154b9e228c29;_lsd=P3Zpn;_lxe=metm.daquin%40virgin.net;_lxs=3;_s_vsn_facebookpoc_1=9874874320812" /> <Content-Length rdf:resource="984" /> <Connection rdf:resource="keep-alive" /> <Proxy-Connection rdf:resource="keep-alive" /> <data rdf:resource="data_c22b691f691dabd5ae893b9cb2f8add7" /> <response> <Response rdf:about="#response-1257949232709--1257949233757"> <HTTPVersionrdf:resource="HTTP--1.0" /> <responseCoderdf:resource="200_OK" /> <Cache-Control rdf:resource="private._no-store._no-cache._must-revalidate._post-check=0._pre-check=0" /> <Content-Type rdf:resource="application--json" /> <Expires rdf:resource="Mon._26_Jul_1997_05:00:00_GMT" /> <Pragmardf:resource="no-cache" /> <Content-Encoding rdf:resource="gzip" /> <Content-Length rdf:resource="5943" /> <X-Cache rdf:resource="MISS_from_roeburn.open.ac.uk" /> <Proxy-Connection rdf:resource="keep-alive" /> <data rdf:resource="data_5ccf6054fd0fba3ee7eb444e178eaf19" /> </Response></response></Request>
  • 8. What this talk is aboutUsing ontologies and external datasets to Generate abstractions of this low level dataEnrich it with external knowledge and modelsInterpret to give back useful information to the user
  • 9. Online Activities Ontology HTTP Ontology Parameters and Website info.Personal InformationWeb Site InformationTrust ModelLocation Information
  • 10. HTTP OntologyBuilt bottom-up from the dataCan help inferring simple things from itAnd answer questions through SPARQL queriesInternetPoint time: DateTimeorigineRequest time: DateTimetoURL: URLreferer: URLtoHostWebHost domain: StringUser-AgentWebAgent ID: StringhasResponseContentContent-TypeResponse time: DateTimeresponseCode: intDataFile ID: StringContentContent-TypeDataFormatMineID: String
  • 11. Simple examplesRequests per time of dayRequests per User AgentsRequests per Host
  • 12. Integrating basic infoDomain nameIPLocation“What!? What requests have I made to websites in Nigeria? What Data did I send?”Can be answered in a SPARQL query
  • 13. More information about websitesThe linked data cloud is full of it.Using the domain name to address this information.CONSTRUCT {<domain_name> ?p ?y}WHERE {{{?xdbpedia:homepage <http://domain_name>}. {?x ?p ?y}}UNION {{?xowl:sameAs ?z}. {?xdbpedia:homepage <http://domain_name>}. {?x ?p ?y}}}
  • 14. ExamplesGoogle ServicesEntertainment WebsitesWeb AnalyticsInternet Search Enginesubject/categoryVideo sharingVideo Hostingwww.google-analytics.comCompanydeveloperWeb Search EngineSearch Enginetypesubject/categorygoogleownersubsediaryOfwww.youtube.comwww.google.comparentDBpediafreebase
  • 15. ActivitiesCan we now understand the user activities?Based on website categories and on their parameters:GET http://uk.search.yahoo.com/beacon/module?p=idiocracy&url=http%3A%2F%2Fwww.imdb.com%2Ftitle%2Ftt0387808%2FPOST format=JSON&method=fql%2Emultiquery&api%5Fkey=51d350e8d92da1f5623512a9e801da2b&v =1%2E0&queries=%7B%22query2%22%3A%22SELECT%20app%5Fid%2C%20display%5Fname%20FROM %20application%20WHERE%20app%5Fid%20IN%20%28SELECT%20app%5Fid%20FROM%20%23query1 %29%22%2C%22query1%22%3A%22SELECT%20post%5Fid%2C%20source%5Fid%2C%20created%5Ftime%2C%20updated%5Ftime%2C%20actor%5Fid%2C%20target%5Fid%2C%20app%5Fid%2C%20message%2C%20attachment%2C%20comments%2C%20likes%2C%20permalink%2C%20attribution%2C%20type%20FROM%20stream%20WHERE%20filter%5Fkey%20IN%20%28SELECT%20filter%5Fkey%20FROM%20stream%5Ffilter%20WHERE%20uid%20%3D%20605559235%20AND%20type%20%3D%20%27newsfeed%27%29%20AND%20%28created%5Ftime%20%3E%3D%201257443596%29%20AND%20%28%28created%5Ftime%20%3E%201257945423%29%20OR%20%28updated%5Ftime%20%21%3D%20created%5Ftime%29%29%20ORDER%20BY%20created%5Ftime%20DESC%20LIMIT%20200%22%7D&call%5Fid=12565739074246102&sig=01a13a72825ed83ed6d23bdf2791ad1a&session%5Fkey=be312ffdf9b9e1a5ec6c5768%2D605559235
  • 16. Activities in an OntologyDerived in a bottom-up way from categories of activities/requestCan be used to characterize overall activities, individual activities or correlations between activities ActivityBasedRequestImplicitActivityExplicitActivityReportToAnalyticsSearchCheckStatusFeedSearchVideoSearchImageAutoCheckStatusFeedFollowLinkManualCheckStatusFeedFollowSearchResult
  • 18. Example Activity: SearchinverseOf(linked-followed, referer)InformationalSearch= SearchRequest and min 2 link-followedNavigationalSearch= SearchRequest and =1 link-followedProminence of Navigational SearchesIndexedSite= exists refererNavigationalSearchIndexedSite(?x), NavigationalSearch(?y), referer(?x, ?y), searchTerm(?y, ?z) IndexedWithKeyword(?x, ?z)
  • 19. Example Activity: SearchSearch KeywordsOpenCalaisTopics of interest
  • 20. Personal data exchangeRequest ParametersPersonal Information (Profile)Trust Model
  • 21. Tool used to create mappings between data sent to websites (from logs on the right) with the user profile (left). Effectively reconstructing the profile from the data
  • 22. User profile re-constructed from Web activities36 attributes, 1,080 values, to 123 domainsA model of what piece of personal information was sent where (can answer the questions)
  • 23. What that tells us about trustTaking the point of view of an external observer, we can derive an observed model of trust and criticality of dataIf this piece of data is critical to you and you give it to bob, you must trust bobIf you give this piece of data to many untrusted people, you probably don’t consider it critical
  • 24. FormallyTrust in a domain = max of criticality of data it receivedCriticality of a piece of data= 1 / 1 + Σ (1- trust in websites that received the data)Obviously, these 2 formulas are interdependent. Treating them as a sequence, with initial values at 0.5
  • 25. Interacting with the modelExpose the user to his own observed behavior has observed, so that he can try to align it to his intended behavior
  • 26. Demo
  • 27. ConclusionFirst set tools exploiting logs of personal Web activity Demonstrate the need for ways to abstract and interpreter activity data, to support Web UsersDemonstrate the ability of semantic technologies, ontologies and the enrichment through external data, to provide such abilities
  • 28. So much more to doCan I collect this tweet? From HTTPS? From my mobile phone?Can I link it to where I am?To what I’m doing? To what I have been doing?To the abstract of the presentation? To the slides on SlideShare.net? To blogs mentioning it?Can I cope with the scale of all this information? Can I decide what to share? Can I store all this securely? Can I get usable access to it? Can I learn something from it?