SlideShare a Scribd company logo

precRec on D2, D3

P
pdi2013

The document presents various precision, recall, and F1 score metrics in relation to different settings such as truth fraction, number of sources, and number of tuples. Statistical comparisons are illustrated through graphs depicting the performance of different evaluation methods (d2 and d3) under various thresholds and weights. Overall, it focuses on examining the impacts of these variables on evaluation metrics.

1 of 12
Download to read offline
1
2
3
4
5
6
7
8
9
10
11
12
Precision vs. FR 1 0.8 0.6 Precision 0.4 0.2 0 0 0.2 0.4 0.6 0.8 1 FR D2 (random-threshold) D3 (random) D2 (uniform-weighted) D2 (random-weighted) D2 (uniform-threshold) D3 (uniform)
Precision vs. Number of Sources 1 0.8 0.6 Precision 0.4 0.2 0 60 80 100 120 140 160 180 200 Number of Sources D2 (random-threshold) D3 (random) D2 (uniform-weighted) D2 (random-weighted) D2 (uniform-threshold) D3 (uniform)
Precision vs. Number of Tuples 1 0.8 0.6 Precision 0.4 0.2 0 500 1000 1500 2000 2500 3000 3500 4000 Number of Tuples D2 (random-threshold) D3 (random) D2 (uniform-weighted) D2 (random-weighted) D2 (uniform-threshold) D3 (uniform)
Precision vs. Truth Fraction 1 0.8 0.6 Precision 0.4 0.2 0 0 0.2 0.4 0.6 0.8 1 Truth Fraction (TF) D2 (random-threshold) D3 (random) D2 (uniform-weighted) D2 (random-weighted) D2 (uniform-threshold) D3 (uniform)
Recall vs. FR 1 0.8 0.6 Recall 0.4 0.2 0 0 0.2 0.4 0.6 0.8 1 FR D2 (random-threshold) D3 (random) D2 (uniform-weighted) D2 (random-weighted) D2 (uniform-threshold) D3 (uniform)
Recall vs. Number of Sources 1 0.8 0.6 Recall 0.4 0.2 0 60 80 100 120 140 160 180 200 Number of Sources D2 (random-threshold) D3 (random) D2 (uniform-weighted) D2 (random-weighted) D2 (uniform-threshold) D3 (uniform)
Recall vs. Number of Tuples 1 0.8 0.6 Recall 0.4 0.2 0 500 1000 1500 2000 2500 3000 3500 4000 Number of Tuples D2 (random-threshold) D3 (random) D2 (uniform-weighted) D2 (random-weighted) D2 (uniform-threshold) D3 (uniform)
Recall vs. Truth Fraction 1 0.8 0.6 Recall 0.4 0.2 0 0 0.2 0.4 0.6 0.8 1 Truth Fraction (TF) D2 (random-threshold) D3 (random) D2 (uniform-weighted) D2 (random-weighted) D2 (uniform-threshold) D3 (uniform)
F-1 vs. FR 1 0.8 0.6 F-1 0.4 0.2 0 0 0.2 0.4 0.6 0.8 1 FR D2 (random-threshold) D3 (random) D2 (uniform-weighted) D2 (random-weighted) D2 (uniform-threshold) D3 (uniform)
F-1 vs. Number of Sources 1 0.8 0.6 F-1 0.4 0.2 0 60 80 100 120 140 160 180 200 Number of Sources D2 (random-threshold) D3 (random) D2 (uniform-weighted) D2 (random-weighted) D2 (uniform-threshold) D3 (uniform)
F-1 vs. Number of Tuples 1 0.8 0.6 F-1 0.4 0.2 0 500 1000 1500 2000 2500 3000 3500 4000 Number of Tuples D2 (random-threshold) D3 (random) D2 (uniform-weighted) D2 (random-weighted) D2 (uniform-threshold) D3 (uniform)
F-1 vs. Truth Fraction 1 0.8 0.6 F-1 0.4 0.2 0 0 0.2 0.4 0.6 0.8 1 Truth Fraction (TF) D2 (random-threshold) D3 (random) D2 (uniform-weighted) D2 (random-weighted) D2 (uniform-threshold) D3 (uniform)

More Related Content

PDF
Graphs on Synthetic Data
pdi2013
 
PDF
precRec vs. baselines
pdi2013
 
PDF
precRec with P1=0.4, P2=0.6
pdi2013
 
PDF
precRec with P1=0.4, P2=0.6
pdi2013
 
PDF
December 7, Projects
University of Colorado at Boulder
 
PDF
precRec on D2, D3
pdi2013
 
PPT
Unit v regulation and promotion of foreign trade
Naveen Kumar
 
PDF
Patagonia Puma Tracking - Wildlife Photo Adventure Travel Guide #Wildlife2014
Cascada Expediciones
 
Graphs on Synthetic Data
pdi2013
 
precRec vs. baselines
pdi2013
 
precRec with P1=0.4, P2=0.6
pdi2013
 
precRec with P1=0.4, P2=0.6
pdi2013
 
December 7, Projects
University of Colorado at Boulder
 
precRec on D2, D3
pdi2013
 
Unit v regulation and promotion of foreign trade
Naveen Kumar
 
Patagonia Puma Tracking - Wildlife Photo Adventure Travel Guide #Wildlife2014
Cascada Expediciones
 

Featured (20)

PDF
2024 Trend Updates: What Really Works In SEO & Content Marketing
Search Engine Journal
 
PDF
Storytelling For The Web: Integrate Storytelling in your Design Process
Chiara Aliotta
 
PDF
Artificial Intelligence, Data and Competition – SCHREPEL – June 2024 OECD dis...
OECD Directorate for Financial and Enterprise Affairs
 
PDF
How to Leverage AI to Boost Employee Wellness - Lydia Di Francesco - SocialHR...
SocialHRCamp
 
PDF
2024 State of Marketing Report – by Hubspot
Marius Sescu
 
PDF
Everything You Need To Know About ChatGPT
Expeed Software
 
PDF
Product Design Trends in 2024 | Teenage Engineerings
Pixeldarts
 
PDF
How Race, Age and Gender Shape Attitudes Towards Mental Health
ThinkNow
 
PDF
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
marketingartwork
 
PDF
Skeleton Culture Code
Skeleton Technologies
 
PDF
PEPSICO Presentation to CAGNY Conference Feb 2024
Neil Kimberley
 
PDF
Content Methodology: A Best Practices Report (Webinar)
contently
 
PPTX
How to Prepare For a Successful Job Search for 2024
Albert Qian
 
PDF
Social Media Marketing Trends 2024 // The Global Indie Insights
Kurio // The Social Media Age(ncy)
 
PDF
Trends In Paid Search: Navigating The Digital Landscape In 2024
Search Engine Journal
 
PDF
5 Public speaking tips from TED - Visualized summary
SpeakerHub
 
PDF
ChatGPT and the Future of Work - Clark Boyd
Clark Boyd
 
PDF
Getting into the tech field. what next
Tessa Mero
 
PDF
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Lily Ray
 
PDF
How to have difficult conversations
Rajiv Jayarajah, MAppComm, ACC
 
2024 Trend Updates: What Really Works In SEO & Content Marketing
Search Engine Journal
 
Storytelling For The Web: Integrate Storytelling in your Design Process
Chiara Aliotta
 
Artificial Intelligence, Data and Competition – SCHREPEL – June 2024 OECD dis...
OECD Directorate for Financial and Enterprise Affairs
 
How to Leverage AI to Boost Employee Wellness - Lydia Di Francesco - SocialHR...
SocialHRCamp
 
2024 State of Marketing Report – by Hubspot
Marius Sescu
 
Everything You Need To Know About ChatGPT
Expeed Software
 
Product Design Trends in 2024 | Teenage Engineerings
Pixeldarts
 
How Race, Age and Gender Shape Attitudes Towards Mental Health
ThinkNow
 
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
marketingartwork
 
Skeleton Culture Code
Skeleton Technologies
 
PEPSICO Presentation to CAGNY Conference Feb 2024
Neil Kimberley
 
Content Methodology: A Best Practices Report (Webinar)
contently
 
How to Prepare For a Successful Job Search for 2024
Albert Qian
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Kurio // The Social Media Age(ncy)
 
Trends In Paid Search: Navigating The Digital Landscape In 2024
Search Engine Journal
 
5 Public speaking tips from TED - Visualized summary
SpeakerHub
 
ChatGPT and the Future of Work - Clark Boyd
Clark Boyd
 
Getting into the tech field. what next
Tessa Mero
 
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Lily Ray
 
How to have difficult conversations
Rajiv Jayarajah, MAppComm, ACC
 
Ad

precRec on D2, D3

  • 1. Precision vs. FR 1 0.8 0.6 Precision 0.4 0.2 0 0 0.2 0.4 0.6 0.8 1 FR D2 (random-threshold) D3 (random) D2 (uniform-weighted) D2 (random-weighted) D2 (uniform-threshold) D3 (uniform)
  • 2. Precision vs. Number of Sources 1 0.8 0.6 Precision 0.4 0.2 0 60 80 100 120 140 160 180 200 Number of Sources D2 (random-threshold) D3 (random) D2 (uniform-weighted) D2 (random-weighted) D2 (uniform-threshold) D3 (uniform)
  • 3. Precision vs. Number of Tuples 1 0.8 0.6 Precision 0.4 0.2 0 500 1000 1500 2000 2500 3000 3500 4000 Number of Tuples D2 (random-threshold) D3 (random) D2 (uniform-weighted) D2 (random-weighted) D2 (uniform-threshold) D3 (uniform)
  • 4. Precision vs. Truth Fraction 1 0.8 0.6 Precision 0.4 0.2 0 0 0.2 0.4 0.6 0.8 1 Truth Fraction (TF) D2 (random-threshold) D3 (random) D2 (uniform-weighted) D2 (random-weighted) D2 (uniform-threshold) D3 (uniform)
  • 5. Recall vs. FR 1 0.8 0.6 Recall 0.4 0.2 0 0 0.2 0.4 0.6 0.8 1 FR D2 (random-threshold) D3 (random) D2 (uniform-weighted) D2 (random-weighted) D2 (uniform-threshold) D3 (uniform)
  • 6. Recall vs. Number of Sources 1 0.8 0.6 Recall 0.4 0.2 0 60 80 100 120 140 160 180 200 Number of Sources D2 (random-threshold) D3 (random) D2 (uniform-weighted) D2 (random-weighted) D2 (uniform-threshold) D3 (uniform)
  • 7. Recall vs. Number of Tuples 1 0.8 0.6 Recall 0.4 0.2 0 500 1000 1500 2000 2500 3000 3500 4000 Number of Tuples D2 (random-threshold) D3 (random) D2 (uniform-weighted) D2 (random-weighted) D2 (uniform-threshold) D3 (uniform)
  • 8. Recall vs. Truth Fraction 1 0.8 0.6 Recall 0.4 0.2 0 0 0.2 0.4 0.6 0.8 1 Truth Fraction (TF) D2 (random-threshold) D3 (random) D2 (uniform-weighted) D2 (random-weighted) D2 (uniform-threshold) D3 (uniform)
  • 9. F-1 vs. FR 1 0.8 0.6 F-1 0.4 0.2 0 0 0.2 0.4 0.6 0.8 1 FR D2 (random-threshold) D3 (random) D2 (uniform-weighted) D2 (random-weighted) D2 (uniform-threshold) D3 (uniform)
  • 10. F-1 vs. Number of Sources 1 0.8 0.6 F-1 0.4 0.2 0 60 80 100 120 140 160 180 200 Number of Sources D2 (random-threshold) D3 (random) D2 (uniform-weighted) D2 (random-weighted) D2 (uniform-threshold) D3 (uniform)
  • 11. F-1 vs. Number of Tuples 1 0.8 0.6 F-1 0.4 0.2 0 500 1000 1500 2000 2500 3000 3500 4000 Number of Tuples D2 (random-threshold) D3 (random) D2 (uniform-weighted) D2 (random-weighted) D2 (uniform-threshold) D3 (uniform)
  • 12. F-1 vs. Truth Fraction 1 0.8 0.6 F-1 0.4 0.2 0 0 0.2 0.4 0.6 0.8 1 Truth Fraction (TF) D2 (random-threshold) D3 (random) D2 (uniform-weighted) D2 (random-weighted) D2 (uniform-threshold) D3 (uniform)