SlideShare a Scribd company logo
A Systematic Analysis on the Impact of Contextual Information
on Point-of-Interest Recommendation
Hossein A. Rahmani, WI, University College London
Mohammad Aliannejadi, IRLab, University of Amsterdam
Mitra Baratchi, STAR, Leiden University
Fabio Crestani, USI-IR, Universitá della Svizzera italiana (USI)
The 46th International ACM SIGIR Conference on Research and Development in Information Retrieval
July 23-27, 2023 | Taipei, Taiwan
Hybrid Conference
Invited Paper
ACM Transactions on Information Systems (TOIS) 40, no. 4 (2022): 1-35.
Introduction
● Point-of-Interest Recommender Systems (POI RecSys)
● Data Sparsity as a main problem in POI RecSys
● Using of contextual information to address to this problem
● Different types of contextual information
● Which context has more impact?
● Different experiments on Matrix Factorization (linear) and Neural Network (non-linear)
models
2
Contextual Information in POI
3
RQ1
How effectively do different models incorporate multiple contextual
factors in recommendation?
Experiment 1: Focus on Contexts
● The impact of each contextual information
● Considering different combinations to evaluate the combined use of contextual
information in the recommendation process
● Enabling to understand better how each of the contextual factors would affect
each of the models
4
Experiment 1: Focus on Contexts (RQ1)
● Temporal context is crucial across all contextual models
● Solely using categorical information won't improve performance
● Incorporating all available contextual information may not enhance performance
● Geographical and temporal information are particularly important in different contextual
combinations
5
RQ2
How can different evaluation metrics capture the effect of contextual
information on various models?
Experiment 2: Focus on Metrics
● Studying the results of different evaluation metrics
● Comparing evaluation metrics on the use of contextual information
○ Most common evaluation metrics in IR and RecSys: Precision, Recall, and nDCG
● How different evaluation metrics can capture the effect of contextual information on
various models
6
Experiment 2: Focus on Metrics (RQ2)
● Contextual information leads to diverse effects on traditional evaluation metrics for POI
recommendation models
○ E.g., a model may excel in nDCG but perform differently in precision and recall
● Due to the distinct nature of evaluation metrics, varied model performance is observed.
● Proposing of novel evaluation metrics tailored to contextual information is recommended
7
RQ3
How can we incorporate different contextual factors in linear and
non-linear models?
Experiment 3: Focus on Contextual Models
● Studying the results of the proposed models based on the selected evaluation metrics
● Comparing the results of different context-aware POI models on different evaluation
metrics
8
Contextual Models
9
Experiment 3: Focus on Contextual Models (RQ3)
● Dataset size greatly affects model performance
● Neural network models outperform matrix factorization due to better user-POI
representation
● The fusion of contextual information improves performance in both approaches
● Using all contextual information may lead to inaccurate results and poor performance
10
Experiment 3: Focus on Contextual Models (RQ3) (Cont.)
● Sparse datasets benefit from matrix factorization with geographical data
● Temporal and geographical information enhance both matrix factorization and neural
network models
● Categorical information shows the weakest performance among contextual models
11
RQ4
How do models incorporating contextual information perform for
users with different behavior?
Experiment 4: Focus on Users Behavior
● Studying the users’ behavior based on different contexts
● Considering three different behavioral habit experiments based on geographical,
temporal, and user preference information
12
Geographical Distance
13
Temporal Distance
14
Exploration Factor
15
Experiment 4: Focus on Users Behavior (RQ4)
● Accurate recommendations are achieved in smaller neighborhoods
● High user movement range leads to less accurate recommendations
● Non-linear models excel in modeling consecutive check-ins
● Recommendations perform worse with greater time gaps between user check-ins
● POI recommendation models underperform when users explore extensively
16
Findings (Summary)
● Carefully evaluating and selecting contextual information instead of fusing all
● Assessing the impact of different combinations and fusion methods
● Geographical and temporal data are more influential than social and categorical
information
● IR common metrics yield diverse results for contextual recommendation models
17
Conclusion
● Analyzed and evaluated contextual info in POI recommendation systems
● Conducted an extensive survey, comparing different approaches (geographical,
temporal, social, and categorical)
● Experimented on benchmark datasets using popular evaluation metrics
● Studied the impact of contextual information combinations on recommendation
performance
18
Conclusion (Cont.)
● Explored contextual info importance in POI recommendation for linear and non-linear
models
● Analyzed the influence of user behaviors (geographical distance, temporal density,
exploration) on recommendation quality
19
Future Work
● Additional info like comments, tips, or images can enhance POI recommendation models
● Generalization requires diverse datasets with sufficient user, POI, and category
information
● Introducing new evaluation metrics for testing contextual information in recommender
systems
● Investigating datasets with distinct characteristics to understand their impact on
performance
20
● This work was in part supported by the Swiss State Secretariat for Education, Research
and Innovation (SERI) mobility grant between Switzerland and Iran, and in part by the
NWO (No. 016.Vidi.189.039 and No. 314-99-301).
● Work done while Hossein A. Rahmani was affiliated with Università della Svizzera italiana
(USI), Switzerland.
Acknowledgement
21
CREDITS: This presentation template was created by Slidesgo, and
includes icons by Flaticon, and infographics & images by Freepik
´
Thanks!
Do you have any questions?
hossein.rahmani.22@ucl.ac.uk
https://github.com/rahmanidashti/ContextsPOI
22

More Related Content

PDF
The Unfairness of Active Users and Popularity Bias in Point-of-Interest Recom...
PDF
Survey on Location Based Recommendation System Using POI
PPT
Contextual Information Elicitation in Travel Recommender Systems
PPT
Contextual information elicitation in travel recommender systems
PDF
Geotecs: Exploiting Geographical, temporal, categorical, and social context f...
PDF
TFMAP: Optimizing MAP for Top-N Context-aware Recommendation
PDF
Not venturini enter_2013
PDF
Paper id 41201614
The Unfairness of Active Users and Popularity Bias in Point-of-Interest Recom...
Survey on Location Based Recommendation System Using POI
Contextual Information Elicitation in Travel Recommender Systems
Contextual information elicitation in travel recommender systems
Geotecs: Exploiting Geographical, temporal, categorical, and social context f...
TFMAP: Optimizing MAP for Top-N Context-aware Recommendation
Not venturini enter_2013
Paper id 41201614

Similar to ContextsPOI (Slides) (20)

PDF
Context-aware Recommendation: A Quick View
PDF
MAPS: A Multi Aspect Personalized POI Recommender System
PDF
Rec sys2008 tutorial
PPTX
Quettra Design Problem Solution - Deepti Chafekar
PDF
User Experience Design for Mobile Cartography: Research Agenda Panel Discussion
PDF
Mobile "Context Awareness"
PDF
[ECWEB2012]Differential Context Relaxation for Context-Aware Travel Recommend...
ODP
CaRR 2012 Opening Presentation
PDF
South Tyrol Suggests - STS
PDF
Context Aware User Modeling for Recommendation
PDF
[UMAP2013]Tutorial on Context-Aware User Modeling for Recommendation by Bamsh...
PDF
Rating Prediction for Restaurant
PPTX
Utilizing additional information in factorization methods (research overview,...
PDF
[WI 2017] Context Suggestion: Empirical Evaluations vs User Studies
PDF
Tutorial: Context-awareness In Information Retrieval and Recommender Systems
PPT
Context-Aware Points of Interest Suggestion with Dynamic Weather Data Management
PPT
Context-Aware Points of Interest Suggestion with Dynamic Weather Data Management
PDF
Following the user’s interests in mobile context aware recommender systems
PDF
A Personalized Assistant Framework for Service Recommendation
PPTX
Context-aware user modeling strategies for journey plan recommendation
Context-aware Recommendation: A Quick View
MAPS: A Multi Aspect Personalized POI Recommender System
Rec sys2008 tutorial
Quettra Design Problem Solution - Deepti Chafekar
User Experience Design for Mobile Cartography: Research Agenda Panel Discussion
Mobile "Context Awareness"
[ECWEB2012]Differential Context Relaxation for Context-Aware Travel Recommend...
CaRR 2012 Opening Presentation
South Tyrol Suggests - STS
Context Aware User Modeling for Recommendation
[UMAP2013]Tutorial on Context-Aware User Modeling for Recommendation by Bamsh...
Rating Prediction for Restaurant
Utilizing additional information in factorization methods (research overview,...
[WI 2017] Context Suggestion: Empirical Evaluations vs User Studies
Tutorial: Context-awareness In Information Retrieval and Recommender Systems
Context-Aware Points of Interest Suggestion with Dynamic Weather Data Management
Context-Aware Points of Interest Suggestion with Dynamic Weather Data Management
Following the user’s interests in mobile context aware recommender systems
A Personalized Assistant Framework for Service Recommendation
Context-aware user modeling strategies for journey plan recommendation
Ad

More from Hossein A. (Saeed) Rahmani (14)

PDF
Intro to LLMs Basics and their Safety Consideration
PDF
Clarification Questions Usefulness (Slides)
PDF
TREC 2023 DL - Synthetic Data Generation (Slides)
PDF
Synthetic Test Collections for Retrieval Evaluation (Poster)
PDF
Beyond-Accuracy Provider Fairness (Slides)
PDF
ACQSurvey (Slides)
PDF
ACQSurvey (Poster)
PDF
GeneralizibilityFairness - DEFirst Reading Group
PDF
Towards Confidence-aware Calibrated Recommendation (Poster)
PDF
Towards Confidence-aware Calibrated Recommendation (Slides)
PDF
Experiments on Generalizability of User-Oriented Fairness in Recommender Systems
PDF
CPFair: Personalized Consumer and Producer Fairness Re-ranking for Recommende...
PDF
The Unfairness of Popularity Bias in Book Recommendation (Bias@ECIR22)
PDF
Introduction to Complex Networks
Intro to LLMs Basics and their Safety Consideration
Clarification Questions Usefulness (Slides)
TREC 2023 DL - Synthetic Data Generation (Slides)
Synthetic Test Collections for Retrieval Evaluation (Poster)
Beyond-Accuracy Provider Fairness (Slides)
ACQSurvey (Slides)
ACQSurvey (Poster)
GeneralizibilityFairness - DEFirst Reading Group
Towards Confidence-aware Calibrated Recommendation (Poster)
Towards Confidence-aware Calibrated Recommendation (Slides)
Experiments on Generalizability of User-Oriented Fairness in Recommender Systems
CPFair: Personalized Consumer and Producer Fairness Re-ranking for Recommende...
The Unfairness of Popularity Bias in Book Recommendation (Bias@ECIR22)
Introduction to Complex Networks
Ad

Recently uploaded (20)

PDF
Embodied AI: Ushering in the Next Era of Intelligent Systems
PDF
keyrequirementskkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk
PPTX
CH1 Production IntroductoryConcepts.pptx
PDF
PRIZ Academy - 9 Windows Thinking Where to Invest Today to Win Tomorrow.pdf
PPTX
Internet of Things (IOT) - A guide to understanding
PDF
Enhancing Cyber Defense Against Zero-Day Attacks using Ensemble Neural Networks
PPTX
additive manufacturing of ss316l using mig welding
PDF
July 2025 - Top 10 Read Articles in International Journal of Software Enginee...
DOCX
573137875-Attendance-Management-System-original
PPTX
Engineering Ethics, Safety and Environment [Autosaved] (1).pptx
PPTX
bas. eng. economics group 4 presentation 1.pptx
PDF
BMEC211 - INTRODUCTION TO MECHATRONICS-1.pdf
PPTX
Lecture Notes Electrical Wiring System Components
PDF
Digital Logic Computer Design lecture notes
PPT
Mechanical Engineering MATERIALS Selection
PDF
Automation-in-Manufacturing-Chapter-Introduction.pdf
PPTX
MET 305 2019 SCHEME MODULE 2 COMPLETE.pptx
PPTX
FINAL REVIEW FOR COPD DIANOSIS FOR PULMONARY DISEASE.pptx
PPTX
Construction Project Organization Group 2.pptx
PPTX
MCN 401 KTU-2019-PPE KITS-MODULE 2.pptx
Embodied AI: Ushering in the Next Era of Intelligent Systems
keyrequirementskkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk
CH1 Production IntroductoryConcepts.pptx
PRIZ Academy - 9 Windows Thinking Where to Invest Today to Win Tomorrow.pdf
Internet of Things (IOT) - A guide to understanding
Enhancing Cyber Defense Against Zero-Day Attacks using Ensemble Neural Networks
additive manufacturing of ss316l using mig welding
July 2025 - Top 10 Read Articles in International Journal of Software Enginee...
573137875-Attendance-Management-System-original
Engineering Ethics, Safety and Environment [Autosaved] (1).pptx
bas. eng. economics group 4 presentation 1.pptx
BMEC211 - INTRODUCTION TO MECHATRONICS-1.pdf
Lecture Notes Electrical Wiring System Components
Digital Logic Computer Design lecture notes
Mechanical Engineering MATERIALS Selection
Automation-in-Manufacturing-Chapter-Introduction.pdf
MET 305 2019 SCHEME MODULE 2 COMPLETE.pptx
FINAL REVIEW FOR COPD DIANOSIS FOR PULMONARY DISEASE.pptx
Construction Project Organization Group 2.pptx
MCN 401 KTU-2019-PPE KITS-MODULE 2.pptx

ContextsPOI (Slides)

  • 1. A Systematic Analysis on the Impact of Contextual Information on Point-of-Interest Recommendation Hossein A. Rahmani, WI, University College London Mohammad Aliannejadi, IRLab, University of Amsterdam Mitra Baratchi, STAR, Leiden University Fabio Crestani, USI-IR, Universitá della Svizzera italiana (USI) The 46th International ACM SIGIR Conference on Research and Development in Information Retrieval July 23-27, 2023 | Taipei, Taiwan Hybrid Conference Invited Paper ACM Transactions on Information Systems (TOIS) 40, no. 4 (2022): 1-35.
  • 2. Introduction ● Point-of-Interest Recommender Systems (POI RecSys) ● Data Sparsity as a main problem in POI RecSys ● Using of contextual information to address to this problem ● Different types of contextual information ● Which context has more impact? ● Different experiments on Matrix Factorization (linear) and Neural Network (non-linear) models 2
  • 4. RQ1 How effectively do different models incorporate multiple contextual factors in recommendation? Experiment 1: Focus on Contexts ● The impact of each contextual information ● Considering different combinations to evaluate the combined use of contextual information in the recommendation process ● Enabling to understand better how each of the contextual factors would affect each of the models 4
  • 5. Experiment 1: Focus on Contexts (RQ1) ● Temporal context is crucial across all contextual models ● Solely using categorical information won't improve performance ● Incorporating all available contextual information may not enhance performance ● Geographical and temporal information are particularly important in different contextual combinations 5
  • 6. RQ2 How can different evaluation metrics capture the effect of contextual information on various models? Experiment 2: Focus on Metrics ● Studying the results of different evaluation metrics ● Comparing evaluation metrics on the use of contextual information ○ Most common evaluation metrics in IR and RecSys: Precision, Recall, and nDCG ● How different evaluation metrics can capture the effect of contextual information on various models 6
  • 7. Experiment 2: Focus on Metrics (RQ2) ● Contextual information leads to diverse effects on traditional evaluation metrics for POI recommendation models ○ E.g., a model may excel in nDCG but perform differently in precision and recall ● Due to the distinct nature of evaluation metrics, varied model performance is observed. ● Proposing of novel evaluation metrics tailored to contextual information is recommended 7
  • 8. RQ3 How can we incorporate different contextual factors in linear and non-linear models? Experiment 3: Focus on Contextual Models ● Studying the results of the proposed models based on the selected evaluation metrics ● Comparing the results of different context-aware POI models on different evaluation metrics 8
  • 10. Experiment 3: Focus on Contextual Models (RQ3) ● Dataset size greatly affects model performance ● Neural network models outperform matrix factorization due to better user-POI representation ● The fusion of contextual information improves performance in both approaches ● Using all contextual information may lead to inaccurate results and poor performance 10
  • 11. Experiment 3: Focus on Contextual Models (RQ3) (Cont.) ● Sparse datasets benefit from matrix factorization with geographical data ● Temporal and geographical information enhance both matrix factorization and neural network models ● Categorical information shows the weakest performance among contextual models 11
  • 12. RQ4 How do models incorporating contextual information perform for users with different behavior? Experiment 4: Focus on Users Behavior ● Studying the users’ behavior based on different contexts ● Considering three different behavioral habit experiments based on geographical, temporal, and user preference information 12
  • 16. Experiment 4: Focus on Users Behavior (RQ4) ● Accurate recommendations are achieved in smaller neighborhoods ● High user movement range leads to less accurate recommendations ● Non-linear models excel in modeling consecutive check-ins ● Recommendations perform worse with greater time gaps between user check-ins ● POI recommendation models underperform when users explore extensively 16
  • 17. Findings (Summary) ● Carefully evaluating and selecting contextual information instead of fusing all ● Assessing the impact of different combinations and fusion methods ● Geographical and temporal data are more influential than social and categorical information ● IR common metrics yield diverse results for contextual recommendation models 17
  • 18. Conclusion ● Analyzed and evaluated contextual info in POI recommendation systems ● Conducted an extensive survey, comparing different approaches (geographical, temporal, social, and categorical) ● Experimented on benchmark datasets using popular evaluation metrics ● Studied the impact of contextual information combinations on recommendation performance 18
  • 19. Conclusion (Cont.) ● Explored contextual info importance in POI recommendation for linear and non-linear models ● Analyzed the influence of user behaviors (geographical distance, temporal density, exploration) on recommendation quality 19
  • 20. Future Work ● Additional info like comments, tips, or images can enhance POI recommendation models ● Generalization requires diverse datasets with sufficient user, POI, and category information ● Introducing new evaluation metrics for testing contextual information in recommender systems ● Investigating datasets with distinct characteristics to understand their impact on performance 20
  • 21. ● This work was in part supported by the Swiss State Secretariat for Education, Research and Innovation (SERI) mobility grant between Switzerland and Iran, and in part by the NWO (No. 016.Vidi.189.039 and No. 314-99-301). ● Work done while Hossein A. Rahmani was affiliated with Università della Svizzera italiana (USI), Switzerland. Acknowledgement 21
  • 22. CREDITS: This presentation template was created by Slidesgo, and includes icons by Flaticon, and infographics & images by Freepik ´ Thanks! Do you have any questions? hossein.rahmani.22@ucl.ac.uk https://github.com/rahmanidashti/ContextsPOI 22