SlideShare a Scribd company logo
Active Learning in Collaborative
Filtering RSs: a Survey
Mehdi Elahi
Francesco Ricci
Neil Rubens
August	2014	
Munich,	Germany	
1
Corresponding journal article:
Elahi, Mehdi, Francesco Ricci, and Neil Rubens. "A survey of active learning in
collaborative filtering recommender systems." Computer Science Review (2016).
Outline
¤ Introduction
¤ Cold Start Problem
¤ Active Learning in RS
¤ Conclusion and Future Works
2
Introduction
¤ Recommender Systems are tools that support users
decision making by suggesting products that are
interesting to them.
¤ Collaborative Filtering: A technique used to predict
unknown ratings exploiting ratings given by users to
items.
3
3
 4
2
 5
3
 ?
Cold Start Problem
¤ New User Problem: when
a new user has no rating
it is impossible to predict
her ratings.
4
3
 4
2
 5
?
 ?
 ?
3
 ?
2
 5
 ?
3
 ?
¤  New item problem: when
a new item is added to
the catalogue and none
has rated this item it will
never be recommended.
Active Learning for Collaborative
Filtering
¤ Active Learning:
¤ Requests and try to collect more ratings from the
users before offering recommendations.
5
Which Items should be chosen?
¤ Not all the ratings are equally useful, i.e.,
equally bring information to the system.
¤ To minimize the user rating effort only some
of them should be requested and acquired.
6
An Illustrative Example
7
Comedy	movies	
Si-Fi	movies	
Obscure	movie	
Zombie	movies	
Which Movie should be proposed to user to rate?
Definition of AL Strategy
¤ An active learning strategy for a Collaborative
Filtering is a set of rules to choose the best items
for the users to rate.
8
How an AL Strategy works
Item Score
1 151
2 44
3 7
4 1
5 42
6 34
7 9
8 55
9 20
… …
N 12
System computes the
scores for all the
items that can be
scored (according to
a strategy)
9
How an AL Strategy works
Top 10
items
Score
1 151
8 55
43 54
11 50
2 44
5 42
6 34
22 33
75 29
13 25
The system selects
the top 10 items
and presents them
to the simulated
user
10
How an AL Strategy works
The items that are
rated are added to
the train set
Rated
items
1
2
5
75
13
11
Classifying AL Strategies
A.  Personalization: addresses the what extent the
personalization is performed when selecting the list of
candidate items for the users to rate
¤ Two Classes of Strategies:
12
Non-personalized: are
those that ask all the
users to rate the same list
of items
Personalized: ask different
users to rate different
items – the best for each
user.
Classifying AL Strategies
13
Personalization Dimension
Corresponding journal article:
Elahi, Mehdi, Francesco Ricci, and Neil Rubens. "A survey
of active learning in collaborative filtering recommender
systems." Computer Science Review (2016).
Classifying AL Strategies
B.  Hybridization: whether the strategy takes into
account a single heuristic (criterion) for selecting the
items or combines several heuristics
¤ Two Classes of Strategies:
14
Single-heuristic: are
those that implement a
unique item selection
rule.
Combined-heuristic strategies
hybridize single-heuristic
strategies by aggregating
and combining a number of
strategies.
Classifying AL Strategies
15
Hybridization Dimension
Corresponding journal article:
Elahi, Mehdi, Francesco Ricci, and Neil Rubens. "A survey
of active learning in collaborative filtering recommender
systems." Computer Science Review (2016).
Non Personalized AL: Classes and
Sub-Classes
16
Non Personalized AL: Strategies
17
Example of Non-Personalized AL
¤ Single Heuristics:
¤  Popularity: scores an item according to the frequency of
its ratings and then chooses the highest scored items
(Carenini, 2003)
¤  Entropy: scores each item with the entropy of its ratings
and then chooses the highest scored items (Rashid, 2002
and 2008)
¤ Combined Heuristics:
¤  log(Popularity)*Entropy: combines the popularity and
entropy scores and then chooses the highest scored
items (Rashid, 2002 and 2008)
18
Personalized AL: Classes and Sub-
Classes
19
Personalized AL: Strategies
20
Example of Personalized AL
¤  Single Heuristics:
¤  Decision Tree Based: uses a decision tree whose nodes,
represents groups of users. Each node divides the users into
three groups based on their ratings: Lovers, Haters, and
Unknowns. Starting from the root node, a new user is proposed
to rate a sequence of items, until she reaches one of the leaf
nodes (Golbandi, 2011)
¤  Binary Prediction: scores an item according to the prediction
of its ratings (using transformed matrix of user-item) and then
chooses the highest scored items (Elahi, 2011)
¤  Combined Heuristics:
¤  Combined with Voting: scores an item according to the
votes given by a committee of different strategies and
then chooses the highest scored items (Elahi, 2011)
21
Pros and Cons
22
+ simple, fast, no training, serves users
with no rating, good for early stage
- less accurate, same items for all users
+ fast, benefits of multiple strategies
- flaws of multiple strategies, difficulty of
combining properly
+ accurate, different items for different
users, higher prob. of collecting ratings,
good for late stage
- complex, slow, needs training, cannot
serve users with no rating
+ accurate, great adaptivity to
condition of the system
- more complex, slowest
Conclusion
¤ We provided a comprehensive review of the state-of-
the-art on active learning in collaborative filtering
recommender systems
¤ We have classified a wide range of active learning
techniques, called Strategies, along the two
dimensions:
¤ how personalized these techniques are
¤ how many different item selection criteria (heuristics)
are considered by these strategies in their rating
elicitation process.
23
Future Works
2424
¤ To survey works that have been done in AL
for other types of recommender systems,
such as content-based and context-aware.
¤ To analyze active learning techniques based
on their applicability to specific application
domains.
Thank you!
25
August	2014	
Munich,	Germany	
25
Corresponding journal article:
Elahi, Mehdi, Francesco Ricci, and Neil Rubens. "A survey of active learning in
collaborative filtering recommender systems." Computer Science Review (2016).

More Related Content

PPTX
Unit 1 polynomial manipulation
PPTX
04 Multi-layer Feedforward Networks
PDF
Recommender Systems
PPTX
PageRank Algorithm In data mining
PDF
Recommender Systems
PDF
Context-aware Recommendation: A Quick View
PPTX
Recommender systems: Content-based and collaborative filtering
PDF
Collaborative filtering
Unit 1 polynomial manipulation
04 Multi-layer Feedforward Networks
Recommender Systems
PageRank Algorithm In data mining
Recommender Systems
Context-aware Recommendation: A Quick View
Recommender systems: Content-based and collaborative filtering
Collaborative filtering

What's hot (20)

PPTX
Doubly linked list
PDF
How Lazada ranks products to improve customer experience and conversion
PDF
Introduction to Recommendation Systems
PPTX
Uninformed Search technique
PPTX
Recommendation Systems Basics
PPTX
First order logic
PPT
PPTX
Reinforcement learning
PPTX
Collaborative Filtering Recommendation System
PDF
FAKE Review Detection
PPTX
Recommender Systems
PPTX
Autoencoders in Deep Learning
PPTX
Collaborative filtering
PPT
backpropagation in neural networks
DOCX
Open source search engine
PPTX
[Final]collaborative filtering and recommender systems
PPT
Pagerank Algorithm Explained
PPTX
Data Mining: Graph mining and social network analysis
PDF
I.INFORMED SEARCH IN ARTIFICIAL INTELLIGENCE II. HEURISTIC FUNCTION IN AI III...
Doubly linked list
How Lazada ranks products to improve customer experience and conversion
Introduction to Recommendation Systems
Uninformed Search technique
Recommendation Systems Basics
First order logic
Reinforcement learning
Collaborative Filtering Recommendation System
FAKE Review Detection
Recommender Systems
Autoencoders in Deep Learning
Collaborative filtering
backpropagation in neural networks
Open source search engine
[Final]collaborative filtering and recommender systems
Pagerank Algorithm Explained
Data Mining: Graph mining and social network analysis
I.INFORMED SEARCH IN ARTIFICIAL INTELLIGENCE II. HEURISTIC FUNCTION IN AI III...
Ad

Viewers also liked (6)

PDF
Exploring The Semantic Gap for Movie Recommendations
PPTX
Apache Spark RDD 101
PDF
Developing a Movie recommendation Engine with Spark
PDF
Overview of recommender system
PDF
Recommender Systems with Apache Spark's ALS Function
PDF
Collaborative Filtering and Recommender Systems By Navisro Analytics
Exploring The Semantic Gap for Movie Recommendations
Apache Spark RDD 101
Developing a Movie recommendation Engine with Spark
Overview of recommender system
Recommender Systems with Apache Spark's ALS Function
Collaborative Filtering and Recommender Systems By Navisro Analytics
Ad

Similar to Active Learning in Collaborative Filtering Recommender Systems : a Survey (20)

PDF
Empirical Evaluation of Active Learning in Recommender Systems
PDF
Recommender Systems and Active Learning
PDF
Recommender Systems and Active Learning (for Startups)
PDF
Active Learning In Recommender Systems
PPTX
Udacity webinar on Recommendation Systems
PPTX
[UPDATE] Udacity webinar on Recommendation Systems
PDF
Recsys 2018 overview and highlights
PPTX
Олександр Обєдніков “Рекомендательные системы”
PDF
Interactive Recommender Systems with Netflix and Spotify
PDF
Interactive Recommender Systems
PPT
Introduction to recommendation system
PPT
Impersonal Recommendation system on top of Hadoop
PDF
Recommender systems
PDF
Recommendation Systems
PDF
IRJET- Review on Different Recommendation Techniques for GRS in Online Social...
PPTX
Rokach-GomaxSlides (1).pptx
PPTX
Rokach-GomaxSlides.pptx
PDF
Modern Perspectives on Recommender Systems and their Applications in Mendeley
PPTX
Immersive Recommendation Workshop, NYC Media Lab'17
DOCX
Recommender system definition, types with examples
Empirical Evaluation of Active Learning in Recommender Systems
Recommender Systems and Active Learning
Recommender Systems and Active Learning (for Startups)
Active Learning In Recommender Systems
Udacity webinar on Recommendation Systems
[UPDATE] Udacity webinar on Recommendation Systems
Recsys 2018 overview and highlights
Олександр Обєдніков “Рекомендательные системы”
Interactive Recommender Systems with Netflix and Spotify
Interactive Recommender Systems
Introduction to recommendation system
Impersonal Recommendation system on top of Hadoop
Recommender systems
Recommendation Systems
IRJET- Review on Different Recommendation Techniques for GRS in Online Social...
Rokach-GomaxSlides (1).pptx
Rokach-GomaxSlides.pptx
Modern Perspectives on Recommender Systems and their Applications in Mendeley
Immersive Recommendation Workshop, NYC Media Lab'17
Recommender system definition, types with examples

Recently uploaded (20)

PPT
ISS -ESG Data flows What is ESG and HowHow
PDF
Lecture1 pattern recognition............
PDF
BF and FI - Blockchain, fintech and Financial Innovation Lesson 2.pdf
PPTX
climate analysis of Dhaka ,Banglades.pptx
PDF
Recruitment and Placement PPT.pdfbjfibjdfbjfobj
PPTX
Computer network topology notes for revision
PPTX
Business Acumen Training GuidePresentation.pptx
PDF
annual-report-2024-2025 original latest.
PPTX
STUDY DESIGN details- Lt Col Maksud (21).pptx
PPTX
oil_refinery_comprehensive_20250804084928 (1).pptx
PPTX
Database Infoormation System (DBIS).pptx
PPTX
iec ppt-1 pptx icmr ppt on rehabilitation.pptx
PPTX
AI Strategy room jwfjksfksfjsjsjsjsjfsjfsj
PDF
Foundation of Data Science unit number two notes
PPTX
Introduction to Basics of Ethical Hacking and Penetration Testing -Unit No. 1...
PPTX
Business Ppt On Nestle.pptx huunnnhhgfvu
PPTX
IB Computer Science - Internal Assessment.pptx
PPTX
Acceptance and paychological effects of mandatory extra coach I classes.pptx
PDF
.pdf is not working space design for the following data for the following dat...
PDF
“Getting Started with Data Analytics Using R – Concepts, Tools & Case Studies”
ISS -ESG Data flows What is ESG and HowHow
Lecture1 pattern recognition............
BF and FI - Blockchain, fintech and Financial Innovation Lesson 2.pdf
climate analysis of Dhaka ,Banglades.pptx
Recruitment and Placement PPT.pdfbjfibjdfbjfobj
Computer network topology notes for revision
Business Acumen Training GuidePresentation.pptx
annual-report-2024-2025 original latest.
STUDY DESIGN details- Lt Col Maksud (21).pptx
oil_refinery_comprehensive_20250804084928 (1).pptx
Database Infoormation System (DBIS).pptx
iec ppt-1 pptx icmr ppt on rehabilitation.pptx
AI Strategy room jwfjksfksfjsjsjsjsjfsjfsj
Foundation of Data Science unit number two notes
Introduction to Basics of Ethical Hacking and Penetration Testing -Unit No. 1...
Business Ppt On Nestle.pptx huunnnhhgfvu
IB Computer Science - Internal Assessment.pptx
Acceptance and paychological effects of mandatory extra coach I classes.pptx
.pdf is not working space design for the following data for the following dat...
“Getting Started with Data Analytics Using R – Concepts, Tools & Case Studies”

Active Learning in Collaborative Filtering Recommender Systems : a Survey

  • 1. Active Learning in Collaborative Filtering RSs: a Survey Mehdi Elahi Francesco Ricci Neil Rubens August 2014 Munich, Germany 1 Corresponding journal article: Elahi, Mehdi, Francesco Ricci, and Neil Rubens. "A survey of active learning in collaborative filtering recommender systems." Computer Science Review (2016).
  • 2. Outline ¤ Introduction ¤ Cold Start Problem ¤ Active Learning in RS ¤ Conclusion and Future Works 2
  • 3. Introduction ¤ Recommender Systems are tools that support users decision making by suggesting products that are interesting to them. ¤ Collaborative Filtering: A technique used to predict unknown ratings exploiting ratings given by users to items. 3 3 4 2 5 3 ?
  • 4. Cold Start Problem ¤ New User Problem: when a new user has no rating it is impossible to predict her ratings. 4 3 4 2 5 ? ? ? 3 ? 2 5 ? 3 ? ¤  New item problem: when a new item is added to the catalogue and none has rated this item it will never be recommended.
  • 5. Active Learning for Collaborative Filtering ¤ Active Learning: ¤ Requests and try to collect more ratings from the users before offering recommendations. 5
  • 6. Which Items should be chosen? ¤ Not all the ratings are equally useful, i.e., equally bring information to the system. ¤ To minimize the user rating effort only some of them should be requested and acquired. 6
  • 8. Definition of AL Strategy ¤ An active learning strategy for a Collaborative Filtering is a set of rules to choose the best items for the users to rate. 8
  • 9. How an AL Strategy works Item Score 1 151 2 44 3 7 4 1 5 42 6 34 7 9 8 55 9 20 … … N 12 System computes the scores for all the items that can be scored (according to a strategy) 9
  • 10. How an AL Strategy works Top 10 items Score 1 151 8 55 43 54 11 50 2 44 5 42 6 34 22 33 75 29 13 25 The system selects the top 10 items and presents them to the simulated user 10
  • 11. How an AL Strategy works The items that are rated are added to the train set Rated items 1 2 5 75 13 11
  • 12. Classifying AL Strategies A.  Personalization: addresses the what extent the personalization is performed when selecting the list of candidate items for the users to rate ¤ Two Classes of Strategies: 12 Non-personalized: are those that ask all the users to rate the same list of items Personalized: ask different users to rate different items – the best for each user.
  • 13. Classifying AL Strategies 13 Personalization Dimension Corresponding journal article: Elahi, Mehdi, Francesco Ricci, and Neil Rubens. "A survey of active learning in collaborative filtering recommender systems." Computer Science Review (2016).
  • 14. Classifying AL Strategies B.  Hybridization: whether the strategy takes into account a single heuristic (criterion) for selecting the items or combines several heuristics ¤ Two Classes of Strategies: 14 Single-heuristic: are those that implement a unique item selection rule. Combined-heuristic strategies hybridize single-heuristic strategies by aggregating and combining a number of strategies.
  • 15. Classifying AL Strategies 15 Hybridization Dimension Corresponding journal article: Elahi, Mehdi, Francesco Ricci, and Neil Rubens. "A survey of active learning in collaborative filtering recommender systems." Computer Science Review (2016).
  • 16. Non Personalized AL: Classes and Sub-Classes 16
  • 17. Non Personalized AL: Strategies 17
  • 18. Example of Non-Personalized AL ¤ Single Heuristics: ¤  Popularity: scores an item according to the frequency of its ratings and then chooses the highest scored items (Carenini, 2003) ¤  Entropy: scores each item with the entropy of its ratings and then chooses the highest scored items (Rashid, 2002 and 2008) ¤ Combined Heuristics: ¤  log(Popularity)*Entropy: combines the popularity and entropy scores and then chooses the highest scored items (Rashid, 2002 and 2008) 18
  • 19. Personalized AL: Classes and Sub- Classes 19
  • 21. Example of Personalized AL ¤  Single Heuristics: ¤  Decision Tree Based: uses a decision tree whose nodes, represents groups of users. Each node divides the users into three groups based on their ratings: Lovers, Haters, and Unknowns. Starting from the root node, a new user is proposed to rate a sequence of items, until she reaches one of the leaf nodes (Golbandi, 2011) ¤  Binary Prediction: scores an item according to the prediction of its ratings (using transformed matrix of user-item) and then chooses the highest scored items (Elahi, 2011) ¤  Combined Heuristics: ¤  Combined with Voting: scores an item according to the votes given by a committee of different strategies and then chooses the highest scored items (Elahi, 2011) 21
  • 22. Pros and Cons 22 + simple, fast, no training, serves users with no rating, good for early stage - less accurate, same items for all users + fast, benefits of multiple strategies - flaws of multiple strategies, difficulty of combining properly + accurate, different items for different users, higher prob. of collecting ratings, good for late stage - complex, slow, needs training, cannot serve users with no rating + accurate, great adaptivity to condition of the system - more complex, slowest
  • 23. Conclusion ¤ We provided a comprehensive review of the state-of- the-art on active learning in collaborative filtering recommender systems ¤ We have classified a wide range of active learning techniques, called Strategies, along the two dimensions: ¤ how personalized these techniques are ¤ how many different item selection criteria (heuristics) are considered by these strategies in their rating elicitation process. 23
  • 24. Future Works 2424 ¤ To survey works that have been done in AL for other types of recommender systems, such as content-based and context-aware. ¤ To analyze active learning techniques based on their applicability to specific application domains.
  • 25. Thank you! 25 August 2014 Munich, Germany 25 Corresponding journal article: Elahi, Mehdi, Francesco Ricci, and Neil Rubens. "A survey of active learning in collaborative filtering recommender systems." Computer Science Review (2016).