SlideShare a Scribd company logo
Neural Graph Collaborative Filtering (2020)
Xiang Wang et al.
The 42nd International ACM SIGIR Conference on Research and Development in
Information Retrieval
Department of Industrial Engineering
Financial Engineering Lab
JunPyo Park
UNIST Financial Engineering Lab. 1
Contents
Neural Graph Collaborative Filtering
Recommender System
Collaborative Filtering
Latent Factor Model
Matrix Factorization
UNIST Financial Engineering Lab. 2
Contents
Neural Graph Collaborative Filtering
NCF
UNIST Financial Engineering Lab. 3
Contents
Neural Graph Collaborative Filtering
NGCF
UNIST Financial Engineering Lab. 4
Recommender Systems
UNIST Financial Engineering Lab. 5
Recommender Systems
Goal - Increasing Product Sales
Relevance
Novelty
Serendipity
Diversity
Problem Formulation
Matrix Completion Problem
Top-k recommendation Problem
UNIST Financial Engineering Lab. 6
Recommender Systems - Models
Collaborative Filtering
User-Item interaction 정보 활용 (평점, 좋아요, 장바구니, 구매내역 등…)
Content-Based
Attribute information 활용 (유저 프로필, 상품 정보 등)
Knowledge-Based
Domain Knowledge 또는 Constraint가 가미된
Demographic
Hybrid
Context-Based
Time-Sensitivity
UNIST Financial Engineering Lab. 7
Recommender Systems - Models
Collaborative Filtering
User-Item interaction 정보 활용 (평점, 좋아요, 장바구니, 구매내역 등…)
Content-Based
Attribute information 활용 (유저 프로필, 상품 정보 등)
Knowledge-Based
Domain Knowledge 또는 Constraint가 가미된
Demographic
Hybrid
Context-Based
Time-Sensitivity
UNIST Financial Engineering Lab. 8
Collaborative Filtering - Concepts
Collaborative Filtering models use the collaborative power of the ratings provided by
multiple users to make recommendations. The main challenge in designing collaborative
filtering methods is that the underlying ratings matrices are sparse.
UNIST Financial Engineering Lab. 9
Collaborative Filtering
The basic idea of collaborative filtering methods is that these unspecified ratings can be
imputed because the observed ratings are often highly correlated across various users
and items.
UNIST Financial Engineering Lab. 10
Collaborative Filtering - Methods
Memory(neighborhood)-based
User-based CF
Item-based CF
Model-based
Decision and Regression Trees
Naive bayes
Latent Factor Model
…
UNIST Financial Engineering Lab. 11
Latent Factor Model
Goal is to use dimensionality reduction methods to directly estimate the data matrix in one shot.
UNIST Financial Engineering Lab. 12
Latent Factor Model – Matrix Factorization (MF)
UNIST Financial Engineering Lab. 13
Latent Factor Model – Matrix Factorization (MF)
UNIST Financial Engineering Lab. 14
Latent Factor Model – Matrix Factorization (MF)
UNIST Financial Engineering Lab. 15
Latent Factor Model – Matrix Factorization (MF)
UNIST Financial Engineering Lab. 16
Latent Factor Model
UNIST Financial Engineering Lab. 17
Latent Factor Model – Matrix Factorization (MF)
UNIST Financial Engineering Lab. 18
Latent Factor Model – NCF
UNIST Financial Engineering Lab. 19
Latent Factor Model – NCF
UNIST Financial Engineering Lab. 20
Latent Factor Model – NGCF
UNIST Financial Engineering Lab. 21
Latent Factor Model – NGCF
UNIST Financial Engineering Lab. 22
Latent Factor Model – NGCF
UNIST Financial Engineering Lab. 23
Latent Factor Model – NGCF
u1 과 비슷한 유저는?
u1 에게 추천해줄 아이템은?
UNIST Financial Engineering Lab. 24
GNN Basics
From GRL textbook
UNIST Financial Engineering Lab. 25
GNN Basics
UNIST Financial Engineering Lab. 26
GNN Basics
UNIST Financial Engineering Lab. 27
GNN Basics
UNIST Financial Engineering Lab. 28
Embedding Propagation Layers
UNIST Financial Engineering Lab. 29
Embedding Propagation Layers
UNIST Financial Engineering Lab. 30
Embedding Propagation Layers
UNIST Financial Engineering Lab. 31
NGCF Optimization
UNIST Financial Engineering Lab. 32
Q&A
UNIST Financial Engineering Lab. 33
Q&A
Collaborative Filtering의 문제점을 잘 지적해 주셨습니다.
특히 많은 비즈니스 분야에서 파레토 법칙(전체 결과의
80%가 전체 원인의 20%에서 일어나는 현상)이 적용 되
기 때문에
User의 과거 행동 양상에 기반한 CF는 쏠림 현상을 초래
할 수 있습니다.
UNIST Financial Engineering Lab. 34
Q&A
이런 문제의 해결 방안으로는 처음에 살펴본 다른 방법론인
Content-based method 또는 Knowledge based method를 적용하
는 것 입니다.
또는 위 방법론 들을 CF와 Hybrid 하게 적용해 볼 수 있겠습니다.
Collaborative Filtering
User-Item interaction 정보 활용 (평점, 좋아요, 장바구니, 구매내역 등…)
Content-Based
Attribute information 활용 (유저 프로필, 상품 정보 등)
Knowledge-Based
Domain Knowledge 또는 Constraint가 가미된
Demographic
Hybrid
Context-Based
Time-Sensitivity
UNIST Financial Engineering Lab. 35
Q&A
비즈니스 측면에서는 Serendipity(일부러 다른 취향의 아
이템을 노출)와 Diversity(추천 품목의 특성 다각화) 정도
를 조절하여 A/B 테스트 등을 통해 사용자의 만족도를 올
릴 수 있겠습니다.
Goal - Increasing Product Sales
Relevance
Novelty
Serendipity
Diversity
UNIST Financial Engineering Lab. 36
Q&A
UNIST Financial Engineering Lab. 37
Q&A
Pui를 통해 메시지의 감쇠가 일어나기 때
문에 멀리 있는 정보는 레이어를 거칠수
록 그 양이 줄어들게 됩니다.
UNIST Financial Engineering Lab. 38
Thank you for listening!

More Related Content

PDF
Hands on Explainable Recommender Systems with Knowledge Graphs @ RecSys22
PDF
[PaperReview] LightGCN: Simplifying and Powering Graph Convolution Network fo...
PDF
Marketplace in motion - AdKDD keynote - 2020
PDF
Graph Neural Networks for Recommendations
PPTX
JSAI2017:敵対的訓練を利用したドメイン不変な表現の学習
PDF
Bpr bayesian personalized ranking from implicit feedback
PDF
Deep Learning for Recommender Systems
PDF
Anomaly detection 系の論文を一言でまとめた
Hands on Explainable Recommender Systems with Knowledge Graphs @ RecSys22
[PaperReview] LightGCN: Simplifying and Powering Graph Convolution Network fo...
Marketplace in motion - AdKDD keynote - 2020
Graph Neural Networks for Recommendations
JSAI2017:敵対的訓練を利用したドメイン不変な表現の学習
Bpr bayesian personalized ranking from implicit feedback
Deep Learning for Recommender Systems
Anomaly detection 系の論文を一言でまとめた

What's hot (20)

PPTX
[Final]collaborative filtering and recommender systems
PPTX
概念モデルを精査する ~ 現象学・圏論・言語哲学
PPTX
Recommender Systems
PPTX
Movie Recommendation System - MovieLens Dataset
PPTX
Recommendation Systems
PDF
Deep Learning for Recommender Systems RecSys2017 Tutorial
PDF
Recent advances in deep recommender systems
PDF
Introduction to Recommendation Systems
PDF
[기초개념] Graph Convolutional Network (GCN)
PDF
Time, Context and Causality in Recommender Systems
PDF
Recsys 2016 tutorial: Lessons learned from building real-life recommender sys...
PDF
Recommendation System Explained
ODP
コサインクラスタリング
PPTX
Netflix talk at ML Platform meetup Sep 2019
PDF
Deep Learning for Recommender Systems
PDF
Past, present, and future of Recommender Systems: an industry perspective
PDF
Recommender system algorithm and architecture
PPTX
輪講スライド20220903.pptx
PDF
[DL輪読会]Convolutional Conditional Neural Processesと Neural Processes Familyの紹介
PDF
Contrastive learning 20200607
[Final]collaborative filtering and recommender systems
概念モデルを精査する ~ 現象学・圏論・言語哲学
Recommender Systems
Movie Recommendation System - MovieLens Dataset
Recommendation Systems
Deep Learning for Recommender Systems RecSys2017 Tutorial
Recent advances in deep recommender systems
Introduction to Recommendation Systems
[기초개념] Graph Convolutional Network (GCN)
Time, Context and Causality in Recommender Systems
Recsys 2016 tutorial: Lessons learned from building real-life recommender sys...
Recommendation System Explained
コサインクラスタリング
Netflix talk at ML Platform meetup Sep 2019
Deep Learning for Recommender Systems
Past, present, and future of Recommender Systems: an industry perspective
Recommender system algorithm and architecture
輪講スライド20220903.pptx
[DL輪読会]Convolutional Conditional Neural Processesと Neural Processes Familyの紹介
Contrastive learning 20200607
Ad

Similar to Collaborative Filtering - MF, NCF, NGCF (9)

PPTX
Classifying and understanding financial data using graph neural network
PPTX
Graph Neural Network #2-1 (PinSage)
PDF
AWS를 활용한 상품 추천 서비스 구축::김태현:: AWS Summit Seoul 2018
PDF
Bigdata based fraud detection
PDF
Mobile App Recommendations Using Deep Learning and Big Data
PDF
The Forward-Forward Algorithm
PPTX
Session-Based Recommendations with Recurrent Neural Networks (Balazs Hidasi, ...
PDF
Graph neural network 2부 recommendation 개요
Classifying and understanding financial data using graph neural network
Graph Neural Network #2-1 (PinSage)
AWS를 활용한 상품 추천 서비스 구축::김태현:: AWS Summit Seoul 2018
Bigdata based fraud detection
Mobile App Recommendations Using Deep Learning and Big Data
The Forward-Forward Algorithm
Session-Based Recommendations with Recurrent Neural Networks (Balazs Hidasi, ...
Graph neural network 2부 recommendation 개요
Ad

More from Park JunPyo (11)

PDF
230427 Pseudo-Mathematics and Financial Charlatanism The Effects of Backtest ...
PDF
210708 - Momentum, Acceleration, and Reversal 발표자료
PPTX
210520 - Analyzing the analysts when do recommendations add value?
PPTX
TadGAN: Time Series Anomaly Detection Using GANs (2020)
PPTX
A quantitative approach to tactical asset allocation (2014)
PDF
Stock fraud detection using peer group analysis
PPTX
Nonverbal Communications in Advertisement
PPTX
STARBUCKS Site Selection Analysis drift
PPTX
Statistics project outline team the oni
PPTX
KERIS 한국교육학술정보원 운영지원단 최종 발표자료
PPTX
Incheon Road Network Analysis-Midterm Project
230427 Pseudo-Mathematics and Financial Charlatanism The Effects of Backtest ...
210708 - Momentum, Acceleration, and Reversal 발표자료
210520 - Analyzing the analysts when do recommendations add value?
TadGAN: Time Series Anomaly Detection Using GANs (2020)
A quantitative approach to tactical asset allocation (2014)
Stock fraud detection using peer group analysis
Nonverbal Communications in Advertisement
STARBUCKS Site Selection Analysis drift
Statistics project outline team the oni
KERIS 한국교육학술정보원 운영지원단 최종 발표자료
Incheon Road Network Analysis-Midterm Project

Recently uploaded (20)

PPT
Predictive modeling basics in data cleaning process
PPTX
Steganography Project Steganography Project .pptx
PDF
Data Engineering Interview Questions & Answers Cloud Data Stacks (AWS, Azure,...
PPT
Image processing and pattern recognition 2.ppt
PDF
Global Data and Analytics Market Outlook Report
PDF
Systems Analysis and Design, 12th Edition by Scott Tilley Test Bank.pdf
PPTX
retention in jsjsksksksnbsndjddjdnFPD.pptx
PPTX
Topic 5 Presentation 5 Lesson 5 Corporate Fin
PPTX
STERILIZATION AND DISINFECTION-1.ppthhhbx
PPT
DU, AIS, Big Data and Data Analytics.ppt
PDF
Tetra Pak Index 2023 - The future of health and nutrition - Full report.pdf
PPTX
IMPACT OF LANDSLIDE.....................
PPTX
CYBER SECURITY the Next Warefare Tactics
PDF
Transcultural that can help you someday.
PPTX
DS-40-Pre-Engagement and Kickoff deck - v8.0.pptx
PDF
Optimise Shopper Experiences with a Strong Data Estate.pdf
PDF
Navigating the Thai Supplements Landscape.pdf
PDF
Introduction to Data Science and Data Analysis
PPTX
FMIS 108 and AISlaudon_mis17_ppt_ch11.pptx
PDF
[EN] Industrial Machine Downtime Prediction
Predictive modeling basics in data cleaning process
Steganography Project Steganography Project .pptx
Data Engineering Interview Questions & Answers Cloud Data Stacks (AWS, Azure,...
Image processing and pattern recognition 2.ppt
Global Data and Analytics Market Outlook Report
Systems Analysis and Design, 12th Edition by Scott Tilley Test Bank.pdf
retention in jsjsksksksnbsndjddjdnFPD.pptx
Topic 5 Presentation 5 Lesson 5 Corporate Fin
STERILIZATION AND DISINFECTION-1.ppthhhbx
DU, AIS, Big Data and Data Analytics.ppt
Tetra Pak Index 2023 - The future of health and nutrition - Full report.pdf
IMPACT OF LANDSLIDE.....................
CYBER SECURITY the Next Warefare Tactics
Transcultural that can help you someday.
DS-40-Pre-Engagement and Kickoff deck - v8.0.pptx
Optimise Shopper Experiences with a Strong Data Estate.pdf
Navigating the Thai Supplements Landscape.pdf
Introduction to Data Science and Data Analysis
FMIS 108 and AISlaudon_mis17_ppt_ch11.pptx
[EN] Industrial Machine Downtime Prediction

Collaborative Filtering - MF, NCF, NGCF

  • 1. Neural Graph Collaborative Filtering (2020) Xiang Wang et al. The 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval Department of Industrial Engineering Financial Engineering Lab JunPyo Park
  • 2. UNIST Financial Engineering Lab. 1 Contents Neural Graph Collaborative Filtering Recommender System Collaborative Filtering Latent Factor Model Matrix Factorization
  • 3. UNIST Financial Engineering Lab. 2 Contents Neural Graph Collaborative Filtering NCF
  • 4. UNIST Financial Engineering Lab. 3 Contents Neural Graph Collaborative Filtering NGCF
  • 5. UNIST Financial Engineering Lab. 4 Recommender Systems
  • 6. UNIST Financial Engineering Lab. 5 Recommender Systems Goal - Increasing Product Sales Relevance Novelty Serendipity Diversity Problem Formulation Matrix Completion Problem Top-k recommendation Problem
  • 7. UNIST Financial Engineering Lab. 6 Recommender Systems - Models Collaborative Filtering User-Item interaction 정보 활용 (평점, 좋아요, 장바구니, 구매내역 등…) Content-Based Attribute information 활용 (유저 프로필, 상품 정보 등) Knowledge-Based Domain Knowledge 또는 Constraint가 가미된 Demographic Hybrid Context-Based Time-Sensitivity
  • 8. UNIST Financial Engineering Lab. 7 Recommender Systems - Models Collaborative Filtering User-Item interaction 정보 활용 (평점, 좋아요, 장바구니, 구매내역 등…) Content-Based Attribute information 활용 (유저 프로필, 상품 정보 등) Knowledge-Based Domain Knowledge 또는 Constraint가 가미된 Demographic Hybrid Context-Based Time-Sensitivity
  • 9. UNIST Financial Engineering Lab. 8 Collaborative Filtering - Concepts Collaborative Filtering models use the collaborative power of the ratings provided by multiple users to make recommendations. The main challenge in designing collaborative filtering methods is that the underlying ratings matrices are sparse.
  • 10. UNIST Financial Engineering Lab. 9 Collaborative Filtering The basic idea of collaborative filtering methods is that these unspecified ratings can be imputed because the observed ratings are often highly correlated across various users and items.
  • 11. UNIST Financial Engineering Lab. 10 Collaborative Filtering - Methods Memory(neighborhood)-based User-based CF Item-based CF Model-based Decision and Regression Trees Naive bayes Latent Factor Model …
  • 12. UNIST Financial Engineering Lab. 11 Latent Factor Model Goal is to use dimensionality reduction methods to directly estimate the data matrix in one shot.
  • 13. UNIST Financial Engineering Lab. 12 Latent Factor Model – Matrix Factorization (MF)
  • 14. UNIST Financial Engineering Lab. 13 Latent Factor Model – Matrix Factorization (MF)
  • 15. UNIST Financial Engineering Lab. 14 Latent Factor Model – Matrix Factorization (MF)
  • 16. UNIST Financial Engineering Lab. 15 Latent Factor Model – Matrix Factorization (MF)
  • 17. UNIST Financial Engineering Lab. 16 Latent Factor Model
  • 18. UNIST Financial Engineering Lab. 17 Latent Factor Model – Matrix Factorization (MF)
  • 19. UNIST Financial Engineering Lab. 18 Latent Factor Model – NCF
  • 20. UNIST Financial Engineering Lab. 19 Latent Factor Model – NCF
  • 21. UNIST Financial Engineering Lab. 20 Latent Factor Model – NGCF
  • 22. UNIST Financial Engineering Lab. 21 Latent Factor Model – NGCF
  • 23. UNIST Financial Engineering Lab. 22 Latent Factor Model – NGCF
  • 24. UNIST Financial Engineering Lab. 23 Latent Factor Model – NGCF u1 과 비슷한 유저는? u1 에게 추천해줄 아이템은?
  • 25. UNIST Financial Engineering Lab. 24 GNN Basics From GRL textbook
  • 26. UNIST Financial Engineering Lab. 25 GNN Basics
  • 27. UNIST Financial Engineering Lab. 26 GNN Basics
  • 28. UNIST Financial Engineering Lab. 27 GNN Basics
  • 29. UNIST Financial Engineering Lab. 28 Embedding Propagation Layers
  • 30. UNIST Financial Engineering Lab. 29 Embedding Propagation Layers
  • 31. UNIST Financial Engineering Lab. 30 Embedding Propagation Layers
  • 32. UNIST Financial Engineering Lab. 31 NGCF Optimization
  • 34. UNIST Financial Engineering Lab. 33 Q&A Collaborative Filtering의 문제점을 잘 지적해 주셨습니다. 특히 많은 비즈니스 분야에서 파레토 법칙(전체 결과의 80%가 전체 원인의 20%에서 일어나는 현상)이 적용 되 기 때문에 User의 과거 행동 양상에 기반한 CF는 쏠림 현상을 초래 할 수 있습니다.
  • 35. UNIST Financial Engineering Lab. 34 Q&A 이런 문제의 해결 방안으로는 처음에 살펴본 다른 방법론인 Content-based method 또는 Knowledge based method를 적용하 는 것 입니다. 또는 위 방법론 들을 CF와 Hybrid 하게 적용해 볼 수 있겠습니다. Collaborative Filtering User-Item interaction 정보 활용 (평점, 좋아요, 장바구니, 구매내역 등…) Content-Based Attribute information 활용 (유저 프로필, 상품 정보 등) Knowledge-Based Domain Knowledge 또는 Constraint가 가미된 Demographic Hybrid Context-Based Time-Sensitivity
  • 36. UNIST Financial Engineering Lab. 35 Q&A 비즈니스 측면에서는 Serendipity(일부러 다른 취향의 아 이템을 노출)와 Diversity(추천 품목의 특성 다각화) 정도 를 조절하여 A/B 테스트 등을 통해 사용자의 만족도를 올 릴 수 있겠습니다. Goal - Increasing Product Sales Relevance Novelty Serendipity Diversity
  • 38. UNIST Financial Engineering Lab. 37 Q&A Pui를 통해 메시지의 감쇠가 일어나기 때 문에 멀리 있는 정보는 레이어를 거칠수 록 그 양이 줄어들게 됩니다.
  • 39. UNIST Financial Engineering Lab. 38 Thank you for listening!