SlideShare a Scribd company logo
In search of a better
Recommender System
using
Deep Learning
by SK Reddy
Chief Product Officer AI
linkedin.com/in/sk-reddy/
where R - observed ratings, X - user embeddings, Y - item embeddings, λ is regularization parameter
Explicit feedback
including general bias and biases for user and item
Implicit Feedback
X, Y are user and item embeddings
http://dsnotes.com/post/2017-05-28-matrix-factorization-for-recommender-systems/
Basics
m users, n items, and an
extremely sparse rating matrix R
Additional side information matrix of user and
item are denoted by
The objective function of matrix factorization can be
written as
Types of machine learning algorithms used in recommender systems
https://arxiv.org/pdf/1511.05263.pdf
Google Play Recommendation System
https://arxiv.org/pdf/1606.07792.pdf
Apps recommendation pipeline overview
Wide & Deep model
Over 500 billion examples
Model’s prediction using logistic regression
where Y is the binary class label, σ(·) is the sigmoid function, φ(x) are the cross
product transformations of the original features x, and b is the bias term.
A. is the vector of all wide model weights, and are the weights
applied on the final activations a (lf ) .
Memorization: learning the frequent co-occurrence of items and exploiting the correlation.
Generalization: transitivity of correlation and explores new feature combinations that have
never or rarely occurred in the past.
http://www.kdd.org/kdd2017/papers/view/embedding-based-news-recommendation-for-millions-of-users
Yahoo News Recommender
Yahoo! JAPAN’s homepage on smartphones
Encoder for triplets of articlesBrowsing history and session
LSTM-based model
• Start with distributed representations of articles based on a
variant of the denoising autoencoder
• Generate user representations by using an RNN with
browsing histories as input sequences
• Match and list articles for each user based on the inner
product of article-user for relevance and article-article for
de-duplication
YouTube
Recommendation Engine
https://static.googleusercontent.com/media/research.google.com/en//pubs/archive/45530.pdf
Ranking
Candidate Generation
Additional Stacked Denoising
Autoencoder(aSDAE)
Additional Denoising
Autoencoder(aDAE)
Ref: A Hybrid Collaborative Filtering Model with Deep Structure for Recommender Systems.
The structure of the proposed hybrid model. The model contains three
components: the upper component and the lower component are two
aSDAEs which extract latent factor vectors for users and items respectively;
the middle component decomposes the rating matrix R into two latent
factor matrices
Hybrid model based on Autoencoders
Loss function of Autoencoder
Loss function of Denoising Autoencoder
(ADE)
Loss function of additional Denoising
Autoencoder (aDAE)
Thank you
SK Reddy
www.linkedin.com/in/sk-reddy/

More Related Content

PDF
How recommender systems work
PPTX
Information Filtration
PDF
Sistemas de Recomendação sem Enrolação
PPTX
HABIB FIGA GUYE {BULE HORA UNIVERSITY}(habibifiga@gmail.com
PDF
Real-Time Recommendations with Hopsworks and OpenSearch - MLOps World 2022
PDF
Projection Multi Scale Hashing Keyword Search in Multidimensional Datasets
How recommender systems work
Information Filtration
Sistemas de Recomendação sem Enrolação
HABIB FIGA GUYE {BULE HORA UNIVERSITY}(habibifiga@gmail.com
Real-Time Recommendations with Hopsworks and OpenSearch - MLOps World 2022
Projection Multi Scale Hashing Keyword Search in Multidimensional Datasets

Similar to In search of better deep Recommender Systems (20)

PDF
Evaluating and Enhancing Efficiency of Recommendation System using Big Data A...
PPT
Synthese Recommender System
PPTX
PhD defense
PDF
K1803057782
PDF
IOSR Journals
PDF
A Survey on Recommendation System based on Knowledge Graph and Machine Learning
PDF
L035478083
PDF
SEMANTiCS2016 - Exploring Dynamics and Semantics of User Interests for User ...
PDF
Document Recommendation using Boosting Based Multi-graph Classification: A Re...
PDF
Mixed Recommendation Algorithm Based on Content, Demographic and Collaborativ...
PPTX
Movie Recommender System Using Artificial Intelligence
PDF
Modeling Object Oriented Applications by Using Dynamic Information for the I...
PDF
IRJET - Recommendation System using Big Data Mining on Social Networks
PPT
Negotiated Studies - A semantic social network based expert recommender system
PDF
Recsys 2016
PDF
Recsys2016 Tutorial by Xavier and Deepak
PDF
Co-Extracting Opinions from Online Reviews
PDF
Cd24534538
PDF
IRJET- An Integrated Recommendation System using Graph Database and QGIS
PDF
Overview of Movie Recommendation System using Machine learning by R programmi...
Evaluating and Enhancing Efficiency of Recommendation System using Big Data A...
Synthese Recommender System
PhD defense
K1803057782
IOSR Journals
A Survey on Recommendation System based on Knowledge Graph and Machine Learning
L035478083
SEMANTiCS2016 - Exploring Dynamics and Semantics of User Interests for User ...
Document Recommendation using Boosting Based Multi-graph Classification: A Re...
Mixed Recommendation Algorithm Based on Content, Demographic and Collaborativ...
Movie Recommender System Using Artificial Intelligence
Modeling Object Oriented Applications by Using Dynamic Information for the I...
IRJET - Recommendation System using Big Data Mining on Social Networks
Negotiated Studies - A semantic social network based expert recommender system
Recsys 2016
Recsys2016 Tutorial by Xavier and Deepak
Co-Extracting Opinions from Online Reviews
Cd24534538
IRJET- An Integrated Recommendation System using Graph Database and QGIS
Overview of Movie Recommendation System using Machine learning by R programmi...
Ad

More from SK Reddy (19)

PDF
Finding the right Machine Learning method for predictive modeling
PDF
AI to open more doors in Personal Finance Management (PFM)
PDF
Making sense from 3D Point Clouds
PDF
The wonders of big data processing using Deep Learning in Brazil Live 15 sep ...
PDF
How organizations can get ready for ai
PDF
Practical implementation of AI solutions for Smart Cities
PDF
Recommender systems
PPTX
Deep Learning (DL) Solutions for Smart City use cases
PDF
AI driven innovation
PDF
How AI is revolutionizing the world
PDF
How NLP is revolutionizing marketing and communications
PDF
AI in Smart Cities
PDF
SF ACM Bay chapter meetup on NLP will revolutionize the world
PPTX
The Magic of Image processing using Neural Networks
PDF
The Magic of Text Summarization using Deep Networks
PDF
Natural Language Processing Tech workshop
PPTX
The magic of machine translation 20 july 2017
PDF
Summarization and Abstraction using deep learning
PPTX
Question Answering in NLP on Mahabharata 24 may 2017
Finding the right Machine Learning method for predictive modeling
AI to open more doors in Personal Finance Management (PFM)
Making sense from 3D Point Clouds
The wonders of big data processing using Deep Learning in Brazil Live 15 sep ...
How organizations can get ready for ai
Practical implementation of AI solutions for Smart Cities
Recommender systems
Deep Learning (DL) Solutions for Smart City use cases
AI driven innovation
How AI is revolutionizing the world
How NLP is revolutionizing marketing and communications
AI in Smart Cities
SF ACM Bay chapter meetup on NLP will revolutionize the world
The Magic of Image processing using Neural Networks
The Magic of Text Summarization using Deep Networks
Natural Language Processing Tech workshop
The magic of machine translation 20 july 2017
Summarization and Abstraction using deep learning
Question Answering in NLP on Mahabharata 24 may 2017
Ad

Recently uploaded (20)

PPTX
OMC Textile Division Presentation 2021.pptx
PDF
Zenith AI: Advanced Artificial Intelligence
PDF
A novel scalable deep ensemble learning framework for big data classification...
PDF
ENT215_Completing-a-large-scale-migration-and-modernization-with-AWS.pdf
PDF
Heart disease approach using modified random forest and particle swarm optimi...
PDF
Building Integrated photovoltaic BIPV_UPV.pdf
PDF
Univ-Connecticut-ChatGPT-Presentaion.pdf
PDF
August Patch Tuesday
PPTX
Group 1 Presentation -Planning and Decision Making .pptx
PPTX
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
PPTX
cloud_computing_Infrastucture_as_cloud_p
PDF
Transform Your ITIL® 4 & ITSM Strategy with AI in 2025.pdf
PPTX
TechTalks-8-2019-Service-Management-ITIL-Refresh-ITIL-4-Framework-Supports-Ou...
PDF
Agricultural_Statistics_at_a_Glance_2022_0.pdf
PDF
Enhancing emotion recognition model for a student engagement use case through...
PDF
Encapsulation theory and applications.pdf
PDF
DP Operators-handbook-extract for the Mautical Institute
PPTX
A Presentation on Artificial Intelligence
PDF
gpt5_lecture_notes_comprehensive_20250812015547.pdf
PDF
project resource management chapter-09.pdf
OMC Textile Division Presentation 2021.pptx
Zenith AI: Advanced Artificial Intelligence
A novel scalable deep ensemble learning framework for big data classification...
ENT215_Completing-a-large-scale-migration-and-modernization-with-AWS.pdf
Heart disease approach using modified random forest and particle swarm optimi...
Building Integrated photovoltaic BIPV_UPV.pdf
Univ-Connecticut-ChatGPT-Presentaion.pdf
August Patch Tuesday
Group 1 Presentation -Planning and Decision Making .pptx
KOM of Painting work and Equipment Insulation REV00 update 25-dec.pptx
cloud_computing_Infrastucture_as_cloud_p
Transform Your ITIL® 4 & ITSM Strategy with AI in 2025.pdf
TechTalks-8-2019-Service-Management-ITIL-Refresh-ITIL-4-Framework-Supports-Ou...
Agricultural_Statistics_at_a_Glance_2022_0.pdf
Enhancing emotion recognition model for a student engagement use case through...
Encapsulation theory and applications.pdf
DP Operators-handbook-extract for the Mautical Institute
A Presentation on Artificial Intelligence
gpt5_lecture_notes_comprehensive_20250812015547.pdf
project resource management chapter-09.pdf

In search of better deep Recommender Systems

  • 1. In search of a better Recommender System using Deep Learning by SK Reddy Chief Product Officer AI linkedin.com/in/sk-reddy/
  • 2. where R - observed ratings, X - user embeddings, Y - item embeddings, λ is regularization parameter Explicit feedback including general bias and biases for user and item Implicit Feedback X, Y are user and item embeddings http://dsnotes.com/post/2017-05-28-matrix-factorization-for-recommender-systems/ Basics m users, n items, and an extremely sparse rating matrix R Additional side information matrix of user and item are denoted by The objective function of matrix factorization can be written as
  • 3. Types of machine learning algorithms used in recommender systems https://arxiv.org/pdf/1511.05263.pdf
  • 4. Google Play Recommendation System https://arxiv.org/pdf/1606.07792.pdf Apps recommendation pipeline overview Wide & Deep model Over 500 billion examples Model’s prediction using logistic regression where Y is the binary class label, σ(·) is the sigmoid function, φ(x) are the cross product transformations of the original features x, and b is the bias term. A. is the vector of all wide model weights, and are the weights applied on the final activations a (lf ) . Memorization: learning the frequent co-occurrence of items and exploiting the correlation. Generalization: transitivity of correlation and explores new feature combinations that have never or rarely occurred in the past.
  • 5. http://www.kdd.org/kdd2017/papers/view/embedding-based-news-recommendation-for-millions-of-users Yahoo News Recommender Yahoo! JAPAN’s homepage on smartphones Encoder for triplets of articlesBrowsing history and session LSTM-based model • Start with distributed representations of articles based on a variant of the denoising autoencoder • Generate user representations by using an RNN with browsing histories as input sequences • Match and list articles for each user based on the inner product of article-user for relevance and article-article for de-duplication
  • 7. Additional Stacked Denoising Autoencoder(aSDAE) Additional Denoising Autoencoder(aDAE) Ref: A Hybrid Collaborative Filtering Model with Deep Structure for Recommender Systems. The structure of the proposed hybrid model. The model contains three components: the upper component and the lower component are two aSDAEs which extract latent factor vectors for users and items respectively; the middle component decomposes the rating matrix R into two latent factor matrices Hybrid model based on Autoencoders Loss function of Autoencoder Loss function of Denoising Autoencoder (ADE) Loss function of additional Denoising Autoencoder (aDAE)