SlideShare a Scribd company logo
Recruiting SolutionsRecruiting SolutionsRecruiting Solutions
Learning to Rank Personalized Search Results in
Professional Networks
Viet Ha-Thuc and Shakti Sinha
SIGIR Industry - 2016
1
2
● Dual Roles of Search
○ Enable talent discover opportunity
○ Help companies to search for the right talent
Unique Nature of LinkedIn Search
▪ Heterogeneous sources
– People, jobs, companies,
slideshares, members’ posts, groups
▪Support many use-cases
– Recruiting, connecting, job seeking,
research, sales, etc.
▪Deep Personalization
3
Overview
4
Query
Federated Search
Spell Correction
Query Tagging
Intent Prediction
People Companies
Federated Search
Name Title Skill
Jobs
Personalized Job Search
▪ Short and vague queries
–“San francisco”, “microsoft”
–Augment queries with searcher information
▪ Skill Homophily [Li, Ha-Thuc et al. KDD’16]
–“Classic” homophily: People tend to connect with similar ones
–Skill homophily: People tend to apply for jobs requiring similar skills
–Skills in job descriptions
5
Member Skills
▪ Skills
– 35K+ standardized skills
– Represent professional
expertise
▪Challenges
– Sparsity
– Outlier skills
▪Approach: skill reputation
6
Reputation
Information a decision maker uses to make a
judgment on an entity with a record (*)
7
(*) “Building web reputation systems”, Glass and Farmer, 2010
Skill Reputation Scores [Ha-Thuc et al. BigData’15]
8
▪ Decision Maker: searcher
▪ Record: Professional
career
▪ Skill reputation: member
expertise on a skill
▪ Judgment: Hire?
Estimating Skill Reputation
9
● Remove outlier skills
● Infer missing ones
Overview
10
Query
Federated Search
Spell Correction
Query Tagging
Intent Prediction
People Companies
Federated Search
Name Title Skill
Jobs
▪ Why do we need this?
11
Personalized Federated Search - Motivation
Personalized Federated Model [Arya, Ha-Thuc et al. CIKM’15]
▪ Searcher intent
– Mine searcher profiles and past behavior to infer intent
▪ Title recruiter -> recruiting intent
▪ Search for jobs -> job seeking intent
– Machine-learned models predict member intents:
▪ Job seeking
▪ Recruiting
▪ Content consuming
12
Calibrate Signals across Verticals
▪ Verticals associate with different intents
13
People Result
Job Result
Group Result
Recruiting
Intent
Job Seeking
Intent
Content
Consuming
Intent
Calibrate Signals across Verticals
▪ Verticals associate with different intents
14
People Result
Job Result
Group Result
Recruiting
Intent
Job Seeking
Intent
Content
Consuming
Intent
Calibrate Signals across Verticals
▪ Verticals associate with different intents
15
People Result
Job Result
Group Result
Recruiting
Intent
Job Seeking
Intent
Content
Consuming
Intent
Take-Aways
▪ Text match is still important but not enough
▪ Go beyond text
▪Semi-structured data
▪Behavioral data
▪ Collaborative filtering works for skill reputation
▪ Personalized Learning-to-Rank is crucial
16
References
▪“Personalized Expertise Search at LinkedIn”, Ha-Thuc,
Venkataraman, Rodriguez, Sinha, Sundaram and Guo,
BigData, 2015
▪“Personalized Federated Search at LinkedIn”, Arya, Ha-
Thuc and Sinha, CIKM, 2015
▪“How to Get Them a Dream Job?”, Li, Arya, Ha-Thuc,
Sinha, KDD, 2016
17

More Related Content

PPTX
Search Ranking Across Heterogeneous Information Sources
PPTX
Machine Learning for Search at LinkedIn
PPTX
Keeping It Professional: Relevance, Recommendations, and Reputation at LinkedIn
PPTX
Personalizing Search at LinkedIn
PPT
Sourcing And Networking LinkedIn
PDF
Query Understanding at LinkedIn [Talk at Facebook]
PPTX
Diversity sourcing panel sclv2018 consolidated
PPTX
Learn to Rank search results
Search Ranking Across Heterogeneous Information Sources
Machine Learning for Search at LinkedIn
Keeping It Professional: Relevance, Recommendations, and Reputation at LinkedIn
Personalizing Search at LinkedIn
Sourcing And Networking LinkedIn
Query Understanding at LinkedIn [Talk at Facebook]
Diversity sourcing panel sclv2018 consolidated
Learn to Rank search results

Viewers also liked (20)

PDF
Learning to Rank: An Introduction to LambdaMART
PDF
Learning to Rank for Recommender Systems - ACM RecSys 2013 tutorial
PDF
Learning to Rank - From pairwise approach to listwise
PDF
Learning to rank fulltext results from clicks
PDF
WSDM2016報告会−論文紹介(Beyond Ranking:Optimizing Whole-Page Presentation)#yjwsdm
PDF
Concept search for e commerce with solr
PPTX
Practical Machine Learning for Smarter Search with Spark+Solr
PDF
Instant search - A hands-on tutorial
PDF
Applied machine learning for search engine relevance 3
PDF
Learning To Rank User Queries to Detect Search Tasks
PPTX
Tutorial on query auto-completion
PPTX
Recurrent networks and beyond by Tomas Mikolov
PPTX
Interleaving - SIGIR 2016 presentation
PPTX
eCommerce for Everyone: What to Expect in 2017 - State of Search
PDF
IEEE big data 2015
PDF
[RecSys '13]Pairwise Learning: Experiments with Community Recommendation on L...
PDF
Machine Learning Search and SEO - Zenith; Duluth, MN.
PPTX
Penguin 4.0 - State of Search 2016
PPTX
Machine Learning and Search -State of Search 2016
PDF
Architecture of a search engine
Learning to Rank: An Introduction to LambdaMART
Learning to Rank for Recommender Systems - ACM RecSys 2013 tutorial
Learning to Rank - From pairwise approach to listwise
Learning to rank fulltext results from clicks
WSDM2016報告会−論文紹介(Beyond Ranking:Optimizing Whole-Page Presentation)#yjwsdm
Concept search for e commerce with solr
Practical Machine Learning for Smarter Search with Spark+Solr
Instant search - A hands-on tutorial
Applied machine learning for search engine relevance 3
Learning To Rank User Queries to Detect Search Tasks
Tutorial on query auto-completion
Recurrent networks and beyond by Tomas Mikolov
Interleaving - SIGIR 2016 presentation
eCommerce for Everyone: What to Expect in 2017 - State of Search
IEEE big data 2015
[RecSys '13]Pairwise Learning: Experiments with Community Recommendation on L...
Machine Learning Search and SEO - Zenith; Duluth, MN.
Penguin 4.0 - State of Search 2016
Machine Learning and Search -State of Search 2016
Architecture of a search engine
Ad

Similar to Learning to Rank Personalized Search Results in Professional Networks (20)

PDF
Talent Search and Recommendation Systems at LinkedIn: Practical Challenges an...
PPTX
Next generation linked in talent search
PPTX
Skills, Reputation, and Search
PPTX
Enhancing Enterprise Search with Machine Learning - Simon Hughes, Dice.com
PDF
Find and be Found: Information Retrieval at LinkedIn
PDF
Keynote Peter Skomoroch - skills, reputation, and search
PDF
KEYNOTE: Skills, Reputation and Search
PDF
Haystack 2019 - Towards a Learning To Rank Ecosystem @ Snag - We've got LTR t...
PDF
Fast, Lenient, and Accurate – Building Personalized Instant Search Experience...
PPTX
Talent Sourcing and Matching - Artificial Intelligence and Black Box Semantic...
PPTX
How CareerBuilder Uses Innovation to Solve Talent Acquisition Problems
PDF
Structure, Personalization, Scale: A Deep Dive into LinkedIn Search
PPTX
Sourceconaifullv6forslideshare 120108133422-phpapp02
PPSX
Recru mejor by turisys-new
PDF
Haystack- Learning to rank in an hourly job market
PDF
Recsys2016 Tutorial by Xavier and Deepak
PPTX
Candidate selection tutorial
PPTX
SIGIR 2017 - Candidate Selection for Large Scale Personalized Search and Reco...
PDF
From Queries to Candidates: Exploring the Search and Source Interaction Behav...
PDF
Key Lessons Learned Building Recommender Systems for Large-Scale Social Netw...
Talent Search and Recommendation Systems at LinkedIn: Practical Challenges an...
Next generation linked in talent search
Skills, Reputation, and Search
Enhancing Enterprise Search with Machine Learning - Simon Hughes, Dice.com
Find and be Found: Information Retrieval at LinkedIn
Keynote Peter Skomoroch - skills, reputation, and search
KEYNOTE: Skills, Reputation and Search
Haystack 2019 - Towards a Learning To Rank Ecosystem @ Snag - We've got LTR t...
Fast, Lenient, and Accurate – Building Personalized Instant Search Experience...
Talent Sourcing and Matching - Artificial Intelligence and Black Box Semantic...
How CareerBuilder Uses Innovation to Solve Talent Acquisition Problems
Structure, Personalization, Scale: A Deep Dive into LinkedIn Search
Sourceconaifullv6forslideshare 120108133422-phpapp02
Recru mejor by turisys-new
Haystack- Learning to rank in an hourly job market
Recsys2016 Tutorial by Xavier and Deepak
Candidate selection tutorial
SIGIR 2017 - Candidate Selection for Large Scale Personalized Search and Reco...
From Queries to Candidates: Exploring the Search and Source Interaction Behav...
Key Lessons Learned Building Recommender Systems for Large-Scale Social Netw...
Ad

Recently uploaded (20)

PPTX
Funds Management Learning Material for Beg
PPT
Design_with_Watersergyerge45hrbgre4top (1).ppt
PDF
Unit-1 introduction to cyber security discuss about how to secure a system
PDF
Vigrab.top – Online Tool for Downloading and Converting Social Media Videos a...
PPTX
innovation process that make everything different.pptx
PDF
Tenda Login Guide: Access Your Router in 5 Easy Steps
PPTX
Mathew Digital SEO Checklist Guidlines 2025
PPT
isotopes_sddsadsaadasdasdasdasdsa1213.ppt
PPT
FIRE PREVENTION AND CONTROL PLAN- LUS.FM.MQ.OM.UTM.PLN.00014.ppt
PPT
Ethics in Information System - Management Information System
PDF
Introduction to the IoT system, how the IoT system works
PPTX
presentation_pfe-universite-molay-seltan.pptx
PPTX
Job_Card_System_Styled_lorem_ipsum_.pptx
PPTX
Internet___Basics___Styled_ presentation
PPTX
Slides PPTX World Game (s) Eco Economic Epochs.pptx
PPTX
SAP Ariba Sourcing PPT for learning material
PDF
💰 𝐔𝐊𝐓𝐈 𝐊𝐄𝐌𝐄𝐍𝐀𝐍𝐆𝐀𝐍 𝐊𝐈𝐏𝐄𝐑𝟒𝐃 𝐇𝐀𝐑𝐈 𝐈𝐍𝐈 𝟐𝟎𝟐𝟓 💰
PDF
The New Creative Director: How AI Tools for Social Media Content Creation Are...
PDF
Smart Home Technology for Health Monitoring (www.kiu.ac.ug)
PPTX
INTERNET------BASICS-------UPDATED PPT PRESENTATION
Funds Management Learning Material for Beg
Design_with_Watersergyerge45hrbgre4top (1).ppt
Unit-1 introduction to cyber security discuss about how to secure a system
Vigrab.top – Online Tool for Downloading and Converting Social Media Videos a...
innovation process that make everything different.pptx
Tenda Login Guide: Access Your Router in 5 Easy Steps
Mathew Digital SEO Checklist Guidlines 2025
isotopes_sddsadsaadasdasdasdasdsa1213.ppt
FIRE PREVENTION AND CONTROL PLAN- LUS.FM.MQ.OM.UTM.PLN.00014.ppt
Ethics in Information System - Management Information System
Introduction to the IoT system, how the IoT system works
presentation_pfe-universite-molay-seltan.pptx
Job_Card_System_Styled_lorem_ipsum_.pptx
Internet___Basics___Styled_ presentation
Slides PPTX World Game (s) Eco Economic Epochs.pptx
SAP Ariba Sourcing PPT for learning material
💰 𝐔𝐊𝐓𝐈 𝐊𝐄𝐌𝐄𝐍𝐀𝐍𝐆𝐀𝐍 𝐊𝐈𝐏𝐄𝐑𝟒𝐃 𝐇𝐀𝐑𝐈 𝐈𝐍𝐈 𝟐𝟎𝟐𝟓 💰
The New Creative Director: How AI Tools for Social Media Content Creation Are...
Smart Home Technology for Health Monitoring (www.kiu.ac.ug)
INTERNET------BASICS-------UPDATED PPT PRESENTATION

Learning to Rank Personalized Search Results in Professional Networks

  • 1. Recruiting SolutionsRecruiting SolutionsRecruiting Solutions Learning to Rank Personalized Search Results in Professional Networks Viet Ha-Thuc and Shakti Sinha SIGIR Industry - 2016 1
  • 2. 2 ● Dual Roles of Search ○ Enable talent discover opportunity ○ Help companies to search for the right talent
  • 3. Unique Nature of LinkedIn Search ▪ Heterogeneous sources – People, jobs, companies, slideshares, members’ posts, groups ▪Support many use-cases – Recruiting, connecting, job seeking, research, sales, etc. ▪Deep Personalization 3
  • 4. Overview 4 Query Federated Search Spell Correction Query Tagging Intent Prediction People Companies Federated Search Name Title Skill Jobs
  • 5. Personalized Job Search ▪ Short and vague queries –“San francisco”, “microsoft” –Augment queries with searcher information ▪ Skill Homophily [Li, Ha-Thuc et al. KDD’16] –“Classic” homophily: People tend to connect with similar ones –Skill homophily: People tend to apply for jobs requiring similar skills –Skills in job descriptions 5
  • 6. Member Skills ▪ Skills – 35K+ standardized skills – Represent professional expertise ▪Challenges – Sparsity – Outlier skills ▪Approach: skill reputation 6
  • 7. Reputation Information a decision maker uses to make a judgment on an entity with a record (*) 7 (*) “Building web reputation systems”, Glass and Farmer, 2010
  • 8. Skill Reputation Scores [Ha-Thuc et al. BigData’15] 8 ▪ Decision Maker: searcher ▪ Record: Professional career ▪ Skill reputation: member expertise on a skill ▪ Judgment: Hire?
  • 9. Estimating Skill Reputation 9 ● Remove outlier skills ● Infer missing ones
  • 10. Overview 10 Query Federated Search Spell Correction Query Tagging Intent Prediction People Companies Federated Search Name Title Skill Jobs
  • 11. ▪ Why do we need this? 11 Personalized Federated Search - Motivation
  • 12. Personalized Federated Model [Arya, Ha-Thuc et al. CIKM’15] ▪ Searcher intent – Mine searcher profiles and past behavior to infer intent ▪ Title recruiter -> recruiting intent ▪ Search for jobs -> job seeking intent – Machine-learned models predict member intents: ▪ Job seeking ▪ Recruiting ▪ Content consuming 12
  • 13. Calibrate Signals across Verticals ▪ Verticals associate with different intents 13 People Result Job Result Group Result Recruiting Intent Job Seeking Intent Content Consuming Intent
  • 14. Calibrate Signals across Verticals ▪ Verticals associate with different intents 14 People Result Job Result Group Result Recruiting Intent Job Seeking Intent Content Consuming Intent
  • 15. Calibrate Signals across Verticals ▪ Verticals associate with different intents 15 People Result Job Result Group Result Recruiting Intent Job Seeking Intent Content Consuming Intent
  • 16. Take-Aways ▪ Text match is still important but not enough ▪ Go beyond text ▪Semi-structured data ▪Behavioral data ▪ Collaborative filtering works for skill reputation ▪ Personalized Learning-to-Rank is crucial 16
  • 17. References ▪“Personalized Expertise Search at LinkedIn”, Ha-Thuc, Venkataraman, Rodriguez, Sinha, Sundaram and Guo, BigData, 2015 ▪“Personalized Federated Search at LinkedIn”, Arya, Ha- Thuc and Sinha, CIKM, 2015 ▪“How to Get Them a Dream Job?”, Li, Arya, Ha-Thuc, Sinha, KDD, 2016 17