SlideShare a Scribd company logo
Personaliza+on Challenges in E-Learning
Roberto Turrin
29th Aug 2017
About us
Roberto Turrin
Head of Technology, PhD
@robytur cloudacademy.com/
Personalization Challenges in E-Learning
Personalized Thema4c path Search/explore
CTR
CONSUM.
DRIVER
CCR
Intent-based
User task - standard
Roberto Turrin
Personaliza0on Challenges in E-Learning
Watching a movie
Listening to a song
Planning a travel
I know what I want to achieve
I don’t know what to do
Explora0on level
Discovery
Goal-driven
Search
Watching a movie with my partner
Planning a travel with my family
I know how I want to get sth Watching the last movie of TaranPno
Finding the Pmetable of flights to Madrid
Standard
Enjoyment
Intent-based
User task - educaPon
Roberto Turrin
Personaliza0on Challenges in E-Learning
Studying something
I know what I want to achieve
I don’t know what to do
Explora0on level
Discovery
Goal-driven
Search
Learning Python
Preparing for a cerPficaPon
TesPng the level of knowledge
Mastering BBQ cooking
Becoming a data scienPst
I know how I want to get sth Doing an advanced course about

deep learning
Educa4on
Learning
User profile - interests
Standard
Roberto Turrin
Personaliza0on Challenges in E-Learning
Interests/tastes
Educa4on Interests/tastes
Comedy vs drama movies
Rock vs pop songs

Statues vs painPngs
Sea vs mountain vacaPon
Astrology
Machine Learning
What I am interested in

What I prefer
What I am interested in

What I prefer
Enjoyment
Learning
User profile - interests
Roberto Turrin
Personaliza0on Challenges in E-Learning
Educa4on Interests/tastes Astrology
Machine LearningWhat I am interested in

What I prefer
Learning
?
User profile - educaPon-specific
Standard
Roberto Turrin
Personaliza0on Challenges in E-Learning
Interests/tastes
Educa4on Interests/tastes
Comedy vs drama movies
Rock vs pop songs

Statues vs painPngs
Sea vs mountain vacaPon
Astrology
Machine Learning
Skills/knowledge Java
Excel
Novice in ML
Expert of astrology
NLP
What I am interested in

What I prefer
What I am interested in

What I prefer
What I know
Enjoyment
Learning
User profile - signals
Roberto Turrin
Personaliza0on Challenges in E-Learning
What I know
What I am interested in
Consuming a resource
What I am interested in
Educa4onStandard
The activities done by the user affect his skills. 

In fact, as I study a change my knowledge, I learn more
about a topic, I increase my understanding, I enable
myself to learn something more complex on the same
topic. Since skills are part of my profile, I practically
change my profile. We can so say that use profile in
education really changes over time
Watching/discovering a new kind of movie

might modify my interests
User profile & User task
Roberto Turrin
Personaliza0on Challenges in E-Learning
Educa4on
User profile Java
Excel
Novice in ML
Expert of astrology
NLP
Learning Python
Preparing for a cerPficaPon
TesPng the level of knowledge
Mastering BBQ cooking
Becoming a data scienPst
User task
“Changing what I know”
What I want to achieve/know
What I know
Heterogeneity - resources
Roberto Turrin
Personaliza0on Challenges in E-Learning
Learning
Tes0ng
Video lectures Hands-on Quizzes
Time evoluPon
Roberto Turrin
Personaliza0on Challenges in E-Learning
S3
BigQuery
0me
Learning Tes0ngLearning Learning
Recommender goal:
• “providing learning resources to make the user profile close to the user goal”
• “providing training resources to improve the confidence of user profile representa+on”
Heterogeneity - connecPons
Roberto Turrin
Personaliza0on Challenges in E-Learning
Video lectures Hands-on Quizzes
Heterogeneity - bundles and paths
Roberto Turrin
Personaliza0on Challenges in E-Learning
Video lectures Hands-on Quizzes
Learning paths Exams
User raPngs
Roberto Turrin
Personaliza0on Challenges in E-Learning
User ra+ngs not par+cularly useful for the recommender:
• They are rare. Most of user signals are implicit.
• They are more related to the quality of the resource than to the interest of the user
or to their uPlity for the user goal.
• They are more useful for the content producer than for the user as they represent a
feedback for the content. 

In fact, there is a high correlaPon between the raPng mean and the number of
negaPve and posiPve comments.
Algorithms
User profile transparency is o^en a requirement:
• the user profile represents the current user skills
• the user is curious about “himself”
Roberto Turrin
Personaliza0on Challenges in E-Learning
Experiments with pure collabora0ve did not succeed
• not aligned with the user learning task
• a lot of new content
?
• Currently, a hybrid is being used
• Working on embedding learning tasks
through an ontology.
Other peculiariPes of on-line training: open points
Lack of a physical class:
• social features
• forum
• pair-tasks
Roberto Turrin
Personaliza0on Challenges in E-Learning
User recommendaPons
Time constraints:
• user learning pace
• user deadlines
• resource Pming
• resource Pme availability
Planning
Conclusions
Roberto Turrin
Personaliza0on Challenges in E-Learning
• Learning goals drive most of user consumpPons.
• User profile also represents skills.
• The main user goal can be translated into “changing my skills”, i.e., changing my
profile.
• Consequently,
• profile conPnuously changes over Pme.
• profile is something the user is interested into.
• Use carefully raPngs and collaboraPve filtering
Thank you!
Roberto Turrin
roberto.turrin@cloudacademy.com
29th Aug 2017 cloudacademy.com/

More Related Content

PDF
Bootstrapping a Destination Recommendation Engine
PPTX
Personalized Page Generation for Browsing Recommendations
PPTX
Personalized Job Recommendation System at LinkedIn: Practical Challenges and ...
PDF
Building Recommender Systems for Fashion
PPTX
Is that a Time Machine? Some Design Patterns for Real World Machine Learning ...
PDF
Past, Present & Future of Recommender Systems: An Industry Perspective
PPTX
Lessons Learned from Building Machine Learning Software at Netflix
PPTX
Recommendations for Building Machine Learning Software
Bootstrapping a Destination Recommendation Engine
Personalized Page Generation for Browsing Recommendations
Personalized Job Recommendation System at LinkedIn: Practical Challenges and ...
Building Recommender Systems for Fashion
Is that a Time Machine? Some Design Patterns for Real World Machine Learning ...
Past, Present & Future of Recommender Systems: An Industry Perspective
Lessons Learned from Building Machine Learning Software at Netflix
Recommendations for Building Machine Learning Software

Similar to Personalization Challenges in E-Learning (20)

PPT
Web 2.0 professional development program
PPTX
SFASU: Using Brightspace Tools to Increase Student Engagement and Instructor ...
PPTX
Preparing Instructors to Teach Online: Two Faculty Development Models
PPTX
ITEC 299 Level 3 Synthesis Presentation
PPT
Synthesis project activity 3
PPTX
Final portfolio
PPTX
Final portfolio
PPTX
Improving Retention in Online Courses -- Inside HigherEd webinar
PPTX
‘The postgraduate research student’s user experience (UX): How can libraries ...
PPTX
Workplace learningincrowdwork140218
PPTX
Digital Portfolio Reflection
PPTX
Synthesis presentation
PPT
Collaborative Spaces
DOCX
Discussion boards
PPTX
Fall 2009 LTT Portfolio Presentation
PPTX
xAPI: What Does an Instructional Designer Need to Know?
PPTX
Fall 2009 Portfolio Presentation With Music
PPT
CCA eLearning Conference Presentation -
PPT
Learning Unit
PDF
Doctoral studies Year 1 the journey @chrissinerantzi
Web 2.0 professional development program
SFASU: Using Brightspace Tools to Increase Student Engagement and Instructor ...
Preparing Instructors to Teach Online: Two Faculty Development Models
ITEC 299 Level 3 Synthesis Presentation
Synthesis project activity 3
Final portfolio
Final portfolio
Improving Retention in Online Courses -- Inside HigherEd webinar
‘The postgraduate research student’s user experience (UX): How can libraries ...
Workplace learningincrowdwork140218
Digital Portfolio Reflection
Synthesis presentation
Collaborative Spaces
Discussion boards
Fall 2009 LTT Portfolio Presentation
xAPI: What Does an Instructional Designer Need to Know?
Fall 2009 Portfolio Presentation With Music
CCA eLearning Conference Presentation -
Learning Unit
Doctoral studies Year 1 the journey @chrissinerantzi
Ad

Recently uploaded (20)

PPTX
Introduction-to-Food-Packaging-and-packaging -materials.pptx
PDF
Swiggy’s Playbook: UX, Logistics & Monetization
PDF
COLEAD A2F approach and Theory of Change
PPTX
Effective_Handling_Information_Presentation.pptx
PPT
The Effect of Human Resource Management Practice on Organizational Performanc...
PPTX
Human Mind & its character Characteristics
PPTX
Tour Presentation Educational Activity.pptx
PPTX
water for all cao bang - a charity project
PPTX
2025-08-10 Joseph 02 (shared slides).pptx
PPTX
Emphasizing It's Not The End 08 06 2025.pptx
PPT
First Aid Training Presentation Slides.ppt
PPTX
worship songs, in any order, compilation
PPTX
chapter8-180915055454bycuufucdghrwtrt.pptx
PPTX
PHIL.-ASTRONOMY-AND-NAVIGATION of ..pptx
PPTX
Anesthesia and it's stage with mnemonic and images
PPTX
BIOLOGY TISSUE PPT CLASS 9 PROJECT PUBLIC
DOC
学位双硕士UTAS毕业证,墨尔本理工学院毕业证留学硕士毕业证
PPTX
lesson6-211001025531lesson plan ppt.pptx
PDF
natwest.pdf company description and business model
PDF
Instagram's Product Secrets Unveiled with this PPT
Introduction-to-Food-Packaging-and-packaging -materials.pptx
Swiggy’s Playbook: UX, Logistics & Monetization
COLEAD A2F approach and Theory of Change
Effective_Handling_Information_Presentation.pptx
The Effect of Human Resource Management Practice on Organizational Performanc...
Human Mind & its character Characteristics
Tour Presentation Educational Activity.pptx
water for all cao bang - a charity project
2025-08-10 Joseph 02 (shared slides).pptx
Emphasizing It's Not The End 08 06 2025.pptx
First Aid Training Presentation Slides.ppt
worship songs, in any order, compilation
chapter8-180915055454bycuufucdghrwtrt.pptx
PHIL.-ASTRONOMY-AND-NAVIGATION of ..pptx
Anesthesia and it's stage with mnemonic and images
BIOLOGY TISSUE PPT CLASS 9 PROJECT PUBLIC
学位双硕士UTAS毕业证,墨尔本理工学院毕业证留学硕士毕业证
lesson6-211001025531lesson plan ppt.pptx
natwest.pdf company description and business model
Instagram's Product Secrets Unveiled with this PPT
Ad

Personalization Challenges in E-Learning

  • 1. Personaliza+on Challenges in E-Learning Roberto Turrin 29th Aug 2017
  • 2. About us Roberto Turrin Head of Technology, PhD @robytur cloudacademy.com/
  • 4. Personalized Thema4c path Search/explore CTR CONSUM. DRIVER CCR
  • 5. Intent-based User task - standard Roberto Turrin Personaliza0on Challenges in E-Learning Watching a movie Listening to a song Planning a travel I know what I want to achieve I don’t know what to do Explora0on level Discovery Goal-driven Search Watching a movie with my partner Planning a travel with my family I know how I want to get sth Watching the last movie of TaranPno Finding the Pmetable of flights to Madrid Standard Enjoyment
  • 6. Intent-based User task - educaPon Roberto Turrin Personaliza0on Challenges in E-Learning Studying something I know what I want to achieve I don’t know what to do Explora0on level Discovery Goal-driven Search Learning Python Preparing for a cerPficaPon TesPng the level of knowledge Mastering BBQ cooking Becoming a data scienPst I know how I want to get sth Doing an advanced course about
 deep learning Educa4on Learning
  • 7. User profile - interests Standard Roberto Turrin Personaliza0on Challenges in E-Learning Interests/tastes Educa4on Interests/tastes Comedy vs drama movies Rock vs pop songs
 Statues vs painPngs Sea vs mountain vacaPon Astrology Machine Learning What I am interested in
 What I prefer What I am interested in
 What I prefer Enjoyment Learning
  • 8. User profile - interests Roberto Turrin Personaliza0on Challenges in E-Learning Educa4on Interests/tastes Astrology Machine LearningWhat I am interested in
 What I prefer Learning ?
  • 9. User profile - educaPon-specific Standard Roberto Turrin Personaliza0on Challenges in E-Learning Interests/tastes Educa4on Interests/tastes Comedy vs drama movies Rock vs pop songs
 Statues vs painPngs Sea vs mountain vacaPon Astrology Machine Learning Skills/knowledge Java Excel Novice in ML Expert of astrology NLP What I am interested in
 What I prefer What I am interested in
 What I prefer What I know Enjoyment Learning
  • 10. User profile - signals Roberto Turrin Personaliza0on Challenges in E-Learning What I know What I am interested in Consuming a resource What I am interested in Educa4onStandard The activities done by the user affect his skills. 
 In fact, as I study a change my knowledge, I learn more about a topic, I increase my understanding, I enable myself to learn something more complex on the same topic. Since skills are part of my profile, I practically change my profile. We can so say that use profile in education really changes over time Watching/discovering a new kind of movie
 might modify my interests
  • 11. User profile & User task Roberto Turrin Personaliza0on Challenges in E-Learning Educa4on User profile Java Excel Novice in ML Expert of astrology NLP Learning Python Preparing for a cerPficaPon TesPng the level of knowledge Mastering BBQ cooking Becoming a data scienPst User task “Changing what I know” What I want to achieve/know What I know
  • 12. Heterogeneity - resources Roberto Turrin Personaliza0on Challenges in E-Learning Learning Tes0ng Video lectures Hands-on Quizzes
  • 13. Time evoluPon Roberto Turrin Personaliza0on Challenges in E-Learning S3 BigQuery 0me Learning Tes0ngLearning Learning Recommender goal: • “providing learning resources to make the user profile close to the user goal” • “providing training resources to improve the confidence of user profile representa+on”
  • 14. Heterogeneity - connecPons Roberto Turrin Personaliza0on Challenges in E-Learning Video lectures Hands-on Quizzes
  • 15. Heterogeneity - bundles and paths Roberto Turrin Personaliza0on Challenges in E-Learning Video lectures Hands-on Quizzes Learning paths Exams
  • 16. User raPngs Roberto Turrin Personaliza0on Challenges in E-Learning User ra+ngs not par+cularly useful for the recommender: • They are rare. Most of user signals are implicit. • They are more related to the quality of the resource than to the interest of the user or to their uPlity for the user goal. • They are more useful for the content producer than for the user as they represent a feedback for the content. 
 In fact, there is a high correlaPon between the raPng mean and the number of negaPve and posiPve comments.
  • 17. Algorithms User profile transparency is o^en a requirement: • the user profile represents the current user skills • the user is curious about “himself” Roberto Turrin Personaliza0on Challenges in E-Learning Experiments with pure collabora0ve did not succeed • not aligned with the user learning task • a lot of new content ? • Currently, a hybrid is being used • Working on embedding learning tasks through an ontology.
  • 18. Other peculiariPes of on-line training: open points Lack of a physical class: • social features • forum • pair-tasks Roberto Turrin Personaliza0on Challenges in E-Learning User recommendaPons Time constraints: • user learning pace • user deadlines • resource Pming • resource Pme availability Planning
  • 19. Conclusions Roberto Turrin Personaliza0on Challenges in E-Learning • Learning goals drive most of user consumpPons. • User profile also represents skills. • The main user goal can be translated into “changing my skills”, i.e., changing my profile. • Consequently, • profile conPnuously changes over Pme. • profile is something the user is interested into. • Use carefully raPngs and collaboraPve filtering