SlideShare a Scribd company logo
Augmenting Digital Textbooks
with Reusable Smart Learning
Content: Solutions and Challenges
Jordan Barria-Pineda, Arun Balajiee Lekshmi Narayanan,
Peter Brusilovsky
iTextbooks’22 Workshop @ AIED’22
Current approaches for Intelligent Textbooks
AUTHOR
Textbook content
Current approaches for Intelligent Textbooks
AUTHOR
Textbook content Learning content
Current approaches for Intelligent Textbooks
AUTHOR
Textbook content Learning content
Current approaches for Intelligent Textbooks
AUTHOR
Textbook content Learning content
Current approaches for Intelligent Textbooks
AUTHOR
Textbook content Learning content
Example: Runestone interactive books
Our vision
Our vision
Our vision
Our vision
Crowdsourcing, Interoperability (e.g, LTI)
Online Reading System: Reading Mirror
Case 1: Educational video recommendations
Concept
extraction and
initial
relevancy filter
Collection of
video
candidates
Textual
representation
of the videos
Reading-Video
similarity
calculation
Recommenda-
tions
presentation
in the UI
Case 1: Educational video recommendations
Concept
extraction and
initial
relevancy filter
Collection of
video
candidates
Textual
representation
of the videos
Reading-Video
similarity
calculation
Recommenda-
tions
presentation
in the UI
Thaker, K.M., Brusilovsky, P., He, D. (2018) Concept enhanced content
representation for linking educational resources.
Case 1: Educational video recommendations
Concept
extraction and
initial
relevancy filter
Collection of
video
candidates
Textual
representation
of the videos
Reading-Video
similarity
calculation
Recommenda-
tions
presentation
in the UI
https://youtube-dl.org/
Case 1: Educational video recommendations
Concept
extraction and
initial
relevancy filter
Collection of
video
candidates
Textual
representation
of the videos
Reading-Video
similarity
calculation
Recommenda-
tions
presentation
in the UI
Simple textual matching of transcripts’ keyphrases and the concepts extracted
from the textbook in the first step.
Case 1: Educational video recommendations
Concept
extraction and
initial
relevancy filter
Collection of
video
candidates
Textual
representation
of the videos
Reading-Video
similarity
calculation
Recommenda-
tions
presentation
in the UI
tf-idf
Concept
extraction and
initial
relevancy filter
Collection of
video
candidates
Textual
representation
of the videos
Reading-Video
similarity
calculation
Recommenda-
tions
presentation
in the UI
Case 1: Educational video recommendations
Concept
extraction and
initial
relevancy filter
Collection of
video
candidates
Textual
representation
of the videos
Reading-Video
similarity
calculation
Recommenda-
tions
presentation
in the UI
Case 1: Educational video recommendations
Case 2: Smart learning content recommendations
Case 2: Smart learning content recommendations
Case 2: Smart learning content recommendations
Case 2: Smart learning content recommendations
Case 2: Smart learning content recommendations
Case 2: Smart learning content recommendations
Case 2: Smart learning content recommendations
Other related educ. recommendations
1. Recommendations to external resources (Rahdari et al. 2020)
1. Recommendations to external resources (Rahdari et al. 2020)
2. Recommendations to other textbooks (Thaker et al. 2020)
Other related educ. recommendations
1. Recommendations to external resources (Rahdari et al. 2020)
2. Recommendations to other textbooks (Thaker et al. 2020)
3. Recommendations of learning content for instructional design (Albó et al. 2019;
Chau et al. 2017; 2018)
Other related educ. recommendations
1. Recommendations to external resources (Rahdari et al. 2020)
2. Recommendations to other textbooks (Thaker et al. 2020)
3. Recommendations of learning content for instructional design (Albó et al. 2019;
Chau et al. 2017; 2018)
4. Recommendations to video courses
Other related educ. recommendations
1. Recommendations to external resources (Rahdari et al. 2020)
2. Recommendations to other textbooks (Thaker et al. 2020)
3. Recommendations of learning content for instructional design (Albó et al. 2019;
Chau et al. 2017; 2018)
4. Recommendations to video courses
5. In this work, also, recommendations to interactive book exercises!
Other related educ. recommendations
1. B Rahdari, P Brusilovsky, K Thaker, J Barria-Pineda. Using knowledge graph for explainable recommendation of external content in electronic textbooks iTextbooks@ AIED, 2020
2. Khushboo Thaker, Lei Zhang, Daqing He and Peter Brusilovsky "Recommending Remedial Readings Using Student's Knowledge state" (EDM 2020)
3. Albó, L., Barria-Pineda, J., Brusilovsky, P., Hernández-Leo, D. (2019). Concept-Level Design Analytics for Blended Courses. https://doi.org/10.1007/978-3-030-29736-7_40
Challenges
1. Scaling the system by the type of smart content allocation,
potentially making it automatic instead of static allocation as
noted in prior work (Alpizar-Chacon et al. 2021)
Challenges
1. Scaling the system by the type of smart content allocation,
potentially making it automatic instead of static or semi-
automatic allocation as noted (Alpizar-Chacon et al. 2021)
2. Allocation that adapts to the teacher’s understanding of the
course in a finer grained way – previous efforts have been
done by following coarse-grained units formed from different
sections (Chau et al. 2017; 2018) or concepts (Rahdari et al.
2020).
1. Alpizar-Chacon, Isaac; Barria-Pineda, Jordan; Akhuseyinoglu, Kamil; Sosnovsky, Sergey; Brusilovsky, Peter. Integrating textbooks with smart interactive content for learning programming. iTextbooks @
AIED 2021
2. Chau, H., Barria-Pineda, J., Brusilovsky, P. (2018). Learning Content Recommender System for Instructors of Programming Courses. AIED 2018.
3. Hung Chau, Jordan Barria-Pineda, and Peter Brusilovsky. 2017. Content Wizard: Concept-Based Recommender System for Instructors of Programming Courses. (UMAP 2017).
Challenges
1. Scaling the system by the type of smart content allocation,
potentially making it automatic instead of static or semi-
automatic allocation as noted in prior work (Alpizar-Chacon
et al. 2021)
2. Allocation that adapts to the teacher’s understanding of the
course in a fine-grained way is allocated as coarse-grained
units formed from different sections (Chau et al. 2017; 2018)
and as demonstrated by wiki recommendations (Rahdari et
al. 2020) in e-textbooks.
3. Adapt to the learner state
Discussion and Future work
1. Dynamic SLC at different levels of granularity
Discussion and Future work
1. Dynamic SLC at different levels of granularity
2. Reader’s control over the smart content curation
Discussion and Future work
1. Dynamic SLC at different levels of granularity
2. Reader’s control over the smart content curation
3. Passive recommendations as another option
Discussion and Future work
1. Dynamic SLC at different levels of granularity
2. Reader’s control over the smart content curation
3. Passive recommendations as another option
4. Learner-sourced recommendations
Discussion and Future work
1. Dynamic SLC at different levels of granularity
2. Reader’s control over the smart content curation
3. Passive recommendations as another option
4. Learner-sourced recommendations
5. Overcoming challenges identified with their possible solutions
Discussion and Future work
1. Dynamic SLC at different levels of granularity
2. Reader’s control over the smart content curation
3. Passive recommendations as another option
4. Learner-sourced recommendations
5. Overcoming challenges identified with their possible solutions
6. Evaluation of the approaches through a “live” classroom study (pending analysis)
Conclusions
1. Integrating multiple SLCs into an eTextbook – making it a “intelligent” textbook
with recommendations for the reader.
2. Present a system that is flexible with the possibility of interchangeable learning
platform (eTextbook system)
3. Identify the challenges and discuss solutions
Q & A
Thanks for your attention!
Augmenting Digital Textbooks with Reusable Smart Learning
Content: Solutions and Challenges
Jordan Barria-Pineda, Arun Balajiee Lekshmi Narayanan, Peter
Brusilovsky
iTextbooks’22 Workshop @ AIED’22

More Related Content

DOCX
Atl structure by Josephine
PDF
Graduate coursework
PPTX
2014 ku village presentation pbl ct for participants
PPTX
2.0-Role_of_Technology_in_PBL-1.pptx_20250223_172220_0000.pptx
PPT
C-SAP e-learning forum: Overview of Open Educational Resources project
PPT
Overview of C-SAP open educational resources project
PPT
OnCourse Instructional Design Model
PDF
Content Wizard: Concept-Based Recommender System for Instructors of Programmi...
Atl structure by Josephine
Graduate coursework
2014 ku village presentation pbl ct for participants
2.0-Role_of_Technology_in_PBL-1.pptx_20250223_172220_0000.pptx
C-SAP e-learning forum: Overview of Open Educational Resources project
Overview of C-SAP open educational resources project
OnCourse Instructional Design Model
Content Wizard: Concept-Based Recommender System for Instructors of Programmi...

Similar to Augmenting Digital Textbooks with Reusable Smart Learning Content: Solutions and Challenges (20)

PPTX
Click and Connect: Social Media Affordances & their influence on user partici...
PDF
Evolution of educational research topics a bibliometric analysis-based compre...
PDF
Produce thing 4 5 6
DOCX
Arc credit hour
PPT
Action researchexamplefi
PDF
ai_report_for_educators_16-7-23.pdf
PDF
The Generative AI System Shock, and some thoughts on Collective Intelligence ...
PPTX
ENCORE Workshop Webinar 26 February 2024
PPTX
Context modelling for Learning; some heuristics
PPTX
OERs in research methods teaching
PPTX
Paper Review - "Problems Underlying the Learning Object Approach", Sami Nurmi...
PPT
Learner generated-contexts-pecha-kucha
PDF
Open Educational Resources (OER) and AI – the essence of quality
PPTX
The role of Open Access and Open Educational Resources within Distance Education
PPTX
Democratizing the Discussion Board: Establishing a Community of Learners to G...
PDF
Learning Analytics Dashboards for Advisors – A Systematic Literature Review
PPTX
PPTX
Guide to Open Educational Resources - WALA 2016
PDF
Automatic Assessment of University Teachers Critical Thinking Levels.pdf
PPTX
Writing literature review
Click and Connect: Social Media Affordances & their influence on user partici...
Evolution of educational research topics a bibliometric analysis-based compre...
Produce thing 4 5 6
Arc credit hour
Action researchexamplefi
ai_report_for_educators_16-7-23.pdf
The Generative AI System Shock, and some thoughts on Collective Intelligence ...
ENCORE Workshop Webinar 26 February 2024
Context modelling for Learning; some heuristics
OERs in research methods teaching
Paper Review - "Problems Underlying the Learning Object Approach", Sami Nurmi...
Learner generated-contexts-pecha-kucha
Open Educational Resources (OER) and AI – the essence of quality
The role of Open Access and Open Educational Resources within Distance Education
Democratizing the Discussion Board: Establishing a Community of Learners to G...
Learning Analytics Dashboards for Advisors – A Systematic Literature Review
Guide to Open Educational Resources - WALA 2016
Automatic Assessment of University Teachers Critical Thinking Levels.pdf
Writing literature review
Ad

More from Sergey Sosnovsky (20)

PPTX
Harnessing Textbooks for High-Quality Labeled Data: An Approach to Automatic ...
PDF
Toward Eliminating Hallucinations: GPT-based Explanatory AI for Intelligent T...
PDF
Layout- and Activity-based Textbook Modeling for Automatic PDF Textbook Extra...
PPTX
Exploring the Content Ecosystem of the First Open-source Adaptive Tutor and i...
PPTX
Advancing Intelligent Textbooks with Automatically Generated Practice: A Larg...
PPTX
Creating Session Data from eTextbook Event Streams
PDF
Interactions of reading and assessment activities
PDF
Parallel Construction: A Parallel Corpus Approach for Automatic Question Gene...
PDF
YAI4Edu: an Explanatory AI to Generate Interactive e-Books for Education
PDF
Automatic Question Generation for Evidence-based Online Courseware Engineering
PDF
Reading Comprehension Quiz Generation using Generative Pre-trained Transformers
PPTX
Mathematical Language Processing via Tree Embeddings
PPTX
Contextual Definition Generation
PPTX
Transforming Textbooks into Learning by Doing Environments: An Evaluation of ...
PPTX
Generation of Assessment Questions from Textbooks Enriched with Knowledge Models
PPTX
Using Semantics of Textbook Highlights to Predict Student Comprehension and K...
PPTX
Dental TutorBot: Exploitation of Dental Textbooks for Automated Learning
PDF
What's in a textbook
PPTX
Using Programmed Instruction to Help Students Engage with eTextbook Content
PPTX
Adding Intelligence to a Textbook for Human Anatomy with a Causal Concept Map...
Harnessing Textbooks for High-Quality Labeled Data: An Approach to Automatic ...
Toward Eliminating Hallucinations: GPT-based Explanatory AI for Intelligent T...
Layout- and Activity-based Textbook Modeling for Automatic PDF Textbook Extra...
Exploring the Content Ecosystem of the First Open-source Adaptive Tutor and i...
Advancing Intelligent Textbooks with Automatically Generated Practice: A Larg...
Creating Session Data from eTextbook Event Streams
Interactions of reading and assessment activities
Parallel Construction: A Parallel Corpus Approach for Automatic Question Gene...
YAI4Edu: an Explanatory AI to Generate Interactive e-Books for Education
Automatic Question Generation for Evidence-based Online Courseware Engineering
Reading Comprehension Quiz Generation using Generative Pre-trained Transformers
Mathematical Language Processing via Tree Embeddings
Contextual Definition Generation
Transforming Textbooks into Learning by Doing Environments: An Evaluation of ...
Generation of Assessment Questions from Textbooks Enriched with Knowledge Models
Using Semantics of Textbook Highlights to Predict Student Comprehension and K...
Dental TutorBot: Exploitation of Dental Textbooks for Automated Learning
What's in a textbook
Using Programmed Instruction to Help Students Engage with eTextbook Content
Adding Intelligence to a Textbook for Human Anatomy with a Causal Concept Map...
Ad

Recently uploaded (20)

PDF
Placing the Near-Earth Object Impact Probability in Context
PPT
protein biochemistry.ppt for university classes
PDF
CAPERS-LRD-z9:AGas-enshroudedLittleRedDotHostingaBroad-lineActive GalacticNuc...
PPTX
famous lake in india and its disturibution and importance
PDF
bbec55_b34400a7914c42429908233dbd381773.pdf
PDF
Biophysics 2.pdffffffffffffffffffffffffff
PPTX
ANEMIA WITH LEUKOPENIA MDS 07_25.pptx htggtftgt fredrctvg
PPTX
ognitive-behavioral therapy, mindfulness-based approaches, coping skills trai...
PDF
Unveiling a 36 billion solar mass black hole at the centre of the Cosmic Hors...
PDF
AlphaEarth Foundations and the Satellite Embedding dataset
DOCX
Viruses (History, structure and composition, classification, Bacteriophage Re...
PPTX
Microbiology with diagram medical studies .pptx
PPT
The World of Physical Science, • Labs: Safety Simulation, Measurement Practice
PPTX
2. Earth - The Living Planet Module 2ELS
PDF
Mastering Bioreactors and Media Sterilization: A Complete Guide to Sterile Fe...
PPTX
Derivatives of integument scales, beaks, horns,.pptx
PDF
The scientific heritage No 166 (166) (2025)
PDF
ELS_Q1_Module-11_Formation-of-Rock-Layers_v2.pdf
PPTX
TOTAL hIP ARTHROPLASTY Presentation.pptx
PDF
IFIT3 RNA-binding activity primores influenza A viruz infection and translati...
Placing the Near-Earth Object Impact Probability in Context
protein biochemistry.ppt for university classes
CAPERS-LRD-z9:AGas-enshroudedLittleRedDotHostingaBroad-lineActive GalacticNuc...
famous lake in india and its disturibution and importance
bbec55_b34400a7914c42429908233dbd381773.pdf
Biophysics 2.pdffffffffffffffffffffffffff
ANEMIA WITH LEUKOPENIA MDS 07_25.pptx htggtftgt fredrctvg
ognitive-behavioral therapy, mindfulness-based approaches, coping skills trai...
Unveiling a 36 billion solar mass black hole at the centre of the Cosmic Hors...
AlphaEarth Foundations and the Satellite Embedding dataset
Viruses (History, structure and composition, classification, Bacteriophage Re...
Microbiology with diagram medical studies .pptx
The World of Physical Science, • Labs: Safety Simulation, Measurement Practice
2. Earth - The Living Planet Module 2ELS
Mastering Bioreactors and Media Sterilization: A Complete Guide to Sterile Fe...
Derivatives of integument scales, beaks, horns,.pptx
The scientific heritage No 166 (166) (2025)
ELS_Q1_Module-11_Formation-of-Rock-Layers_v2.pdf
TOTAL hIP ARTHROPLASTY Presentation.pptx
IFIT3 RNA-binding activity primores influenza A viruz infection and translati...

Augmenting Digital Textbooks with Reusable Smart Learning Content: Solutions and Challenges

  • 1. Augmenting Digital Textbooks with Reusable Smart Learning Content: Solutions and Challenges Jordan Barria-Pineda, Arun Balajiee Lekshmi Narayanan, Peter Brusilovsky iTextbooks’22 Workshop @ AIED’22
  • 2. Current approaches for Intelligent Textbooks AUTHOR Textbook content
  • 3. Current approaches for Intelligent Textbooks AUTHOR Textbook content Learning content
  • 4. Current approaches for Intelligent Textbooks AUTHOR Textbook content Learning content
  • 5. Current approaches for Intelligent Textbooks AUTHOR Textbook content Learning content
  • 6. Current approaches for Intelligent Textbooks AUTHOR Textbook content Learning content
  • 12. Online Reading System: Reading Mirror
  • 13. Case 1: Educational video recommendations Concept extraction and initial relevancy filter Collection of video candidates Textual representation of the videos Reading-Video similarity calculation Recommenda- tions presentation in the UI
  • 14. Case 1: Educational video recommendations Concept extraction and initial relevancy filter Collection of video candidates Textual representation of the videos Reading-Video similarity calculation Recommenda- tions presentation in the UI Thaker, K.M., Brusilovsky, P., He, D. (2018) Concept enhanced content representation for linking educational resources.
  • 15. Case 1: Educational video recommendations Concept extraction and initial relevancy filter Collection of video candidates Textual representation of the videos Reading-Video similarity calculation Recommenda- tions presentation in the UI https://youtube-dl.org/
  • 16. Case 1: Educational video recommendations Concept extraction and initial relevancy filter Collection of video candidates Textual representation of the videos Reading-Video similarity calculation Recommenda- tions presentation in the UI Simple textual matching of transcripts’ keyphrases and the concepts extracted from the textbook in the first step.
  • 17. Case 1: Educational video recommendations Concept extraction and initial relevancy filter Collection of video candidates Textual representation of the videos Reading-Video similarity calculation Recommenda- tions presentation in the UI tf-idf
  • 18. Concept extraction and initial relevancy filter Collection of video candidates Textual representation of the videos Reading-Video similarity calculation Recommenda- tions presentation in the UI Case 1: Educational video recommendations
  • 19. Concept extraction and initial relevancy filter Collection of video candidates Textual representation of the videos Reading-Video similarity calculation Recommenda- tions presentation in the UI Case 1: Educational video recommendations
  • 20. Case 2: Smart learning content recommendations
  • 21. Case 2: Smart learning content recommendations
  • 22. Case 2: Smart learning content recommendations
  • 23. Case 2: Smart learning content recommendations
  • 24. Case 2: Smart learning content recommendations
  • 25. Case 2: Smart learning content recommendations
  • 26. Case 2: Smart learning content recommendations
  • 27. Other related educ. recommendations 1. Recommendations to external resources (Rahdari et al. 2020)
  • 28. 1. Recommendations to external resources (Rahdari et al. 2020) 2. Recommendations to other textbooks (Thaker et al. 2020) Other related educ. recommendations
  • 29. 1. Recommendations to external resources (Rahdari et al. 2020) 2. Recommendations to other textbooks (Thaker et al. 2020) 3. Recommendations of learning content for instructional design (Albó et al. 2019; Chau et al. 2017; 2018) Other related educ. recommendations
  • 30. 1. Recommendations to external resources (Rahdari et al. 2020) 2. Recommendations to other textbooks (Thaker et al. 2020) 3. Recommendations of learning content for instructional design (Albó et al. 2019; Chau et al. 2017; 2018) 4. Recommendations to video courses Other related educ. recommendations
  • 31. 1. Recommendations to external resources (Rahdari et al. 2020) 2. Recommendations to other textbooks (Thaker et al. 2020) 3. Recommendations of learning content for instructional design (Albó et al. 2019; Chau et al. 2017; 2018) 4. Recommendations to video courses 5. In this work, also, recommendations to interactive book exercises! Other related educ. recommendations 1. B Rahdari, P Brusilovsky, K Thaker, J Barria-Pineda. Using knowledge graph for explainable recommendation of external content in electronic textbooks iTextbooks@ AIED, 2020 2. Khushboo Thaker, Lei Zhang, Daqing He and Peter Brusilovsky "Recommending Remedial Readings Using Student's Knowledge state" (EDM 2020) 3. Albó, L., Barria-Pineda, J., Brusilovsky, P., Hernández-Leo, D. (2019). Concept-Level Design Analytics for Blended Courses. https://doi.org/10.1007/978-3-030-29736-7_40
  • 32. Challenges 1. Scaling the system by the type of smart content allocation, potentially making it automatic instead of static allocation as noted in prior work (Alpizar-Chacon et al. 2021)
  • 33. Challenges 1. Scaling the system by the type of smart content allocation, potentially making it automatic instead of static or semi- automatic allocation as noted (Alpizar-Chacon et al. 2021) 2. Allocation that adapts to the teacher’s understanding of the course in a finer grained way – previous efforts have been done by following coarse-grained units formed from different sections (Chau et al. 2017; 2018) or concepts (Rahdari et al. 2020). 1. Alpizar-Chacon, Isaac; Barria-Pineda, Jordan; Akhuseyinoglu, Kamil; Sosnovsky, Sergey; Brusilovsky, Peter. Integrating textbooks with smart interactive content for learning programming. iTextbooks @ AIED 2021 2. Chau, H., Barria-Pineda, J., Brusilovsky, P. (2018). Learning Content Recommender System for Instructors of Programming Courses. AIED 2018. 3. Hung Chau, Jordan Barria-Pineda, and Peter Brusilovsky. 2017. Content Wizard: Concept-Based Recommender System for Instructors of Programming Courses. (UMAP 2017).
  • 34. Challenges 1. Scaling the system by the type of smart content allocation, potentially making it automatic instead of static or semi- automatic allocation as noted in prior work (Alpizar-Chacon et al. 2021) 2. Allocation that adapts to the teacher’s understanding of the course in a fine-grained way is allocated as coarse-grained units formed from different sections (Chau et al. 2017; 2018) and as demonstrated by wiki recommendations (Rahdari et al. 2020) in e-textbooks. 3. Adapt to the learner state
  • 35. Discussion and Future work 1. Dynamic SLC at different levels of granularity
  • 36. Discussion and Future work 1. Dynamic SLC at different levels of granularity 2. Reader’s control over the smart content curation
  • 37. Discussion and Future work 1. Dynamic SLC at different levels of granularity 2. Reader’s control over the smart content curation 3. Passive recommendations as another option
  • 38. Discussion and Future work 1. Dynamic SLC at different levels of granularity 2. Reader’s control over the smart content curation 3. Passive recommendations as another option 4. Learner-sourced recommendations
  • 39. Discussion and Future work 1. Dynamic SLC at different levels of granularity 2. Reader’s control over the smart content curation 3. Passive recommendations as another option 4. Learner-sourced recommendations 5. Overcoming challenges identified with their possible solutions
  • 40. Discussion and Future work 1. Dynamic SLC at different levels of granularity 2. Reader’s control over the smart content curation 3. Passive recommendations as another option 4. Learner-sourced recommendations 5. Overcoming challenges identified with their possible solutions 6. Evaluation of the approaches through a “live” classroom study (pending analysis)
  • 41. Conclusions 1. Integrating multiple SLCs into an eTextbook – making it a “intelligent” textbook with recommendations for the reader. 2. Present a system that is flexible with the possibility of interchangeable learning platform (eTextbook system) 3. Identify the challenges and discuss solutions
  • 42. Q & A Thanks for your attention! Augmenting Digital Textbooks with Reusable Smart Learning Content: Solutions and Challenges Jordan Barria-Pineda, Arun Balajiee Lekshmi Narayanan, Peter Brusilovsky iTextbooks’22 Workshop @ AIED’22