Modern Learning Ecosystem Design with xAPI
8 likes1,329 views
The document discusses the implementation of xAPI to modernize learning ecosystems by capturing experience data across various tools, enabling real-time insights into learning and performance. It emphasizes the transition from siloed systems to a unified approach, allowing stakeholders to leverage data for better decision-making and improved learner experiences. Several case studies highlight how organizations have successfully used xAPI to enhance learning analytics and content effectiveness.
Modern Learning Ecosystem Design with xAPI
- 1. Modern Learning Ecosystem Design with xAPI March 28, 2018 — #xAPI Margaret Roth // @margaret_h_r
- 2. Today’s Agenda • What We Heard in 2017 • State of Learning Ecosystems • Intro to xAPI • xAPI Case Studies • Takeaways and Next Steps Welcome! Thank you for joining me today! 2 background xAPI case studies Q&A takeaways
- 3. 1. Provide data about individual learning and performance directly to employees, managers, and other stakeholders. 2. Make the move from manual data processing to real-time reporting and automated analytics in the next 9-18 months. 3. Bring together stakeholders from across departments including IT, Sales, HR, andTalent Development at the onset of xAPI initiatives. Quick Rewind: 3 L&D Leader Goals 3 background xAPI case studies takeawaysQ&A
- 4. “I’m responsible for a complex, fragmented ecosystem and I don’t love the tools we’re using.And neither does anyone else.” Quick Rewind: One Big Problem “From what I’ve seen, xAPI could be our way to fix this whole thing.” 4 background xAPI case studies takeawaysQ&A
- 5. Current State • Very siloed systems • Data fragmentation • Poor learner experience (LX) • Disaster in reporting • Lots of time spent in data cleaning, little time in analytics 5 background xAPI case studies Q&A takeaways
- 6. Current State • Very siloed systems • Data fragmentation • Poor learner experience (LX) • Reporting is a disaster • Lots of time spent in data cleaning, little time in analytics “My life right now.” 6 background xAPI case studies Q&A takeaways
- 7. • Seamless system and content communication • Learning experience happens in unified system • Automated data collection, reporting, and analytics accessible to stakeholders Total Integration 7 background xAPI case studies Q&A takeaways
- 8. • Seamless system and content communication • Learning experience happens in unified system • Automated data collection, reporting, and analytics accessible to stakeholders Total Integration “By 2020.” 8 background xAPI case studies Q&A takeaways
- 9. We know we can’t go from 0-100. We have to build the road first. 9 background xAPI case studies Q&A takeaways
- 10. What is xAPI? xAPI is a way to capture experience data. Let’s start with the basics! 10 background xAPI case studies Q&A takeaways
- 11. Experience data is a combination of activity, learning, behavior, and performance data. By unifying data from across organizational data sources, insights into engagement, learning effectiveness, information use, and team behaviors can be identified and applied to improve business outcomes. What is experience data? 11 background xAPI case studies Q&A takeaways
- 12. Experience data is collected using the Experience API (xAPI), a standardized Actor —Verb — Object data format. This interoperable data structure allows you to activate information across tools and technologies where experience data is created in real-time. How is experience data collected? Stacey Completed Course #1 Actor Verb Object 12 background xAPI case studies Q&A takeaways
- 13. How is experience data collected? Because xAPI is designed around activity-based data collection, xAPI data can provide high-resolution insights into specific learner activity. For example, completing a course is actually a summation of many, much more granular, actions. This information can show us how engaging or valuable an experience is for a learner. Stacey Completed Course Launched Viewed Played Clicked Paused Clicked Opened Clicked Clicked Submitted Viewed Closed Course Title Page Video Rewind Video Resource Link Article Radio Button #1 Radio Button #2 Answer Final Slide Course 13 background xAPI case studies Q&A takeaways
- 14. xAPI allows for modular, flexible, and scalable learning ecosystem design through data interoperability. How is a learning ecosystem designed with xAPI? 14 background xAPI case studies Q&A takeaways
- 15. Experience data is standardized across tools into xAPI format and stored in a Learning Record Store (LRS). Data can then be sent to other system like automated dashboards, reporting tools, or applications. How does xAPI power a learning ecosystem? 15 background xAPI case studies Q&A takeaways
- 16. Experience data is standardized across tools into xAPI format and stored in a Learning Record Store (LRS). Data can then be sent to other system like automated dashboards, reporting tools, or applications. How does xAPI power a learning ecosystem? 16 background xAPI case studies Q&A takeaways But where are organizations starting?
- 17. • Modernization of learning ecosystem to modular structure • Solves for reporting challenges through data unification using the LRS • Future-proofed through xAPI enablement Hybrid Ecosystem 17 background xAPI case studies Q&A takeaways
- 18. • Modernization of learning ecosystem to modular structure • Solves for reporting challenges through data unification using the LRS • Future-proofed through xAPI enablement Hybrid Ecosystem Where you can be 6-8 months from today. 18 background xAPI case studies Q&A takeaways
- 19. No. Definitely not. Proof or it can’t happen. Do you think it’s true? 6-8 months! 19 background xAPI case studies Q&A takeaways
- 20. A RETAIL CO. Case Studies to Prove It Measuring the Effectiveness of Instructional Content with Granular Learner Behavior Creating xAPI-Powered Career Pathways to Improve Retention Measuring Skill Development through a Multi-Source Learning Experience Interface 20 background xAPI case studies Q&A takeaways Identifying Content Improvements through Learner Usage Data Reimagining Performance Assessment for Personalized Learning & Development AIROAn International Research Organization
- 21. + Identifying Content Improvements through Learner Usage Data 21 background xAPI case studies Q&A takeaways AIRO An International Research Organization
- 22. An international research organization works to improve food security and reduce poverty in developing countries. In order to understand where their training initiatives are having the greatest impact, they need to know which of their resources are getting used, who they are used by, and where those users are. By using xAPI to get better data about learning patterns and content use, they are able to understand overall engagement and improve their resources. + 22 background xAPI case studies Q&A takeaways AIRO
- 23. Problem ØContent usage is unknown ØContent users are unknown ØWanted to understand how much time is spent on different resources ØWanted to identify where there are content gaps or opportunities to create more supporting resources 23 background xAPI case studies Q&A takeaways
- 24. ØConnect LMS and CMS to LRS ØUse xAPI to gather activity and behavior data from content users ØSend statements to theYet LRS ØAnalyze results to understand content usage patterns and opportunities Solution 24 background xAPI case studies Q&A takeaways
- 25. ØUnderstanding of audience engagement ØBy using xAPI to get better data about learning patterns and content use, they are able to shift their content creation team to be proactive designers rather than reactionary producers Outcomes 25 background xAPI case studies Q&A takeaways
- 26. Public Nursing School + Measuring the Effectiveness of Instructional Content with Granular Learner Behavior 26 background xAPI case studies Q&A takeaways
- 27. A California-based Public Nursing School has created online, interactive experiences to simulate clinical problem solving and help students develop reasoning skills. By enabling xAPI data to be collected from their LMS and sent to theYet LRS, instructional designers are able to analyze high-resolution activity and behavior data to measure the effectiveness of content, identify modules that need improvement, and understand student decision-making processes.With this data about digital learning, instructors are now able to personalize in-person instruction and make more relevant student interventions. + 27 background xAPI case studies Q&A takeaways
- 28. Problem ØDeveloping the expertise of students in diverse patient environment ØFocused on in-person experiential learning for students ØWanted to incorporate online interactive simulations and provide mobile learning solutions ØWanted more granular data 28 background xAPI case studies Q&A takeaways
- 29. ØDevelop interactive eLearning modules using Lectora ØUse xAPI to collect granular data about student response behavior and send statements to theYet LRS ØAnalyze and manipulate data inYet LRS ØExport unified data to current BI workflow to correlate and apply results Solution 29 background xAPI case studies Q&A takeaways
- 30. ØMost students correctly identify findings ØSome students ask more questions than they need to and flag things that are not relevant ØIdentification of significant findings does not translate to correct decision making in branching scenarios ØMost students reject poor choices but many get distracted by reasonable choices Learning Analytics 30 background xAPI case studies Q&A takeaways Source: https://www.slideshare.net/slideshow/embed_code/key/cImyNV4uIAS2d1
- 31. ØInteractive eLearning modules enhance instruction and improve learning analytics ØCreates feedback loop for instructors so they can identify necessary interventions and personalize learning ØEasy to collect learning analytics provide foundation for long-term data-driven instructional improvements Outcomes “With xAPI it’s now possible to gain insights into our students’ clinical reasoning skills.Yet Analytics worked closely with us and made it possible to harness this new technology. ” – Andrew Corbett, PhD 31 background xAPI case studies Q&A takeaways Source: https://www.slideshare.net/slideshow/embed_code/key/cImyNV4uIAS2d1
- 32. + Reimagining Progress Reports in a Unified Data Dashboard for Mastery Based Blended Learning 32 background xAPI case studies Q&A takeaways
- 33. + Reimagining Performance Assessment in Personalized Learning & Development 33 background xAPI case studies Q&A takeaways
- 34. Khan Lab School is an independent school associated with Khan Academy that runs a personalized, mixed-age program with a project-based learning approach. Because KLS tracks mastery instead of letter grades and groups students by independence level instead of age, a new kind of reporting system is needed to show student progress. Yet Analytics has built student-facing and instructor-facing dashboards that pull data from digital and in-person learning activity to provide a unified view of student progress at KLS. + 34 background xAPI case studies Q&A takeaways
- 35. Problem ØHad selected the best learning tools and platforms ØUsed a modular approach and combined the components that best suited their needs ØDesigned a program and curriculum to support self-paced, self-directed, blended learning 35 background xAPI case studies Q&A takeaways
- 36. Problem ØCompletely siloed data ØHad no way to connect learning and performance across tools ØHours of time spent hand-mapping progress in spreadsheets each week “My life right now.” 36 background xAPI case studies Q&A takeaways
- 37. ØEasy to understand for students, actionable for teachers and other stakeholders ØSeamless, single-sign-on, multi-permission access structure ØSecure data processing and storage ØModular ecosystem approach for future compatibility Solution 37 background xAPI case studies Q&A takeaways
- 38. Teacher – ProfessionalStudent – 9Years Old 38 background xAPI case studies Q&A takeaways
- 39. Outcomes ØReal-time insight into student progress ØIndividual learner dashboards that empower students and facilitate communication with other stakeholders ØRole-specific dashboards making it easy for teachers, parents, and administrators to see learner masteries across tools at a glance 39 background xAPI case studies Q&A takeaways
- 40. + Creating xAPI-Powered Career Pathways to Improve Retention A RETAIL CO. 40 background xAPI case studies Q&A takeaways
- 41. One of a Fortune 1000 retail organization’s strategic business objectives is to make more data driven decisions. For the L&D team this means shifting from a content-centric mindset to a data-centric mindset. Rather than continuing to focus on providing reactionary content solutions, the company’s leadership team has started the process of creating a modular xAPI-powered learning ecosystem.Their vision is to create a single source of record to enable observability, granularity, and accountability with regard to both learning activity and content. Using this data, they aim to deliver personal corporate transcripts to each employee and improve retention. +A RETAIL CO. 41 background xAPI case studies Q&A takeaways
- 42. Problem ØData siloed across departments compounded by manual data analysis ØRobust career pathways on paper; no connection to digital activity or training ØLack of observability into learner engagement, no visibility into informal learning ØEmployees don’t know their way forward “What we have.” 42 background xAPI case studies Q&A takeaways
- 43. ØTeam had self-identified that xAPI is the technology they need to solve their problems ØHave a clear vision for a fully implemented xAPI learning ecosystem with a seamless employee experience ØUnsure how to start Problem “What we want!” 43 background xAPI case studies Q&A takeaways
- 44. ØDefinition of business objectives and inventory of current technology infrastructure ØIdentification of system improvements, gap analysis, and prioritization of platforms ØOnsite workshop withYet Analytics data engineers and business performance specialists Solution Step One: Data Assessment What are your business objectives? What tools are in your current ecosystem? What do you want to do with the data once you have it? How do people use data now? What are your most used platforms? Where are your blind spots? 44 background xAPI case studies Q&A takeaways
- 45. Solution StepTwo: Develop Phased Approach Internal HR Resources: Measure and improve employee engagement with critical HR documents and benefits help desk Proof of Concept Project: Business Objective Management Training: Measure and improve manager engagement with required training and policy Content Optimization: Understand what content is used in informal self-directed learning offerings Seller Readiness: Understand how engagement with content prepares sellers for success 45 background xAPI case studies Q&A takeaways
- 46. Solution StepTwo: Develop Phased Approach Internal HR Resources: Measure and improve employee engagement with critical HR documents and benefits help desk Proof of Concept Project: Business Objective Management Training: Measure and improve manager engagement with required training and policy Content Optimization: Understand what content is used in informal self-directed learning offerings Seller Readiness: Understand how engagement with content prepares sellers for success 46 background xAPI case studies Q&A takeaways
- 47. Solution StepThree: Start in One Place ØDefine relevant data sources to connect ØIdentify critical experience data activity types that are valuable to support business objective ØGather input from each type of end user ØCreate organization specific xAPI Profile for future iteration and ecosystem build out Seller Readiness: Understand how engagement with content prepares sellers for success 47 background xAPI case studies Q&A takeaways
- 48. Outcomes ØBuilding support within your team, convening stakeholders and increasing shared buy-in for investment ØDefinition of a prioritized and phased roadmap of how to move forward ØExpert support, design recommendations and guidance 48 background xAPI case studies Q&A takeaways
- 49. Outcomes ØBuilding support within your team, convening stakeholders and increasing shared buy-in for investment ØDefinition of a prioritized and phased roadmap of how to move forward ØExpert support, design recommendations and guidance 49 background xAPI case studies Q&A takeaways
- 50. + Measuring Skill Development through a Multi-Source Learning Experience Interface 50 background xAPI case studies Q&A takeaways
- 51. Through partnerships with leading human capital organizations, the Learning Accelerator aims to transform K-12 education through blended learning on a national scale. As part of their distributed adult-learning strategy, TLA has partnered withYet Analytics to create the Learning Commons, an xAPI-enabled, multi-source content exploration and experience tracking portal.As learners utilize content through curated playlists, skill development is automatically tracked and presented back to individual learners, cohort leaders and content providers through role-specific dashboards. + 51 background xAPI case studies Q&A takeaways
- 52. Problem ØLearning content lives in an overwhelming number of locations ØDifficult for learners to get the content needed when it’s needed ØInstructional designers lack visibility into how resources are used or if they are valuable 52 background xAPI case studies Q&A takeaways
- 53. ØContent from different platforms and hosting systems is searchable in a single user interface ØIndividual learners can track their progress across content and playlists ØContent creators and cohort leaders are able to see engagement trends and informal learning progress Solution 53 background xAPI case studies Q&A takeaways
- 54. Curated Playlists Created by InstructorsUnified Search Portal for Learners 54 background xAPI case studies Q&A takeaways
- 55. Learner Profile with Skill Development Content Browse by Source andTopic 55 background xAPI case studies Q&A takeaways
- 56. Learning Network by Provider Competency MappingThrough Data Model 56 background xAPI case studies Q&A takeaways
- 57. Outcomes ØProvides multiple pathways into content for learners and improves content searchability ØContent curation is streamlined through playlist creation and community validation ØProgress data from informal learning is automatically collected and stored in a learner’s profile ØEnables a unified learner experience 57 background xAPI case studies Q&A takeaways
- 58. I agree.That was very good proof. Wow! What great case studies! 58 background xAPI case studies takeawaysQ&A
- 59. xAPI allows us to create learning ecosystems that are modular, flexible, and future-proof. Learning Ecosystem Configuration Recap 59 background xAPI case studies takeawaysQ&A
- 60. Designing Your Modern Learning Ecosystem 60 background xAPI case studies takeawaysQ&A Start with the data sources that mean the most to business objectives.Then add in other components and systems in order of priority, usage, and impact.Apply and share the results throughout the process to involve all stakeholders.
- 61. Your xAPI ImplementationTimeline Today 6-8 Months 12-18 Months 61 background xAPI case studies takeawaysQ&A
- 62. That was a lot! What are your questions? 62 background case studies Q&A takeawaysxAPI
- 63. Manage Learning Analytics: See the status of your team’s key performance metrics, and identify outliers with theYet DXd, a Data Experience Dashboard. Review activity logs and completion rates. Identify top content and courses. See activity across cohorts. Measure engagement and tool usage. Monitor trends and patterns in learner engagement and performance. 63 background xAPI case studies takeawaysQ&A
- 64. Manage Learning Analytics: See the status of your team’s key performance metrics, and identify outliers with theYet DXd, a Data Experience Dashboard. Review engagement on individual learner profiles. See individual activity, resource use, and adoption across tools. Measure changes in learning performance. 64 background xAPI case studies takeawaysQ&A
- 65. Unify Access to Formal and Informal Learning : Search across content, curate learning playlists, track progress in learner profiles in theYet LXi, a Learning Experience Interface. Collect content from any web- based source. Highlight top content. Allow learners to search across content, competencies, and categories. 65 background xAPI case studies takeawaysQ&A
- 66. Unify Access to Formal and Informal Learning : Search across content, curate learning playlists, track progress in learner profiles in theYet LXi, unifying the learner experience with learning analytics. Share and save content, or create your own playlists. Curate content in playlists. 66 background xAPI case studies takeawaysQ&A
- 67. Unify Access to Formal and Informal Learning : Search across content, curate learning playlists, track progress in learner profiles in theYet LXi, a Learning Experience Interface. Connect with peers through learning networks. Save resources. Track progress in informal learning by competencies or skills. 67 background xAPI case studies takeawaysQ&A
- 68. Built on theYet LRS: Connect data using xAPI in theYet Learning Record Store. Compare across learners and cohorts and identify high performers. View data in real-time activity stream . See activity, behavior, learning, and performance activity. 68 background xAPI case studies takeawaysQ&A
- 69. Start with Yet Adapter: The fastest, easiest way to get xAPI data. Click to transform data to xAPI.Select and upload a .csv file from your computer. 69 background xAPI case studies takeawaysQ&A
- 70. Start with Yet Adapter: The fastest, easiest way to get xAPI data. Create new chips as needed. Manipulate columns from .csv file to configure xAPI statements. 70 background xAPI case studies takeawaysQ&A
- 71. Start with Yet Adapter: The fastest, easiest way to get xAPI data. Send data to an LRS of your choice. 71 background xAPI case studies takeawaysQ&A
- 72. Start with Yet Adapter: The fastest, easiest way to get xAPI data. 72 background xAPI case studies takeawaysQ&A If you send it to theYet LRS it will look something like this!
- 73. • Go explore an LRS for yourself — https://www.yetanalytics.com/demo • Get aYet xAPI LRS Sandbox — https://www.yetanalytics.com/free-sandbox-account • Start using theYet Adapter — https://www.yetanalytics.com/yetadapter • TheYet Adapter allows non-technical users an easy way to upload spreadsheet data and to transform it into xAPI data which can be sent to any Learning Record Store. • Have questions? Want these slides? Leave a card or email margaret@yetanalytics.com. Thank you for sharing your time with me! 73 background xAPI case studies takeawaysQ&A
- 74. From learning analytics to data logistics, Yet Analytics helps transform learning experience into business intelligence. Tools and solutions used to improve learning and talent development. 74 background xAPI case studies takeawaysQ&A
- 75. xAPI allows us to create learning ecosystems that are modular, flexible, and future-proof. Learning Ecosystem Configuration Recap 75 Yet Analytics — Modern Learning Ecosystem Design with xAPI — Learning Solutions 2018 — hello@yetanalytics.com
- 76. Designing Your Modern Learning Ecosystem Start with the data sources that mean the most to business objectives.Then add in other components and systems in order of priority, usage, and impact.Apply and share the results throughout the process to involve all stakeholders. 76 Yet Analytics — Modern Learning Ecosystem Design with xAPI — Learning Solutions 2018 — hello@yetanalytics.com