SlideShare a Scribd company logo
Learning Benchmarking Forum   Facilitator: Bryan Chapman Chief Learning Strategist Chapman Alliance [email_address] 24x7 Learning presents
Agenda Benchmarking Learning Infrastructure Alignment with Business and Instructional Needs Benchmarking Learning Content Development (Rapid and Simulation-Based) Benchmarking the use of Web 2.0 learning technologies and informal learning Benchmarking Blended Learning Benchmarking Talent and Performance Management Practices
Delivery formats 53% Instructor-Led, Classroom ASTD, State of the Industry Report (2006) 29% Online, Self-Paced 1% Instructor-Led Distance 3% Instructor-Led Online 4% CD-ROM, etc. 4% Print – Self Paced 1% Audio/Video 5% Other
Benchmark: Learning Infrastructure and Alignment
Virtual Classroom Synchronous Learning Self-Paced, Self-Service  Online Learning Informal Learning , Knowledge On Demand Off-the-shelf ,  pre-built courses Authoring Tools Learning Content Management Ready-to-use content (courseware) Easy to find: IT skills, leadership, safety Hard to find: very specific, job-related skills Custom development Screen design and layout Interactive exercises Tests, Quiz, Assessment Simulations Manage large-scale development (workflow) Reusable learning content Searchable repository of source material Central Access to Learning Individualized Learning Plans Reporting & Completion Tracking Instructor-Led Training Scheduling Launch and track online learning Certification Management Competency Management Instructor-led, Real time, Online Connecting geographical disperse learners Groups of learners meet together 24 X 7 X 365 access to courses Completed at learner’s own pace Remediation and feedback are automated Developed once, used many times Automated scoring and completion status Just-in-time, anywhere, anytime Capture and retain organizational knowledge Facilitates collaboration Learning Management System   LMS
International Airline Geographically disperse Mix of live, virtual classroom  (personal interaction) Self-paced e-learning  (conceptual, procedural)
Construction Company Big issue: regulatory compliance (safety) Off-the-shelf courses & LMS
Medical Association Thousands of medical, teaching case studies On CD, on shelf; photos, charts, graphs, narrative Manage and distribute (no patient names) for teaching (25,000 association members)
National Restaurant Chain Large population, customer-facing employees Not large groups, needs to be self-paced Simulation, role-play exercises (empowerment)
Industrial/Manufacturing 100,000+ employees; lack of information about other parts of the company Learning Wiki – invited 200 authors to write articles Ended up with over 7,000 content contributors
Trend Changes in Delivery CLO Magazine, July 2006
What is your mix? …now? …future? Creating a Learning Culture: Jumstart Planner, Chapman Alliance
Why do we buy an LMS in the first place?
Why do we buy an LMS in the first place?
Cost vs. Functionality of learning platform Skill-Gap Analysis Launch  e-learning Advanced Classroom Management Content Development Tools Reusable Learning Content Happy Sheet Talent Management Analytics Language support 3 rd  party content Deep Backoffice Integration Certification Testing Advanced Question Types Reporting Collaborative Learning E-commerce Informal Learning Repository Regulatory & Compliance Tracking Multiple Portals
How long…? How long does it take to create 1 hour of  Classroom  Instruction (ILT)?
20% Student Guide Development 21% PowerPoint Development 13% Front-End Analysis/ Data Collection, Working with SME’s 8% Test and Exam Creation 13% Instructional Design, Objectives, Outlining, Writing Content, etc. 6% Other Development Tasks 11% Lesson Plan Development 8% Creation of handout materials n=132 See next slide for “Other” tasks Development of Instructor-Led Training (ILT) Itemized Development Tasks, with hours overlay Research data collected: November, 2007, by Chapman Alliance 36  Total Hours 4.8 hours 4.6 hours 3.8 hours 3.0 hours 7.2 hours 7.6 hours 2.8 hours 2.3 hours
How long…? How long does it take to create 1 hour of  E-Learning ?
How long…? How long does it take to create 1 hour of  PowerPoint-based, online learning ? Low Range = 12:1 High Range = 60:1
How long…? How long does it take to create 1 hour of  Simulation-Based e-learning ? 1300 hours
Development Costs Reoccurring costs, over time Instructor-Led Online, Self-Paced Break even point (10 Months) 221:1 (hours of development per finished hour of instruction) 34:1 (hours of development per finished hour of instruction) Example Only
Development Costs Reoccurring costs, over time Instructor-Led Online, Self-Paced Break even point (10 Months) 221:1 (hours of development per finished hour of instruction) 34:1 (hours of development per finished hour of instruction) Return on Investment Example Only
Development Costs Reoccurring costs, over time Instructor-Led Online, Self-Paced 221:1 (hours of development per finished hour of instruction) 34:1 (hours of development per finished hour of instruction) 75:1 Break even point (10 Months) Example Only (3.5 Months) Return on Investment
ROI factors Infrastructure Cost (LMS, LCMS, etc.) Internal Development costs 75:1 (for quick and dirty) 220:1 (for Level 2) 750:1 (highly interactive, simulation) Outsourcing Custom Development Cost of 3 rd  party courseware # of learners Required travel (geographic distribution) {less tangible} Opportunity costs
Additional ROI Benefits Shorter Overall Training Times Increased Increased Consistency  Keeping up with Rapidly Changing Information Open enrollment Building Customer/Brand Loyalty Capturing and Maintaining Corporate Knowledge
Rapid Development, without sacrificing Interactivity
 
PCWeek Shoot Out Several teams invited to compete Convert a 54-hour instructor-led course to online learning 2 days of development 1 person at the computer at any time Storyboard…. actually a lesson plan Present course to 20 judges and 150 members of media gallery Watched the other teams in action Wide variety of approaches
Continuum of Interaction
Cost per finished hour… Source: Brandon Hall Research, Custom Content Development Knowledgebase Ratio:  750:1 Cost:  $30,000 (assumed rate of $40 pay per hour) Average:  $41,138 Low:  $29,639 High:  $70,279 Level 3: High level of gaming and/ or simulation Ratio:  221:1 Cost:  $8,840 (assumed rate of $40 pay per hour) Average:  $24,672 Low:  $17,627 High:  $33,711 Level 2: Level 1, plus… 25% interactive exercises, games and mini-simulations Ratio:  30-50:1 Cost:  $1,200 - $2,000 (assumed rate of $40 pay per hour)   Average:  $15,067 Low:  $10,009 High:  $20,088 Level 1: Page turning Test Questions Internally Developed (per finished hour) Outsource Developed (per finished hour) Levels of Interactivity
IBM Learning Model White Papers Product Knowledge PowerPoint Word .PDF Student  Guide Role Play  Simulations Business  Simulations Self Assessment Instructor-Led “ culminating experience” Practice
Blended Learning as a development model White Papers Product Knowledge PowerPoint Word .PDF Student  Guide Games Exercises Practice Scenario-Based  Simulations Classroom uses the same development model Rapid Simulation Development – Best Tool for the Job Rapid Authoring Tools
“ Remember” – “Do”
Bloom’s Taxonomy Knowledge Action verbs: list, define, tell, describe, identify, show, label, collect, examine, tabulate, quote, name, who, when, where, etc.   Comprehension  Action verbs: summarize, describe, interpret, contrast, predict, associate, distinguish, estimate, differentiate, discuss, extend, etc.   Application  Action verbs: apply, demonstrate, calculate, complete, illustrate, show, solve, examine, modify, relate, change, classify, experiment, discover, etc.  Analysis  Action verbs: analyze, separate, order, explain, connect, classify, arrange, divide, compare, select, explain, infer, etc.   Synthesis  Action verbs: combine, integrate, modify, rearrange, substitute, plan, create, design, invent, what if?, compose, formulate, prepare, generalize, rewrite, etc.   Evaluation  Action verbs: assess, decide, rank, grade, test, measure, recommend, convince, select, judge, explain, discriminate, support, conclude, compare, summarize, etc.
Don’t wait too late to apply interactivity Course Designer Analyze Develop Implement Evaluate Design Document Storyboard Design Prototype Authoring and Production
Raptivity – Interactivity Sampler www.raptivity.com Course Designer
Half-Baked Software www.halfbakedsoftware.com Course Designer
Class Tool – Free Games www.classtools.net Course Designer
247,000 employees Factory Training Supply Chain Model 50 SME’s created 200 learning modules in very short timeframe SME- Developed Published by Center Learning Champions (local units) Support Staff ISD Graphic Artists Strategy? Learners
Interactivity to meet instructional goals Course Designer Interactivity Menu… Discovery Exercise Progressive Disclosure Branching Scenario  (troubleshooting) Software Application Simulation Labeling Exercise Role-play simulation Discrimination Exercise  (classification) Game show  (i.e. Jeopardy, Millionaire) Simple Games  (Tic-Tac-Toe) Crossword puzzle  (reinforce terminology) Sequencing Exercise Interactive Glossary Flash Cards  (recall) Branching Questions Matching Video Interaction Animated Diagram
Tips and Suggestion  – Using Interactivity for Rapid Development Create an interactivity “sampler” to show to internal customers, SME’s, etc.  Review  before  design activities. Don’t create navigation controls at the page level. It’s a waste of time. Page turning isn’t bad if used in moderation. Add a healthy mix of interactivity. When prototyping, create a prototype for each interaction, not just a single lesson or module. Consider using multiple tools to meet the need. One caution: make sure interactivity choices don’t overshadow the instruction. It is possible to use too much of a good thing.
Benchmarking the Use of Web 2.0 Learning Technologies and Informal Learning
Early Web Social Web Personal Web Pages Online Encyclopedias MP3.com Banner Ads Online Stores Bookstore Content Management Website Stickiness Email Communication Learning Web Early Web
Early Web to “Social Web” Blogs Wikipedia itunes Google Adsense Ebay Auctions  Book Reviews Wikis Democratic syndication MySpace/Facebook Social Web Personal Web Pages Online Encyclopedias MP3.com Banner Ads Online Stores Bookstore Content Management Website Stickiness Email Communication Learning Web Early Web
Traditional Learning Management Model New Hire Orientation Learning Portal - Formal LMS – Learning Portal Sales Process Leadership Computer Applications Safety Product Knowledge Job-specific Skills
Knowledge Management Traditional KM Centralized Knowledge Assets Expert Learner Instructor Worker Manager Mentor Expert Learner Sales
Using both approaches simultaneously Traditional KM Centralized Knowledge Assets Expert Learner Manager Mentor Expert Sales LMS – Learning Portal Sales Process Leadership Computer Applications Safety Product Knowledge Job-specific Skills Learning Portal - Formal New Hire Orientation
Informal Learning “ Informal learning is simply that, which is not directed by an organization or somebody in a control position.” - Jay Cross webinar poll
What about tacit knowledge? Explicit Knowledge Tacit  Knowledge Identifying is difficult Documenting is even more difficult
Formal vs. Informal Learning Collaboration Communities of practice Access to Experts Mentors Knowledgebanks Classroom Events Online courses Virtual Classroom Informal (ad hoc) Formal How?
Delivery formats
Definition of Wiki Wiki:   A website created by a group; rather than by an individual. In Hawaiian, Wiki means “quick” W hat  I   K now  I s…  (descriptive of the process of collaborative content development.
Ideas for using Wikis in Learning Ad hoc, Knowledge Management Repository Centralized location for documenting and organizing procedural information Group-based learning assignments (work as a team)  Soliciting information from Subject Matter Experts; allowing a group of experts to contribute and edit content. Creating content with varying points of view (Groupthink) Learning content delivery for content that changes rapidly (bio-technology). Learn by teaching (Wiki authors)
Tips to successfully using Wikis for Learning Work on the initial taxonomy as a group, then turn them loose The more specific the topic focus, the better the content. Designated time period (when used as part of a structured course) Allow the Wiki to develop organically without enforcing too much workflow Allow learners to correct each other; rather than jumping in to correct problems (constructivist approach) Hold informal training sessions to teach Wiki syntax especially to Subject Matter Expert Lead by example – post excellent content
Title here….
Title here…. ...most popular videoblogs on the Web 200,000 viewers
Low-cost production
RocketBoom compared to TV Program Consumer-brand, video camera; laptop; two lights & a map Almost zero overhead costs  Very minimal distribution costs (web-delivered) Global distribution (world wide demand) Large potential audience $0 spent on promotion – 100% word of mouth Engage audience in topical discussions Audience can submit stories (including their own video content)
Vlogs  (thinking outside the box)
Vlogs gone Wild! www.anivegvideo.com
www.anivegvideo.com
“ podcast”
University Lectures via podcasts Pilot tests (By Apple) at universities such as Stanford, University of Washington, Missouri, etc. Students who can’t attend class have the option to download courses. Take classes while exercising or traveling.
Title here….
Title here….
Early Web to “Social Web” Blogs Wikipedia itunes Google Adsense Ebay Auctions  Book Reviews Wikis Democratic syndication MySpace/Facebook Social Web Personal Web Pages Online Encyclopedias MP3.com Banner Ads Online Stores Bookstore Content Management Website Stickiness Email Communication Learning Web Early Web
Application of Social Web to Learning Blogs Wikipedia itunes Google Adsense Ebay Auctions  Book Reviews Wikis Democratic syndication MySpace/Facebook Social Web Focused topic forums Corporate “pedias” Sharing Learning Bits Personalized Learning Plan Peer-to-peer learning market Content, Mentor Reviews Knowledge Management Learning syndication Social Learning Network Personal Web Pages Online Encyclopedias MP3.com Banner Ads Online Stores Bookstore Content Management Website Stickiness Email Communication Learning Web Early Web
Questions about Informal Learning After this discussion…. Is informal learning part of my job as a Training/Learning Professional? If not, whose job is it? Should I just set up the technical infrastructure for informal learning, or do I need to be a primary content contributor? How much “control” of informal learning is right for my organization? Should informal learning ever be tracked? If so, what is the best way to track it? What can I do to make sure that informal learning doesn’t become just another “content silo”? How do I set up a loop to make sure that critical issues raised in informal learning exchanges get on the company’s radar screen as possible formal training opportunities?
http://edutechwiki.unige.ch
Learning Blog Recommendations:   www.internettime.com  www.willatworklearning.com www. learningcircuits.blogspot.com www.elearningpost.com
Blog Creation Tools:   www.blogger.com (#14 in Global, Top 100) www.wikibooks.com www.bblog.com www.blogcms.com www.sixapart.com/movabletype www.nucleuscms.org www.pivotlog.net www.s9y.org www.spip.net www.textpattern.com www.wordpress.org
Podcast – Tools and Services www.odeo.com (free podcast posting through a telephone) www.audioblog.com (monthly service fee) http://audacity.sourceforge.net/ (free, open-source sound editing software) www.audioblogger.com (free, puts audio inside your blog on blogger.com) www.industrialaudiosoftware.com www.mixcastlive.com … .just about any audio recording software capable of creating .mp3 files
Wiki Sites:   www.wikispaces.com  ($5 a month for private Wikis) www.socialtext.com www.jot.com www.atlassian.com www.twiki.org www.zwiki.org www.pbwiki.com www.snipsnap.org www.openwiki.com www.mediawiki.org www.wikibooks.org  (same engine used for wikipedia)
Benchmarking Blended Learning
Definition Blended Learning   To combine or mix various instructional delivery modes and methods to meet a common set of learning goals or objectives. Blending the best characteristics of instructor-led training with other, innovative forms of instruction.  A phrase frequently used as “buzz words” to try and persuade buyers to choose e-learning solutions (sometimes synonymous with “ hype ”).
How organizations view “Blended” Constructivism – “learners create their own reality, based on past experience.” Behaviorism – “cause and control of behaviors that can be measured and observed.” Cognitivism – “Mental maps, macro thinking, cognition”
Delivery Methods Blended Learning Classroom Hands-on Lab Video Self Study CD-ROM E-Learning Virtual Classroom/ Virtual Meeting Collaboration: Email Threaded  Discussion, etc. Video Conferencing Satellite  Solutions Webcasts Simulations Embedded Workflow Just-in-time Learning Knowledgebase OJT Coaching/Mentoring
Blended Learning
Ameriprise  (Minneapolis, MN) Business issue: how do you offer consistent training to learners in Atlanta, Boston, Minneapolis, and Seattle?  Previously used regionally located trainers Learning community (by date of hire) meet together for training for 10 weeks; 90 minutes, 3 times each week; 15 virtual sessions each day Embedded “war stories” from experts in the field (pre-recorded Webex mini-scenarios) Before $4.1 Million; After $1.3 Million 95% pass rate; 60,000 completions from in 16 months Case Study Financial Advisors; geographically disperse Learners: War stories, blended learning, regular sessions with learning community Best Practice:
Time Zones
 
Cathay Pacific Airline  (Hong Kong) Case Study Difficult to pull people off the job for location-based training Rapidly changing visa requirements (China) Cathay was fined millions for misunderstanding of visa requirements Needed quick, hard-hitting training in 32 countries Synchronous learning Wide use of pictures of documents for interactive discussion; passing application sharing control for others to point out parts of documents 14,000 staff worldwide; very geographically disperse Learners: Rapid delivery of quickly changing content; innovative use of application sharing for interactivity Best Practice:
Service as a Product Traditional Model Real-Time, Blending Learning
University of Phoenix  (½ virtual, ½ on-campus University) 1300 virtual online sessions per week; 17,000 instructors Typical course 5 to 6 weeks in duration Class size 10-13 people to “make the course manageable for instructor and to facilitate collaboration” Evaluations of course effectiveness indicate that there is “no significant difference” in either the cognitive or affective results   Case Study Higher Education, For-Profit University Main Business: 180,000 students; 106k attend classes at physical locations; 74,000 take courses fully online Learners: Optimization of class size through experience; research-based findings comparing classroom and virtual Best Practice:
Blended Curriculum One Lecture per Week.  Live virtual session or recorded session. Group and Individual Projects Given Weekly.  Small group of 3 to 6; many projects done through work; assignment uploaded Threaded Discussion.  Students are graded on their level of participation Course Resources.  Articles, worksheets, online textbook Knowledge Tests.  Multiple choice, true/false and essay questions Post Course Evaluation.  Level 1
Blended Learning in an LMS
Blended Learning in an LMS
Kirkpatrick – 4 Levels of Evaluation Level 1  –  Reaction   (did they like it?) Level 2  –  Learning   (did they learn something?) Level 3  –  Behavior   (do they now perform better?) Level 4  –  Results   (are we meeting organizational goals?) Donald Kirkpatrick Author
Benchmarking Talent and Performance Management Training HR LINE OF BIZ
Who owns performance Management in your organization? ASTD
Convergence of Learning and Talent Management   LMS Talent Management Compensation  Management Talent  Acquisition Time and Attendance Performance Appraisals Competency Management Career and  Succession Planning Workforce Planning Classroom Management Onboarding e-Learning Performance Management Certification & Assessment Learning Content Management Learning Reporting And Tracking
Convergence of Learning and Talent Management   LMS Talent Management Compensation  Management Talent  Acquisition Time and Attendance Performance Appraisals Competency Management Career and  Succession Planning Workforce Planning Classroom Management Onboarding e-Learning Performance Management Certification & Assessment Learning Content Management Learning Reporting And Tracking Performance Management
Goals of Performance Management   Align employee behaviors with organizational goals and guiding principles Ensure employee motivation and accomplishment of objectives Improve interactions between managers and employees about performance Document employee performance objectively for use in development and rewards
Convergence of Learning and Talent Management   LMS Talent Management Compensation  Management Talent  Acquisition Time and Attendance Performance Appraisals Competency Management Career and  Succession Planning Workforce Planning Classroom Management Onboarding e-Learning Performance Management Certification & Assessment Learning Content Management Learning Reporting And Tracking Solutions originating from HR Automation Sector Taleo BrassRing Vurv Authoria Ceridian Halogen SuccessFactors Cezanne Softscape SAP Oracle
Convergence of Learning and Talent Management   LMS Talent Management Compensation  Management Talent  Acquisition Time and Attendance Performance Appraisals Competency Management Career and  Succession Planning Workforce Planning Classroom Management Onboarding e-Learning Performance Management Certification & Assessment Learning Content Management Learning Reporting And Tracking Solutions originating from the Learning Space Saba Cornerstone  GeoLearning Learn.com KnowledgePlanet Plateau TEDS SumTotal
Cost vs. Functionality of learning platform Skill-Gap Analysis Launch  e-learning Advanced Classroom Management Content Development Tools Reusable Learning Content Happy Sheet Talent Management Analytics Language support 3 rd  party content Deep Backoffice Integration Certification Testing Advanced Question Types Reporting Collaborative Learning E-commerce Informal Learning Repository Regulatory & Compliance Tracking Multiple Portals
Who are the buyers/owners?  (LMS) Training HR IT LINE OF BIZ
Levels of Performance Management Treatment Level 1.   Paper-based, filing system (pharma non-example) Level 2.  Spreadsheet or other standard application, tracking compliance and qualifications Level 3.  Using isolated tools for performance management (i.e. forms for performance appraisals, stand-alone 360 degree assessment. Level 4.  Learning Management System (LMS) with robust tracking, competency management, blended learning Level 5.  Convergence of LMS and Talent Management
Levels of Performance Management Treatment
Typical Evolution of Performance Management   New Company Human Resources Training Deploy system to track employees, benefits, compensation Oversee annual performance reviews Provide learning content in the areas of management, regulatory/compliance, and software application Work with “competencies” Skills, knowledge and attitude training Manage classroom and online learning Provide a catalog of learning content to teach people how to “do their jobs” Creates reports showing “learning gains” Measures through “competencies” Learning Management System   LMS
Does the word “competency” mean the same thing to both groups?  New Company Human Resources Radiology Technician: Operates X-ray equipment Good people/patient skills Practice patient safety Teamwork/Collaboration Radiology Technician: Follows correct procedure to calibrate X-ray equipment Practices seven steps to mixing chemicals without endangering patients When encountering a difficult patient, practices proper engagement strategy Training Learning Management System   LMS
Is “Performance Management” a product or a practice/process?  Consider the practice of  “Knowledge Management” Name the top 3, Knowledge Management solutions. Define the term “knowledge management” Knowledge management in an organization is controlled by which group?
Involvement Time on job HR Training Recruit Onboard Line of Biz Learn Appraise Career Compensate Promote
Cathay Pacific Airline  (Hong Kong) Case Study Previous approach: annual reviews almost always lead to annual pay raises, based on simple, scored form The process was sending the wrong message about what constitutes good performance Goal: Build an environment that encourages the practice of desired “behavior” LMS serves up a combination of learning and performance events, then creates a profile to reward performance. 14,000 staff worldwide; very geographically disperse Learners: Connecting annual performance review with actual, observed behavior as opposed to arbitrary pay increase. Using an LMS Best Practice:
Tips for optimizing performance management using an LMS Open communication between HR and Training; find a way to work together on competencies If you already have some form of competency management in place, link it; rather than replace Blended learning is more about on-the-job training, than it is about mixing classroom and online. Don’t be afraid to have your learners “perform.” It is the key to performance management. Take advantage of the testing capabilities of your LMS to measure knowledge. Pass this information along during performance reviews
Tips for optimizing performance management using an LMS   (cont) Use Analytics to measure Kirkpatrick levels 3 and 4. It will take some thought, but you can do it. Try taking on “onboarding” as a task for you LMS. You can mix forms and learning into a single environment. Great proof-of-concept for what is possible. The most important thing you can do is to create a unified, learning delivery system to bridge the content from HR, training and other content providers into a unified, individualized learning plan.
Unified System Unified Interface Individualized Learning Plans Common messaging Comprehensive Transcript
Questions???   Facilitator: Bryan Chapman Chief Learning Strategist Chapman Alliance [email_address] Hosted by
Learning Governance: Aligning People, Processes and Technology (Bonus Slides)
High-Level Governance IBM Learning Investment Council .   Representatives from each learning organization comprise the IBM Learning Investment Council. The role of this team is to decide which projects are the most critical enterprise learning priorities. An endorsement by this team provides official enterprise sanction and funding. In addition, the group monitors spending by project. Learning Management Council.   Representatives from lines of business form this council that are responsible for (1) setting rules on how we manage all learning at IBM, (2) defining principles of operation, (3) defining standards for learning design, (4) defining vision and strategy for learning systems, and (5) sharing best practices.
Learning Governance Create and organize single-point, dedicated staff for managing and operating the learning infrastructure including (1) a central learning system manager, (2) root training administrator, and (3) dedicated IT support position. This group will serve as a central resource for ALL training projects, company wide. Training  Manager Learning System Manager Central Training Admin LMS IT Support Optional Highly Recommended E-Learning Project Manager Authoring Specialist Instructional Designer Graphic Artist
FTE’s Companies with up to 500 learners - 3 FTE’s and a median of 3 months 501 – 5,000 learners – 4 FTE’s and 4 months More than 5,000 – 4 FTE’s and 6 months Learning Governance  - How many people does it take to install and implement?
Learning System Manager, Primary Responsibilities  Full stewardship responsibility for all things pertaining to  the overall learning infrastructure Manages team of dedicated learning system support staff Head of the Learning Governance Committee, liaison with stakeholders Creates the LMS Charter (with input from the committee) Owner of standards for learning platform Single point of contact with vendor reps for issues with the learning platform (although others from IT,  training and stakeholder groups will be involved in discussions and decisions) Single point of contact for supporting divisional training needs Provides training for LMS admin users and content contributors company wide Manages relationships with 3 rd  party courseware providers and external development resources Communicates with management and users on project status, planned activities and future enhancements Promote and support system adoption, including the use of new functionality Oversee the compilation of system statistics, publishing them for key user groups on a monthly, quarterly and annual basis. Supervise day-to-day administrative operation of the LMS Learning Governance Optional Highly Recommended Learning System Manager
Central Training Administrator, Primary Responsibilities   Responsible for compilation of system statistics, publishing them for key user groups on a monthly, quarterly and annual basis Expert resource on how to use the system for classroom enrollment, registration, self enrollment, etc. Responsible for owning and running the automated notification schedule, making sure the right learners will be in the right place at the right time.  Trains group training administrators and managers interacting with the system For groups that don’t have admin staff, this person can operate as an ad hoc training admin; scheduling classroom/workshop events, tracking attendance and completion, and mining reporting data. Provide help desk support for admin users and managers Provides 2nd tier escalation of help desk issues Generating and validating chargeback/billing reports on system usage Detail tracking of all work done to support system upgrade enhancements and requests. Works with stakeholders to design reporting template specification Understands workflow processes/procedures within the organization and make suggestions and improvements to better align learning with day-to-day workflow Learning Governance Central Training Admin Optional Highly Recommended
LMS IT Support, Primary Responsibilities  Responsible for insuring that the LMS is meeting company needs.  Responsible for making changes to the system, based on Governance Committee approved enhancements. Maintains a record of system bugs, issues, problems and recommended enhancements Develops workaround for limitations in system functionality Creates report templates and mines data for ad hoc reporting Maintains interoperability between the LMS and back office systems Assist in the development  and maintenance of systems documentation (design specifications, technical manuals, user guides, etc.) Provide systems training and support to both internal and partner administrators, facilitators, and coordinators. Handles 3 rd  tier help desk issues. Chases down and validates bugs vs. user error. Quality assurance and platform testing for online learning solutions Manages and maintains specifications for learning applications Uploads learning content to central server and ensures smooth operation of training delivery AICC/SCORM expert; tests interoperability of learning content Manages system uptime Learning Governance Optional Highly Recommended LMS IT Support
E-Learning Project Manager, Primary Responsibilities   Responsible for creating a management strategy for all online learning content Primary, internal development resource to create online learning according to training needs (i.e. developing courses on new hire orientation, product knowledge, how to manage budgets, sales training, etc.) Support the creation and management of a cohesive training curriculum and support materials Supervises team of dedicated resources for creating online learning including instructional designer(s), graphic artist(s), and authoring specialist(s) Works with organizations hired for outsource development of online learning content. Champion learning projects and articulate strategic goals across the company (from the content perspective) Develop an annual plan for curriculum development Establish and maintain a quality end-to-end development process, managing overall production process Teach divisional groups how to create their own learning content according to standards Collect, assess and disseminate information about learner satisfaction Learning Governance Optional Highly Recommended E-Learning Project Manager
Authoring Specialist, Primary Responsibilities   Author, edit  and maintain online courseware using tools such as Flash, Dreamweaver, etc. Become an expert on LMS authoring modules and assess use for specific content Ensure interoperability between online courses and the LMS Assist in testing courseware compatibility with hardware and network specifications Meeting project deadlines for timely delivery of critical online learning course materials Developing software simulations  Works closely with subject matter experts to ensure content integrity and fidelity Learning Governance Optional Highly Recommended Authoring Specialist
Instructional Designer, Primary Responsibilities  Designs and produces quality training materials based on adult learning theories using interactive technologies Works directly with subject matter experts to collect developmental information and for script-storyboard approval Writes performance-based learning objectives Write test items to ensure learning transfer Creates design documents to communicate design plans to others Generates scripts-storyboards (specifications for the authoring specialist)  Conducts learning-project needs analysis  and front-end assessment Validates training results, ensuring that the courses are meeting their objectives for both internally and externally created learning content. Creates and manages training project timelines to ensure ontime delivery of learning projects. Learning Governance Optional Highly Recommended Instructional Designer
Graphic Artist, Primary Responsibilities  Work closely with instructional development team to design and layout instructional media including art, photos, animations and video Maintains library of media assets used for learning and training purposes (both for online and classroom-based learning) Meeting with subject matter experts to collect information about instructional media requirements Creates media for computer-based, web-based, and print-based learning. Learning Governance Optional Highly Recommended Graphic Artist

More Related Content

PPTX
The new learning architect at DevLearn 2011
PPTX
How Online Learning Delivery Tools Are Changing the Business Landscape
PPTX
5 Steps for Data-Driven Learning
PPT
My PADLA (1/20/09) Presentation
PDF
Delivering The Next Generation LMS Experience
PPTX
Learning Ecosystems
PPTX
Planning your analytics journey - webinar slides
PPT
How to implement an lms - webinar slides
The new learning architect at DevLearn 2011
How Online Learning Delivery Tools Are Changing the Business Landscape
5 Steps for Data-Driven Learning
My PADLA (1/20/09) Presentation
Delivering The Next Generation LMS Experience
Learning Ecosystems
Planning your analytics journey - webinar slides
How to implement an lms - webinar slides

What's hot (20)

PDF
Trends in digital learning - 2018
PPT
What You Can Achieve with a Flexible LMS
PDF
MS Teams Teacher Training Day2
PPTX
Enabling learning ecosystems - Webinar slides
PPTX
How AI is transforming learning
PPT
Module1 Intro
PDF
MS Teams Teacher Training Day3
PPT
Successful eLearning Implementation
PPTX
ELearning Outsourcing
PPTX
Lessons from Adopting an Adaptive Learning Platform
PPTX
Integrating user experience and instructional design
PPTX
Reimaging The Classroom
PPTX
Designing Teaching and Learning Activities for Blended Learning
PPT
Storyboarding: how to plan for an e-learning module
PDF
Agile Education
PDF
The Performance Support Storm
PPTX
E learning Implementation strategy
PDF
xAPI 101 - webinar slides
PPTX
Workplace Simulated Courses - Course Technology Computing Conference
PPTX
Open Education 2011: A case study in OER within the LMS
Trends in digital learning - 2018
What You Can Achieve with a Flexible LMS
MS Teams Teacher Training Day2
Enabling learning ecosystems - Webinar slides
How AI is transforming learning
Module1 Intro
MS Teams Teacher Training Day3
Successful eLearning Implementation
ELearning Outsourcing
Lessons from Adopting an Adaptive Learning Platform
Integrating user experience and instructional design
Reimaging The Classroom
Designing Teaching and Learning Activities for Blended Learning
Storyboarding: how to plan for an e-learning module
Agile Education
The Performance Support Storm
E learning Implementation strategy
xAPI 101 - webinar slides
Workplace Simulated Courses - Course Technology Computing Conference
Open Education 2011: A case study in OER within the LMS
Ad

Viewers also liked (11)

PPTX
Leveraging your Learning Management System (LMS) for long term success
PPTX
First bankcard presentation 3.3.15
PDF
Featured Presentation
PPT
February 2012 - Marketing Roundtable - Chris Kochmanski
PPT
Balanced Scorecard
PPTX
PPT
30 , 60, 90 Days Plan To Meet Goals For New Organization
PPT
Balanced Scorecard Presentation
PDF
The New Model for Talent Management: Agenda for 2015
PDF
Ideal Brand Plan
PPT
Characteristics of gifted students
Leveraging your Learning Management System (LMS) for long term success
First bankcard presentation 3.3.15
Featured Presentation
February 2012 - Marketing Roundtable - Chris Kochmanski
Balanced Scorecard
30 , 60, 90 Days Plan To Meet Goals For New Organization
Balanced Scorecard Presentation
The New Model for Talent Management: Agenda for 2015
Ideal Brand Plan
Characteristics of gifted students
Ad

Similar to 01 Handout Version (20)

PPT
Hubert Managing The Content Explosion
PPTX
Merits of good design - Plymouth e-learning conference
PPT
CETS 2010, Trish Uhl & M.E. Majeske, Building a 21st Century Blended Learning...
PPT
Hci techniques from idea to deployment
PPT
Cb Cetis June 2007 Final
PPTX
Unit 6 presentation
PPTX
Technology Integration class #1 2011
PPTX
Learning Development Times - Benchmark
ODP
Redesigning Corporate Training in a Web 2.0 World
PPT
Rapid elearning tools and techniques
PPS
E Capability What And How
PPT
educational simulations interface development
PPT
Ppp Of Simulation Development2
PPTX
eLearning from Classroom Material – All You Need to Know to Get Started
PPTX
Creating Online and Blended Learning
PPT
LMS: Selecting the Right Tool
PDF
Exploring Learning Ecologies: Models and Experiences So Far
PDF
Informal Learning: Broadening the Spectrum of Corporate Learning
PPT
Blended Learning For Faculty
PPT
Shiv
Hubert Managing The Content Explosion
Merits of good design - Plymouth e-learning conference
CETS 2010, Trish Uhl & M.E. Majeske, Building a 21st Century Blended Learning...
Hci techniques from idea to deployment
Cb Cetis June 2007 Final
Unit 6 presentation
Technology Integration class #1 2011
Learning Development Times - Benchmark
Redesigning Corporate Training in a Web 2.0 World
Rapid elearning tools and techniques
E Capability What And How
educational simulations interface development
Ppp Of Simulation Development2
eLearning from Classroom Material – All You Need to Know to Get Started
Creating Online and Blended Learning
LMS: Selecting the Right Tool
Exploring Learning Ecologies: Models and Experiences So Far
Informal Learning: Broadening the Spectrum of Corporate Learning
Blended Learning For Faculty
Shiv

Recently uploaded (20)

PPTX
Probability Distribution, binomial distribution, poisson distribution
PDF
Cours de Système d'information about ERP.pdf
PDF
Daniels 2024 Inclusive, Sustainable Development
PDF
Deliverable file - Regulatory guideline analysis.pdf
PPT
340036916-American-Literature-Literary-Period-Overview.ppt
PPTX
ICG2025_ICG 6th steering committee 30-8-24.pptx
PDF
Tata consultancy services case study shri Sharda college, basrur
PDF
How to Get Funding for Your Trucking Business
PPTX
CkgxkgxydkydyldylydlydyldlyddolydyoyyU2.pptx
PDF
NEW - FEES STRUCTURES (01-july-2024).pdf
PDF
IFRS Notes in your pocket for study all the time
PDF
Nante Industrial Plug Factory: Engineering Quality for Modern Power Applications
PDF
How to Get Business Funding for Small Business Fast
PPTX
2025 Product Deck V1.0.pptxCATALOGTCLCIA
PDF
Outsourced Audit & Assurance in USA Why Globus Finanza is Your Trusted Choice
PDF
SIMNET Inc – 2023’s Most Trusted IT Services & Solution Provider
PDF
NewBase 12 August 2025 Energy News issue - 1812 by Khaled Al Awadi_compresse...
PDF
Digital Marketing & E-commerce Certificate Glossary.pdf.................
PDF
NISM Series V-A MFD Workbook v December 2024.khhhjtgvwevoypdnew one must use ...
PPTX
Business Ethics - An introduction and its overview.pptx
Probability Distribution, binomial distribution, poisson distribution
Cours de Système d'information about ERP.pdf
Daniels 2024 Inclusive, Sustainable Development
Deliverable file - Regulatory guideline analysis.pdf
340036916-American-Literature-Literary-Period-Overview.ppt
ICG2025_ICG 6th steering committee 30-8-24.pptx
Tata consultancy services case study shri Sharda college, basrur
How to Get Funding for Your Trucking Business
CkgxkgxydkydyldylydlydyldlyddolydyoyyU2.pptx
NEW - FEES STRUCTURES (01-july-2024).pdf
IFRS Notes in your pocket for study all the time
Nante Industrial Plug Factory: Engineering Quality for Modern Power Applications
How to Get Business Funding for Small Business Fast
2025 Product Deck V1.0.pptxCATALOGTCLCIA
Outsourced Audit & Assurance in USA Why Globus Finanza is Your Trusted Choice
SIMNET Inc – 2023’s Most Trusted IT Services & Solution Provider
NewBase 12 August 2025 Energy News issue - 1812 by Khaled Al Awadi_compresse...
Digital Marketing & E-commerce Certificate Glossary.pdf.................
NISM Series V-A MFD Workbook v December 2024.khhhjtgvwevoypdnew one must use ...
Business Ethics - An introduction and its overview.pptx

01 Handout Version

  • 1. Learning Benchmarking Forum Facilitator: Bryan Chapman Chief Learning Strategist Chapman Alliance [email_address] 24x7 Learning presents
  • 2. Agenda Benchmarking Learning Infrastructure Alignment with Business and Instructional Needs Benchmarking Learning Content Development (Rapid and Simulation-Based) Benchmarking the use of Web 2.0 learning technologies and informal learning Benchmarking Blended Learning Benchmarking Talent and Performance Management Practices
  • 3. Delivery formats 53% Instructor-Led, Classroom ASTD, State of the Industry Report (2006) 29% Online, Self-Paced 1% Instructor-Led Distance 3% Instructor-Led Online 4% CD-ROM, etc. 4% Print – Self Paced 1% Audio/Video 5% Other
  • 5. Virtual Classroom Synchronous Learning Self-Paced, Self-Service Online Learning Informal Learning , Knowledge On Demand Off-the-shelf , pre-built courses Authoring Tools Learning Content Management Ready-to-use content (courseware) Easy to find: IT skills, leadership, safety Hard to find: very specific, job-related skills Custom development Screen design and layout Interactive exercises Tests, Quiz, Assessment Simulations Manage large-scale development (workflow) Reusable learning content Searchable repository of source material Central Access to Learning Individualized Learning Plans Reporting & Completion Tracking Instructor-Led Training Scheduling Launch and track online learning Certification Management Competency Management Instructor-led, Real time, Online Connecting geographical disperse learners Groups of learners meet together 24 X 7 X 365 access to courses Completed at learner’s own pace Remediation and feedback are automated Developed once, used many times Automated scoring and completion status Just-in-time, anywhere, anytime Capture and retain organizational knowledge Facilitates collaboration Learning Management System LMS
  • 6. International Airline Geographically disperse Mix of live, virtual classroom (personal interaction) Self-paced e-learning (conceptual, procedural)
  • 7. Construction Company Big issue: regulatory compliance (safety) Off-the-shelf courses & LMS
  • 8. Medical Association Thousands of medical, teaching case studies On CD, on shelf; photos, charts, graphs, narrative Manage and distribute (no patient names) for teaching (25,000 association members)
  • 9. National Restaurant Chain Large population, customer-facing employees Not large groups, needs to be self-paced Simulation, role-play exercises (empowerment)
  • 10. Industrial/Manufacturing 100,000+ employees; lack of information about other parts of the company Learning Wiki – invited 200 authors to write articles Ended up with over 7,000 content contributors
  • 11. Trend Changes in Delivery CLO Magazine, July 2006
  • 12. What is your mix? …now? …future? Creating a Learning Culture: Jumstart Planner, Chapman Alliance
  • 13. Why do we buy an LMS in the first place?
  • 14. Why do we buy an LMS in the first place?
  • 15. Cost vs. Functionality of learning platform Skill-Gap Analysis Launch e-learning Advanced Classroom Management Content Development Tools Reusable Learning Content Happy Sheet Talent Management Analytics Language support 3 rd party content Deep Backoffice Integration Certification Testing Advanced Question Types Reporting Collaborative Learning E-commerce Informal Learning Repository Regulatory & Compliance Tracking Multiple Portals
  • 16. How long…? How long does it take to create 1 hour of Classroom Instruction (ILT)?
  • 17. 20% Student Guide Development 21% PowerPoint Development 13% Front-End Analysis/ Data Collection, Working with SME’s 8% Test and Exam Creation 13% Instructional Design, Objectives, Outlining, Writing Content, etc. 6% Other Development Tasks 11% Lesson Plan Development 8% Creation of handout materials n=132 See next slide for “Other” tasks Development of Instructor-Led Training (ILT) Itemized Development Tasks, with hours overlay Research data collected: November, 2007, by Chapman Alliance 36 Total Hours 4.8 hours 4.6 hours 3.8 hours 3.0 hours 7.2 hours 7.6 hours 2.8 hours 2.3 hours
  • 18. How long…? How long does it take to create 1 hour of E-Learning ?
  • 19. How long…? How long does it take to create 1 hour of PowerPoint-based, online learning ? Low Range = 12:1 High Range = 60:1
  • 20. How long…? How long does it take to create 1 hour of Simulation-Based e-learning ? 1300 hours
  • 21. Development Costs Reoccurring costs, over time Instructor-Led Online, Self-Paced Break even point (10 Months) 221:1 (hours of development per finished hour of instruction) 34:1 (hours of development per finished hour of instruction) Example Only
  • 22. Development Costs Reoccurring costs, over time Instructor-Led Online, Self-Paced Break even point (10 Months) 221:1 (hours of development per finished hour of instruction) 34:1 (hours of development per finished hour of instruction) Return on Investment Example Only
  • 23. Development Costs Reoccurring costs, over time Instructor-Led Online, Self-Paced 221:1 (hours of development per finished hour of instruction) 34:1 (hours of development per finished hour of instruction) 75:1 Break even point (10 Months) Example Only (3.5 Months) Return on Investment
  • 24. ROI factors Infrastructure Cost (LMS, LCMS, etc.) Internal Development costs 75:1 (for quick and dirty) 220:1 (for Level 2) 750:1 (highly interactive, simulation) Outsourcing Custom Development Cost of 3 rd party courseware # of learners Required travel (geographic distribution) {less tangible} Opportunity costs
  • 25. Additional ROI Benefits Shorter Overall Training Times Increased Increased Consistency Keeping up with Rapidly Changing Information Open enrollment Building Customer/Brand Loyalty Capturing and Maintaining Corporate Knowledge
  • 26. Rapid Development, without sacrificing Interactivity
  • 27.  
  • 28. PCWeek Shoot Out Several teams invited to compete Convert a 54-hour instructor-led course to online learning 2 days of development 1 person at the computer at any time Storyboard…. actually a lesson plan Present course to 20 judges and 150 members of media gallery Watched the other teams in action Wide variety of approaches
  • 30. Cost per finished hour… Source: Brandon Hall Research, Custom Content Development Knowledgebase Ratio: 750:1 Cost: $30,000 (assumed rate of $40 pay per hour) Average: $41,138 Low: $29,639 High: $70,279 Level 3: High level of gaming and/ or simulation Ratio: 221:1 Cost: $8,840 (assumed rate of $40 pay per hour) Average: $24,672 Low: $17,627 High: $33,711 Level 2: Level 1, plus… 25% interactive exercises, games and mini-simulations Ratio: 30-50:1 Cost: $1,200 - $2,000 (assumed rate of $40 pay per hour) Average: $15,067 Low: $10,009 High: $20,088 Level 1: Page turning Test Questions Internally Developed (per finished hour) Outsource Developed (per finished hour) Levels of Interactivity
  • 31. IBM Learning Model White Papers Product Knowledge PowerPoint Word .PDF Student Guide Role Play Simulations Business Simulations Self Assessment Instructor-Led “ culminating experience” Practice
  • 32. Blended Learning as a development model White Papers Product Knowledge PowerPoint Word .PDF Student Guide Games Exercises Practice Scenario-Based Simulations Classroom uses the same development model Rapid Simulation Development – Best Tool for the Job Rapid Authoring Tools
  • 34. Bloom’s Taxonomy Knowledge Action verbs: list, define, tell, describe, identify, show, label, collect, examine, tabulate, quote, name, who, when, where, etc. Comprehension Action verbs: summarize, describe, interpret, contrast, predict, associate, distinguish, estimate, differentiate, discuss, extend, etc. Application Action verbs: apply, demonstrate, calculate, complete, illustrate, show, solve, examine, modify, relate, change, classify, experiment, discover, etc. Analysis Action verbs: analyze, separate, order, explain, connect, classify, arrange, divide, compare, select, explain, infer, etc. Synthesis Action verbs: combine, integrate, modify, rearrange, substitute, plan, create, design, invent, what if?, compose, formulate, prepare, generalize, rewrite, etc. Evaluation Action verbs: assess, decide, rank, grade, test, measure, recommend, convince, select, judge, explain, discriminate, support, conclude, compare, summarize, etc.
  • 35. Don’t wait too late to apply interactivity Course Designer Analyze Develop Implement Evaluate Design Document Storyboard Design Prototype Authoring and Production
  • 36. Raptivity – Interactivity Sampler www.raptivity.com Course Designer
  • 38. Class Tool – Free Games www.classtools.net Course Designer
  • 39. 247,000 employees Factory Training Supply Chain Model 50 SME’s created 200 learning modules in very short timeframe SME- Developed Published by Center Learning Champions (local units) Support Staff ISD Graphic Artists Strategy? Learners
  • 40. Interactivity to meet instructional goals Course Designer Interactivity Menu… Discovery Exercise Progressive Disclosure Branching Scenario (troubleshooting) Software Application Simulation Labeling Exercise Role-play simulation Discrimination Exercise (classification) Game show (i.e. Jeopardy, Millionaire) Simple Games (Tic-Tac-Toe) Crossword puzzle (reinforce terminology) Sequencing Exercise Interactive Glossary Flash Cards (recall) Branching Questions Matching Video Interaction Animated Diagram
  • 41. Tips and Suggestion – Using Interactivity for Rapid Development Create an interactivity “sampler” to show to internal customers, SME’s, etc. Review before design activities. Don’t create navigation controls at the page level. It’s a waste of time. Page turning isn’t bad if used in moderation. Add a healthy mix of interactivity. When prototyping, create a prototype for each interaction, not just a single lesson or module. Consider using multiple tools to meet the need. One caution: make sure interactivity choices don’t overshadow the instruction. It is possible to use too much of a good thing.
  • 42. Benchmarking the Use of Web 2.0 Learning Technologies and Informal Learning
  • 43. Early Web Social Web Personal Web Pages Online Encyclopedias MP3.com Banner Ads Online Stores Bookstore Content Management Website Stickiness Email Communication Learning Web Early Web
  • 44. Early Web to “Social Web” Blogs Wikipedia itunes Google Adsense Ebay Auctions Book Reviews Wikis Democratic syndication MySpace/Facebook Social Web Personal Web Pages Online Encyclopedias MP3.com Banner Ads Online Stores Bookstore Content Management Website Stickiness Email Communication Learning Web Early Web
  • 45. Traditional Learning Management Model New Hire Orientation Learning Portal - Formal LMS – Learning Portal Sales Process Leadership Computer Applications Safety Product Knowledge Job-specific Skills
  • 46. Knowledge Management Traditional KM Centralized Knowledge Assets Expert Learner Instructor Worker Manager Mentor Expert Learner Sales
  • 47. Using both approaches simultaneously Traditional KM Centralized Knowledge Assets Expert Learner Manager Mentor Expert Sales LMS – Learning Portal Sales Process Leadership Computer Applications Safety Product Knowledge Job-specific Skills Learning Portal - Formal New Hire Orientation
  • 48. Informal Learning “ Informal learning is simply that, which is not directed by an organization or somebody in a control position.” - Jay Cross webinar poll
  • 49. What about tacit knowledge? Explicit Knowledge Tacit Knowledge Identifying is difficult Documenting is even more difficult
  • 50. Formal vs. Informal Learning Collaboration Communities of practice Access to Experts Mentors Knowledgebanks Classroom Events Online courses Virtual Classroom Informal (ad hoc) Formal How?
  • 52. Definition of Wiki Wiki: A website created by a group; rather than by an individual. In Hawaiian, Wiki means “quick” W hat I K now I s… (descriptive of the process of collaborative content development.
  • 53. Ideas for using Wikis in Learning Ad hoc, Knowledge Management Repository Centralized location for documenting and organizing procedural information Group-based learning assignments (work as a team) Soliciting information from Subject Matter Experts; allowing a group of experts to contribute and edit content. Creating content with varying points of view (Groupthink) Learning content delivery for content that changes rapidly (bio-technology). Learn by teaching (Wiki authors)
  • 54. Tips to successfully using Wikis for Learning Work on the initial taxonomy as a group, then turn them loose The more specific the topic focus, the better the content. Designated time period (when used as part of a structured course) Allow the Wiki to develop organically without enforcing too much workflow Allow learners to correct each other; rather than jumping in to correct problems (constructivist approach) Hold informal training sessions to teach Wiki syntax especially to Subject Matter Expert Lead by example – post excellent content
  • 56. Title here…. ...most popular videoblogs on the Web 200,000 viewers
  • 58. RocketBoom compared to TV Program Consumer-brand, video camera; laptop; two lights & a map Almost zero overhead costs Very minimal distribution costs (web-delivered) Global distribution (world wide demand) Large potential audience $0 spent on promotion – 100% word of mouth Engage audience in topical discussions Audience can submit stories (including their own video content)
  • 59. Vlogs (thinking outside the box)
  • 60. Vlogs gone Wild! www.anivegvideo.com
  • 63. University Lectures via podcasts Pilot tests (By Apple) at universities such as Stanford, University of Washington, Missouri, etc. Students who can’t attend class have the option to download courses. Take classes while exercising or traveling.
  • 66. Early Web to “Social Web” Blogs Wikipedia itunes Google Adsense Ebay Auctions Book Reviews Wikis Democratic syndication MySpace/Facebook Social Web Personal Web Pages Online Encyclopedias MP3.com Banner Ads Online Stores Bookstore Content Management Website Stickiness Email Communication Learning Web Early Web
  • 67. Application of Social Web to Learning Blogs Wikipedia itunes Google Adsense Ebay Auctions Book Reviews Wikis Democratic syndication MySpace/Facebook Social Web Focused topic forums Corporate “pedias” Sharing Learning Bits Personalized Learning Plan Peer-to-peer learning market Content, Mentor Reviews Knowledge Management Learning syndication Social Learning Network Personal Web Pages Online Encyclopedias MP3.com Banner Ads Online Stores Bookstore Content Management Website Stickiness Email Communication Learning Web Early Web
  • 68. Questions about Informal Learning After this discussion…. Is informal learning part of my job as a Training/Learning Professional? If not, whose job is it? Should I just set up the technical infrastructure for informal learning, or do I need to be a primary content contributor? How much “control” of informal learning is right for my organization? Should informal learning ever be tracked? If so, what is the best way to track it? What can I do to make sure that informal learning doesn’t become just another “content silo”? How do I set up a loop to make sure that critical issues raised in informal learning exchanges get on the company’s radar screen as possible formal training opportunities?
  • 70. Learning Blog Recommendations: www.internettime.com www.willatworklearning.com www. learningcircuits.blogspot.com www.elearningpost.com
  • 71. Blog Creation Tools: www.blogger.com (#14 in Global, Top 100) www.wikibooks.com www.bblog.com www.blogcms.com www.sixapart.com/movabletype www.nucleuscms.org www.pivotlog.net www.s9y.org www.spip.net www.textpattern.com www.wordpress.org
  • 72. Podcast – Tools and Services www.odeo.com (free podcast posting through a telephone) www.audioblog.com (monthly service fee) http://audacity.sourceforge.net/ (free, open-source sound editing software) www.audioblogger.com (free, puts audio inside your blog on blogger.com) www.industrialaudiosoftware.com www.mixcastlive.com … .just about any audio recording software capable of creating .mp3 files
  • 73. Wiki Sites: www.wikispaces.com ($5 a month for private Wikis) www.socialtext.com www.jot.com www.atlassian.com www.twiki.org www.zwiki.org www.pbwiki.com www.snipsnap.org www.openwiki.com www.mediawiki.org www.wikibooks.org (same engine used for wikipedia)
  • 75. Definition Blended Learning To combine or mix various instructional delivery modes and methods to meet a common set of learning goals or objectives. Blending the best characteristics of instructor-led training with other, innovative forms of instruction. A phrase frequently used as “buzz words” to try and persuade buyers to choose e-learning solutions (sometimes synonymous with “ hype ”).
  • 76. How organizations view “Blended” Constructivism – “learners create their own reality, based on past experience.” Behaviorism – “cause and control of behaviors that can be measured and observed.” Cognitivism – “Mental maps, macro thinking, cognition”
  • 77. Delivery Methods Blended Learning Classroom Hands-on Lab Video Self Study CD-ROM E-Learning Virtual Classroom/ Virtual Meeting Collaboration: Email Threaded Discussion, etc. Video Conferencing Satellite Solutions Webcasts Simulations Embedded Workflow Just-in-time Learning Knowledgebase OJT Coaching/Mentoring
  • 79. Ameriprise (Minneapolis, MN) Business issue: how do you offer consistent training to learners in Atlanta, Boston, Minneapolis, and Seattle? Previously used regionally located trainers Learning community (by date of hire) meet together for training for 10 weeks; 90 minutes, 3 times each week; 15 virtual sessions each day Embedded “war stories” from experts in the field (pre-recorded Webex mini-scenarios) Before $4.1 Million; After $1.3 Million 95% pass rate; 60,000 completions from in 16 months Case Study Financial Advisors; geographically disperse Learners: War stories, blended learning, regular sessions with learning community Best Practice:
  • 81.  
  • 82. Cathay Pacific Airline (Hong Kong) Case Study Difficult to pull people off the job for location-based training Rapidly changing visa requirements (China) Cathay was fined millions for misunderstanding of visa requirements Needed quick, hard-hitting training in 32 countries Synchronous learning Wide use of pictures of documents for interactive discussion; passing application sharing control for others to point out parts of documents 14,000 staff worldwide; very geographically disperse Learners: Rapid delivery of quickly changing content; innovative use of application sharing for interactivity Best Practice:
  • 83. Service as a Product Traditional Model Real-Time, Blending Learning
  • 84. University of Phoenix (½ virtual, ½ on-campus University) 1300 virtual online sessions per week; 17,000 instructors Typical course 5 to 6 weeks in duration Class size 10-13 people to “make the course manageable for instructor and to facilitate collaboration” Evaluations of course effectiveness indicate that there is “no significant difference” in either the cognitive or affective results Case Study Higher Education, For-Profit University Main Business: 180,000 students; 106k attend classes at physical locations; 74,000 take courses fully online Learners: Optimization of class size through experience; research-based findings comparing classroom and virtual Best Practice:
  • 85. Blended Curriculum One Lecture per Week. Live virtual session or recorded session. Group and Individual Projects Given Weekly. Small group of 3 to 6; many projects done through work; assignment uploaded Threaded Discussion. Students are graded on their level of participation Course Resources. Articles, worksheets, online textbook Knowledge Tests. Multiple choice, true/false and essay questions Post Course Evaluation. Level 1
  • 88. Kirkpatrick – 4 Levels of Evaluation Level 1 – Reaction (did they like it?) Level 2 – Learning (did they learn something?) Level 3 – Behavior (do they now perform better?) Level 4 – Results (are we meeting organizational goals?) Donald Kirkpatrick Author
  • 89. Benchmarking Talent and Performance Management Training HR LINE OF BIZ
  • 90. Who owns performance Management in your organization? ASTD
  • 91. Convergence of Learning and Talent Management LMS Talent Management Compensation Management Talent Acquisition Time and Attendance Performance Appraisals Competency Management Career and Succession Planning Workforce Planning Classroom Management Onboarding e-Learning Performance Management Certification & Assessment Learning Content Management Learning Reporting And Tracking
  • 92. Convergence of Learning and Talent Management LMS Talent Management Compensation Management Talent Acquisition Time and Attendance Performance Appraisals Competency Management Career and Succession Planning Workforce Planning Classroom Management Onboarding e-Learning Performance Management Certification & Assessment Learning Content Management Learning Reporting And Tracking Performance Management
  • 93. Goals of Performance Management Align employee behaviors with organizational goals and guiding principles Ensure employee motivation and accomplishment of objectives Improve interactions between managers and employees about performance Document employee performance objectively for use in development and rewards
  • 94. Convergence of Learning and Talent Management LMS Talent Management Compensation Management Talent Acquisition Time and Attendance Performance Appraisals Competency Management Career and Succession Planning Workforce Planning Classroom Management Onboarding e-Learning Performance Management Certification & Assessment Learning Content Management Learning Reporting And Tracking Solutions originating from HR Automation Sector Taleo BrassRing Vurv Authoria Ceridian Halogen SuccessFactors Cezanne Softscape SAP Oracle
  • 95. Convergence of Learning and Talent Management LMS Talent Management Compensation Management Talent Acquisition Time and Attendance Performance Appraisals Competency Management Career and Succession Planning Workforce Planning Classroom Management Onboarding e-Learning Performance Management Certification & Assessment Learning Content Management Learning Reporting And Tracking Solutions originating from the Learning Space Saba Cornerstone GeoLearning Learn.com KnowledgePlanet Plateau TEDS SumTotal
  • 96. Cost vs. Functionality of learning platform Skill-Gap Analysis Launch e-learning Advanced Classroom Management Content Development Tools Reusable Learning Content Happy Sheet Talent Management Analytics Language support 3 rd party content Deep Backoffice Integration Certification Testing Advanced Question Types Reporting Collaborative Learning E-commerce Informal Learning Repository Regulatory & Compliance Tracking Multiple Portals
  • 97. Who are the buyers/owners? (LMS) Training HR IT LINE OF BIZ
  • 98. Levels of Performance Management Treatment Level 1. Paper-based, filing system (pharma non-example) Level 2. Spreadsheet or other standard application, tracking compliance and qualifications Level 3. Using isolated tools for performance management (i.e. forms for performance appraisals, stand-alone 360 degree assessment. Level 4. Learning Management System (LMS) with robust tracking, competency management, blended learning Level 5. Convergence of LMS and Talent Management
  • 99. Levels of Performance Management Treatment
  • 100. Typical Evolution of Performance Management New Company Human Resources Training Deploy system to track employees, benefits, compensation Oversee annual performance reviews Provide learning content in the areas of management, regulatory/compliance, and software application Work with “competencies” Skills, knowledge and attitude training Manage classroom and online learning Provide a catalog of learning content to teach people how to “do their jobs” Creates reports showing “learning gains” Measures through “competencies” Learning Management System LMS
  • 101. Does the word “competency” mean the same thing to both groups? New Company Human Resources Radiology Technician: Operates X-ray equipment Good people/patient skills Practice patient safety Teamwork/Collaboration Radiology Technician: Follows correct procedure to calibrate X-ray equipment Practices seven steps to mixing chemicals without endangering patients When encountering a difficult patient, practices proper engagement strategy Training Learning Management System LMS
  • 102. Is “Performance Management” a product or a practice/process? Consider the practice of “Knowledge Management” Name the top 3, Knowledge Management solutions. Define the term “knowledge management” Knowledge management in an organization is controlled by which group?
  • 103. Involvement Time on job HR Training Recruit Onboard Line of Biz Learn Appraise Career Compensate Promote
  • 104. Cathay Pacific Airline (Hong Kong) Case Study Previous approach: annual reviews almost always lead to annual pay raises, based on simple, scored form The process was sending the wrong message about what constitutes good performance Goal: Build an environment that encourages the practice of desired “behavior” LMS serves up a combination of learning and performance events, then creates a profile to reward performance. 14,000 staff worldwide; very geographically disperse Learners: Connecting annual performance review with actual, observed behavior as opposed to arbitrary pay increase. Using an LMS Best Practice:
  • 105. Tips for optimizing performance management using an LMS Open communication between HR and Training; find a way to work together on competencies If you already have some form of competency management in place, link it; rather than replace Blended learning is more about on-the-job training, than it is about mixing classroom and online. Don’t be afraid to have your learners “perform.” It is the key to performance management. Take advantage of the testing capabilities of your LMS to measure knowledge. Pass this information along during performance reviews
  • 106. Tips for optimizing performance management using an LMS (cont) Use Analytics to measure Kirkpatrick levels 3 and 4. It will take some thought, but you can do it. Try taking on “onboarding” as a task for you LMS. You can mix forms and learning into a single environment. Great proof-of-concept for what is possible. The most important thing you can do is to create a unified, learning delivery system to bridge the content from HR, training and other content providers into a unified, individualized learning plan.
  • 107. Unified System Unified Interface Individualized Learning Plans Common messaging Comprehensive Transcript
  • 108. Questions??? Facilitator: Bryan Chapman Chief Learning Strategist Chapman Alliance [email_address] Hosted by
  • 109. Learning Governance: Aligning People, Processes and Technology (Bonus Slides)
  • 110. High-Level Governance IBM Learning Investment Council . Representatives from each learning organization comprise the IBM Learning Investment Council. The role of this team is to decide which projects are the most critical enterprise learning priorities. An endorsement by this team provides official enterprise sanction and funding. In addition, the group monitors spending by project. Learning Management Council. Representatives from lines of business form this council that are responsible for (1) setting rules on how we manage all learning at IBM, (2) defining principles of operation, (3) defining standards for learning design, (4) defining vision and strategy for learning systems, and (5) sharing best practices.
  • 111. Learning Governance Create and organize single-point, dedicated staff for managing and operating the learning infrastructure including (1) a central learning system manager, (2) root training administrator, and (3) dedicated IT support position. This group will serve as a central resource for ALL training projects, company wide. Training Manager Learning System Manager Central Training Admin LMS IT Support Optional Highly Recommended E-Learning Project Manager Authoring Specialist Instructional Designer Graphic Artist
  • 112. FTE’s Companies with up to 500 learners - 3 FTE’s and a median of 3 months 501 – 5,000 learners – 4 FTE’s and 4 months More than 5,000 – 4 FTE’s and 6 months Learning Governance - How many people does it take to install and implement?
  • 113. Learning System Manager, Primary Responsibilities Full stewardship responsibility for all things pertaining to the overall learning infrastructure Manages team of dedicated learning system support staff Head of the Learning Governance Committee, liaison with stakeholders Creates the LMS Charter (with input from the committee) Owner of standards for learning platform Single point of contact with vendor reps for issues with the learning platform (although others from IT, training and stakeholder groups will be involved in discussions and decisions) Single point of contact for supporting divisional training needs Provides training for LMS admin users and content contributors company wide Manages relationships with 3 rd party courseware providers and external development resources Communicates with management and users on project status, planned activities and future enhancements Promote and support system adoption, including the use of new functionality Oversee the compilation of system statistics, publishing them for key user groups on a monthly, quarterly and annual basis. Supervise day-to-day administrative operation of the LMS Learning Governance Optional Highly Recommended Learning System Manager
  • 114. Central Training Administrator, Primary Responsibilities Responsible for compilation of system statistics, publishing them for key user groups on a monthly, quarterly and annual basis Expert resource on how to use the system for classroom enrollment, registration, self enrollment, etc. Responsible for owning and running the automated notification schedule, making sure the right learners will be in the right place at the right time. Trains group training administrators and managers interacting with the system For groups that don’t have admin staff, this person can operate as an ad hoc training admin; scheduling classroom/workshop events, tracking attendance and completion, and mining reporting data. Provide help desk support for admin users and managers Provides 2nd tier escalation of help desk issues Generating and validating chargeback/billing reports on system usage Detail tracking of all work done to support system upgrade enhancements and requests. Works with stakeholders to design reporting template specification Understands workflow processes/procedures within the organization and make suggestions and improvements to better align learning with day-to-day workflow Learning Governance Central Training Admin Optional Highly Recommended
  • 115. LMS IT Support, Primary Responsibilities Responsible for insuring that the LMS is meeting company needs. Responsible for making changes to the system, based on Governance Committee approved enhancements. Maintains a record of system bugs, issues, problems and recommended enhancements Develops workaround for limitations in system functionality Creates report templates and mines data for ad hoc reporting Maintains interoperability between the LMS and back office systems Assist in the development and maintenance of systems documentation (design specifications, technical manuals, user guides, etc.) Provide systems training and support to both internal and partner administrators, facilitators, and coordinators. Handles 3 rd tier help desk issues. Chases down and validates bugs vs. user error. Quality assurance and platform testing for online learning solutions Manages and maintains specifications for learning applications Uploads learning content to central server and ensures smooth operation of training delivery AICC/SCORM expert; tests interoperability of learning content Manages system uptime Learning Governance Optional Highly Recommended LMS IT Support
  • 116. E-Learning Project Manager, Primary Responsibilities Responsible for creating a management strategy for all online learning content Primary, internal development resource to create online learning according to training needs (i.e. developing courses on new hire orientation, product knowledge, how to manage budgets, sales training, etc.) Support the creation and management of a cohesive training curriculum and support materials Supervises team of dedicated resources for creating online learning including instructional designer(s), graphic artist(s), and authoring specialist(s) Works with organizations hired for outsource development of online learning content. Champion learning projects and articulate strategic goals across the company (from the content perspective) Develop an annual plan for curriculum development Establish and maintain a quality end-to-end development process, managing overall production process Teach divisional groups how to create their own learning content according to standards Collect, assess and disseminate information about learner satisfaction Learning Governance Optional Highly Recommended E-Learning Project Manager
  • 117. Authoring Specialist, Primary Responsibilities Author, edit and maintain online courseware using tools such as Flash, Dreamweaver, etc. Become an expert on LMS authoring modules and assess use for specific content Ensure interoperability between online courses and the LMS Assist in testing courseware compatibility with hardware and network specifications Meeting project deadlines for timely delivery of critical online learning course materials Developing software simulations Works closely with subject matter experts to ensure content integrity and fidelity Learning Governance Optional Highly Recommended Authoring Specialist
  • 118. Instructional Designer, Primary Responsibilities Designs and produces quality training materials based on adult learning theories using interactive technologies Works directly with subject matter experts to collect developmental information and for script-storyboard approval Writes performance-based learning objectives Write test items to ensure learning transfer Creates design documents to communicate design plans to others Generates scripts-storyboards (specifications for the authoring specialist) Conducts learning-project needs analysis and front-end assessment Validates training results, ensuring that the courses are meeting their objectives for both internally and externally created learning content. Creates and manages training project timelines to ensure ontime delivery of learning projects. Learning Governance Optional Highly Recommended Instructional Designer
  • 119. Graphic Artist, Primary Responsibilities Work closely with instructional development team to design and layout instructional media including art, photos, animations and video Maintains library of media assets used for learning and training purposes (both for online and classroom-based learning) Meeting with subject matter experts to collect information about instructional media requirements Creates media for computer-based, web-based, and print-based learning. Learning Governance Optional Highly Recommended Graphic Artist