Hackathon: Developing a high level certification program
3 likes423 views
This document outlines the agenda and rules for a hackathon event involving 5 teams - RED, GREEN, BLUE, YELLOW, and ORANGE. The teams will develop certification program proposals for energy conservation across Europe over 3 episodes, with the goal of coming up with the most innovative, widely applicable, and quickly implementable idea. In the final session, the teams will present their proposals and the attendees will vote for the winning team, which will be announced on Friday. The document provides context and background on developing certification programs and the labor market for relevant skills.
Hackathon: Developing a high level certification program
- 1. Gaining advantage through assessment Growing Talent In Europe Hackathon Developing a high level certification program Host: Erwin van Schaffelaar
- 2. Gaining advantage through assessment Growing Talent In Europe Topic: Energy conservation 10:30 10/2/2014 2
- 3. Gaining advantage through assessment Growing Talent In Europe Industry Leaders 10:35-10:40 ▪ Clarke Porter, Vice President and General Manager at Pearson ▪ Marten Roorda, CEO at Cito, Institute for Educational Measurement 10/2/2014 3
- 4. Gaining advantage through assessment Growing Talent In Europe The competing Teams 10:40 ▪ Team RED ▪ Team GREEN ▪ Team BLUE ▪ Team YELLOW ▪ Team ORANGE 10/2/2014 4
- 5. Gaining advantage through assessment Growing Talent In Europe Team Leaders (random order) 10:42 ▪ Christine Niero, Vice President at Professional Testing ▪ Nikki Eatchel, Vice President, Assessment & Professional Services at Scantron ▪ Susan Martin, Global Certification Director at SAP ▪ Arnold Brouwer, Director Research & Development GrowTalent BV ▪ Greg Becker, Executive Vice President Strategy and Market Development at PSI 10/2/2014 5
- 6. Gaining advantage through assessment Growing Talent In Europe Game rules 1 10:45 ▪ Workshop divided into 3 episodes ▪ Teams stay together, no cheating ▪ No physical contact ▪ Program = 7 predefined slides ▪ + 1 wild ‘card slide’ ▪ Slide available on USB stick ▪ Draft the slides with your team ▪ Questions: ask your Team Leader 10/2/2014 6
- 7. Gaining advantage through assessment Growing Talent In Europe Game rules 2 10:47 ▪ Choose your presenter ▪ Prepare final pitch ▪ 8 slides in 5 minutes (make your point) --- ▪ Each of you can vote (1st choice) ▪ Vote for one of the other 4 teams ▪ Most votes = Winning Team ▪ Winning Team announced on Friday 10/2/2014 7
- 8. Gaining advantage through assessment Growing Talent In Europe Voting criteria 10:49 Review criteria 1. Applicable across European borders 2. Innovative approach (outside the box) 3. Quickest time to market 10/2/2014 8
- 9. 10:50-11:05 Gaining advantage through assessment Growing Talent In Europe Energy Conservation What?#! Clarke Porter at the EATP Conference, Budapest 25 September 2014
- 10. Growing Talent In Europe Gaining advantage through assessment The Hackathon Challenge 10/2/2014 10
- 11. Gaining advantage through assessment Growing Talent In Europe Labor Market Data … Top 5 Skills Energy Conservation Inspection Energy Management Energy Efficiency Water Conservation Top 5 Titles Maintenance Technician Chief Engineer Energy Engineer Mechanical Engineer Building Engineer 10/2/2014 11
- 12. Gaining advantage through assessment Growing Talent In Europe Market & Adoption What are the outcomes for stakeholders? Adoption Early adopters Cornerstone commitment (prime the pump) Marketing efforts – active engagement, they won’t sign up themselves Modeling (2 years) Development timeline Monthly at the onset, then quarterly, yearly Performance based indicators Start with cornerstone commitment 10/2/2014 12
- 13. Gaining advantage through assessment Growing Talent In Europe Building Recognition and Demand 10/2/2014 13
- 14. Gaining advantage through assessment Growing Talent In Europe 1st Episode 11:05-11:20 10/2/2014 14
- 15. 11:20-11:35 Gaining advantage through assessment Growing Talent In Europe Certification for certain Marten Roorda at the EATP Conference, Budapest 25 September 2014
- 16. Gaining advantage through assessment Growing Talent In Europe What is personnel certification? ▪ To prove that a person is (still) competent for a task or job ▪ In some cases a certificate or credential is required to exercise a profession: licensure ▪ Valid for only a limited number of years, must be renewed periodically ▪ Use an assessment, independent from training courses or course providers 10/2/2014 16
- 17. Growing Talent In Europe Gaining advantage through assessment 10/2/2014 17
- 18. Gaining advantage through assessment Growing Talent In Europe Who are the actors in certification? ▪ Employer/client company ▪ Employee/test taker ▪ Training and development provider ▪ Certifying body ▪ Accreditation institute ▪ The customer of the client company ▪ Trade association ▪ The government 10/2/2014 18
- 19. Growing Talent In Europe Gaining advantage through assessment 10/2/2014 19
- 20. Gaining advantage through assessment Growing Talent In Europe How do I define the purpose? ▪ To reduce security or safety risks ▪ To reduce liability risks ▪ To improve quality and customer satisfaction ▪ To distinguish from malpractice ▪ Self-regulation, avoid government intervention ▪ To improve the image of the company or industry ▪ HR: share knowledge and create employability 10/2/2014 20
- 21. Growing Talent In Europe Gaining advantage through assessment 10/2/2014 21
- 22. Gaining advantage through assessment Growing Talent In Europe How do I secure my program? ▪ Become a (compulsory) part of a license, charter or registry ▪ Have the support of a trade organization or professional association ▪ Use a panel of experts to approve the program ▪ Make certification part of a continuing education program ▪ Consult the target group and perform pilots to improve acceptance 10/2/2014 22
- 23. Growing Talent In Europe Gaining advantage through assessment 10/2/2014 23
- 24. Gaining advantage through assessment Growing Talent In Europe How do I create external validation? ▪ Educate, create awareness, use marketing/PR ▪ Look for accreditation of the certification ▪ Keep certification and training separate ▪ Use an exam board and appeals procedure ▪ Use standards: ISO, ANSI, EN, DIN, APA, etc. ▪ Publish a scientific report (psychometrics) ▪ Use good and fair assessments… 10/2/2014 24
- 25. Growing Talent In Europe Gaining advantage through assessment 10/2/2014 25
- 26. Gaining advantage through assessment Growing Talent In Europe What are the requirements? ▪ Generelizable ▪ Extrapolatable ▪ Accurate, reliable ▪ Valid for the construct ▪ Have the trust of the users ▪ Implementable, practical 10/2/2014 26
- 27. Growing Talent In Europe Gaining advantage through assessment 10/2/2014 27
- 28. Gaining advantage through assessment Growing Talent In Europe What do you measure? The proof is about competences, a mix of: ▪ Knowledge ▪ Skills ▪ Attitudes ▪ Abilities Often a task requires several competences 10/2/2014 28
- 29. Gaining advantage through assessment Growing Talent In Europe How to measure competences? Raising reliability using a mix of methods ▪ Hands-on (e.g. tasks) ▪ Simulation (e.g. games) ▪ Hands-off (e.g. tests) You can also use proof from practice: e.g. cases, testimonials, figures, publications, … 10/2/2014 29
- 30. Growing Talent In Europe Gaining advantage through assessment 10/2/2014 30
- 31. Gaining advantage through assessment Growing Talent In Europe How to make the best mix? Hands-on Simulate Hands-off Accurate - +/- + Generalizable - +/- + Extrapolatable + +/- - The competence can be proven at different levels of maturity, using different mixes 10/2/2014 31
- 32. Growing Talent In Europe Gaining advantage through assessment 10/2/2014 32
- 33. Gaining advantage through assessment Growing Talent In Europe How do I go digital? ▪ Keep it secret: build up value in an itembank ▪ Security (web proctoring, web monitoring) ▪ Think of a fall back scenario ▪ Choose a good test platform (best of breed) ▪ Use adaptive testing whenever useful ▪ To collect proof, use a digital portfolio ▪ Use an instrument for portfolio scoring 10/2/2014 33
- 34. Growing Talent In Europe Gaining advantage through assessment Questions? 10/2/2014 34
- 35. Gaining advantage through assessment Growing Talent In Europe 2nd Episode 11:35-11:50 10/2/2014 35
- 36. Gaining advantage through assessment Growing Talent In Europe 3rd Episode 11:50-12:05 10/2/2014 36
- 37. Gaining advantage through assessment Growing Talent In Europe Teams Presentations 12:05-12:40 ▪ Team RED 5 min ▪ Team GREEN 5 min ▪ Team BLUE 5 min ▪ Team YELLOW 5 min ▪ Team ORANGE 5 min 10/2/2014 37
- 38. Gaining advantage through assessment Growing Talent In Europe Hand in your votes 12:40 Review criteria ▪ Applicable across European borders ▪ Innovative approach (outside the box) ▪ Quickest time to market ----- Vote for the Team that should win. 10/2/2014 38
- 39. Gaining advantage through assessment Growing Talent In Europe And the winner is 12:45 Friday, September 26, 12:00 at Closing Keynote 10/2/2014 39
Editor's Notes
- #11: Certification of Energy Professionals Some ideas: People, not buildings Residential Commercial Transportation
- #12: How do you identify the jobs? Domain experts Associations or governing bodies Focus groups Labour market/demand data – “follow the money” Considerations “Stakes” of the job/role Number of professionals & turnover Regulated or voluntary Industry/sector outlook
- #14: Upfront & Ongoing Engaged professional associations Employers Suppliers Documented accomplishments Certificate Public Registry Badges Connection to social media – LinkedIn