Designing Rebo, the reflection guidance chatbot: In the context of digitalising apprenticeship training – Presentation DC ECTEL 2020
- 1. © Know-Center GmbH, www.know-center.at Designing Rebo, the Reflection Guidance Chatbot IN THE CONTEXT OF DIGITALISING APPRENTICESHIP TRAINING Mag. Irmtraud Wolfbauer ECTEL 2020, online
- 2. © Know-Center GmbH • Research Center for Data-Driven Business and Big Data Analytics • 2020 Reflection works on different levels 0. Revisiting: Returning to learning experience 1. Description: Describing learning experience 2. Judgement: Did it go well? Why/Why not? 3. Emotions: What did it feel like? Did you enjoy it? 4. Learning: Evaluate experience - What did you learn? 5. Contextualisation: What was the situation like? 6. Planning: Behaviour change – And next time? Inspired by e.g. Boud, D. et. al.: Reflection. Turning experience into learning, London, New York (1985) Renner, B. et. al.: Effects of Prompting in Reflective Learning Tools: Findings from Experimental Field, Lab, and Online Studies. Frontiers in psychology (2016). 2
- 3. © Know-Center GmbH • Research Center for Data-Driven Business and Big Data Analytics • 2020 Research Questions RQ1: How do apprentices use computers and how self-efficacious are they with regard to ICT? RQ2: What characterises apprentices as a community of practice with special re-gard to their learner identities? Understanding the target group 3
- 4. © Know-Center GmbH • Research Center for Data-Driven Business and Big Data Analytics • 2020 Research Questions RQ3: How apt is Rebo’s dialogue structure to successfully lead apprentices in reflection? - Focusing on: acceptance of the conversational agent, reflectiveness of interactions, engagement of apprentices over time. RQ4: Which adaption mechanisms does a conversational agent for reflection on practical learning tasks need? Designing the learning intervention with guided reflection & continuous evaluation 4
- 5. © Know-Center GmbH • Research Center for Data-Driven Business and Big Data Analytics • 2020 Research Questions RQ5: What characterises discourse between humans and chatbots? Interesting emerging discursive features of resulting reflective dialogues 5
- 6. © Know-Center GmbH • Research Center for Data-Driven Business and Big Data Analytics • 2020 RQ1 Apprentices & Computers: An investigation of usage and self-efficacy in a sample of Austrian apprentices in metal and electrical engineering Mixed-method approach: • Quantitative method: questionnaire, 72 apprentices • Qualitative method: in-depth interviews, 6 apprentices Questionnaire based on: • Computer Usage: Glušac, D. et. al.: Adolescents' informal computer usage and their expectations of ICT in teaching – Case study: Serbia. Computers & Education (2015). • Computer Self-Efficacy: Wang, Y., Haggerty, N.: Individual Virtual Competence and Its Influence on Work Out-comes. Journal of Management Information Systems (2011). Paper in preparation 6
- 7. © Know-Center GmbH • Research Center for Data-Driven Business and Big Data Analytics • 2020 RQ2 Apprentices as Community of Practise: An Investigation of Learner Identities Method: • Semi structured in-depth interviews • 8 apprentices, 3 apprenticeship supervisors, 3 trainers Literature: • Lave, J., & Wenger, E. (1991). Situated Learning - Legitimate peripheral participation. • Boud, D., & Solomon, N. (2003). “I don’t think I am a learner”: acts of naming learners at work. Journal of Workplace Learning. Data available, analysis upcoming 7
- 8. © Know-Center GmbH • Research Center for Data-Driven Business and Big Data Analytics • 2020 RQ3 Rebo Junior: Analysis of Dialogue Structure Quality for a Reflection Guidance Chatbot You are cordially invited to my paper presentation here at ECTEL! Parallel session 22: Impact III Thursday, September 17, 1:30 pm Track: Track 4 (Z4) Track Location: Zoom room 4 published 8
- 9. © Know-Center GmbH • Research Center for Data-Driven Business and Big Data Analytics • 2020 9 2. Judgement 3. Emotions 4. Learning 5. Planning 0. Revisiting 1. Description Upload of task Field study 1 Reflective dialogue with Rebo Junior
- 10. © Know-Center GmbH • Research Center for Data-Driven Business and Big Data Analytics • 2020 RQ4 & RQ5 • Designing Rebo, the Reflection Guidance Chatbot Method: Experimental field studies • Chatting with Bots– a New Discourse Method: (Critical) Discourse Analysis Analysis ongoing 10
- 11. © Know-Center GmbH • Research Center for Data-Driven Business and Big Data Analytics • 2020 Thank you! Well, what do you think? |
- 12. © Know-Center GmbH Know-Center GmbH Research Center for Data-Driven Business and Big Data Analytics Inffeldgasse 13/6 8010 Graz, Austria Firmenbuchgericht Graz FN 199 685 f UID: ATU 50367703 gefördert durch das Programm COMET (Competence Centers for Excellent Technologies), wir danken unseren Fördergebern: Researcher iwolfbauer@know-center.at Irmtraud Wolfbauer