Assessment in active learning - didactical and technological issues
- 1. Assessment in active learning - didactical and technological issues Daniela Tuparova, Georgi Tuparov, SOUTH-WEST UNIVERSITY “NEOFIT RILSKI” ALICT Project, Kranjska Gora, Slovenia, 31.07.2014
- 2. • Assessment – basic didactical characteristics • 6W about educational assessment in active learning • The “Rainbow” of assessment activities • Place of assessment activities into classroom • Performance based assessment of ICT skills – examples from contests in Bulgaria Agenda
- 3. Assessment – basic characteristics • Activities such as assessment and evaluation of student’s achievements are basic one in any educational process. • Assessment has ‘’driving’’ role and takes an important place during the development of any educational process.
- 4. Assessment – basic characteristics • Learning goals, objectives (LOs) and assessment – describe the level of knowledge, skills, competences and other characteristics that any learner should achieve in the process of learning; `Would you tell me, please, which way I ought to go from here?' `That depends a good deal on where you want to get to,' said the Cat. `I don't much care where--' said Alice. `Then it doesn't matter which way you go,' said the Cat. Lewis Carroll, “Alice in Wonderland”
- 5. LO LO LO LO LO LO LO LO Assessment activities Assessment activities Assessment activities Assessment activities in educational process (EP) Setup of Learning Objectives (LO’s) Start of EP
- 6. 6W about educational assessment in active learning Who assesses? Who will be assessed? When do we assess? What do we assess? What kind of methods do we use? What kind of ICT tools do we use?
- 7. Who assesses? Teacher Students Automated assessment Basic questions – 6W
- 8. Who assesses? Teacher Students Automated assessment Basic questions – 6W Self assessment Peer assessment
- 9. Who assesses? Teacher Students Automated assessment Basic questions – 6W Self assessment Peer assessment Self assessment Evaluation and grading
- 10. Basic questions – 6W Who will be assessed? Individual student Group of students Whole class Whole population of students in the country
- 11. Basic questions – 6W When do we assess? Initial assessment Diagnostics in the beginning of education unit – lesson, chapter, school year
- 12. Basic questions – 6W When do we assess? Initial assessment Formative assessment Diagnostics in the beginning of education unit – lesson, chapter, school year During the educational process, obtaining feedback by the teachers
- 13. Basic questions – 6W When do we assess? Initial assessment Formative assessment Summative assessment Diagnostics in the beginning of education unit – lesson, chapter, school year During the educational process, obtaining feedback by the teachers At the end of school year, final exam, standardized tests, sertification
- 14. Basic questions – 6W When do we assess? Initial assessment Formative assessment Summative assessment Diagnostics in the beginning of education unit – lesson, chapter, school year During the educational process, obtaining feedback by the teachers At the end of school year, final exam, standardized tests, sertification When the cook tastes the soup, that's formative. When the guests taste the soup, that's summative. /Scriven, M. (1991). Evaluation thesaurus. 4th ed. Newbury Park, CA: Sage Publications. ISBN 0-8039-4364-4./
- 15. Basic questions – 6W What do we assess? Knowledge Skills Competences Level’s of students’ achievements of learning objectives
- 16. Basic questions – 6W What kind of methods and tools do we use? Test/Quiz Game based Discussion Problem Solving Individual/Group Project Portfolio Performance based assessment Observation Rubrics, Check lists, Rating Scales
- 17. Basic questions – 6W What kind of methods and tools do we use? Test/Quiz Game based Discussion Problem Solving Individual/Group Project Portfolio Performance based assessment Observation Rubrics, Check lists, Rating Scales Criterion referenced vs. Normative referenced Achievement Tests Objective tests Etc.
- 18. Basic questions – 6W What kind of methods and tools do we use? Test/Quiz Game based Discussion Problem Solving Individual/Group Project Portfolio Performance based assessment Observation Rubrics, Check lists, Rating Scales Criterion referenced vs. Normative referenced Achievement Tests Objective tests Etc. Story based games Memory games Attention games Role played games Puzzles Crosswords Quiz based games Etc.
- 19. Basic questions – 6W What kind of methods and tools do we use? Test/Quiz Game based Discussion Problem Solving Individual/Group Project Portfolio Performance based assessment Observation Rubrics, Check lists, Rating Scales Criterion referenced vs. Normative referenced Achievement Tests Objective tests Etc. Story based games Memory games Attention games Role played games Puzzles Crosswords Quiz based games Etc. “Represents a set of strategies for the acquisition and application of knowledge, skills, and work habits through the performance of tasks that are meaningful and engaging to students. (K. M Hibbard at all, Teacher's Guide to Performance-Based Learning and Assessment, http://www.ascd.org/ Use of Observation, Rubrics, Check lists, Rating Scales Is a part from methods as Performance assessment, Problem solving, Projects, Portfolio
- 20. Basic questions – 6W What kind of ICT tools do we use ? Computer based tests/quizzes Computer based simulations Computer Games Performance assessment (CS and ICT) Assignments in e-learning environments Discussion forums Wiki Blog Digital Story Telling Rubrics, Surveys
- 21. Basic questions – 6W What kind of ICT tools do we use ? Computer based tests/quizzes Computer based simulations Computer Games Performance assessment (CS and ICT) Assignments in e-learning environments Discussion forums Wiki Blog Digital Story Telling Rubrics, Surveys Authoring software for quiz creation – HotPot, iSpring
- 22. Basic questions – 6W What kind of ICT tools do we use ? Computer based tests/quizzes Computer based simulations Computer Games Performance assessment (CS and ICT) Assignments in e-learning environments Discussion forums Wiki Blog Digital Story Telling Rubrics, Surveys Authoring software for quiz creation – HotPot, iSpring Game Engines – eAdventure, Unity3D
- 23. Basic questions – 6W What kind of ICT tools do we use ? Computer based tests/quizzes Computer based simulations Computer Games Performance assessment (CS and ICT) Assignments in e-learning environments Discussion forums Wiki Blog Digital Story Telling Rubrics, Surveys Authoring software for quiz creation – HotPot, iSpring Game Engines – eAdventure, Unity3D Programming Languages
- 24. Basic questions – 6W What kind of ICT tools do we use ? Computer based tests/quizzes Computer based simulations Computer Games Performance assessment (CS and ICT) Assignments in e-learning environments Discussion forums Wiki Blog Digital Story Telling Rubrics, Surveys Authoring software for quiz creation – HotPot, iSpring Google Drive - Forms, Spreadsheets Game Engines – eAdventure, Unity3D Programming Languages
- 25. Basic questions – 6W What kind of ICT tools do we use ? Computer based tests/quizzes Computer based simulations Computer Games Performance assessment (CS and ICT) Assignments in e-learning environments Discussion forums Wiki Blog Digital Story Telling Rubrics, Surveys Authoring software for quiz creation – HotPot, iSpring Authoring tools for multimedia processing - Flash, Captivate, Google Drive - Forms, Spreadsheets Game Engines – eAdventure, Unity3D Programming Languages
- 26. Basic questions – 6W What kind of ICT tools do we use ? Computer based tests/quizzes Computer based simulations Computer Games Performance assessment (CS and ICT) Assignments in e-learning environments Discussion forums Wiki Blog Digital Story Telling Rubrics, Surveys Authoring software for quiz creation – HotPot, iSpring Authoring tools for multimedia processing - Flash, Captivate, Google Drive - Forms, Spreadsheets Game Engines – eAdventure, Unity3D Programming Languages Video processing
- 27. Basic questions – 6W What kind of ICT tools do we use ? Computer based tests/quizzes Computer based simulations Computer Games Performance assessment (CS and ICT) Assignments in e-learning environments Discussion forums Wiki Blog Digital Story Telling Rubrics, Surveys Authoring software for quiz creation – HotPot, iSpring Authoring tools for multimedia processing - Flash, Captivate, Google Drive - Forms, Spreadsheets Online/ offline tools for creation of Memory Games, Crosswords, Puzzles Game Engines – eAdventure, Unity3D Programming Languages Video processing
- 28. Basic questions – 6W What kind of ICT tools do we use ? Computer based tests/quizzes Computer based simulations Computer Games Performance assessment (CS and ICT) Assignments in e-learning environments Discussion forums Wiki Blog Digital Story Telling Rubrics, Surveys Authoring software for quiz creation – HotPot, iSpring Authoring tools for multimedia processing - Flash, Captivate, Google Drive - Forms, Spreadsheets Online/ offline tools for creation of Memory Games, Crosswords, Puzzles MS Office – Word, Excel, PowerPoint Game Engines – eAdventure, Unity3D Programming Languages Video processing
- 29. Basic questions – 6W What kind of ICT tools do we use ? Computer based tests/quizzes Computer based simulations Computer Games Performance assessment (CS and ICT) Assignments in e-learning environments Discussion forums Wiki Blog Digital Story Telling Rubrics, Surveys Authoring software for quiz creation – HotPot, iSpring Authoring tools for multimedia processing - Flash, Captivate, Google Drive - Forms, Spreadsheets Online/ offline tools for creation of Memory Games, Crosswords, Puzzles MS Office – Word, Excel, PowerPoint Game Engines – eAdventure, Unity3D MS Office – Word, Excel, PowerPoint with Visual basic for Application code Programming Languages Video processing
- 30. Basic questions – 6W What kind of ICT tools do we use ? Computer based tests/quizzes Computer based simulations Computer Games Performance assessment (CS and ICT) Assignments in e-learning environments Discussion forums Wiki Blog Digital Story Telling Rubrics, Surveys Authoring software for quiz creation – HotPot, iSpring Authoring tools for multimedia processing - Flash, Captivate, E-Learning environments – Moodle, Claroline, ILIAS, Docebo Google Drive - Forms, Spreadsheets Online/ offline tools for creation of Memory Games, Crosswords, Puzzles MS Office – Word, Excel, PowerPoint Game Engines – eAdventure, Unity3D MS Office – Word, Excel, PowerPoint with Visual basic for Application code Programming Languages Video processing Web 2.0 tools
- 31. Basic questions – 6W What kind of ICT tools do we use ? Computer based tests/quizzes Computer based simulations Computer Games Performance assessment (CS and ICT) Assignments in e-learning environments Discussion forums Wiki Blog Digital Story Telling Rubrics, Surveys Authoring software for quiz creation – HotPot, iSpring Authoring tools for multimedia processing - Flash, Captivate, E-Learning environments – Moodle, Claroline, ILIAS, Docebo Google Drive - Forms, Spreadsheets Online/ offline tools for creation of Memory Games, Crosswords, Puzzles MS Office – Word, Excel, PowerPoint Game Engines – eAdventure, Unity3D MS Office – Word, Excel, PowerPoint with Visual basic for Application code Programming Languages Video processing
- 32. 26.09.2008 32 The “Rainbow” of assessment activities in active learning Assessment activities Collaborative assessment activities Individual assessment activities Services Discussion Forum Live Audio Conference File exchange e-mail/List server Chat Live Video Conference Blog Wiki e-note e-journal whiteboard Workshop/collaborative assignment Testing module/system Simulation Real-live application assessment tools Group ware system e-portfolio module or system Test/Quiz Individual assignment (problem solving, project etc., performance) Individual Portfolio Discussion Collaborative assignment (problem solving, project etc.) Collaborative Portfolio
- 33. Place of ICT based assessment into classroom • In the beginning of the lesson – Used type of tools • Short quiz • Crosswords • Puzzles • Memory Cards • …. – Purpose • Motivation • Feedback • Setup the topic of the lesson
- 34. Place of ICT based assessment into classroom • Formative assessment – Used type of tools • Short quiz • Crosswords • Puzzles • Performance based assessment • Problem solving • Story Telling • ….. – Purpose • Feedback
- 35. Performance based assessment in ICT – an examples • Contests in ICT • Tasks have to be performed onsite – Blagoevgrad, National Contest, http://www.sastezanie.7sou-blagoevgrad.com
- 36. Performance based assessment in ICT • Contests in ICT – National Contest Blagoevgrad - Organisation – Tasks have to be performed onsite; – Students work in categories: • Multimedia Clip; • Multimedia Prezentation; • Group Project for 5-7 grade ; – Selection of Top 10 and presentations of projects in front of Jury and other participants – Evaluation is based on final artefacts and project defense
- 37. Performance based assessment in ICT • Contests in ICT – National Contest Blagoevgrad – Task for Group Project for 5-7 grade ; – Students obtain resource files that consist images, audio files, text documents, spreadsheets data. – The task is to prepare for 3 hours with given resources small project the topic set by the jury. (2013 – Trip on Danube river, 2014 – Trip in Bulgaria).
- 38. Performance based assessment in ICT • Contests in ICT – National Contest Blagoevgrad – Task for Group Project for 5-7 grade ; – The task consists of 6 elements: • To process data in spreadsheet file; • To create presentation with use of processed spreadsheet data, given resource material or developed own artefacts during the contest. • Prepare short document in MS Word with description of project activities and used tools • Prepare short presentation for performance of project in front of jury and other teams • Save all artefacts in proper way on DVD or CD • Perform project
- 39. Performance based assessment in ICT • Contests in ICT • Tasks have to be performed onsite – “I can here and now”, Devin http://contest.az-moga.bg/reglament
- 40. Performance based assessment in ICT • Contests in ICT – Tasks have to be performed onsite • “I can here and now”, Devin http://contest.az-moga.bg/reglament • Tasks – In different categories - presentations, video clip, web site redesign, photography, programing - students have to perform task with given resource materials or create own graphical elements. • Task for presentations is to create two minutes advertisement. Evaluation is based on the technical graphical and communication characteristics of the created artefacts.
- 41. Performance based assessment in ICT • Contests in ICT – Projects developed for a 3-5 months and presented on the contest • National Olympiad – Project+ test with questions mainly at highest levels of Bloom’s Taxonomy - http://edusoft.fmi.uni-sofia.bg/reglament
- 42. Performance based assessment in ICT • Contests in ICT – National contests – Sofia, Blagoevgrad etc. – Regional contests – Blagoevgrad • Primary school http://8sou-blg.com/sastezanie/arhiv.html • Secondary Schools: – http://www.sastezanie.petosoubl.com/ – http://www.sastezanie-sandanski.com/
- 43. Performance based assessment in ICT • Contests in ICT – National contests – Blagoevgrad • Pupils develop and present ICT project in categories similar to National Olympiad • Topics of the projects are under specific topics and motto: – Computers in the classrooms – all categories – The school of the 21 age – all categories – Bulgaria known and unknown – web design – Computer networks – Multilanguage Europe – The Art and my World – The greatest events in the world – ……
- 44. Performance based assessment in ICT – Primary School, Blagoevgrad • Started in 2009, http://8sou-blg.com/sastezanie/arhiv.html – The idea was extended and implemented by national competition “IT znajko”, – Pupils develop pictures, word processing documents integrated with drawings, multimedia presentations – Play in different non-computer games – Working time is 1 hour – Topics • Bulgarian traditions and celebrations • In the world of the tales • Novels for kids • Fables – Tasks integrate knowledge from ICT, Bulgarian Language and literature, Fine Arts
- 45. Regional Contest – Blagoevgrad, Artifacts (1) • 1 grade, MS Paint
- 46. • 1 grade, MS Paint Regional Contest – Blagoevgrad, Artifacts (2)
- 47. • 1 grade, MS Paint Regional Contest – Blagoevgrad, Artifacts (3)
- 48. • 2 grade, MS Paint Regional Contest – Blagoevgrad, Artifacts (4)
- 49. • 2 grade, MS Paint Regional Contest – Blagoevgrad, Artifacts (5)
- 50. • 2 grade, MS Paint Regional Contest – Blagoevgrad, Artifacts (6)
- 51. • 3 grade, MS Word • Task – Student has to open file with name of selected tale, correct grammatical errors in the text, format text and draw the picture relevant to the text. Regional Contest – Blagoevgrad, Artifacts (9)
- 52. • 3 grade, MS Word Regional Contest – Blagoevgrad, Artifacts (10)
- 53. • 3 grade, MS Word Regional Contest – Blagoevgrad, Artifacts (11)
- 54. • 4 grade, MS Power Point • Task – Students have to develop presentation for selected tale. They can use images installed on the computer, comment their opinion about story heroes, make animations and own images, relevant to the story. Regional Contest – Blagoevgrad, Artifacts (12)
- 55. • 4 grade, MS Power Point Regional Contest – Blagoevgrad, Artifacts (13)
- 56. Regional Contest – Blagoevgrad 2010 - • Criteria for assessment: – Composition; – Creativity – Difficulties and complexity (number of graphical objects) – Expression of own opinion about lessons learned by the story (4th grades) – Errors corrections (3rd and 4th grades)
- 57. Thank you for attention! • Contacts: – ddureva(at)swu.bg – georgett(at)swu.bg