SlideShare a Scribd company logo
What Can e-Assessment Do for  Teaching & Learning? Cliff Beevers e-Assessment Association On behalf of the eAA expert panel
Introduction http://caa.ecs.soton.ac.uk/papers/ Technology to serve Education Build on research More complex question & test structure Fast/accurate feedback Efficient use of data
Definition e-Assessment  occurs when there is an automated marking/response, to student input on-screen in a test, informing on the process of answering a question and providing feedback to learners and their teachers through well-crafted advice and reports.
Outline ARG principles Successful e-assessment Other research Greenwood et al (1998) Int Conf Mathematics/Science Edu and Tech, Vol. 2000, Iss 1, 2000, 179 Sandine et al (2005) “ The National Assessment of Educational Progress in Online Assessment  in Mathematics and Writing” Ashton et al (2005) BJET, 36(5), 771-787
ARG’s Formative Principles Effective planning of T&L Focus on how students learn Centre of classroom practice Promote professional skills Sensitive/constructive
ARG’s Formative Principles Foster motivation Promote learning goals Help improve learning Develop self-assessment Recognise range of achievement
Examples of Formative Success ALTA at Primary/Secondary SCHOLAR at Secondary/Tertiary Medicine at Dundee Maths at Newcastle/Birmingham Physics at Surrey Open University courses Professional eg Accountancy
Heriot-Watt Experience CALM started in 1985 and used      e-assessment in: Diagnostic tests Self-testing Monitoring reports Motivating exercises to test the gifted Grading in part from 1995 More info at  www.calm.hw.ac.uk
ARG’s Summative Principles Valid : measure appropriate achievements Reliable : accurate and consistent Impact : desirable for T&L Practical : resources provide value
Innovation to Mainstream 1985 CALM provides formative assessment 1995 CAA used summatively after educational evaluation 1999 SCHOLAR creates e-learning across broad spectrum of subjects in Higher and Advanced Higher 2001 Research with SQA on medium and partial credit effects 2003 PASS-IT begins
Example of Summative Success Research  to check on  Reliability  &  Validity Impact : encourages use of formative e-resources Practical : 500 undergraduates tested over week randomisation mathematical expressions steps provided immediate re-test.
QTI Benefits : no lock in to supplier  question sharing potential Barriers : reduced range & quality of question types MCQ + variants too restrictive lessons not passed on not appropriate in STEM subjects lack of adaptive modes
Barriers Time to create good questions High initial costs Poor collaboration history NIH Digital divide
PASS-IT Background Collaborative project: HW/LTS/BBC/SFEU/SQA Built on previous work Explored the potential of formative/summative e-testing  in post-16 education 1042 candidates in 21 schools/3 colleges
PASS-IT Summary Pilots delivered in  6 levels in 1 subject Variety of levels in 5 other subjects Support candidates with additional needs Candidate questionnaires & focus group for teachers/IT staff Summary at  www.pass-it.org.uk/project_materials.asp
Role of Steps Can over-complicate for good students  Provides structure in formative tests Helps with partial credit Contributes to comparability with paper tests Ashton et al, (2006) BJET, 37(1), 93-119 (2006)
Alternative Evidence Higher Mathematics 3 NAB units available from 2005/6 Practice for unit assessment Taking actual unit assessment Initially 1300 registered, 25 schools, >8000 tests Re-sits available on demand 7% - 15% coverage since 2007
Conclusions What works in Education? Make that the standard. e-Assessment can: Enhance teaching, improve learning and measure part of it. F ormative:  SCHOLAR (Scotland) from 1999 R esearch:  www.pass-it.org.uk , 2003-5 S ummative:  e-NABs from 2006

More Related Content

PPTX
Iblc10 making an existing assessment more efficient
PPT
Terry Handley - Assessing Pupils Progress in ICT
PPT
APP and Controlled Assessment in History - June 2009
PPTX
e-assessment in Scotland's Colleges - 2013 contexts
PPT
WebCT Grading Forms
PDF
Iain Mansfield
PPT
Making An Impact
Iblc10 making an existing assessment more efficient
Terry Handley - Assessing Pupils Progress in ICT
APP and Controlled Assessment in History - June 2009
e-assessment in Scotland's Colleges - 2013 contexts
WebCT Grading Forms
Iain Mansfield
Making An Impact

What's hot (20)

PDF
Sunil Maher
PDF
ABLE - LAK conference 2016
PPTX
Rob howe - assessment strategies in a digital age
PDF
George Mitchell
PPT
2009 ECNO Conference - Teaching Learning Critical Pathway
PPTX
Evaluation in distance education @ VIVES: some tools and trends - Jean-Claude...
PDF
Tom Lowe & Liz Dunne
DOCX
Quality Evaluation of the Higher Education Programmes
PDF
Sharon Smith
PDF
Documents oerc_160913_va_symp_cohen-final(1)
PPTX
Student services regional introduction to redesign
PPTX
Feedback as Dialogue
PPTX
Assessment in the era of ccss
PDF
Midlands Conference 2015: Strategic responses presentation
PPTX
Ian Scott and Roger Grew - Module Evaluation at Oxford Brookes
PPT
UC Dual Pilot Study
PPTX
ALP presentation
PDF
ABLE - NTU Eunis case study - Nov 2017
PPTX
Rob Howe - The honest journey to full e-submission and feedback using blackboard
PDF
13:1, may the odds be forever in our favour - Valerie Innes, University of th...
Sunil Maher
ABLE - LAK conference 2016
Rob howe - assessment strategies in a digital age
George Mitchell
2009 ECNO Conference - Teaching Learning Critical Pathway
Evaluation in distance education @ VIVES: some tools and trends - Jean-Claude...
Tom Lowe & Liz Dunne
Quality Evaluation of the Higher Education Programmes
Sharon Smith
Documents oerc_160913_va_symp_cohen-final(1)
Student services regional introduction to redesign
Feedback as Dialogue
Assessment in the era of ccss
Midlands Conference 2015: Strategic responses presentation
Ian Scott and Roger Grew - Module Evaluation at Oxford Brookes
UC Dual Pilot Study
ALP presentation
ABLE - NTU Eunis case study - Nov 2017
Rob Howe - The honest journey to full e-submission and feedback using blackboard
13:1, may the odds be forever in our favour - Valerie Innes, University of th...
Ad

Viewers also liked (20)

PDF
Some Ideas about effective teaching and assessment
PPT
Assessment Of Student Learning
PPT
Classroom management-presentation
PDF
K to 12 classroom assessment ppt
PPTX
Assessment concept map
PPTX
EDUCARNIVAL 2016 at IIT DELHI - Presentation by Dr Ravinder S Panwar
PPT
Teacher Assessment: A Formative Path to Teacher Development
PPTX
ESE444/544 - Types of Assessment
PPTX
Assessment
PDF
Hazards Risks Disasters 1
PPT
First Lesson
PPTX
Assessment, types and purpose
PPTX
Test and Assessment Types
PPT
Classroom management-presentation-120712190047-phpapp02
PPTX
Teaching models
PDF
Risk Analysis of Geological Hazards and Disaster Management
PPT
Beyond test : alternatives assesment
PPTX
Learners' roles in the different teaching approaches and methods
DOC
The Teaching Portfolio: Reflective Practice for Improvement and Assessment of...
PPTX
An Introduction to the assessment of learning in the Psychomotor And Affectiv...
Some Ideas about effective teaching and assessment
Assessment Of Student Learning
Classroom management-presentation
K to 12 classroom assessment ppt
Assessment concept map
EDUCARNIVAL 2016 at IIT DELHI - Presentation by Dr Ravinder S Panwar
Teacher Assessment: A Formative Path to Teacher Development
ESE444/544 - Types of Assessment
Assessment
Hazards Risks Disasters 1
First Lesson
Assessment, types and purpose
Test and Assessment Types
Classroom management-presentation-120712190047-phpapp02
Teaching models
Risk Analysis of Geological Hazards and Disaster Management
Beyond test : alternatives assesment
Learners' roles in the different teaching approaches and methods
The Teaching Portfolio: Reflective Practice for Improvement and Assessment of...
An Introduction to the assessment of learning in the Psychomotor And Affectiv...
Ad

Similar to What can e assessment do for teaching & learning (20)

PDF
eAssessment in practice
PPT
E Assessment Presentation Ver2 June 2008
PDF
E-Assessment in Practice, 13-14 June 2012, Shrivenham, UK
PPTX
CAA 2012 Closing Address
PPT
Understanding current practice around the Assessment of Multimedia Artefacts
PPT
The Formative Use Of E Assessment
PPT
Assessment Futures: The Role for e-Assessment?
PPT
The challenges of Assessment and Feedback: findings from an HEA project
PDF
'Stepping into the unknown' - Assessment practices in a digital age
PPT
formative e-assessment: a scoping study
PPT
Slf sqa - using e-assessment to support cf e - 100914
PPT
Using Comparative Judgement to Assess Student e-Portfolios
PPT
Formative E Assessment
DOC
Proposal Shima
PPTX
E assessment
PPTX
Assessment and Feedback programme update (April 2012)
PPT
Online assessment
PPTX
Assessment in Education: Principles, Policy & Practice
PPTX
Bringing e-assessment to a higher maturity on a national scale
PPTX
10 Years of E-assessment & Math
eAssessment in practice
E Assessment Presentation Ver2 June 2008
E-Assessment in Practice, 13-14 June 2012, Shrivenham, UK
CAA 2012 Closing Address
Understanding current practice around the Assessment of Multimedia Artefacts
The Formative Use Of E Assessment
Assessment Futures: The Role for e-Assessment?
The challenges of Assessment and Feedback: findings from an HEA project
'Stepping into the unknown' - Assessment practices in a digital age
formative e-assessment: a scoping study
Slf sqa - using e-assessment to support cf e - 100914
Using Comparative Judgement to Assess Student e-Portfolios
Formative E Assessment
Proposal Shima
E assessment
Assessment and Feedback programme update (April 2012)
Online assessment
Assessment in Education: Principles, Policy & Practice
Bringing e-assessment to a higher maturity on a national scale
10 Years of E-assessment & Math

More from Kenji Lamb (20)

PPTX
Beyond Simple MCQs
PPTX
eLearning Alliance CLD Group - Assessment Tools
PPTX
Reduce Reuse
PDF
Peer Collaboration and Assessment
PPT
The NXT Step - Assessing with Lego Robots
PDF
Tips for Creating and Delivering Effective Mobile Assessments
PDF
A Dummies Guide to Secure Digital eAssessment
PPT
Red Pen Tool Case Study - Oldham Hulme Grammar Schools
PPT
Tools to Enhance Assessment in Moodle
PPT
24-hour Papers: the Open-Book Alternative to Exams for Online Assessment
PPTX
Personalising the Assessment Experience: Closing the Gap Between Learning, As...
PPT
Mahara in Action
PPT
Getting Vocal About Feedback
PPTX
e-Assessment for Recruitment, Training and Testing in Private and Public Sect...
PPTX
Building the e-Assessment Centre
PPTX
Harnessing the Potential of PeerMark to Enhance and Enrich the Student Exper...
PPT
Authentic Assessment in Law: SIMPLE
PDF
Open Source Software and Beyond
PPT
Introducing Matterhorn
PPTX
Looking SWEET with my BigBlueButton
Beyond Simple MCQs
eLearning Alliance CLD Group - Assessment Tools
Reduce Reuse
Peer Collaboration and Assessment
The NXT Step - Assessing with Lego Robots
Tips for Creating and Delivering Effective Mobile Assessments
A Dummies Guide to Secure Digital eAssessment
Red Pen Tool Case Study - Oldham Hulme Grammar Schools
Tools to Enhance Assessment in Moodle
24-hour Papers: the Open-Book Alternative to Exams for Online Assessment
Personalising the Assessment Experience: Closing the Gap Between Learning, As...
Mahara in Action
Getting Vocal About Feedback
e-Assessment for Recruitment, Training and Testing in Private and Public Sect...
Building the e-Assessment Centre
Harnessing the Potential of PeerMark to Enhance and Enrich the Student Exper...
Authentic Assessment in Law: SIMPLE
Open Source Software and Beyond
Introducing Matterhorn
Looking SWEET with my BigBlueButton

What can e assessment do for teaching & learning

  • 1. What Can e-Assessment Do for Teaching & Learning? Cliff Beevers e-Assessment Association On behalf of the eAA expert panel
  • 2. Introduction http://caa.ecs.soton.ac.uk/papers/ Technology to serve Education Build on research More complex question & test structure Fast/accurate feedback Efficient use of data
  • 3. Definition e-Assessment occurs when there is an automated marking/response, to student input on-screen in a test, informing on the process of answering a question and providing feedback to learners and their teachers through well-crafted advice and reports.
  • 4. Outline ARG principles Successful e-assessment Other research Greenwood et al (1998) Int Conf Mathematics/Science Edu and Tech, Vol. 2000, Iss 1, 2000, 179 Sandine et al (2005) “ The National Assessment of Educational Progress in Online Assessment in Mathematics and Writing” Ashton et al (2005) BJET, 36(5), 771-787
  • 5. ARG’s Formative Principles Effective planning of T&L Focus on how students learn Centre of classroom practice Promote professional skills Sensitive/constructive
  • 6. ARG’s Formative Principles Foster motivation Promote learning goals Help improve learning Develop self-assessment Recognise range of achievement
  • 7. Examples of Formative Success ALTA at Primary/Secondary SCHOLAR at Secondary/Tertiary Medicine at Dundee Maths at Newcastle/Birmingham Physics at Surrey Open University courses Professional eg Accountancy
  • 8. Heriot-Watt Experience CALM started in 1985 and used e-assessment in: Diagnostic tests Self-testing Monitoring reports Motivating exercises to test the gifted Grading in part from 1995 More info at www.calm.hw.ac.uk
  • 9. ARG’s Summative Principles Valid : measure appropriate achievements Reliable : accurate and consistent Impact : desirable for T&L Practical : resources provide value
  • 10. Innovation to Mainstream 1985 CALM provides formative assessment 1995 CAA used summatively after educational evaluation 1999 SCHOLAR creates e-learning across broad spectrum of subjects in Higher and Advanced Higher 2001 Research with SQA on medium and partial credit effects 2003 PASS-IT begins
  • 11. Example of Summative Success Research to check on Reliability & Validity Impact : encourages use of formative e-resources Practical : 500 undergraduates tested over week randomisation mathematical expressions steps provided immediate re-test.
  • 12. QTI Benefits : no lock in to supplier question sharing potential Barriers : reduced range & quality of question types MCQ + variants too restrictive lessons not passed on not appropriate in STEM subjects lack of adaptive modes
  • 13. Barriers Time to create good questions High initial costs Poor collaboration history NIH Digital divide
  • 14. PASS-IT Background Collaborative project: HW/LTS/BBC/SFEU/SQA Built on previous work Explored the potential of formative/summative e-testing in post-16 education 1042 candidates in 21 schools/3 colleges
  • 15. PASS-IT Summary Pilots delivered in 6 levels in 1 subject Variety of levels in 5 other subjects Support candidates with additional needs Candidate questionnaires & focus group for teachers/IT staff Summary at www.pass-it.org.uk/project_materials.asp
  • 16. Role of Steps Can over-complicate for good students Provides structure in formative tests Helps with partial credit Contributes to comparability with paper tests Ashton et al, (2006) BJET, 37(1), 93-119 (2006)
  • 17. Alternative Evidence Higher Mathematics 3 NAB units available from 2005/6 Practice for unit assessment Taking actual unit assessment Initially 1300 registered, 25 schools, >8000 tests Re-sits available on demand 7% - 15% coverage since 2007
  • 18. Conclusions What works in Education? Make that the standard. e-Assessment can: Enhance teaching, improve learning and measure part of it. F ormative: SCHOLAR (Scotland) from 1999 R esearch: www.pass-it.org.uk , 2003-5 S ummative: e-NABs from 2006