Jisc Programme Developments
Download as PPT, PDF1 like265 views
The document outlines various projects and activities undertaken by the JISC in 2008 related to e-assessment, focusing on the development of assessment tools and techniques. It discusses funding opportunities for projects aimed at enhancing e-assessment, the integration of existing components into educational systems, and the need for a broader vision and participant pool in e-assessment services. Additionally, the document highlights studies on advanced e-assessment techniques and the quality of current e-assessments, addressing potential risks and areas for improvement.
![JISC Programme Developments QUESTIONS Myles Danson JISC Programme Manager [email_address] 07796 336319](https://image.slidesharecdn.com/jisc-programme-developments-1212413422014128-9/85/Jisc-Programme-Developments-11-320.jpg)
Jisc Programme Developments
- 1. E-Assessment SIG 22 May 2008 Glasgow 03/06/09 | Supporting education and research | Slide Joint Information Systems Committee Supporting education and research JISC Programme Developments John Winkley
- 2. New Projects & Activities for 2008 Formative Assessment Study about to commence A new demonstrator call in early June 08 Two new studies tendering in early June 08 Ongoing programme work: Evaluation of progress, baselines Roadmap and development planning
- 3. Demonstrator Project Assessment Tools “ composite applications using existing components from existing JISC Toolkits and elsewhere” At least 2 toolkits/components leverage existing assessment content resources Broaden the uptake and usage of QTI2 and support the developer community.
- 4. Demonstrator Project Assessment Tools (2) Let via a JISC Circular: “HE institutions funded via HEFCE and HEFCW, and by FE institutions in England that teach HE to more than 400 FTEs” Up to 4 projects, each up to a maximum of £45k. Each with an available £15k additional funding for the toolkit provider(s) to support the project. Work to be completed by end March 2009 “ risk-managed setting”
- 5. Demonstrator Project Assessment Tools (3) Possible Applications include : Workflow applications for item production and banking processes such as quality assurance, editorial, etc. Orchestration of test creation and assembly applications Loading/converting of existing item bank content to a QTI2 item bank Wider assessment applications (eg online surveys) Adapting components/groups of components to alternative requirements for example formative assessment delivery applications Multi-standard player application (eg SCORM2004, QTI1.x, QTI2.x) Integration of/connection of existing components into other information systems, eg learning environments, administration and student record systems Integration with e-portfolio services
- 6. Design Principles for Studies Benefits of e-assessment well documented But take-up not as fast as expected. Why is this? Need to broaden the pool of participants Need to broaden the vision for e-assessment services
- 7. Study Project Advanced e-assessment techniques Scoping study of the state-of-the-art in e-assessment techniques across the world and in all education sectors. Designed to underpin roadmap and framework/information knowledgebase component specification developments. All aspects of e-assessment including on-screen presentation and marking, but excluding e-portfolio. Summative or formative assessment. Assessment in professional and academic domains. UK and international applications. 6 month project Up to £40,000 including VAT and expenses Let via an open tender : any organisation can bid.
- 8. Study Project Advanced e-assessment techniques (2) Look at specific e-assessment technology and more general techniques and technologies. Examples might include: Computer marking of free text responses (sentences, paragraphs, essays) Response with and assessment of complex mathematical responses Computer marking of other complex responses (eg source code, diagrams) Integration of computer-marking with streamlined human marking, expert and judgement support systems Peer and Group Assessment Associated services such as detection of plagiarism and other cheating Data mining, Fuzzy Logic and Pattern Matching Multi User Virtual Environments (MUVEs) and virtual worlds Serious gaming (to some extent would be covered by (e) above) Web 2.0 technologies such as Flickr
- 9. Study Project Quality of e-assessment Mixed methods study to look at qualitative and quantitative measures of fitness for purpose in the e-assessments used in the JISC community today. Applying 6 month project Up to £40,000 including VAT and expenses Let via an open tender : any organisation can bid.
- 10. Study Project Quality of e-assessment (2) Consensus that e-assessment offers considerable potential to improve assessment quality, but e-assessment also presents some risks to quality, notably: multiple choice objective tests may lead to impoverishment. Multiple choice objective tests tend to emphasise memorisation and factual recall. Multiple choice objective tests require particular attention to be paid to the authoring and item performance evaluation process. Thoroughly explored in literature, this study aims to investigate the quality of actual items in use.
- 11. JISC Programme Developments QUESTIONS Myles Danson JISC Programme Manager [email_address] 07796 336319