Applying standards to
testing
KAYSERI, 29-31 JANUARY 2014
2.1 applying standards to testing: plenary CTS-Academic
Aims

! 

Objectives of setting up standards

! 

Overview of international testing standards

! 

The Common European Framework of Reference
Standards = code of practice

! 

an agreed set of guidelines which should be
consulted and, as far as possible, heeded in the
construction and evaluation of a test
(definition from Language Test Construction and
Evaluation by Alderson, Clapham and Wall, 1995
CUP)
Standards: history

! 

late 20th century:
!  various

competing educational and testing standards

!  some

widely respected, but no universal acceptance:
ALTE Code of Practice (1994) or UCLES Standards (for
Cambridge Main Suite exams)

! 

early 21st century:
!  move

towards internationally recognised standards: the
CEFR (2001)
What the CEFR is

! 

The Common European Framework of Reference for
Languages – Learning, Teaching, Assessment

! 

A Council of Europe project, initiated in 2001

! 

Designed to facilitate ‘mutual recognition of
qualifications, and communication concerning
objectives and achievement standards’

! 

Description, not prescription
What the CEFR isn’t

! 

Not a framework only for Europe (or for the EU)

! 

Not a language teaching curriculum, or syllabus plan

! 

Not an exam system

! 

The Portfolio is only part of the CEFR, and so are the
assessment tables
The Common Reference Levels
Reception
Listening

C2

Audiovisual

Interaction
Reading

Proficient user

C1
B2

Independent user

B1
A2
A1

Basic user

Production

Spoken

Spoken

Written

Written
Criticism of the CEFR
! 

Not user-friendly

! 

Practices differ from school to school, from country to
country

! 

Policymakers see CEFR as a quick fix

! 

The implementation is top-down

! 

Applying the assessment tables in practice is
complicated

! 

Favours the communicate approach only

! 

Creativity is limited
Benefits of the CEFR
! 

The CEFR can be the basis of a school (or national)
curriculum, offering transparent standards

! 

The CEFR can be the basis of a course syllabus

! 

The assessment criteria can serve as the basis for
exam specifications

! 

The Portfolio involves the learner in the process of
their learning (! self-assessment)

! 

The use of CEFR level labels makes distinction
between courses clearer
Disadvantages of applying
CEFR in the school classroom
! 

No measure of grammar-based progression

! 

Not geared towards school-based learners (and
towards non-adults)

! 

Self-assessment descriptors are not exhaustive

! 

Some functional areas are not covered
Advantages of applying CEFR
in the school classroom
! 

Focus on situational / functional language (real
world context)

! 

Skills and strategies (‘can do’)

! 

Less focus on mechanical practice

! 

Clear link between student achievement and exams

! 

Self-assessment and autonomy

! 

Encouragement of continuity
Portfolio
Portfolio: CEFR applied to teaching
! 

Continuous assessment throughout the
learning career

! 

Portfolio work is not only for beginners

! 

Any age group

! 

The Portfolio belongs to the learner, not to
the institution or teacher

! 

The Portfolio becomes a record of the
learning process
Thank you!

zoltan.rezmuves@digimedia.hu
consonantvoiced.blogspot.com

More Related Content

PDF
Two years after Yerevan: progress so far
PDF
Bpest april 2014 eaquals_ma
PDF
European Approach for Quality Assurance of Joint Programmes
PPT
Selecting And Training Students For The External Review Panels
PDF
Brussels Training Seminar Implementing Change Michael Dooms
PDF
General principles of Diploma Supplement
PDF
Diploma Supplements – Responsibilities, Processes, Practice at FAU
PPT
CTS-Academic: Module 2 session 10 lesson shapes
Two years after Yerevan: progress so far
Bpest april 2014 eaquals_ma
European Approach for Quality Assurance of Joint Programmes
Selecting And Training Students For The External Review Panels
Brussels Training Seminar Implementing Change Michael Dooms
General principles of Diploma Supplement
Diploma Supplements – Responsibilities, Processes, Practice at FAU
CTS-Academic: Module 2 session 10 lesson shapes

Viewers also liked (7)

PDF
Progetti PON C5
PPT
CTS-Academic: Module 2 session 2 theories of language learning
PPTX
Tutorial como insertar una imagen
PDF
Corsi di inglese per giovani ingegneri - English for Young Engineers
PDF
Corsi di business english 2016
PDF
Corso di Business English a Londra per giovani. Possibilità di stage successivo
PDF
3.3 tests of productive skills: workshop CTS-Academic
Progetti PON C5
CTS-Academic: Module 2 session 2 theories of language learning
Tutorial como insertar una imagen
Corsi di inglese per giovani ingegneri - English for Young Engineers
Corsi di business english 2016
Corso di Business English a Londra per giovani. Possibilità di stage successivo
3.3 tests of productive skills: workshop CTS-Academic
Ad

Similar to 2.1 applying standards to testing: plenary CTS-Academic (20)

PPTX
Summary:The Common European Framework of Reference for Language
PDF
3.1 curriculum and assessment: plenary CTS-Academic
PDF
1.1 language assessment in Turkey: plenary CTS-Academic
PDF
A quality approach to CEFR implementation
PPTX
Roadmap_MoE_290616.pptx
PDF
Khoa hoc TESOL tai truong Anh ngu EV - Cebu
PPT
CEFR-based tools and resources: latest developments (Mila Angelova)
PPT
Thom Kiddle: Responding to the challenge of testing and assessing speaking
PDF
CEFR and LSs - links english education for all
PPTX
Quality Assurance in Efl for TVET in Colleges of Excellence in Saudi Arabia: ...
PDF
Assessment Module 3
PPT
ppt CEFR.ppt
PPT
!ppt CEFR.ppt
PPT
31GEP3_GA3_Common European Framework
PPT
Thecommoneuropeanframeworkofreferenceforlanguages 110920205758-phpapp01
PDF
PPTX
Classroom Practices for English Learners (ELs) Instruction
PDF
Sarah Aitken - Presenting Eaquals: Preparing for a successful Eaquals inspection
PPTX
Evaluation in Capacity-Building Strategy: The Next Step in the LMD Philosophy
PDF
Assessnent literacy apr 14 (fiona barker)
Summary:The Common European Framework of Reference for Language
3.1 curriculum and assessment: plenary CTS-Academic
1.1 language assessment in Turkey: plenary CTS-Academic
A quality approach to CEFR implementation
Roadmap_MoE_290616.pptx
Khoa hoc TESOL tai truong Anh ngu EV - Cebu
CEFR-based tools and resources: latest developments (Mila Angelova)
Thom Kiddle: Responding to the challenge of testing and assessing speaking
CEFR and LSs - links english education for all
Quality Assurance in Efl for TVET in Colleges of Excellence in Saudi Arabia: ...
Assessment Module 3
ppt CEFR.ppt
!ppt CEFR.ppt
31GEP3_GA3_Common European Framework
Thecommoneuropeanframeworkofreferenceforlanguages 110920205758-phpapp01
Classroom Practices for English Learners (ELs) Instruction
Sarah Aitken - Presenting Eaquals: Preparing for a successful Eaquals inspection
Evaluation in Capacity-Building Strategy: The Next Step in the LMD Philosophy
Assessnent literacy apr 14 (fiona barker)
Ad

More from SeltAcademy (15)

PPT
CTS-Academic: Module 2 session 9 cognitive processes
PPT
CTS-Academic: Module 2 session 8 psycholinguistics
PPT
CTS-Academic: Module 2 session 6 classroom sla
PPT
CTS-Academic: Module 2 session 5 sla research
PPT
CTS-Academic: Module 2 session 3 theories of language learning
PPT
CTS-Academic: Module 2 session 1 theories of language
PDF
1.3 tests of grammar and vocabulary: workshop CTS-Academic
PDF
2.3 tests of receptive skills: workshop CTS-Academic
PDF
3.2 test development cycle: plenary CTS-Academic
PDF
2.2.test design test writing: plenary CTS-Academic
PDF
1.2 principles of test design: plenary CTS-Academic
PPTX
Part 3 great opportunities great expectations
PPTX
Part 2 great opportunities great expectations
PPTX
Part 1 great opportunities great expectations
PPTX
Types of stories for children
CTS-Academic: Module 2 session 9 cognitive processes
CTS-Academic: Module 2 session 8 psycholinguistics
CTS-Academic: Module 2 session 6 classroom sla
CTS-Academic: Module 2 session 5 sla research
CTS-Academic: Module 2 session 3 theories of language learning
CTS-Academic: Module 2 session 1 theories of language
1.3 tests of grammar and vocabulary: workshop CTS-Academic
2.3 tests of receptive skills: workshop CTS-Academic
3.2 test development cycle: plenary CTS-Academic
2.2.test design test writing: plenary CTS-Academic
1.2 principles of test design: plenary CTS-Academic
Part 3 great opportunities great expectations
Part 2 great opportunities great expectations
Part 1 great opportunities great expectations
Types of stories for children

Recently uploaded (20)

PDF
Uderstanding digital marketing and marketing stratergie for engaging the digi...
PDF
Τίμαιος είναι φιλοσοφικός διάλογος του Πλάτωνα
PDF
Chinmaya Tiranga quiz Grand Finale.pdf
PPTX
Introduction to pro and eukaryotes and differences.pptx
PDF
Paper A Mock Exam 9_ Attempt review.pdf.
PPTX
202450812 BayCHI UCSC-SV 20250812 v17.pptx
PDF
LDMMIA Reiki Yoga Finals Review Spring Summer
PDF
International_Financial_Reporting_Standa.pdf
PPTX
Unit 4 Computer Architecture Multicore Processor.pptx
PPTX
Virtual and Augmented Reality in Current Scenario
PDF
Practical Manual AGRO-233 Principles and Practices of Natural Farming
DOCX
Cambridge-Practice-Tests-for-IELTS-12.docx
PDF
OBE - B.A.(HON'S) IN INTERIOR ARCHITECTURE -Ar.MOHIUDDIN.pdf
PDF
ChatGPT for Dummies - Pam Baker Ccesa007.pdf
DOC
Soft-furnishing-By-Architect-A.F.M.Mohiuddin-Akhand.doc
PPTX
ELIAS-SEZIURE AND EPilepsy semmioan session.pptx
PDF
Environmental Education MCQ BD2EE - Share Source.pdf
PPTX
TNA_Presentation-1-Final(SAVE)) (1).pptx
PDF
Trump Administration's workforce development strategy
PPTX
Chinmaya Tiranga Azadi Quiz (Class 7-8 )
Uderstanding digital marketing and marketing stratergie for engaging the digi...
Τίμαιος είναι φιλοσοφικός διάλογος του Πλάτωνα
Chinmaya Tiranga quiz Grand Finale.pdf
Introduction to pro and eukaryotes and differences.pptx
Paper A Mock Exam 9_ Attempt review.pdf.
202450812 BayCHI UCSC-SV 20250812 v17.pptx
LDMMIA Reiki Yoga Finals Review Spring Summer
International_Financial_Reporting_Standa.pdf
Unit 4 Computer Architecture Multicore Processor.pptx
Virtual and Augmented Reality in Current Scenario
Practical Manual AGRO-233 Principles and Practices of Natural Farming
Cambridge-Practice-Tests-for-IELTS-12.docx
OBE - B.A.(HON'S) IN INTERIOR ARCHITECTURE -Ar.MOHIUDDIN.pdf
ChatGPT for Dummies - Pam Baker Ccesa007.pdf
Soft-furnishing-By-Architect-A.F.M.Mohiuddin-Akhand.doc
ELIAS-SEZIURE AND EPilepsy semmioan session.pptx
Environmental Education MCQ BD2EE - Share Source.pdf
TNA_Presentation-1-Final(SAVE)) (1).pptx
Trump Administration's workforce development strategy
Chinmaya Tiranga Azadi Quiz (Class 7-8 )

2.1 applying standards to testing: plenary CTS-Academic

  • 3. Aims !  Objectives of setting up standards !  Overview of international testing standards !  The Common European Framework of Reference
  • 4. Standards = code of practice !  an agreed set of guidelines which should be consulted and, as far as possible, heeded in the construction and evaluation of a test (definition from Language Test Construction and Evaluation by Alderson, Clapham and Wall, 1995 CUP)
  • 5. Standards: history !  late 20th century: !  various competing educational and testing standards !  some widely respected, but no universal acceptance: ALTE Code of Practice (1994) or UCLES Standards (for Cambridge Main Suite exams) !  early 21st century: !  move towards internationally recognised standards: the CEFR (2001)
  • 6. What the CEFR is !  The Common European Framework of Reference for Languages – Learning, Teaching, Assessment !  A Council of Europe project, initiated in 2001 !  Designed to facilitate ‘mutual recognition of qualifications, and communication concerning objectives and achievement standards’ !  Description, not prescription
  • 7. What the CEFR isn’t !  Not a framework only for Europe (or for the EU) !  Not a language teaching curriculum, or syllabus plan !  Not an exam system !  The Portfolio is only part of the CEFR, and so are the assessment tables
  • 8. The Common Reference Levels Reception Listening C2 Audiovisual Interaction Reading Proficient user C1 B2 Independent user B1 A2 A1 Basic user Production Spoken Spoken Written Written
  • 9. Criticism of the CEFR !  Not user-friendly !  Practices differ from school to school, from country to country !  Policymakers see CEFR as a quick fix !  The implementation is top-down !  Applying the assessment tables in practice is complicated !  Favours the communicate approach only !  Creativity is limited
  • 10. Benefits of the CEFR !  The CEFR can be the basis of a school (or national) curriculum, offering transparent standards !  The CEFR can be the basis of a course syllabus !  The assessment criteria can serve as the basis for exam specifications !  The Portfolio involves the learner in the process of their learning (! self-assessment) !  The use of CEFR level labels makes distinction between courses clearer
  • 11. Disadvantages of applying CEFR in the school classroom !  No measure of grammar-based progression !  Not geared towards school-based learners (and towards non-adults) !  Self-assessment descriptors are not exhaustive !  Some functional areas are not covered
  • 12. Advantages of applying CEFR in the school classroom !  Focus on situational / functional language (real world context) !  Skills and strategies (‘can do’) !  Less focus on mechanical practice !  Clear link between student achievement and exams !  Self-assessment and autonomy !  Encouragement of continuity
  • 14. Portfolio: CEFR applied to teaching !  Continuous assessment throughout the learning career !  Portfolio work is not only for beginners !  Any age group !  The Portfolio belongs to the learner, not to the institution or teacher !  The Portfolio becomes a record of the learning process