Placement and Practice Tests from (RELOD + Бабушкина Ирина Викторовна)

Editor's Notes

• #4: As with the previous task, ask participants to work in small groups (or pairs) and write a list of two to five people or institutions that are likely to use some form of placement testing. Then, make a note of what they think they use them for. Bring the group together for a feedback stage. If there is a flipchart or board available, you may want to write up their suggestions. [Click to move on to the next slide to show some possible answers. In all likelihood, trainees’ suggestions will more or less be similar to your list.]
• #7: The OOPT is a computer-adaptive test, which means that it responds to the candidate’s answers in order to determine their level more quickly than a linear test. This screen demonstrates how it homes in on the test taker’s ability. Test items (in other words, questions) are selected on the basis of a candidate’s previous answers, and the final result can be achieved more quickly than through using a pen-and-paper test. As each test is created from a large bank of graded items, no two students will ever take the same test – in fact, no student will receive the same questions even if they re-take the test, but, assuming their levels remained unchanged from the first attempt, they should still reach the same score. This, of course, is only possible with a rigorous item writing, analysis and pretesting procedure in place. More about this later.
• #11: Explain that you’re going to have a brief look at the Oxford Online Placement Test, OUP’s testing service which, among other things, provides a computer-adaptive placement test.  
• #12: Read through the slide. Here is how the Oxford Online Placement Test aims to address all its potential users’ expectations: 1: short: The time taken depends on how fast student is, but OOPT aims to deliver a clear-cut result as quickly as possible. Students have a minimum time of 50 minutes and a maximum time of 90 minutes to complete the test. The teacher decides the length of the test. 2: comprehensive: There are about 45 items divided into Use of English and Listening – testing both knowledge and receptive skill. 3: reliable: The test is computer-adaptive. This means that it adapts to the level of the student, and only presents them with questions that are at an appropriate level of difficulty for them. The test can therefore be shorter than non computer-adaptive tests, yet still be accurate. Also, no two tests are ever exactly the same.  More on how reliability is ensured later in the talk. 4: clear: The tests are automatically marked by the system, and the final score is given instantaneously. 5: flexible: The test can be done anywhere with a computer and internet access, which allows you to assign it remotely to students who are abroad, at the other end of town or just at home. 6: informative: A variety of results are given for more information on level, strength or weaknesses, scores on individual components, speed of response – and includes customisable sections to add any further required information. [slides 13-18 offer a quick walkthrough of the features and content of OOPT – these slides can be skipped with audiences who are familiar with the service from an earlier product presentation or as users]
• #13: The OOPT first tests grammar and vocabulary. The next slide shows an example.
• #15: The format of this question is multiple-choice gap fill, where students select the correct word to complete the dialogue from four options in a scroll-down list.
• #16: The OOPT also tests a candidate’s understanding of the meaning of the words. Many placement tests measure form, but they often fail to establish how language forms are used to convey ideas. To answer this question, the candidate needs to understand the words in context and what the speaker intends to say by using those words. The next slide shows an example of this.
• #18: The third type of question in the Use of English tests both form and meaning in a cloze format. Students will need to enter the correct words and are not able to guess from a multiple choice list.
• #19: While the Use of English section tests form and meaning through the written word, the second section of OOPT tests listening skills. Again, candidates have to identify the meaning in a conversation. To do this, they have to draw on individual, social, cultural or other aspects of the context – to show their awareness of how these factors affect what we communicate. The OOPT is based on the idea that knowledge of a language is more than the sum of what words and grammar structures you know, but also how those elements are integrated in your application. The next slide shows an example of this.
• #23: Once the candidates have completed their placement test, their overall score will be given, both as a numerical score (out of 120 points total) and equated to any of the 6 levels of the Common European Framework of Reference. In the example shown, you are trying to set up an Advanced group of students, which means you are looking for students at or above C1 level. Three of the four students tested scored between 41 and 60 points and are therefore judged to be at B1 level, with one student scoring 81 points, corresponding to a C1 level. Once you have selected any candidates who have reached the required level, you can select them by ticking the box next to their name, then clicking the ‘move’ button to move them into the pre-created Advanced group. The Learning Management System automatically creates the class markbook for all your selected students in all your pre-set learner groups. If you want, you can now create an ‘Intermediate’ group for your other three candidates and move their data into the class register, and you can print or email the results to the students and/or your institution. From this point onwards, you can use the Learning Management System (LMS) to set and check assignments for any of your groups or any individual students remotely, track their progress and give them feedback from the comfort of your terminal – but this would take us beyond the scope of today’s talk. If you want to find out more about what the OLMS can do for you, visit oxfordenglishtesting.com for information, samples and a free trial. [click to reveal OET title slide again, with the internet address for information]
• #24: Each candidate’s results are reported in a variety of ways. They are given both as a point score out of 120, and as a CEFR level. The CEFR level (A1-C2) gives a clear-cut answer to a placement question, but if more differentiation is needed, the point scores also tell us how far along each individual student has progressed. Having the point score reported allows teachers to make a pedagogical decision and overrule the suggestion of the OOPT if there is a good reason to do so. For instance, with students who are near the bottom or top of the range for their level may be better placed in a group at the adjoining level to allow them to work with students whose exact level of ability is closer to theirs. As completing a computer-based test demonstrates only a limited range of language competence, institutions or teachers may also wish to complement the OOPT with their own tests of speaking or writing or translation or business English – whichever is appropriate and relevant for their curriculum. Scores in these separate tests can then influence their placement decisions as well. The beauty of OOPT is that it allows you do record the scores from any extra tests you wish to conduct or indeed any extra information that you feel is relevant (for example, gender, age or first language) together with the scores of the placement test itself. Let’s have a look at the score sheet for the test to see how this works.
• #29: Read through the slide, making the final point that the Oxford Online Placement Test assesses your students and reports their scores giving you information to improve your teaching.
• #31: Here’s a summary of the interactive support in practice mode Online Dictionary – for VOCABULARY Exam tips – for EXAM TECHNIQUES Automatic marking and instant feedback – for USE OF ENGLISH Audio scripts – for LISTENING Sample written answers – for WRITING Useful phrases- for SPEAKING
• #32: “Double-click any word on the screen for a definition.”
• #33: Most answers can be automatically marked. Students then get instant feedback on their answers. This helps them understand why their answer is correct or incorrect. When a student has marked their answer, they can try again and change it. Point to the change button: “The ‘Mark’ button becomes the ‘Change’ button.”
• #34: An example of an Exam tip.
• #35: An example of an Audio script.
• #36: An example of a sample written answer.
• #37: An example of Useful language to describe photographs.
• #38: When a teacher assigns a practice test in Test mode, it is like setting students a mock exam. It has none of the support features of Practice mode and it is timed. Click for each point Teachers can also choose whether or not students see their result when they have finished the test. And to help students actually learn from their mistakes, you can first assign a test in Test mode, and reassign it in Practice mode. Remember it’s important for students to be able to take mock, timed tests to prepare for examinations so they can improve their time management skills. Remind the audience that students can fail a test if they don’t allocate enough time to complete the whole test. This is good practice.
• #39: Click once after screenshot appears You can also choose whether you’d like assign a whole test, a paper or a just part
• #40: Homework - OET lets you assign tests in parts. The teaching aspect of practice tests. Test Mode - assign timed sections to students to help them prepare for the exam. Review answers in class projecting screen with a laptop and data projector or use the IWB. Alternatively reassign it in practice mode and get them to do it for homework.
• #43: This is a good time to encourage your audience to sign up for a free trial on the website. They can go directly to the site, create an account in a few minutes and get 20 licences for up to 5 sample practice tests of their choice so they can see how to use OET to assign practice tests for homework.