Testing   (Exit)


The future of computer-based and online testing
by Fiona Joseph

The recently-published UK Government consultation paper "Towards a Unified E-Learning Strategy" restates the case for increasing the provision of online assessment. The key benefits that the paper outlines are already familiar to CALL enthusiasts, namely instant feedback for the learner, greater flexibility in the delivery times for tests, and a reduced administrative burden for teachers who, in theory at least, can spend more time planning appropriate and informed programmes for their students and less time marking. However, while computer-based (CB) delivery works well for informal assessment even the government has to concede that it would be "undesirable and impractical" to put all public examinations online.

So what progress has been made so far by assessment providers within ESOL? This article will look at the development of online and computer-based tests by two of the largest examination boards, and conclude by seeing what self-tests are available on the web.

Formative assessment
So far Cambridge ESOL has used computer-based technology to develop relatively low-stakes - but nevertheless useful - assessments. Tests such as the Quick Placement Test (QPT), which was produced in conjunction with Oxford University Press, and the Business Language Testing Service (BULATS) Computer Test are each based on a multiple-choice format, which generate immediate scores. The test results are linked to the Council of Europe and ALTE frameworks, as well as the Cambridge Main Suite examinations from KET through to Proficiency. The QPT and BULATS are intended to help teachers and language trainers to place their students in appropriate classes, as well as to recommend the right level of exam to take. The main advantage over their traditional pen and paper versions is that these tests are adaptive, i.e. the test adapts to the ability of the candidate so that he or she only answers questions within their language range. Both tests have demonstration versions which can be done online.
QPT: http://www.oup.com/shockwave_flash/elt/qpt/qptdemo/
BULATS: http://www.bulats.org/minibulats.cfm


High stakes
But what about when the stakes are higher? When it comes to exams used for university entrance, the main developments in CB testing have been made by TOEFL, the standard language exam for admission to American Universities. The Computer-Based TOEFL (www.toefl.com) offers candidates the chance to do the listening and language structure components on computer, as well as to submit essays. The question of whether all major language exams will move in this direction is hard to assess, especially as the global demand for the computer version of TOEFL was initially overestimated. (Last year ETS, the organisation responsible for the delivery of the online TOEFL, announced plans to "reorganize and refocus" its computer-based delivery, which meant the closure of around 80 dedicated test centres that had experienced low numbers.)

Trials are presently taking place to explore the feasibility of delivering a computer-based version of IELTS, the other key test of academic English, which would incorporate all papers apart from Speaking. Cambridge ESOL, one of the key IELTS partners, is currently supporting research into the important issue of whether examiners respond differently to written scripts according to whether they are handwritten or word-processed.

Self-tests on the web
A third category of tests are self-tests, those designed to be used by learners (including the self-study learner) looking for instant feedback and an evaluation of their strengths and weaknesses. The Flo-Joe website (www.flo-joe.co.uk ) provides a range of free and subscription-based resources for the Reading and Use of English papers for FCE, CAE and CPE, as well as access to real student essays with corrections and feedback. The makers of the TOEFL exam have produced an online marking system called ScoreItNow (www.scoreitnow.org), which uses automated scoring technology to assess writing. The E-rater® system gives a score for a submitted essay within 30 seconds as well as suggestions for improvement and is aimed at learners who want an idea of how they would fare in the TOEFL exam. It is stressed that the results are for guidance only and that the exam will continue to be marked by trained examiners.


Fiona Joseph is the co-founder of Flo-Joe, the award-winning website for Cambridge ESOL exam resources, which also publishes the Exam Success Plus series for FCE, CAE and CPE exam preparation. Contact Fiona by emailing: Fiona@flo-joe.co.uk


References

Research Notes: Issue 12, May 2003, University of Cambridge ESOL Exams

'Towards a Unified E-learning Strategy', Consultation Document, July 2003, Department for Education and Employment


Back