The future of computer-based and online testing
by Fiona Joseph
The recently-published UK Government consultation paper
"Towards a Unified E-Learning Strategy" restates the case for
increasing the provision of online assessment. The key benefits that the
paper outlines are already familiar to CALL enthusiasts, namely instant
feedback for the learner, greater flexibility in the delivery times for
tests, and a reduced administrative burden for teachers who, in theory
at least, can spend more time planning appropriate and informed programmes
for their students and less time marking. However, while computer-based
(CB) delivery works well for informal assessment even the government has
to concede that it would be "undesirable and impractical" to
put all public examinations online.
So what progress has been made so far by assessment
providers within ESOL? This article will look at the development of online
and computer-based tests by two of the largest examination boards, and
conclude by seeing what self-tests are available on the web.
Formative assessment
So far Cambridge ESOL has used computer-based technology to develop relatively
low-stakes - but nevertheless useful - assessments. Tests such as the
Quick Placement Test (QPT), which was produced in conjunction with Oxford
University Press, and the Business Language Testing Service (BULATS) Computer
Test are each based on a multiple-choice format, which generate immediate
scores. The test results are linked to the Council of Europe and ALTE
frameworks, as well as the Cambridge Main Suite examinations from KET
through to Proficiency. The QPT and BULATS are intended to help teachers
and language trainers to place their students in appropriate classes,
as well as to recommend the right level of exam to take. The main advantage
over their traditional pen and paper versions is that these tests are
adaptive, i.e. the test adapts to the ability of the candidate so that
he or she only answers questions within their language range. Both tests
have demonstration versions which can be done online.
QPT: http://www.oup.com/shockwave_flash/elt/qpt/qptdemo/
BULATS: http://www.bulats.org/minibulats.cfm
High stakes
But what about when the stakes are higher? When it comes to exams used
for university entrance, the main developments in CB testing have been
made by TOEFL, the standard language exam for admission to American Universities.
The Computer-Based TOEFL (www.toefl.com) offers candidates the chance
to do the listening and language structure components on computer, as
well as to submit essays. The question of whether all major language exams
will move in this direction is hard to assess, especially as the global
demand for the computer version of TOEFL was initially overestimated.
(Last year ETS, the organisation responsible for the delivery of the online
TOEFL, announced plans to "reorganize and refocus" its computer-based
delivery, which meant the closure of around 80 dedicated test centres
that had experienced low numbers.)
Trials are presently taking place to explore the feasibility
of delivering a computer-based version of IELTS, the other key test of
academic English, which would incorporate all papers apart from Speaking.
Cambridge ESOL, one of the key IELTS partners, is currently supporting
research into the important issue of whether examiners respond differently
to written scripts according to whether they are handwritten or word-processed.
Self-tests on the web
A third category of tests are self-tests, those designed to be used by
learners (including the self-study learner) looking for instant feedback
and an evaluation of their strengths and weaknesses. The Flo-Joe website
(www.flo-joe.co.uk ) provides a range of free and subscription-based resources
for the Reading and Use of English papers for FCE, CAE and CPE, as well
as access to real student essays with corrections and feedback. The makers
of the TOEFL exam have produced an online marking system called ScoreItNow
(www.scoreitnow.org), which uses automated scoring technology to assess
writing. The E-rater® system gives a score for a submitted essay within
30 seconds as well as suggestions for improvement and is aimed at learners
who want an idea of how they would fare in the TOEFL exam. It is stressed
that the results are for guidance only and that the exam will continue
to be marked by trained examiners.
Fiona Joseph is the co-founder of Flo-Joe, the award-winning website for
Cambridge ESOL exam resources, which also publishes the Exam Success Plus
series for FCE, CAE and CPE exam preparation. Contact Fiona by emailing:
Fiona@flo-joe.co.uk
References
Research Notes: Issue 12, May 2003, University of Cambridge
ESOL Exams
'Towards a Unified E-learning Strategy', Consultation
Document, July 2003, Department for Education and Employment
Back
|