Electronic assessment of key skills

This section looks at the different ways that assessments can be made using ICT and gives an indication of how electronic assessment opportunities can benefit both your centre and your learners.

QCA's Basic and Key Skills On-Screen Project has concluded that there is "urgent need for a coordinated approach to provision of infrastructures to support e-learning & e-assessment on a national basis."

What kinds of electronic assessment are available?

On-screen assessment replaces the paper-based external test with an on-screen version that is its near duplicate. On-screen tests work best when all information is provided on a single screen.
Online assessment uses the bank of questions available now for Levels 1 and 2. A unique entry number for each candidate will generate a set of questions taken from the question bank.

When did on-screen testing begin?

There was a feasibility study of on-screen testing in 2002 for the tests at Levels 1 and 2. There have since been pilots, and a set of best practice protocols is emerging.

The issues for on-screen tests range from ensuring workstations and servers comply with all requirements; that providers manage the process to standard; and that they are trained in the specific requirements of e-specific invigilation.

To find out more about good practice guidance, access the e-assessment section of QCA's website www.qca.org.uk or visit the e-assessment page on the QCA website.

What is on demand testing?

On demand testing means that you can offer tests outside the test windows. Centres register an interest in giving the external tests on a given day in a certain place. The awarding body then provides the materials needed and organises the marking. Awarding bodies require notice to provide this service which can, in principle, use either paper or on-screen papers . On demand testing can be particularly useful for learners working away from their centres or those who have a work schedule not conducive to allowing leave for the published test windows.

Do learners find on-screen tests more difficult to complete?

This depends on your learners and the opportunities they have been given for practising taking the on-screen tests. Studies have shown that candidates need to practise using the on-screen tests to become familiar with moving around the test paper and going back to check their answers. If a candidate prefers working with ICT to working on paper, then that candidate will perhaps prefer tests on-screen as well.
The ASDAN On-screen pilot found the following:

Summary of Key Skills On-Screen pilot - July 2004

'I prefer doing it like this than on paper because we are comfortable using computers and it's quicker and easier. Also I got my results straight away rather than waiting.'

'I would be quite happy doing it this way all the time.'

These are some of the comments from Emma Tappenden and Jade St Louis, students at Trinity School (now Unity College), Northampton, reported in the local media (Northampton Chronicle and Echo) following their on-screen test experience of key skills.

"This is our first experience of piloting on-screen testing, and we have worked on it with technical partners Exam on Demand.

"Practice tests and live tests were taken on 1st and 2nd July 2004, managed by Exam on Demand. QCA were in attendance, as were the press, TV and radio.

"The pilot proved very successful with a good working relationship between the partners, and a good student reaction.

"Over 80% pass rate for tests taken at Level 2 across the three key skills.

"Nineteen tests were taken at level 2 in Application of Number, IT and Communication, by fifteen candidates.

"Of the 19 tests there were 16 passes and 3 fails.

"It is our understanding that this is the first school to take part in on-screen testing of basic or key skills, with 10 of the 15 candidates in Key stage 4 in year 10, and therefore under 16.

What about ensuring the security of the test room?

As with any paper-based tests you offer, it is the centre's responsibility to ensure security and maintain proper test conditions. Your awarding body will tell you how to set up the test rooms and machines and what you need to do before, during and after the test.