Bespoke robot-written exams to curb student cheating

Bespoke exams containing unique datasets for each student being trialled at a UK university could significantly curtail cheating in online assessments, researchers believe.

With some studies suggesting that cheating has massively increased following the switch to remote assessments, scholars have begun examining how they can design exams that make it impossible for students to collude or plagiarise their classmates’ work.

In a novel approach, chemists at the University of Exeter are using computer coding to generate 60 different datasets for a single class – one for each student – sitting a data analytics test that is worth 20 per cent of the entire module grade.

THE Campus resource: using multimedia as a tool to enhance and transform assessment

The script – which models lab equipment to produce realistic data but introduces some randomness so that each dataset is different – could with very little work be used to generate unique datasets for thousands of exams in different disciplines, says a study published in the Journal of Chemical Education.

“If you have an exam which counts a lot towards a degree and it moves online, it presents an opportunity to cheat and even incentivises it,” explained Alison Hill, a senior lecturer in biosciences who co-authored the paper with her Exeter colleague Nicholas Harmer.

“This [online cheating] isn’t just happening in academia – my husband is a Devon chess champion, and when chess moved online in the pandemic, there were reports of people using computers to help them win.”

One method to prevent collusion on data analysis questions is to limit exams to one hour. However, this brief exam window unfairly penalised students with poor internet connections or those based in different time zones who often had to begin their tests at 3am, explained Dr Hill.

But the students’ preferred option of a 24-hour exam window was an invitation for students to share their answers, she argued.

“We’ve seen in other territories how once the paper goes live, a WhatsApp group is set up immediately – people simply see this kind of sharing as a good investment of their time,” said Dr Hill, who argued that relying on university honour codes to halt cheating would be “completely naive”.

“We can’t entirely stop cheating, but if every student has their own dataset – with the same question – the cost-benefit balance of cheating is no longer in the student’s favour as they will need to do the work again [for a classmate] with a different information set,” said Dr Hill.

Designing out cheating by creating different datasets could be applied to most data-heavy exams – with automatically generated answer sheets for each paper – claims the journal article.

This kind of test design would be far more effective than some exam proctoring techniques piloted in the pandemic, such as the webcam surveillance of those sitting exams, which some students easily circumvented, said Dr Hill.

“Lockdown students will find a way to get around these types of rules,” she said.

jack.grove@timeshighereducation.com