There are fears the LNAAT will deter good teaching candidates. © arrowsmith2 - stock.adobe.com
<div class="theconversation-article-body">
<h2>Australian students are increasingly <a href="https://www.researchgate.net/profile/Suzanne-Vassallo/publication/329718398_Use_of_technology_in_the_classroom/links/5c18154792851c39ebf52376/Use-of-technology-in-the-classroom.pdf" target="_blank">taking tests on computers</a>. This includes <a href="https://www.oecd.org/en/about/programmes/pisa/pisa-frequently-asked-questions-faqs.html" target="_blank">major tests</a> used to check national progress on literacy and numeracy.</h2>
<p>The <a href="https://www.youtube.com/watch?v=yIba0PCcSHY" target="_blank">idea is</a> this prepares students “for the future”, because “technology is everywhere”.</p>
<p>But as our two recent studies suggest, the way students respond to test questions on computers may not be the same as on paper.</p>
<p><a href="https://www.schoolnews.co.nz/latest-print-issue/" target="_blank" rel="noopener"><strong>Read the latest print edition of <em>School News</em> HERE</strong></a></p>
<p>This is a particular issue amid concern over the latest round of <a href="https://theconversation.com/naplan-results-again-show-1-in-3-students-dont-meet-minimum-standards-these-kids-need-more-support-236688" target="_blank">NAPLAN results</a>, which appear to show too many Australian students are not learning basic skills in English and maths. NAPLAN (for Years 3, 5, 7 and 9) has been fully online for two years.</p>
<h2>Our research</h2>
<p>In our <a href="https://www.tandfonline.com/doi/full/10.1080/1475939X.2024.2367517" target="_blank">recent study</a>, we reviewed 43 studies comparing tests on computer and paper. This included research from 18 different countries (including Australia, the United States, Germany and the United Kingdom). Fourteen of these studies focused on school-aged children.</p>
<p>In general, the studies showed for younger school students (who had less computer skills), test scores tended to be higher when done on paper. This effect dropped off as students got older.</p>
<p>We also found when it came to computer testing, scores were worst when students needed to answer complex questions involving multiple steps.</p>
<p>This is due to the demands placed on working memory (the part of your thinking that allows you to hold onto multiple pieces of information at one time – for example, a list of names and coffee orders). When working memory has too many pieces of information at once, we experience “high cognitive load”.</p>
<p>Students may experience this if they are unfamiliar with using a particular computer or particular program, testing platform or browser.</p>
<p>Students may also experience high cognitive load when the questions they answer become more complex. Not only are they working out the answer, but they are working out how to use the computer (or reminding themselves how to use it) at the same time.</p>
<figure class="align-center "><figcaption>
<figure id="attachment_28918" aria-describedby="caption-attachment-28918" style="width: 300px" class="wp-caption alignnone"><img class="size-medium wp-image-28918" src="https://www.schoolnews.co.nz/wp-content/uploads/2023/11/AdobeStock_433454956-300x158.jpeg" alt="" width="300" height="158" /><figcaption id="caption-attachment-28918" class="wp-caption-text">Online exams may contribute to a high cognitive load. Photo: AdobeStock by TommyStockProject</figcaption></figure>
</figcaption></figure>
<h2>Comparing students on paper and on a computer</h2>
<p>We also saw this phenomenon at work in our own <a href="https://link.springer.com/article/10.1007/s10648-023-09781-x" target="_blank">2023 study</a>, even when students were well into high school and familiar with the computers used in a science test.</p>
<p>We compared the differences in test scores for computer and paper-based tests with Year 9 students. This study involved 263 science students from two schools in Perth, where students learn using their own devices. Within this sample, there were 14 individual classes taught by seven different teachers.</p>
<p>Students completed one test on their own computer and another (featuring very similar questions) on paper. We categorised the questions in each test as “easy” or “hard”.</p>
<p>When students answered easy questions, they achieved higher scores (by about 7%) on the computer-based assessment. When students completed hard questions, they performed better (by about 12%) on paper-based assessment.</p>
<p>This suggests the computer mode adds to the cognitive load students experience when answering questions. This is a bit like the way a computer’s memory might become overloaded if you run too many programs at the same time, and it slows down and doesn’t perform as well.</p>
<p>This finding is similar to that of a <a href="https://journals.sagepub.com/doi/10.1177/073428291876149" target="_blank">2018 study</a> that looked at the verbal skills of a group of children aged between four and 11.</p>
<h2>What about working memory capacity?</h2>
<p>In our study on Year 9 students, we also tested students’ working memory capacity, by giving them increasingly long lists of numbers to remember.</p>
<p>We then controlled for this using statistics. This allowed us to compare the computer and paper test scores while assuming all students had the same working memory capacity. Under these conditions, we found there was no difference in test scores between paper and computer.</p>
<p>This suggests students with lower working memory capacities are most disadvantaged by computer-based tests. People with attention-deficit hyperactivity disorder (ADHD) are one group that particularly <a href="https://www.nature.com/articles/s41598-020-64678-x" target="_blank">struggle with working memory</a>. We know there will typically be <a href="https://theconversation.com/my-brain-leaves-the-room-what-happens-when-teachers-talk-too-much-234685" target="_blank">one or two students per classroom</a> who have ADHD.</p>
<h2>What can we do differently?</h2>
<p>Computers of course have an important role to play in education, and are powerful learning tools. But our research shows taking a test on a computer is not the same as taking the same test on paper. Schools should consider:</p>
<ul>
<li>
<p>giving students <a href="https://www.sciencedirect.com/science/article/pii/S0959475220306915?via%3Dihub" target="_blank">extra working time</a> when completing complex tasks or tests on a computer</p>
</li>
<li>
<p>teaching students <a href="https://www.sciencedirect.com/science/article/pii/S8755461524000240" target="_blank">word processing skills</a> from an early age to increase their ability to type and navigate computer programs</p>
</li>
<li>
<p>minimising any <a href="https://link.springer.com/article/10.1007/s11251-020-09517-2" target="_blank">digital distractions</a>, either during tests or during class work. This includes pop-ups, multiple tabs and online games.</p>
</li>
</ul>
<p>Additionally, families should think about providing everday opportunities at home for younger children to learn to type (such as emails, messages and shopping lists). This will help to build their skills and confidence with keyboards and computers.</p>
<hr />
<p><em>Peter Whipp also contributed to the research on which this article is based.</em><!-- Below is The Conversation's page counter tag. Please DO NOT REMOVE. --><img style="border: none !important; box-shadow: none !important; margin: 0 !important; max-height: 1px !important; max-width: 1px !important; min-height: 1px !important; min-width: 1px !important; opacity: 0 !important; outline: none !important; padding: 0 !important;" src="https://counter.theconversation.com/content/236872/count.gif?distributor=republish-lightbox-basic" alt="The Conversation" width="1" height="1" /><!-- End of code. If you don't see any code above, please get new code from the Advanced tab after you click the republish button. The page counter does not collect any personal data. More info: https://theconversation.com/republishing-guidelines --></p>
<p><a href="https://theconversation.com/profiles/james-pengelley-1546716" target="_blank">James Pengelley</a>, Adjunct Lecturer, School of Education, <em><a href="https://theconversation.com/institutions/murdoch-university-746" target="_blank">Murdoch University</a></em>; <a href="https://theconversation.com/profiles/anabela-malpique-1343762" target="_blank">Anabela Malpique</a>, Senior Lecturer in Literacy, <em><a href="https://theconversation.com/institutions/edith-cowan-university-720" target="_blank">Edith Cowan University</a></em>, and <a href="https://theconversation.com/profiles/nina-rovis-hermann-1158535" target="_blank">Nina Rovis-Hermann</a>, Lecturer in Education Psychology, <em><a href="https://theconversation.com/institutions/murdoch-university-746" target="_blank">Murdoch University</a></em></p>
<h5>This article is republished from <a href="https://theconversation.com" target="_blank">The Conversation</a> under a Creative Commons license. Read the <a href="https://theconversation.com/does-it-matter-if-students-do-tests-on-computers-or-on-paper-236872" target="_blank">original article</a>.</h5>
</div>

Curriculum rewrites at the Ministry of Education are struggling with a lack of clarity, according…
Opportunities are critical for preteens to build confidence and capability, says Chisnallwood Intermediate, acclaimed for…
AI detection tools are trained on native English users, which could create bias.
Opinion: Why the Minister’s announcement on open-plan classrooms distracts from what really matters in education.
Positive wellbeing means resilient communities and effective learning.
A new campaign from the Teaching Council of Aotearoa New Zealand aims to lift the…
This website uses cookies.
