News

Are AI detection tools biased against English language learners?

AI detection tools are trained on native English users, which could create bias.

<h5>By Zachary Amos<&sol;h5>&NewLine;<h2>AI detection tools are gaining traction in schools as a way to spot content generated by platforms like ChatGPT&period;<&sol;h2>&NewLine;<p>Still&comma; these programmes can have flaws&comma; especially when identifying work from nonnative English speakers&period; Because many detectors analyse sentence complexity&comma; word choice and flow&comma; they often misinterpret genuine student writing as AI-generated if it doesn’t match native-level patterns&period;<&sol;p>&NewLine;<p>This poses a real problem in New Zealand’s multicultural classrooms&comma; where learners from migrant&comma; Pasifika and Asian backgrounds bring diverse language styles&period; When their work is unfairly flagged&comma; it can lead to confusion&comma; unfair consequences&comma; and a breakdown in trust between students and educators&period;<&sol;p>&NewLine;<h3>The problem with AI detection bias<&sol;h3>&NewLine;<p>AI detectors are built using native English writing patterns&comma; which makes them prone to mislabelling nonnative writing as AI-generated&period; When students use simpler sentence structures or write in a more formulaic way&comma; which are common traits among English language learners&comma; these tools may flag their work incorrectly&period;<&sol;p>&NewLine;<p>This is especially concerning in New Zealand&comma; where there were <a href&equals;"https&colon;&sol;&sol;www&period;enz&period;govt&period;nz&sol;news-and-research&sol;ed-news&sol;69000-international-student-enrolments-in-2023" target&equals;"&lowbar;blank" rel&equals;"noopener">69&comma;000 international student enrollees<&sol;a> in 2023&period; One study revealed that an AI checker wrongly identified <a href&equals;"https&colon;&sol;&sol;www&period;cell&period;com&sol;patterns&sol;fulltext&sol;S2666-3899&lpar;23&rpar;00130-7&num;&percnt;20" target&equals;"&lowbar;blank" rel&equals;"noopener">over half of Chinese students&&num;8217&semi; TOEFL essays<&sol;a> as AI-generated&period; Meanwhile&comma; the same tool accurately classified essays written by American eighth graders&period; This highlights a clear bias that can unfairly penalise real student work and mislead educators trying to uphold academic integrity&period;<&sol;p>&NewLine;<h3>Why this matters in New Zealand classrooms<&sol;h3>&NewLine;<p>New Zealand&&num;8217&semi;s classrooms are becoming more linguistically diverse&comma; with rising English language learners &lpar;ELL&rpar; from migrant communities&period; ELL students may span all levels of language proficiency&comma; from beginners with limited English to those who communicate fluently but are still developing academic writing skills&period;<&sol;p>&NewLine;<p>AI detection tools&comma; however&comma; often misread this range of expression and flag legitimate student work as AI-generated&period; Such false positives can harm a student’s confidence&comma; lead to unnecessary disciplinary measures and create tension in the classroom&period; When edtech models carry built-in language biases&comma; they risk undermining the inclusive&comma; supportive learning environments that New Zealand educators work hard to build&period;<&sol;p>&NewLine;<h3>How educators should respond<&sol;h3>&NewLine;<p>AI detection tools should support&comma; not replace&comma; a teacher’s professional judgment&period; Relying solely on them risks proxy discrimination&comma; especially when <a href&equals;"https&colon;&sol;&sol;rehack&period;com&sol;ai&sol;understanding-3-major-artificial-intelligence-ethical-issues&sol;" target&equals;"&lowbar;blank" rel&equals;"noopener">AI is trained on flawed data<&sol;a> or patterns shaped by systemic bias&period; Educators should treat flagged results as a starting point&comma; not a verdict&period;<&sol;p>&NewLine;<p>Comparing the work with prior writing samples and in-class performance helps contextualise things&period; It&&num;8217&semi;s also vital to equip teachers with the training to recognise genuine red flags while appreciating the natural writing differences that come with linguistic diversity&period; When used thoughtfully&comma; AI detectors can be part of a fairer&comma; more inclusive assessment process&period;<&sol;p>&NewLine;<h3>Better practices for fair use of AI detectors<&sol;h3>&NewLine;<p>Clear communication around AI use is essential&comma; especially as schools grapple with new challenges in student assessment&period; Some institutions have already <a href&equals;"https&colon;&sol;&sol;www&period;rnz&period;co&period;nz&sol;news&sol;national&sol;528800&sol;schools-abandon-take-home-assignments-after-artificial-intelligence-used-to-cheat" target&equals;"&lowbar;blank" rel&equals;"noopener">eliminated take-home assignments<&sol;a> due to concerns that students turn to AI tools to complete their work&period; Rather than creating a climate of suspicion&comma; schools should focus on building trust by setting transparent AI policies and explaining what is and isn’t allowed&period;<&sol;p>&NewLine;<p>Encouraging students to seek writing support can promote better learning outcomes&period; When work from English language learners is flagged&comma; involving English for Speakers of Other Languages specialists ensures a fairer review that considers language development and cultural context&period;<&sol;p>&NewLine;<h3>Striking the balance between integrity and inclusion<&sol;h3>&NewLine;<p>AI tools offer valuable support in upholding academic standards&comma; but they often misjudge writing from nonnative English speakers&period; New Zealand schools must use these programmes thoughtfully to ensure fair treatment&comma; protect student confidence and promote truly inclusive education&period;<&sol;p>&NewLine;<p><em>Article by Zacahry Amos<&sol;em><&sol;p>&NewLine;

Explore our latest issue...
School News

School News is not affiliated with any government agency, body or political party. We are an independently owned, family-operated magazine.

Recent Posts

PLD for teachers in New Zealand needs strengthening, says ERO

Professional learning and development (PLD) for teachers needs to be higher impact for teachers and…

6 days ago

From fear to fluency: what our students learned when they used AI across an entire course

Students displayed increasing AI literacy when explicitly asked to engage with the technology for their…

6 days ago

New collective offer for teachers put to vote

A new Government collective offer will be voted on by members of NZEI Te Riu…

6 days ago

Resetting New Zealand’s Education System for Success

New Zealand’s education system is a canvas of opportunity to inspire and empower every child.…

6 days ago

Wellbeing that sticks: How to run a whole-school wellbeing challenge

When done well, a wellbeing challenge can build habits that support wellbeing for life—and lays…

6 days ago

The recolonisation of Aotearoa New Zealand’s curriculum

Te Akatea Inc., the National Māori Principals’ Association has released a discussion paper reflecting on…

2 weeks ago