The Australian government must explain why it trusts an "inconsistent" automated language test to decide who gets a permanent residency visa, an English educator says.
Clive Liebmann schools people in how to pass English tests the immigration department requires when assessing visa applications, and believes one - the Pearson Test of English (PTE) Academic - is flawed and open to manipulation.
Mr Liebmann says PTE - a computer-based, machine-scored test - is capable of handing inflated scores to people with low English proficiency and low scores to those with high proficiency.
"The government talks about wanting high-level English speakers, through the visa system. That's fair enough. But what's the point in the government using a test that produces - from my students' experience - often wildly inconsistent results," he told AAP.
Mr Liebmann made the comments after highly-educated test takers said they'd essentially flunked the speaking component of PTE - the only government test that uses voice recognition technology.
Candidates' audio recordings are marked by Pearson's "scoring engine", trained to identify acceptable and unacceptable answers. Other test providers use human assessors to test speaking ability.
"In my experience, a student could include some confidently-spoken gibberish in their response, mixed with some topic-specific vocabulary. Even if not used logically, if their fluency, intonation, stress, and speed is good, they could still get a high score," Mr Liebmann said.
"On the other hand many students who go in and speak very well, in a natural, real-world way, could end up getting a low score because they're not giving the computer what it's good at."
This week Irish woman Louise Kennedy - who has spent the past two years working as a vet in Queensland - revealed she'd failed to achieve a PTE speaking score high enough to gain permanent residency.
Mr Liebmann said if people were touched by the story of a young Irish vet, they should "consider the plight of a non-native speaker who has worked diligently on their English their whole life, only to be rejected due to the inaccuracy of the exam".
Mr Liebmann said while PTE technology was good at assessing some things like pitch, volume, and stress, it struggled to deal with complex grammar and arguments, abstract thought and even natural pauses in speaking patterns.
"You need to give the computer what makes it happy. There is an entire niche industry that's sprung up, focusing on tips and tricks - those are the buzz words - to fool the computer," he said.
Pearson has defended its product and says even native English speakers shouldn't assume they will get a perfect score.
Pearson Asia Pacific head of English Sasha Hampson said it was not possible to 'game' its test.
"To suggest that PTE Academic can be gamed by the use of keywords or exaggerated speech significantly underestimates the sophistication of the technology used," she said in a statement.
AAP has sought comment from Immigration Minister Peter Dutton.
