Home Affairs Minister Peter Dutton says it is "beyond frustrating" for inmates in immigration detention to have access to mobile phones.
A Nigerian man held in Villawood Detention Centre is accused of using 16 mobile phones to defraud more than $3 million, which he allegedly sent back to his home country.
"Mate, it drives me mad," Mr Dutton told 2GB radio on Thursday.
"They're organising escapes, they're organising assaults, organising all sorts of things that just aren't consistent with being in immigration detention."
The minister said it defied common sense for immigration detainees to have access to mobile phones, given they can use landlines to contact their lawyers if needed.
"I've tried to get the bill through parliament and for whatever reason the Labor Party won't support it," he said.
"These people shouldn't have mobile phones in the centres."
