The parliamentary secretary for immigration, Andrew Robb, says he wants to look at the idea of a compulsory English-language test for new migrants.
They would also be expected to answer questions on history, law and "Australian values" before being granted citizenship.
Mr Robb has made his remarks in a talk before the conservative think-tank The Sydney Institute.
He says the values he has in mind include freedom of the individual, respect for Australian laws, the equality of men and women and a fair go.*
"For future new citizens to quickly and effectively integrate into our Australian family, to fully realise their potential and their ambitions, it's essential, in my view, they learn the national language of English and they learn something about our history and heritage."