The minister said that he would be inviting the six state premiers and Northern Territory’s Chief Minister Claire Martin insisting a national approach was needed to address the issue.
He said the focus of the summit would be on improving law and order to rid indigenous communities of domestic violence.
“If we remove the perpetrators, if we can get rid of the grog we'll make the biggest step forwards that we have seen in health, in employment opportunities and in education,” Mr Brough told journalists in Alice Springs.
Extra measures
Mr Brough also wants to implement a plan that would see sniffer dogs brought to Alice Springs and police funding boosted to help crack down on drug use and domestic violence.
He said that a sniffer dog team used by police intelligence officers in Darwin since January had been successful and a second team would be deployed to Alice Springs.
"An independent MP came up to me and said it's exactly what we need because the women are too afraid to dob in a perpetrator and the dogs don't have any fear," Mr Brough said.
Extra funding would also be provided for a joint intelligence unit comprising West Australian, South Australian and Northern Territory police.
Law and order issue
When asked if Mr Brough had invited indigenous leaders to the summit the minister said that he had no such plans.
“No, I'm not asking indigenous leaders to come this is a law and order issue. This is a failure of law and order,” he said.
“The indigenous people have spoken they have told us what they need. We now as politicians are the ones who have to step up to the plate. Once decisions have been made there will be a time for consultation,” Mr Brough.
However, he said that if the states decide it was more appropriate to send the chief of police, police minister or their indigenous affairs minister that would be acceptable.
State leaders wary of summit
However Chief Minister Clare Martin said a national summit would achieve little.
"What Aboriginal people want - and I talk to Aboriginal people everyday - is action," she told ABC Radio.
"Another talkfest happening on a national level with another minister, I don't think is going to change anything on an Aboriginal community," she said.
Meanwhile Queensland’s Deputy Premier Anna Bligh said the proposed summit was not the most appropriate venue to discuss abuse in indigenous communities.
Ms Bligh, who is leading the Queensland government while Premier Peter Beattie is overseas, said the best venue for inter-governmental discussions on the issue was the upcoming Council of Australian Governments (COAG) meeting.
"Queensland is of the view that the appropriate national body to address these issues is COAG," she said.
"This is a matter that has been on previous agendas of that body and is something we think requires leadership and therefore the prime minister should be chairing any national discussions of this."
The next COAG meeting will be in July.
Abuse claims re-emerge
The debate arises from an interview that Alice Springs prosecutor Nanette Rogers gave over her concerns about indigenous violence.
She cited horror stories of men and teenage boys raping children as young as seven months.
Ms Bligh said abuse in indigenous communities was an issue which has "bedevilled" governments and policy makers for many years.
"While great efforts have been made by commonwealth and state governments, the material that has been put into the public arena in the last week certainly indicates it may be time to renew those efforts," she said.
Brough tour
Mr Brough told journalists he had gone out with social workers in Alice Springs on Wednesday night and also made his own inquiries of locals during a run along the Todd River this morning.
"I saw a fire burning and sat down in the creek with five women," Mr Brough said.
"These five women, all middle-aged, one had ... a large gash across the nose and under both eyes fresh from last night.
"She had got it in the town camps. She said, `We live here in the river because we are so fearful of living in the town camps. If you could help us with that we would be eternally grateful'.
"They are standing there drinking moselle at seven in the morning. I said, `We've got to get rid of that - that's destroying you, it's taking your soul'.
"And she said, `But it's my medicine'. We've got to replace that medicine with new medicine. They are desperate to be helped. They don't want to live in the river.
"This is the sort of stuff we've got to open Australians eyes to," Mr Brough said.