Many of the protesters who took over central Bendigo over the controversial construction of a mosque travelled from Melbourne.
Greater Bendigo Mayor Peter Cox said it was disappointing people from outside Bendigo felt the need to visit the city and cause trouble.
"It certainly doesn't put Bendigo in the best situation," Councillor Cox told AAP.
"We are a welcoming, giving and thoughtful city."
Councillor Cox said those protesting against the mosque needed to accept the plans had gone through the democratic process twice and had been approved.
About 300 anti-mosque protesters broke through police barricades and started punching anti-racism protesters on the steps of the Bendigo Town Hall on Saturday afternoon.
Victoria Police spokeswoman Clair White said there were no arrests made but capsicum spray was used to disperse some minor scuffles.
The local council first gave the green light to the regional city's first mosque in mid-2014, and the Victorian Civil and Administrative Tribunal had upheld that decision.
