Mr Dutton last month cancelled the visa of so-called pick-up artist Jeff Allen on character grounds.
In a statement, he said the views of Mr Valizadeh are distasteful.
"People who advocate violence against women aren't welcome in Australia. In the past people advocating violence against women have had their visa refused or cancelled."
An online petition is growing against US man Daryush Valizadeh who's heading to Australia to host meetings that promote rape, homophobia and racism.
Sydney protesters are leading the charge against the founder of a group that advocates for "legal rape" who is heading to Australia for string of public meetings.
More than 25,000 people have signed an online petition in a bid to stop "tribal meetings", organised by Return of Kings' American leader Daryush `Roosh' Valizadeh, going ahead this weekend in Sydney.
Meetings are also scheduled for Melbourne, Brisbane and Perth, coinciding with 43 public meetings worldwide.
Women, transgender men and homosexual men are banned from the meeting of "neomasculinist" supporters, who have been urged to travel in pairs or groups using indirect routes to avoid "green-haired female activists or male feminists" following them.
Protesters want Saturday's three Sydney events to be cancelled.
The petition is to inform the NSW Police Force that "this sort of misogynistic form of terrorism" should not be allowed.
The Sydney meeting points for the event will be held in three locations - the Hyde Park Fountain, park benches outside the Coogee Pavilion complex and the shopping strip at Brighton-Le-Sands.
According to Mr Valizadeh's website, "a women's value significantly depends on her fertility and beauty. A man's value significantly depends on his resources, intellect, and character".
The former sex discrimination commissioner Elizabeth Broderick tweeted on Monday night: "The views espoused by Return of Kings are deeply offensive and have no place in Australia".
Online petitions have also started to try and stop the events planned for Brisbane, Melbourne and Perth with several thousand signatures each.