"It's shameful that a married woman suffering family violence can go to such extent," he said.
"She skimmed her lover, husband and father of her two children for all these years. And now she alleges rape. Was she kept locked all these year?"
In another comment he said: "The real victim is the husband."
A spokesperson for the Red Heart Campaign, an organisation that tracks the number of women murdered by their partners, called on the Liberal Party to disendorse Mr Singh.
"You're clearly accepting and you're clearly endorsing that behaviour," the spokesperson told SBS News.
"The Liberal Party and all parties need to make it clear that we're no longer accepting these views. They should be educating their candidates, they should be vetting them better."
The spokesperson questioned how serious the government's commitment was to preventing violence against women if they continued to endorse Mr Singh.
Mr Singh retained his endorsement from the Liberal Party despite revelations about homophobic comments he made as he campaigned against legalising same-sex marriage in 2017.
Prime Minister Scott Morrison said on Wednesday that that matter had been handled and Mr Singh would remain the Liberal candidate.
That's despite the prime minister saying last week that vetting processes of candidates needed to be improved after a series of candidates resigned or were dumped for offensive or inappropriate social media activity.
"The standard you walk by is the standard you accept," Mr Morrison said as he criticised Bill Shorten for a delay in disendorsing Luke Creasey who shared a rape joke on Facebook.
Making the case against changing Australia's marriage laws to SBS Punjabi in October 2017, Mr Singh raised concerns about the children of same-sex marriages.
"It has got very serious implications on the kids which we can't see now, but when these children grow up how they reconcile with that situation is beyond comprehension."
He later added: "I think it is also an issue of paedophilia - in these situations the occurrence can be high."
Equality Australia CEO Anna Brown called on the Liberal Party to take a stand against such views.
"If you’re a party that aims to govern for all Australians, and professes to value individual dignity, respect and diversity, then there is no place for homophobia or attitudes that reveal prejudice and lack of acceptance for cultural diversity."
She said comments like Mr Singh's had the power to cause harm.
"Derogatory and hate-filled speech can also ultimately lead to increases in hate crime, LGBTIQ people reported a doubling in physical assaults during the marriage equality postal survey for example."
Mr Singh did not respond to SBS News' request for comment.
The Victorian Liberal Party has been contacted for comment.