"I have no truck with bullying, whether it's in the classroom, whether it's in the workplace, whether it's in a parliament and all of my colleagues know that," he told reporters in Sydney on Sunday.
But Labor's Clare O'Neil believes her political opponents aren't doing enough to counter what she says is an increasingly toxic environment for female parliamentarians.
She pointed to senior Liberals who suggested Ms Banks needed to toughen up.
"I look at the other side of politics and I see Julia Banks' situation and I think who will drive that culture within that party to make sure that women feel valued and have a voice," Ms O'Neil told the ABC.
She said if she felt badly treated in parliament she would contact Labor's two most senior female parliamentarians.
"If there was bullying and intimidation put on me as a member of parliament, I would pick up the phone, I would call Penny Wong and call Tanya Plibersek and there would be a nuclear Armageddon on the person who did this to me."
Labor MP Emma Husar will also leave politics after one term in parliament following allegations of sexual harassment that were found to be untrue.
Ms Husar, who was found to have behaved unreasonably towards staff, said she was forced to quit after being "slut-shamed".
Ms O'Neil said Ms Husar's treatment was "gendered" but defended Labor's record of supporting women.
"I think her situation was a bit more complicated. I think there's acknowledged wrongdoing on both sides," Ms O'Neil said.
"I'm not claiming that the Labor Party are perfect here, but you've got to say that we're having a crack at fixing the problem and I don't see the same being done on the other side of politics."