The first-term MP has announced she will not recontest her marginal Melbourne seat at the next election, calling out bad behaviour from both within her party and Labor.
Women's council chair Helen Kroger described politics was a "rough and tough" game, saying last week's leadership spill which Ms Banks called the "last straw" was a unique environment.
"I feel really sorry for her, but politics is clearly not for everyone," Ms Kroger told ABC radio on Thursday.
The former Liberal senator said she had experienced leadership spills which created robust conditions that Ms Banks may have considered to be bullying.
"I do not believe there is a culture of bullying and intimidation in the Liberal Party," Ms Kroger said.
Former minister Concetta Fierravanti-Wells, who backed Peter Dutton in the leadership spill, was critical of Malcolm Turnbull's insistence on a petition with a majority of names to call another partyroom meeting.
"The insistence on the petition brought undue and unnecessary escalation of tension," Senator Fierravanti-Wells told the ABC.
She said colleagues had told her they felt pressure, but denied there was a culture of intimidation.
As for bullies on the other side of politics, Labor's Senate leader Penny Wong isn't sure what Ms Banks was referring to.
But Senator Wong said the problem had been compounded by insensitive coalition MPs like Craig Kelly dismissing Ms Banks' concerns as part as the "rough and tumble" of politics.
"Mr Morrison needs to decide if he's going to be a PM that condones this or a leader that says this is unacceptable, because it is," Senator Wong told ABC radio.
She called on Prime Minister Scott Morrison to take a stand.
Mr Morrison said there had been no suggestion any bullying was done “under my name or under my authority.”
“I certainly wouldn’t accept it. I have no truck with bullying in any workplace.
