The Member for Fairfax has come under fire for his comments about Peta Credlin, in which he linked her to the government's proposed paid parental leave scheme.
"Why should Australian citizens and businesses be taxed, and working women discriminated against, just so the prime minister's chief of staff can receive a massive benefit when she gets pregnant?" he said.
Leader of the House Christopher Pyne has demanded an apology, but Mr Palmer remained unapologetic.
Speaking to media on Tuesday, he said Ms Credlin had "undue" influence on the government.
"I believe as chief of staff, regardless of whether she is a woman or man, she exercises undue influence on government policy to the detriment of many of the elected members of Parliament," he said.
Mr Palmer said he was not aware of Ms Credlin's personal struggles, a reference to her public statements on undergoing IVF treatment.
He made the comments because they concerned policy.
"I think policies should be formulated from the party room," he said.
Mr Palmer dismissed the reaction over his comments as a "beat up", telling Fairfax Radio that it was part of the Abbott Government's attempts to "attack my credibility".
He has also taken his message to Twitter.
It is not the first time Mr Palmer has been criticised for his comments regarding female politicians and staffers.
The mining millionaire was awarded the Silver Industrial Ernie, an annual award for sexist remarks, in 2010 after telling then-pregnant federal Housing Minister Tanya Plibersek "you shouldn't get too excited in your fragile condition".
