Senior Liberals say voters "punished" the party for the way Malcolm Turnbull was knifed as prime minister.
The long-time Liberal seat of Wentworth now looks to be in the hands of independent Kerryn Phelps, although counting in Mr Turnbull's old seat continues.
"The fundamental driver of this vote was really the manner in which Malcolm left office," Mr Sharma told Network Ten on Saturday night.
"You heard that from every voter on the street."

Liberal candidate Dave Sharma arrives at the Liberal Party election function in Double Bay before conceding defeat. Source: AAP
Treasurer Josh Frydenberg said the party bore the brunt of the anger about how Mr Turnbull was pushed out of office.
"Obviously the party got punished by the people of Wentworth for the events of a couple of months ago," he told Network Ten.

The former PM Malcolm Turnbull. Source: AAP
The campaign was also derailed in the past two by a series of blunders in Canberra.
"There were significant headwinds from Canberra, I'm not going to diminish or discount them," Mr Sharma said.
"This time the headwinds were too strong."
But he said voters were mainly angry about Mr Turnbull.
"That wouldn't have changed if Canberra had run a tight ship for the last three weeks or not," he said.
Liberal MP Jason Falinski said Mr Turnbull's absence from the campaign hurt Mr Sharma.
"I don't think we can deny that if Malcolm had been more public in his support for Dave that that would have had an impact," he said.

Liberal MP Jason Falinski said voters were angry over Mr Turnbull's rolling. Source: AAP
But Mr Sharma said the former prime minister had been through a "bruising" experience and had offered the support he could.
Earlier this month, former Liberal leader John Hewson told SBS News he expected voters to teach the government a lesson in his old seat of Wentworth over climate change inaction.
"It's irresponsible, it's grossly irresponsible - we have politicians playing short-term political games for short-term political gains when they should be delivering a decisive climate action plan," he told SBS News.
"It's a national disgrace."
Prime Minister Scott Morrison promised the government would be back at work, and "great days" were ahead.