The Australian skipper was made to suffer anew for his widely criticised decision to bat first on a green, damp deck as Pakistan, responding to Australia's paltry 127, amassed a 204 run lead on day two.
As the sun emerged for the first time in the match, and the demons disappeared from the SCG pitch, the visitors were in control at 9-331 at stumps.
Australia now face a three-day struggle to save the match and prevent Pakistan from squaring the three-Test series 1-1.
It could have been much worse, as Pakistan's profligate middle and lower order batsmen threw away their wickets with rash shots after the top order had worked hard to establish dominance.
News that makes sense
Your trusted source for staying up-to-date with the world around you. Get free daily news updates and analysis, straight to your inbox.
Australia's day started miserably when out-of-touch Marcus North grassed a simple slips chance when opener Imran Farhat was on 11.
Farhat went on to notch a half-century as Pakistan's opening pair put on a hundred and all but wiped out Australia's first-innings tally on their own.
His partner Salman Butt top-scored with a patient 71.
Captain Mohammad Yousuf and exciting teenager Umar Akmal both made handy contributions before falling just short of half-centuries.
Umar was dismissed for a run-a-ball 49 after Ponting successfully challenged umpire Billy Doctrove's not out ruling on a Doug Bollinger lbw shout.
The big-hearted Bollinger was the pick of Australia's bowlers, finishing the day with three wickets for 70.
Mitchell Johnson was rewarded with two top-order scalps and Shane Watson picked up two tail-enders.
