A Victorian man who fractured a newborn's skull had declared: "You need to be rough with them when they're little so they don't grow up to be sooks."
The severe shaking he gave the four-week-old girl also broke her ribs and caused brain haemorrhages, leaving her at risk of seizures for the rest of her life.
Darren Weston was sentenced to two years jail in 2015, but that term was doubled on Monday after a successful challenge by the state's public prosecutor.
Weston, aged in his 30s, shook his partner's baby and applied force to her head when he was left alone with her for a few hours.
She went limp and became floppy the next day, and had a seizure soon after arriving at hospital.
Relatives had previously warned Weston to be careful with the girl, after he was seen shaking her, throwing her at people and holding her by one leg.
"You need to be rough with them when they're little so they don't grow up to be sooks," Weston said, when the girl was just one week old.
Weston initially told police the baby's older sister had dropped the infant, and encouraged the three-year-old and the girls' mother to stick to the story.
It was disgraceful behaviour, the Court of Appeal said.
"That he tried to enlist a three-year-old as an unwitting participant in the lie defies credulity," its judgment said.
Weston eventually pleaded guilty to negligently causing serious injury and recklessly causing injury.
The second charge related to him forcefully slapping the cheek of the baby's sister.
Weston's original sentence had a non-parole period of 15 months.
The new four-year term includes a 2.5 year non-parole period.
