The NSW grazier who was on hunger strike for 52 days while up a tower on his property ignored a letter sent on behalf of Kevin Rudd during the protest.
Parliamentary secretary for water Mike Kelly had attempted to deliver a letter from Agriculture Minister Tony Burke to Peter Spencer after he began his strike up the tower.
Mr Kelly's office said the letter had been written on behalf of the prime minister.
News that makes sense
Your trusted source for staying up-to-date with the world around you. Get free daily news updates and analysis, straight to your inbox.
But it was returned unopened.
Doctor's advice ends strike
The 61-year-old farmer ended his hunger strike on Wednesday after receiving advice from his doctor urging him to do so.
After being lowered from the tower, he was sent to Cooma hospital where it's likely he'll stay for two weeks.
During the strike, Mr Spencer said he wanted a royal commission into NSW environmental laws that prevent him and other farmers from clearing their land of native vegetation for agricultural purposes.
When contacted by AAP for comment, Mr Spencer confirmed Mr Kelly had delivered the letter to the property after he began his hunger strike.
"Subsequent to that, telling Mr Kelly to go away, I heard it was only a letter from a junior person himself saying the matter was not something they want to deal with," Mr Spencer said.
"So I have no knowledge if it was (from) the prime minister or not. I'm sorry but I don't believe it was anything significant whatsoever in dealing with the application to the prime minister for a royal commission and payment of the farmers."
'Valid concerns'
Mr Spencer said it was up to the government to prove the letter came from Mr Rudd.
Meanwhile opposition agriculture spokesman John Cobb told AAP that Mr Spencer had some valid concerns but that federally there was not much that could be done.
"At this point in time it would seem that there is no legal avenue for Mr Spencer in the High Court, pretty much because it was a state issue rather than a federal issue," Mr Cobb said.
"I do think, as he is the senior Labor Party figure in Australia, Kevin Rudd could very much go to the NSW government and say come on, do the right thing from the people you stole from.
"But legislatively we cannot do a thing."

