Former West Australian Rural Woman of the Year Catherine Marriott spoke with the ABC on Tuesday night about her allegations against the Nationals MP.
"I have an absolute clear recollection of everything from that day. I know the person very well. It is defamatory and I will leave it at that," Mr Joyce told the Nine Network on Wednesday.
Ms Marriott made the complaint confidentially in February, with the allegations leaked that month.
The complaint contributed to Mr Joyce's resignation as deputy prime minister and as party leader, though he has vehemently denied the allegations.
Ms Marriott says she first avoided contacting police about the incident, which was some time earlier, as she believed it would descend into a case of "me versus him" and didn't want the matter on the public record.
"I ran away from it all and compartmentalised it and said 'I cannot deal with that'," she told ABC TV on Tuesday.
But she says she changed her mind, in part because a friend asked her whether she would live with herself in five years time if similar incidents were occurring.
"The answer to that was unequivocally no," she said.
"I wasn't brought up to run away from things that frighten you, although it took me time to get courage."
She said she had wanted the complaint to remain completely confidential but it was leaked by the National Party.
The impact of the ensuing public discussion was "monumental", she said.
Businesswoman and farmer Catherine Marriott. Source: ABC 730
"That is one of the most frightening things that you will ever have to live through," she said.
"When you finally ... find the courage within yourself to stand up for what you believe in, and then all control is taken away."
An investigation into the allegations against Mr Joyce by the NSW branch of the National Party was unable to make a finding due to "insufficient evidence", the branch said earlier this month.
Ms Marriott said she was disappointed by the result but not angry, having been angry for so long.
She said she chose to work with the party to change their processes despite her name being leaked to make the system better.
"How else am I going to get change?" she said.
"To their credit, they've taken it on. They've not only changed their policies and procedures for harassment and discrimination, but they've also - they're going to roll it out across all national parties in Australia."
