Ilie Nastase says he will be considered the "bad boy" if he says anything more about Serena Williams.
Nastase, the captain of Romania's Fed Cup team, last week speculated about the skin colour of the baby the pregnant Williams is expecting.
When asked Tuesday about Williams' response, Nastase told The Associated Press: "Anything I say, I am the bad boy."
Nastase also questioned the legitimacy of writing about his initial comments ahead of the Fed Cup series against Britain.
"Why write a news story like this? Just to have a scandal? There are many more important things going on," Nastase said.
News that makes sense
Your trusted source for staying up-to-date with the world around you. Get free daily news updates and analysis, straight to your inbox.
Nastase earned the nickname "Nasty" for his on-court outbursts and gamesmanship in his playing heyday in the 1970s.
Despite this, he still managed to win two grand slam singles titles and more than 100 ATP titles and is a member of the International Tennis Hall of Fame.
On Monday, Williams wrote on Instagram that she was disappointed "to know we live in a society where people like Ilie Nastase can make such racist comments towards myself and (my) unborn child."
Williams is black. Her fiance, Reddit co-founder Alexis Ohanian, is white.
Williams also referred to Nastase's "sexist comments against my peers" - a reference to his verbal abuse directed at British player Johanna Konta, British captain Anne Keothavong and the chair umpire during Fed Cup matches over the weekend.
He was ejected from the contest and provisionally suspended by the International Tennis Federation.
Romania won the best-of-five series 3-2.
