In an interview with the Guardian, Caine said he had been "stunned" by the allegation made against Allen by Allen's adopted daughter Dylan Farrow. She has accused him of sexually assaulting her when she was a child, which Allen denies.
Caine said: "I am a patron of the NSPCC [National Society for the Prevention of Cruelty to Children] and have very strong views about pedophilia. I can't come to terms with [the allegation], because I loved Woody and had a wonderful time with him. I even introduced him to Mia [Farrow]. I don't regret working with him, which I did in complete innocence; but I wouldn't work with him again, no."
Variety has reached out to Allen for comment. He has previously pointed out that the allegation was investigated at the time of the alleged incident and that he was never charged.
"I never molested my daughter - as all investigations concluded a quarter of a century ago," Allen said in a statement in January. "When this claim was first made more than 25 years ago, it was thoroughly investigated by both the Child Sexual Abuse Clinic of the Yale-New Haven Hospital and New York State Child Welfare. They both did so for many months and independently concluded that no molestation had ever taken place."
Caine joins a growing number of actors who have appeared in Allen movies but who recently have distanced themselves from him, including Greta Gerwig, Mira Sorvino, Timothee Chalamet, Colin Firth and Rebecca Hall. Others have remained loyal to the director, including Alec Baldwin and Diane Keaton.