But the Lebanese Muslim Association (LMA), which runs the Lakemba Mosque in the city's south-west, said it would give Sheik Hilaly the benefit of the doubt until it had reviewed his address.
The mufti triggered outrage from politicians and moderate Muslims after comparing women who wear revealing clothes to "uncovered meat".
LMA president Tom Zreika said he was "flabbergasted" on reading the cleric's comments.
"In order to afford him natural justice principles, we said he's got the benefit of the doubt until we have reviewed the comments on the tape as well as on the translated transcripts," he told reporters outside Lakemba Mosque.
"We would like to assure the wider public, which we are part of, that those comments were hurtful, misguided and were taken out of context."
Sheik Hilaly has today apologised for any offence caused by his comments.