It follows the decision last week of his Brazilian Republican Party (PRB) to break from President Dilma Rousseff's ruling coalition.
Hilton is to be replaced on an interim basis by Ricardo Leyser, the presidency said in a statement on Wednesday.
Leyser is a senior official in the sports ministry who has been managing Olympic preparations.
