Keller, who has also worked at VfB Stuttgart in the top division and coached Schalke from 2012-14, had agreed a contract until 2018.
"I have found excellent conditions at Union Berlin. The expectations of the club have been clearly stated to me and that was my wish as well," Keller said in a club statement.
Union Berlin are seventh in the second division and have no chance of promotion this season with five matches remaining.
News that makes sense
Your trusted source for staying up-to-date with the world around you. Get free daily news updates and analysis, straight to your inbox.
(Reporting by Karolos Grohmann. Editing by Patrick Johnston)
