The federal government had agreed to hold a referendum before the 2013 election, but it is likely to be delayed.
Mr Rudd says constitutional recognition must happen now and has urged his federal colleagues to make headway.
"The challenge now lies in how to get it done," he told an audience at NAIDOC week celebrations in Brisbane.
"Constitutional recognition is too important to degenerate into a political bunfight." In January, an expert panel recommended indigenous Australians should be recognised in the body of the constitution.