Mr Hunt said people were still coming back from overseas, which is why Australia has mandatory quarantining.
"So we can't pledge whilst there is an international situation that there will be zero cases in Australia," he told Sky News on Sunday.
"But we can fight to find every case."
He said that was why the testing and the tracing regime was so important and why more people needed to download the COVIDSafe app, while the health system now had 100 million masks and 7500 ventilators to help it cope with cases
"We now have the capacity to meet all of the foreseeable scenarios in Australia," he said.
States and territories have started easing COVID-19 restrictions after a three-stage plan was agreed by the national cabinet on Friday, with the aim of full implementation by July.
It is up to the state and territories when they implement each stage.
Labor frontbencher Tony Burke said the virus situation was at a different level in different parts of the country.
"It makes complete sense that different states are then going to respond at a different pace depending on where the virus is in their own region," he told ABC television's Insider program.
Even so, Mr Hunt warned people must still show caution when they go about their day-to-day activities.
"The discipline we've shown is the discipline we must maintain," Mr Hunt said.
"As we move back to work some things cannot change, which is safety of distance, the importance of hygiene and the ability to focus on the fact that if we are ill we shouldn't be near people."
Some jurisdictions have been quick to move on stage one of the roadmap out of the crisis, but NSW is also set to allow cafes and restaurants to re-open for up to 10 patrons from next Friday among a series of restrictions being lifted.
Victoria is due it announce its changes on Monday.
South Australia will start opening up regional travel and allow caravan and camping, which Premier Steven Marshall believes will be a first for the nation.
"We have only got one shot to get this right," he told Sky News.
"We want to get people back to work. We want to get them back to work as quickly but as safely as possible."
Deputy chief medial officer Paul Kelly has warned people to take care when visiting their mums on this Mother's Day, particularly if they are elderly.
Some states are allowing families to visit their mums on Sunday.
"If you are feeling sick yourself, do not go and visit your mum. Please don't." Professor Kelly has said.
"If you are feeling well and you really want to see your mum, I'm sure it is fine. But for elderly mums just be a little bit cautious and probably keep that 1.5 metre distance for now. I know it is hard and we all want to cuddle our mums on Mother's Day."
People in Australia must stay at least 1.5 metres away from others.
Check your state’s restrictions on gathering limits. Testing for coronavirus is now widely available across Australia.
If you are experiencing cold or flu symptoms, arrange a test by calling your doctor or contact the Coronavirus Health Information Hotline on 1800 020 080.
The federal government's coronavirus tracing app COVIDSafe is available for download from your phone's app store. SBS is committed to informing Australia’s diverse communities about the latest COVID-19 developments.
News and information is available in 63 languages at sbs.com.au/coronavirus