"Our tour guide told us this is where one of the scenes of Harry Potter was filmed," one tourist told SBS News, as they wandered through the Quad.
While Sydney University bears a resemblance to Durham Cathedral in the United Kingdom - where the Hogwarts scenes were actually shot - no parts of the film were shot in Australia.
Consumer law expert Sarah Butler says such advertising could fall foul of the law.
"If a tour company is offering tours of the University of Sydney and it's promoting those tours by saying that Harry Potter was filmed at the University of Sydney when that is not in fact the case, that would likely fall in breach of Australian consumer law."
When SBS contacted one of the tour operators about the misleading advertising they said they needed to consult internally and that they would rectify any mistakes.
But that has not stopped tourists. Even the university has noticed an uptick in foot traffic through the Camperdown campus as Potter fans try and grab a glimpse of witches and wizards.
Dr Jamie Fraser is the senior curator of the Nicholson Museum, which sits inside the Quadrangle building, and said he had noticed a significant rise in tourists from predominately Chinese groups visiting the University.
"There's been an astonishing increase in visitors throughout the university campus, in two years in February we've had more than a 4000 people increase since 2017 to 2019," he said.
"One reason for that is the neo-Gothic architecture of our main quadrangle and people come to the front desk of our museum and ask us can you please show us where Harry Potter was filmed."
Another Chinese tourist visiting the Quadrangle told SBS News the university building was "very famous" for its apparent part in the Potter-verse.
"This place filmed or I think it filmed Harry Potter, it's very famous and I've seen looks of my classmates who have come here to take photos that are so beautiful so that's why I really wanted to come here," she said.
SBS approached the tour guide taking the group around the university for comment but she declined to speak.