Victorian Premier Daniel Andrews wants Mr Somyurek booted from the Australian Labor Party and has also referred him to Victoria's anti-corruption watchdog and police.
Mr Albanese on Monday night said Mr Somyurek was someone he had barely met. He also said the Labor party had zero tolerance for branch stacking.
"Events like this do undermine faith in politics, which is why it's important it be dealt with," he told the ABC.
"He was not seeking political power to change society. He was seeking political power for it's own sake. That's why the Labor party is a better party without his involvement."
Nine's 60 Minutes and The Age report alleges Mr Somyurek boasted of having influence over federal Labor MPs from Victoria.
But Mr Albanese said Mr Somyurek, who was also a member of the ALP national executive, has no influence on any members of the federal Labor caucus.
Branch stacking involves recruiting or signing up members for a local branch of a political party to influence the outcome of candidate preselections for parliament.
It is against Labor rules to pay for other people's memberships.
Party members are required to sign a form declaring they have paid for their own memberships.
Footage shows Mr Somyurek withdrawing $2000 in cash from an ATM on April 13, before handing it and dozens of party membership forms to an adviser working for fellow Labor minister Marlene Kairouz.
The adviser then delivers the forms and cash to ALP head office.
A similar cash drop-off reportedly occurred earlier in the year.
Labor's national executive said Mr Somyurek's behaviour was reprehensible.