Issue with 2 hubs

Hello,

I have an Apple TV and a HomePod. They seem to fight over the right to be the hub.

I had my Apple TV first, it has always been my "main hub". I added a HomePod to my home in the beginning of this year. However, since about a month or so, they seem to battle over the right to be the hub.

According to the iPhone/homekit view, one hub is connected, the other can't connect (however I can interact with both of them via my phone).

Whenever the HomePod "wins", all accessories become unavailable (think: hue lights etc). Only solution then is to reboot my Apple TV. After that, the HomePod shows as "unavailable", but at least everything works in my home.

How can I solve this?