Copilot for Mac - random authentications

Every so often, Copilot (for Mac) asks for authentication (require Touch ID in settings is ON) even if the app is not running or open. Anyone else have similar behavior?

I've recently wiped my Mac clean and started fresh, same behavior. The developers say they can't reproduce..

Any ideas?