You absolutely must hold the private keys to your  before you're in a scenario where it's critical to have permissionless access to your wealth

Private keys give you optionality and flexibility for if shit hits the fan in your locale