Best way to disable crowdsec for specific domain?

I have Crowdsec setup with Caddy and I am considering being able to enable/disable it for particular hosts (similar to how you can disable WAF in Cloudflare). I have stumbled upon this: Allowlisting and Rule Overrides | CrowdSec but I suppose this would require to restart crowdsec (agent?)

Another option would be to split Caddy config into multiple sections and dynamically reload it with or without crowdsec, but I haven’t explored that further yet.

I was wondering, maybe you could share best practice of sort on how to achieve this?

Thanks for the great software, cheers!