Generate a robots.txt with explicit per-bot rules for the major AI crawlers, plus Content-Signal directives.
Content-Signal — how may AI use your content?
Per-bot policy