# Content Signals (https://contentsignals.org/): AI use of this content is # welcome. Search indexing, AI answers, and model training all serve our # goal of being found and cited by AI assistants. # # The one exception is the AI Dojo Training Terms at /terms_and_conditions/, # which stay out of search results, AI answers and training data. Every # crawler is disallowed from it here, and the page itself carries noindex. User-agent: * Allow: / Disallow: /search Disallow: /terms_and_conditions/ Content-Signal: search=yes, ai-input=yes, ai-train=yes # Google and Bing may fetch the terms page, but only so they read its noindex # tag: a Disallow would hide the tag from them, and they can still list a # blocked URL they find linked from the AI Dojo. A crawler follows only the # most specific group naming it, so this group repeats the rules above. User-agent: Googlebot User-agent: bingbot Allow: / Disallow: /search Content-Signal: search=yes, ai-input=yes, ai-train=yes Sitemap: https://gtkcyber.com/sitemap-index.xml