# The Valley Desk welcomes search engines and AI assistants. # Public pages may be crawled, indexed, quoted and cited, including by AI search, # answer and model-training crawlers. Please link the page you cite. # Site guide for language-model tools: https://thevalleydesk.org/llms.txt User-agent: * Allow: / Disallow: /lab # The same rules, stated for named crawlers. User-agent: Googlebot User-agent: Bingbot User-agent: Applebot User-agent: DuckDuckBot User-agent: OAI-SearchBot User-agent: ChatGPT-User User-agent: GPTBot User-agent: Claude-SearchBot User-agent: Claude-User User-agent: ClaudeBot User-agent: PerplexityBot User-agent: Perplexity-User User-agent: Google-Extended User-agent: Applebot-Extended User-agent: CCBot User-agent: Amazonbot User-agent: meta-externalagent Allow: / Disallow: /lab Sitemap: https://thevalleydesk.org/sitemap.xml