# Suzega Website - robots.txt # https://suzega.com # Allow all crawlers User-agent: * Allow: / # Sitemap location Sitemap: https://suzega.com/sitemap.xml # Open jobs. Served by the careers app, which keeps it current from the job # board — Google for Jobs reads the JobPosting markup on each posting page. Sitemap: https://suzega.com/careers/sitemap.xml # LLMs.txt for AI crawlers (proposed standard) # See: https://llmstxt.org/ # AI assistants and LLMs can find structured content at: # https://suzega.com/llms.txt (summary) # https://suzega.com/llms-full.txt (detailed) # AI-specific crawlers User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: Google-Extended Allow: / User-agent: anthropic-ai Allow: / User-agent: ClaudeBot Allow: / User-agent: CCBot Allow: / User-agent: PerplexityBot Allow: / # Crawl-delay for bots (optional, 1 second between requests) User-agent: * Crawl-delay: 1