User-Agent: * Allow: / Disallow: /api/ User-Agent: GPTBot Allow: / User-Agent: ChatGPT-User Allow: / User-Agent: ClaudeBot Allow: / User-Agent: anthropic-ai Allow: / User-Agent: Bingbot Allow: / User-Agent: AhrefsBot Allow: / Crawl-delay: 10 User-Agent: SemrushBot Allow: / Crawl-delay: 10 Sitemap: https://mercatoitaliankitchen.com/sitemap.xml