# BaoHost - robots.txt # https://baohost.com # Allow all crawlers full access User-agent: * Allow: / # Disallow admin and API routes Disallow: /admin/ Disallow: /api/ # Sitemap location Sitemap: https://baohost.com/sitemap-index.xml # Crawl-delay for polite crawling (optional, not all bots respect this) # Crawl-delay: 1 # Google-specific User-agent: Googlebot Allow: / # Bing-specific User-agent: Bingbot Allow: / # Host directive (helps with canonicalization) Host: https://baohost.com