# CalculatorHub Robots.txt # Allows all crawlers and points to sitemap User-agent: * Allow: / # Sitemap location Sitemap: https://calculatorhub.example.com/sitemap-index.xml # Disallow admin/private areas (if any) Disallow: /node_modules/ Disallow: /src/ Disallow: /scripts/ Disallow: /*.json$ Disallow: /*.ts$ Disallow: /*.md$ # Crawl-delay for polite crawling Crawl-delay: 10 # Host directive Host: https://calculatorhub.example.com