# ============================================================================== # Robots.txt for Fitness Goal 4U (https://fitnesstools.ai.studio) # Evidence-Based Health, Nutrition, Cardio & Strength Calculators # ============================================================================== # 1. Global Crawler Directives (Googlebot, Bingbot, Applebot, DuckDuckBot, etc.) User-agent: * Allow: / Allow: /api/og Allow: /api/og-image Allow: /favicon.svg Allow: /og-image.svg Allow: /icon-192.svg Allow: /icon-512.svg Allow: /manifest.json Allow: /sitemap.xml Allow: /sw.js # Disallow internal backend APIs and build artifacts Disallow: /api/ Disallow: /dist/ Disallow: /node_modules/ Disallow: /src/ Disallow: /@* # Disallow sensitive, internal, and utility paths Disallow: /admin Disallow: /admin/ Disallow: /auth/ Disallow: /login Disallow: /draft/ Disallow: /category/ Disallow: /categories/ # Disallow search query parameters and faceted filters to preserve crawl budget Disallow: /*?*q= Disallow: /*?*search= Disallow: /*?*filter= Disallow: /*?*sort= Disallow: /*?*page= Disallow: /*?*limit= # Disallow aggressive crawling of tracking parameter URLs Disallow: /*?*fbclid= Disallow: /*?*gclid= Disallow: /*?*utm_ Disallow: /*?*session= Disallow: /*?*ref= Disallow: /*?*source= # 2. Image and Media Crawlers User-agent: Googlebot-Image Allow: / Allow: /api/og Allow: /api/og-image Allow: /*.svg$ Allow: /*.png$ Allow: /*.jpg$ Allow: /*.jpeg$ Allow: /*.webp$ # 3. Social Media & Card Scrapers User-agent: Twitterbot Allow: / Allow: /api/og Allow: /api/og-image User-agent: facebookexternalhit Allow: / Allow: /api/og Allow: /api/og-image User-agent: LinkedInBot Allow: / Allow: /api/og Allow: /api/og-image User-agent: Pinterestbot Allow: / Allow: /api/og Allow: /api/og-image User-agent: Slackbot Allow: / Allow: /api/og Allow: /api/og-image User-agent: TelegramBot Allow: / Allow: /api/og Allow: /api/og-image User-agent: Applebot Allow: / Allow: /api/og Allow: /api/og-image # 4. Search Engine Sitemaps & Host Directives Host: https://fitnesstools.ai.studio Sitemap: https://fitnesstools.ai.studio/sitemap.xml