# ───────────────────────────────────────────────────────── # robots.txt — مجتمع آموزشی نورهدی (Noorhoda Educational Complex) # https://noorhoda.org # ───────────────────────────────────────────────────────── # ── General rules for all crawlers ─────────────────────── User-agent: * Allow: / Allow: /staff Allow: /blog Allow: /gallery Allow: /radio Disallow: /auth Disallow: /auth/ Disallow: /admin Disallow: /admin/ Disallow: /mediamanagement Disallow: /mediamanagement/ Disallow: /dashboard Disallow: /user/ Disallow: /api/ Disallow: /blog/comments Disallow: /blog/views Disallow: /stories/views Disallow: /build/ Disallow: /vendor/ Disallow: /storage/logs/ Disallow: /telescope Disallow: /telescope/ # ── Sitemap ───────────────────────────────────────────── Sitemap: https://noorhoda.org/sitemap.xml # ── AI Assistant Crawlers ─────────────────────────────── # Allow AI crawlers to index public content for AEO User-agent: GPTBot Allow: / Allow: /staff Allow: /blog Allow: /gallery Allow: /radio Disallow: /auth Disallow: /admin Disallow: /mediamanagement Disallow: /api/ Disallow: /telescope User-agent: ChatGPT-User Allow: / Allow: /staff Allow: /blog Allow: /gallery Allow: /radio Disallow: /auth Disallow: /admin Disallow: /mediamanagement Disallow: /api/ Disallow: /telescope User-agent: Google-Extended Allow: / Allow: /staff Allow: /blog Allow: /gallery Allow: /radio Disallow: /auth Disallow: /admin Disallow: /mediamanagement Disallow: /api/ Disallow: /telescope User-agent: CCBot Allow: / Allow: /staff Allow: /blog Allow: /gallery Allow: /radio Disallow: /auth Disallow: /admin Disallow: /mediamanagement Disallow: /api/ Disallow: /telescope User-agent: PerplexityBot Allow: / Allow: /staff Allow: /blog Allow: /gallery Allow: /radio Disallow: /auth Disallow: /admin Disallow: /mediamanagement Disallow: /api/ Disallow: /telescope User-agent: ClaudeBot Allow: / Allow: /staff Allow: /blog Allow: /gallery Allow: /radio Disallow: /auth Disallow: /admin Disallow: /mediamanagement Disallow: /api/ Disallow: /telescope User-agent: Bytespider Allow: / Allow: /staff Allow: /blog Allow: /gallery Allow: /radio Disallow: /auth Disallow: /admin Disallow: /mediamanagement Disallow: /api/ Disallow: /telescope