# Robots.txt for MiladBazar E-commerce Site User-agent: * # E-commerce specific pages - no SEO value Disallow: /cart/ Disallow: /account/ Disallow: /profile/ Disallow: /checkout/ # Search and filter pages - prevent duplicate content Disallow: /search?* Disallow: /search/* Disallow: /collections/*?* Disallow: /*?sort_by* Disallow: /*?filter* Disallow: /*?page=* Disallow: /*?limit=* # API endpoints and dynamic content Disallow: /api/ # Development and staging content Disallow: /staging/ Disallow: /test/ Disallow: /_next/ Disallow: /_app/ # Language redirects (prevent duplicate indexing) Disallow: /en/account/ Disallow: /fa/account/ Disallow: /ar/account/ Disallow: /en/cart/ Disallow: /fa/cart/ Disallow: /ar/cart/ Disallow: /en/profile/ Disallow: /fa/profile/ Disallow: /ar/profile/ # Allow important pages explicitly Allow: / Allow: /collections/ Allow: /en/ Allow: /fa/ Allow: /ar/ # Subdomains blocking Disallow: https://checkout.miladbazar.com/* Disallow: https://stage.miladbazar.com/* # Sitemap location Sitemap: https://miladbazar.com/sitemap.xml