# Blocheaza crawler-ele Meta/Facebook (cauzau CPU 400%) User-agent: meta-externalagent Disallow: / User-agent: meta-externalads Disallow: / User-agent: facebookexternalhit Disallow: / # Limiteaza crawler-ele agresive User-agent: SeRankingBacklinksBot Disallow: / User-agent: AhrefsBot Disallow: / User-agent: SemrushBot Disallow: / User-agent: LinkupBot Disallow: / # Nu indexa URL-uri cu filtre WooCommerce (combinatii infinite) User-agent: * Disallow: /*?filter_ Disallow: /*?query_type_ Disallow: /*?orderby= Disallow: /*?add-to-cart= Disallow: /*?add_to_wishlist= Disallow: /wp-login.php Disallow: /wp-admin/ Disallow: /?s= Disallow: /search/ # Permite Googlebot si Bingbot (ai nevoie de SEO) User-agent: Googlebot Disallow: /*?filter_ Disallow: /*?query_type_ Disallow: /wp-login.php Disallow: /wp-admin/ User-agent: Bingbot Disallow: /*?filter_ Disallow: /*?query_type_ Disallow: /wp-login.php Disallow: /wp-admin/ Sitemap: https://clarfon.ro/sitemap.xml Sitemap: https://clarfon.ro/sitemap_index.xml