### Pages with rec parameter - IAI Recommendation System User-agent: * Disallow: /*?rec=* Disallow: /*&rec=* Sitemap: https://sps24.eu/sitemap.xml.gz ### Automatically banned scanners and crawlers section ### User-agent: 008 Disallow: / user-agent: AhrefsBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: metajobbot Disallow: / User-agent: Exabot Disallow: / User-agent: Ezooms Disallow: / User-agent: fyberspider Disallow: / User-agent: dotbot Disallow: / User-agent: MojeekBot Disallow: / User-agent: BLEXBot Disallow: / User-agent: wotbox Disallow: / ### Section end ### User-agent: TwengaBot-Discover Disallow: / User-agent: TwengaBot/2.0 Disallow: / User-agent: TwengaBot Disallow: / User-agent: TwengaBot-2.0 Disallow: / User-agent: baiduspider Disallow: / User-agent: Yandex Disallow: / User-agent: AI2Bot User-agent: Ai2Bot-Dolma User-agent: Amazonbot User-agent: Brightbot 1.0 User-agent: Bytespider User-agent: Cotoyogi User-agent: Crawlspace User-agent: Diffbot User-agent: FacebookBot User-agent: Factset_spyderbot User-agent: img2dataset User-agent: MyCentralAIScraperBot User-agent: Scrapy User-agent: TikTokSpider User-agent: Timpibot User-agent: YandexAdditional User-agent: YandexAdditionalBot Disallow: / Crawl-delay: 10 User-agent: ClaudeBot User-agent: GPTBot User-agent: anthropic-ai User-agent: Meta-ExternalAgent User-agent: meta-externalagent Disallow: / Crawl-delay: 10 # robots.txt — SPS24.eu (MAX SAFE: SEO + AI) User-agent: * Allow: / # Technical / backend Disallow: /ajax/ Disallow: /edi/ # Checkout / konto / koszyk Disallow: /*/basketchange.html Disallow: /*/basketedit.html Disallow: /*/basket-onchange.html Disallow: /*/login.html Disallow: /*/loginedit.html Disallow: /*/loginonce.html Disallow: /*/client- Disallow: /*/order.html Disallow: /*/order- Disallow: /*/payments- Disallow: /*/rma- Disallow: /*/returns- Disallow: /*/return.html Disallow: /*/download-attachment.html Disallow: /*/rebate-code.html Disallow: /*/settings.html Disallow: /*/checkup.html Disallow: /*/affiliate-resources.html Disallow: /*/przelew.html Disallow: /*/products-bought.html Disallow: /*/products-requests.html # Internal search (włącz, jeśli istnieje) Disallow: /*search Disallow: /*?*search= Disallow: /*?*q= # Parametry (zostaw tylko te, które masz) Disallow: /*?*query_id= Disallow: /*&query_id= # Disallow: /*?*sort= # Disallow: /*?*filter= # Disallow: /*?*price= # Disallow: /*?*brand= # Disallow: /*?*page= # AI crawlers (explicit allow) User-agent: GPTBot Allow: / User-agent: PerplexityBot Allow: / User-agent: CCBot Allow: / User-agent: anthropic-ai Allow: / # Search crawlers (explicit allow; optional) User-agent: Googlebot Allow: / User-agent: Bingbot Allow: /