# All robots will spider the domain User-agent: * Disallow: /ajax/ Disallow: /BasketDisplay.aspx Disallow: /friend/ Disallow: *&referid=* Disallow: *&Referid=* Disallow: *&REFERID=* Disallow: *&ReferID=* Disallow: *&referID=* Disallow: /?referid= Disallow: /?Referid= Disallow: /?REFERID= Disallow: /?ReferID= Disallow: /?referID= Disallow: /en/ Disallow: /de/ Disallow: /es/ Disallow: /ja/ Disallow: /nl/ Disallow: /pt/ Disallow: /it/ Disallow: /ru/ Disallow: /zh/ Disallow: /basket/ Disallow: /mens/ Disallow: /ladies/ Disallow: /secure/ Disallow: *?ea=* Disallow: *&ea=* Disallow: *?s=* Disallow: *&s=* Disallow: *?sr=* Disallow: *&sr=* Disallow: *?ma=* Disallow: *&ma=* Disallow: *?mi=* Disallow: *&mi=* Disallow: *?oma=* Disallow: *&oma=* Disallow: *?omi=* Disallow: *&omi=* Disallow: *?layout=* Disallow: *&layout=* Disallow: *?ris=* Disallow: *&ris=* Disallow: *?o=* Disallow: *&o=* Disallow: *?ps=* Disallow: *&ps=* #Disallow Chinese crawlers from all sites except .cn User-agent: Baiduspider User-agent: Baiduspider-video User-agent: Baiduspider-image User-agent: LieBaoFast User-agent: Sogou web spider Disallow: / #Crawl delay list for all sites except .cn User-agent: AhrefsBot User-agent: Applebot User-agent: Qwantify User-agent: Dotbot User-agent: SemrushBot Crawl-delay: 10 #Disallow Russian crawlers from all sites except .ru User-agent: YandexBot Disallow: / # Sitemaps Index Sitemap: https://www.wiggle.fr/sitemaps/wiggle_fr_site_map_index.xml