User-agent: * ##### Transactional and Content Disallow: /on/demandware.store/* Disallow: *Login-* Disallow: *Register-* Disallow: *Wishlist-* Disallow: *Cart-* Disallow: *Checkout-* Disallow: *Account-* Disallow: *Order-* Disallow: /account Disallow: /cart Disallow: /checkout Disallow: /wishlist Disallow: /write-review Disallow: /auction/*/* Disallow: /thankyou?ID=* Disallow: /product-recalls Disallow: /*null* Disallow: /*/passwordreset/ Disallow: /*/account/ Disallow: /*/orders/ Disallow: /*/profile/ ##### Search and Query Params Allow: /*?dwvar Allow: /*utm_medium=merchant Disallow: /*pmin* Disallow: /*pmax* Disallow: /*srule=* Disallow: /*?q=* Disallow: /*prefv*=* Disallow: /*prefn*=* Disallow: /*?attributes* Disallow: /*?order_by=* ##### Slow crawling rate for some agents User-agent: msnbot Crawl-delay: 30 User-agent: bingbot Crawl-delay: 30 user-agent: Pinterestbot Crawl-delay: 1 user-agent: FacebookBot Crawl-delay: 5 ##### Disallow aggressive agents User-agent: MJ12bot Disallow: / User-Agent: trendictionbot Disallow: / user-agent: MegaIndex.ru Disallow: / User-agent: dotbot Disallow: / user-agent: 360Spider Disallow: / user-agent: HaosouSpider Disallow: / User-Agent: Baiduspider Disallow: / User-Agent: Slurp Disallow: / User-agent: YandexBot Disallow: / User-Agent: SEMrushBot Disallow: / User-Agent: PetalBot Disallow: / User-Agent: UptimeRobot Disallow: / User-Agent: ContentKing Disallow: / ##### Sitemaps Sitemap: https://www.vidaxl.de/sitemap_index.xml