User-agent: Baiduspider Disallow: /*?* Disallow: /admin/ Disallow: /user/ Disallow: /mobile/ Disallow: /myTerriorty/ Disallow: /wFei/ Disallow: /WEB-INF/ Disallow: /META-INF/ Disallow: /*.css$ Disallow: /*.js$ Disallow: /*.jpg$ Disallow: /*.png$ Disallow: /*.gif$ Disallow: /*.jsp$ Disallow: /*.do$ Disallow: /offerToSell/ Disallow: /offerToBuy/ User-agent: Googlebot Disallow: /*?* Disallow: /admin/ Disallow: /user/ Disallow: /mobile/ Disallow: /myTerriorty/ Disallow: /wFei/ Disallow: /WEB-INF/ Disallow: /META-INF/ Disallow: /*.css$ Disallow: /*.js$ Disallow: /*.jpg$ Disallow: /*.png$ Disallow: /*.gif$ Disallow: /*.jsp$ Disallow: /*.do$ Disallow: /offerToSell/ Disallow: /offerToBuy/ Crawl-delay: 10 User-agent: * Disallow: / Sitemap: https://www.afrindex.com/sitemap.xml