User-agent: * # modules Disallow: /@/ Disallow: /x/ Disallow: /fwx/ Disallow: /admin/ Disallow: /cart/ Disallow: /quote/ Disallow: /basket/ Disallow: /client/ Disallow: /members/ Disallow: /my/ Disallow: /do/ Disallow: /login/ Disallow: /signin/ # actions Disallow: /share/ Disallow: */share/$ Disallow: /bookmark/ Disallow: */bookmark/$ Disallow: /contact/ Disallow: */contact/$ Disallow: /favourite/ Disallow: */favourite/$ Disallow: /subscribe/ Disallow: */subscribe/$ Disallow: /book/ Disallow: */book/$ Disallow: /feeds/ Disallow: */feeds/$ # avoid duplicate homepage (all other instances are 301 redirected) Disallow: */index.asp$ Disallow: *.doc$ Disallow: *.tsv$ Disallow: *.csv$ Disallow: *.xls$ Disallow: *.xsl$ Disallow: *.rss$ Disallow: *.atom$ Disallow: *.json$ Disallow: *.asp$