Sitemap: http://www.yingfasydney.com.au/Store/inventory-map.asp User-agent: * Disallow: /Store/data/ Disallow: /_private/ Disallow: /cgi-bin/ Disallow: /images/shopbot/ Disallow: /images/myshop/ Allow: /Store/data/images/ User-agent: Ezooms Disallow: / User-agent: Baiduspider Disallow: / User-agent: baiduspider Disallow: / User-agent: BaiDuSpider Disallow: / User-agent: Baidu Disallow: / User-agent: Yandex Disallow: / User-agent: Findlinks Disallow: / User-agent: TurnitinBot Disallow: / User-agent: Vagabondo Disallow: / User-agent: Exabot Disallow: / # ROBOTS.TXT NOTES: # ================= # values are case sensitive # terminate folders with / # sitemap URL should be absolute # http:// and https:// are distinct # reference URL: https://developers.google.com/webmasters/control-crawl-index/docs/robots_txt