# robots.txt: Specifies URLS "robots" should stay away from. # (see http://web.nexor.co.uk/mak/doc/robots/norobots.html) # Search engines: welcome! # # There are only a few things we ask of you: # * please abide by this list of exclusions # * please try to avoid the hours 8 am to 9 pm Chicago time Monday-Friday # * please don't index us ridiculously quickly, don't hog our bandwidth # ( a good T3 connection could really make our regular visitors suffer ) # * please send a quick note to Webadmin@ama-assn.org with the User Agent # name of your spider so we'll know what to watch for. # # Thanks! User-agent: Offline Explorer Disallow: / User-agent: amalocalindexer Disallow: /excite/ Disallow: /cgi-bin/ Disallow: /cgi-html/ Disallow: /images/ Disallow: /journals/ Disallow: /amnews/ Disallow: /md_recr/ Disallow: /pres_rel/ Disallow: /svrpush/ Disallow: /iwcf/ Disallow: /public/ads/ Disallow: /sci-pubs/ads/ Disallow: /ad-specs/ Disallow: /vapp/freida/ Disallow: /ama1/pub/upload/images Disallow: /ama1/priv/upload/images Disallow: /ama1/noindex/upload/images Disallow: /ama1/x-ama/upload/images Disallow: /ama1/x-arc/upload/images Disallow: /ama1/x-bot/upload/images Disallow: /ama1/x-dbl/upload/images Disallow: /ama1/assets/images Disallow: /ama1/house_ads Disallow: /ama1/images Disallow: /assets User-agent: * Disallow: /excite/ Disallow: /cgi-bin/ Disallow: /cgi-html/ Disallow: /images/ Disallow: /journals/ Disallow: /amnews/ Disallow: /md_recr/ Disallow: /pres_rel/ Disallow: /svrpush/ Disallow: /iwcf/ Disallow: /apps/ Disallow: /public/ads/ Disallow: /sci-pubs/ads/ Disallow: /ad-specs/ Disallow: /vapp/freida/ Disallow: /ama/noindex/ Disallow: /ama1/pub/upload/images Disallow: /ama1/priv/upload/images Disallow: /ama1/noindex/upload/images Disallow: /ama1/x-ama/upload/images Disallow: /ama1/x-arc/upload/images Disallow: /ama1/x-bot/upload/images Disallow: /ama1/x-dbl/upload/images Disallow: /ama1/assets/images Disallow: /ama1/house_ads Disallow: /ama1/images Disallow: /assets