#********************************************** #robots.txt for http://www.cw-group.co.uk/ #created on 13th December 1999 by Peter Landon #updated on 13th December 1999 by Peter Landon #********************************************** #tells webcrawlwes/robots/spiders not to visit #any URL starting with these partial paths #********************************************** User-agent:* Disallow:/_fpclass Disallow:/_private Disallow:/_themes Disallow:/images Disallow:/Links Disallow:/Publications Disallow:/Articles Disallow/News Disallow/Tax Information