# Department for Consitutional Affairs robots.txt file # Updated: 11 Feb 2009 # added the line to disallow all robots # because the site is not being updated and # much of the content will soon be removed # users will be referred to the National Archives webarchive # from 1 April 2009 User-agent: * Disallow: / Disallow: /cgi-bin/ Disallow: /css/ Disallow: /test/ Disallow: /wg/ Disallow: /atest/