12 Dec
2011
12 Dec
'11
8:39 a.m.
Hi, my paster.log is full of errors relating to a googlebot trying to access a library file. I noticed a robots.txt file in the static folder configured as such. User-agent: * Disallow: / I thought this would stop all bots accessing all files. Should this be configured differently? Thanks Shaun -- The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336.