Hi Mark,
Last night a number of disruptions in
cliki.net availability were reported, a happens regularly lately -- and definitely during the weekly backup.
So I checked the server this morning. The server had a load of 50 (>15 per cpu); 80% of that was going to Trac, however the access log trac.common-lisp.net_access.log was silent. Turns out all the traffic was on
abcl.org. It was being spidered like crazy. Trac - or our server setup (or both) - really isn't up to that task, which is why there is only limited spidering allowed on
trac.common-lisp.net. (Enough to spider "current" trunk of projects and their issues.)
To restrict spidering, I've changed the robots.txt file at /project/armedbear/public_html/robots.txt.
Could you please commit that robots.txt (or an even stricter one) to the repository that the site is being synced from?
Thanks!
Regards,
Erik.