Hi Mark,

Last night a number of disruptions in cliki.net availability were reported, a happens regularly lately -- and definitely during the weekly backup.

So I checked the server this morning. The server had a load of 50 (>15 per cpu); 80% of that was going to Trac, however the access log trac.common-lisp.net_access.log was silent. Turns out all the traffic was on abcl.org. It was being spidered like crazy. Trac - or our server setup (or both) - really isn't up to that task, which is why there is only limited spidering allowed on trac.common-lisp.net. (Enough to spider "current" trunk of projects and their issues.)

To restrict spidering, I've changed the robots.txt file at /project/armedbear/public_html/robots.txt.

Could you please commit that robots.txt (or an even stricter one) to the repository that the site is being synced from?

Thanks!

Regards,

Erik.