[clo-devel] upgrading: how do you (want to) use cl.net? [detected: very large home directories]
As part of the upgrading process, I'm looking at the disk sizes, memory, etc to set up for new-cl.net.
One of the things I found is that 30 or 40 user accounts together occupy the nearly the full size allocated to /home (14gb out of 15gb allocated). Which raises the question: what do people do with their /home dirs and is /home really the best way to do that (or the best place to store it)?
At the same time, I'm wondering if you have possibly valid use-cases for common-lisp.net which you might have tried in the past, but did not succeed at, because cl.net wasn't sufficiently set up. As I'm now determining dimensions, it'd be a good time to take requests into account.
Bye,
Erik.
Hello.
Here are the ideas about cl.net I have now.
Maybe it's reasonable to store git/hg repositories at external services as github and bitbucket, and free the common-lisp.net admin resources?
Another idea is that it might be good to have a place where Common Lisp demo code might be run. The same way as we have public_html now, user might be able to have for example public_lisp_app where you can place demo version of your lisp application.
This is just an idea for discussion, I am not sure it's really necessary to do.
I am not sure, how strict sandboxing would be required for lisp code deployed by common-lisp.net users. Should it be run in a single hunchentoot instance shared by all the apps, or maybe a separate lisp processes on behalf of corresponding linux user, or something else.
Providing the lisp "hosting" is more difficult probably than other things already p rovided by common-lisp.net, but ability to run lisp code will really be unique service at the moment (in contrast to the source code repos).
On the other hand, if someone wants to host a free application, he might put some efforts into finishing ABCL support form Google App Engine, and host his application there.
Best regards, - Anton
31.03.2011, 01:05, "Erik Huelsmann" ehuels@gmail.com:
As part of the upgrading process, I'm looking at the disk sizes, memory, etc to set up for new-cl.net.
One of the things I found is that 30 or 40 user accounts together occupy the nearly the full size allocated to /home (14gb out of 15gb allocated). Which raises the question: what do people do with their /home dirs and is /home really the best way to do that (or the best place to store it)?
At the same time, I'm wondering if you have possibly valid use-cases for common-lisp.net which you might have tried in the past, but did not succeed at, because cl.net wasn't sufficiently set up. As I'm now determining dimensions, it'd be a good time to take requests into account.
Bye,
Erik.
clo-devel mailing list clo-devel@common-lisp.net http://common-lisp.net/cgi-bin/mailman/listinfo/clo-devel
On Thu, 31 Mar 2011, Anton Vodonosov wrote:
Maybe it's reasonable to store git/hg repositories at external services as github and bitbucket, and free the common-lisp.net admin resources?
While I like hosting projects on sites like gitorious or github, cl.net seems like it could be "the place" for CL code. There are benefits both ways; and with git, its fairly easy to have mirrors.
I've heard a lot of good things about gitolite. Some people are using it at work, and I am setting it up on another server this week.
https://github.com/sitaramc/gitolite
Later, Daniel
On Wed, 30 Mar 2011, Erik Huelsmann wrote:
One of the things I found is that 30 or 40 user accounts together occupy the nearly the full size allocated to /home (14gb out of 15gb allocated). Which raises the question: what do people do with their /home dirs and is /home really the best way to do that (or the best place to store it)?
I think I bumped into a couple of these. People were hosting entire projects out of their home directory, apparently because they had trouble setting up a project. Automated project creation and management would help.
On the new features list, somewhere we need to set up a public build farm, where people can get easy access to a variety of lisp implementations and platforms...
- Daniel
P.S. Perhaps the most active project on the site, Slime, relies on CVS last I checked...
Hi Daniel,
On Thu, Mar 31, 2011 at 2:43 AM, Daniel Herring dherring@tentpost.com wrote:
On Wed, 30 Mar 2011, Erik Huelsmann wrote:
One of the things I found is that 30 or 40 user accounts together occupy the nearly the full size allocated to /home (14gb out of 15gb allocated). Which raises the question: what do people do with their /home dirs and is /home really the best way to do that (or the best place to store it)?
I think I bumped into a couple of these. People were hosting entire projects out of their home directory, apparently because they had trouble setting up a project. Automated project creation and management would help.
Ok. That's probably not too practical indeed. I've contacted some of the biggest users. Cleaning out some of the old cruft from their home directories made /home go down to a usage of 60%. With that percentage, I know our scaling doesn't need adapting. I'm considering how to deal with the situation for the future. On one hand I think installing a quota of 200MB on the /home directory of each user separately sounds sane and not too restrictive. Otoh, maybe with some monitoring, we can resolve the situation in a less strict way: after all, there's the request at sign-up to use the resources of cl.net sparingly (and exclusively at the service of Common Lisp and its community).
On the new features list, somewhere we need to set up a public build farm, where people can get easy access to a variety of lisp implementations and platforms...
While I think this is a great idea, I'm not sure cl.net is the place for that. The combined services running on the machine are claiming quite a bit of processing power and these build farms can really impact the responsiveness of other services. I don't think we want that for our other services.
P.S. Perhaps the most active project on the site, Slime, relies on CVS last I checked...
Ok. Well, then I guess we'll have to keep running anonymous CVS access through cvsd (pserver).
Bye,
Erik.
"Erik" == Erik Huelsmann ehuels@gmail.com writes:
Erik> Ok. That's probably not too practical indeed. I've contacted Erik> some of the biggest users. Cleaning out some of the old Erik> cruft from their home directories made /home go down to a Erik> usage of 60%. With that percentage, I know our scaling Erik> doesn't need adapting. I'm considering how to deal with the Erik> situation for the future. On one hand I think installing a Erik> quota of 200MB on the /home directory of each user Erik> separately sounds sane and not too restrictive. Otoh, maybe Erik> with some monitoring, we can resolve the situation in a less Erik> strict way: after all, there's the request at sign-up to use Erik> the resources of cl.net
As one of the offenders (who has corrected his ways!), perhaps a gentle email reminder sent out one a month or so for people who have exceeded some soft quota would be sufficient?
I know a main reason for my excessive usage was that I forgot that I had left some experimental tarballs and such around. They were supposed to be temporary for someone to try them out for me. I just plain forgot about them, so an email reminder would have let me know.
Ray
Hi Raymond,
On Sun, Apr 3, 2011 at 10:18 PM, Raymond Toy toy.raymond@gmail.com wrote:
"Erik" == Erik Huelsmann ehuels@gmail.com writes:
Erik> Ok. That's probably not too practical indeed. I've contacted Erik> some of the biggest users. Cleaning out some of the old Erik> cruft from their home directories made /home go down to a Erik> usage of 60%. With that percentage, I know our scaling Erik> doesn't need adapting. I'm considering how to deal with the Erik> situation for the future. On one hand I think installing a Erik> quota of 200MB on the /home directory of each user Erik> separately sounds sane and not too restrictive. Otoh, maybe Erik> with some monitoring, we can resolve the situation in a less Erik> strict way: after all, there's the request at sign-up to use Erik> the resources of cl.net
As one of the offenders (who has corrected his ways!), perhaps a gentle email reminder sent out one a month or so for people who have exceeded some soft quota would be sufficient?
I know a main reason for my excessive usage was that I forgot that I had left some experimental tarballs and such around. They were supposed to be temporary for someone to try them out for me. I just plain forgot about them, so an email reminder would have let me know.
In all honesty: I was one too :-) I didn't even know my /home had grown that big, so, I guess you have a point. Automating such a mail shouldn't be too difficult either. Let's go with that solution and see where we end up.
Regards,
Erik.
-
Anton Vodonosov -
Daniel Herring -
Erik Huelsmann -
Raymond Toy