September 2005 - tbnl-devel@common-lisp.net

[tbnl-devel] tbnl freeze
by Steve Huffman 30 Apr '06

30 Apr '06

Hi all, I'm working on reddit.com, which uses TBNL as its web framework. For the most part, all is well, but I've been running into an error lately that is causing me to worry. Basically, the symptom of the problem is that our website appears to pause, and all requests just hang (eventually they'll timeout on the browser side). I work against our server using remote SLIME. The SLIME session does not hang, but in order to bring the website back to life I log into our web server, use attachtty to view the running lisp process, and hit ctrl + c a few times, after which a debugger will pop open in Emacs that I can abort. I'm running CMUCL 19a on a FreeBSD box. I use apache and mod_lisp in front of TBNL. I haven't been able to find out what causes this lockup, nor do I understand why I must open the process on the web server (when I'm already cruising in SLIME) to wake it up. Has anyone seen any issues like this before? Or perhaps know if this is even a TBNL issue? I've pasted the output I see from the lisp process (via attachtty) and in my emacs session (after I send an interrupt). Any help would be greatly appreciated, Steve Huffman In attachtty I'll see something like this: Interrupted at #x2811F14E. [Condition of type SIMPLE-CONDITION] Restarts: 0: [CONTINUE] Return from BREAK. 1: [DESTROY ] Destroy the process Debug (type H for help) (UNIX::SIGINT-HANDLER #<unused-arg> #<unused-arg> #.(SYSTEM:INT-SAP #x47FD789C)) Source: Error finding source: Error in function DEBUG::GET-FILE-TOP-LEVEL-FORM: Source file no longer exists: target:code/signal.lisp. 0] and in emacs I'll see something like this: Interrupted at #x2811F14E. [Condition of type SIMPLE-CONDITION] Restarts: 0: [CONTINUE] Return from BREAK. 1: [DESTROY] Destroy the process Backtrace: 0: (UNIX::SIGINT-HANDLER #<#1=unused-arg> #<#1#> #.(SYSTEM:INT-SAP #x47FD789C)) 1: (UNIX::SIGINT-HANDLER 3 #<#1=unused-arg> #<#1#> #.(SYSTEM:INT- SAP #x47FD789C))[:EXTERNAL] 2: ("Foreign function call land") 3: ("Foreign function call land") 4: ("Foreign function call land") 5: ("Foreign function call land") 6: ("Foreign function call land") 7: (LISP::FD-STREAM-READ-N-BYTES #<Stream for descriptor 8> "" 0 14 ...) 8: (LISP::FD-STREAM-READ-N-BYTES 5 #<Stream for descriptor 8> "" 0 ...)[:EXTERNAL] 9: (LISP::READ-INTO-SIMPLE-STRING "" #<Stream for descriptor 8> 0 14) 10: (READ-SEQUENCE "" #<Stream for descriptor 8> :START 0 ...) 11: ((METHOD INITIALIZE-INSTANCE (:AFTER) (TBNL::REQUEST)) (#(1 2 0 3 5 ...) . #()) #<#1=unused-arg> #<TBNL::REQUEST {49094BA5}> #<#1#>) 12: ((MAKE-INSTANCE TBNL::REQUEST :HEADERS-IN PCL::|.P0.|) (("content- stream" . #<Stream for descriptor 8>) ("content-length" . "14") ("content-type" . "application/x-www-form-urlencoded") ("remote-ip- addr" . "172.133.113.57") ("remote-ip-port" . "3332") ...)) 13: (TBNL::PROCESS-REQUEST (("content-stream" . #<Stream for descriptor 8>) ("content-length" . "14") ("content-type" . "application/x-www-form-urlencoded") ("remote-ip-addr" . "172.133.113.57") ("remote-ip-port" . "3332") ...)) 14: (TBNL::LISTEN-FOR-REQUEST #<Stream for descriptor 8> TBNL::PROCESS-REQUEST)

4 5

[tbnl-devel] Firefox
by Anthony F 10 Oct '05

10 Oct '05

Hi all, I recently started playing with LispWorks, Apache w/ mod_lisp2 and TBNL. I'm using the newest TBNL as well as the newest versions of all its dependencies. I'm using the free version of LispWorks and therefore have a heap size limit, and I'm using Windows XP Pro. The problem was that I after I got everything working I was randomly clicking on the test page link when LispWorks quickly died after a few simple clicks. It seemed to leak 3-4 megs per click! Upon further investigation it turns out this is a Firefox specific problem (haven't tested Opera yet :) ) and it doesn't happen in IE. Checking the Apache logs I get lots of these when browsing with Firefox: [Thu Sep 29 19:08:10 2005] [notice] [TBNL] No session for session identifier '1:158C42649C449770460538C62DC7A0EF' (User-Agent: 'Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.7.12) Gecko/20050915 Firefox/1.0.7', IP: '127.0.0.1') So obviously there is a session handling problem with Firefox? I'm guessing that it's starting a new session with each refresh, and hence the memory usage. I'll look into it further and try to get into some of the TBNL code, but I'm a rookie with Lisp so it might take me a while! Any help would be appreciated... Thanks! Anthony

3 8

[tbnl-devel] Multiple virtual host
by Nicolas Lamirault 29 Sep '05

29 Sep '05

hello, i use tbnl to manage some web site. i would like to know how can i do to have several web site ? i have this already : LispServer 127.0.0.1 3000 "tbnl" <Location /tbnl> SetHandler lisp-handler </Location> i would like to start a second web site someone know how can i do this ? <Location /foo> SetHandler lisp-handler </Location> -- Nicolas Lamirault

6 9

[tbnl-devel] New version 0.8.1
by Edi Weitz 28 Sep '05

28 Sep '05

ChangeLog: Version 0.8.1 2005-09-29 Bugfix in CMUCL version of STRING-TO-OCTETS Download: <http://weitz.de/files/tbnl.tar.gz> Cheers, Edi.

1 0

[tbnl-devel] REMOTE-ADDR without mod_lisp?
by Stefan Scholl 26 Sep '05

26 Sep '05

Hi! I need the address of the client but REMOTE-ADDR only works with mod_lisp. Is there an easy and portable way to access the address (via KMRCL) without mod_lisp? I'll look into it and maybe provide a patch. But if anybody has a clue where I can continue searching tomorrow that would be fine. Regards, Stefan

1 2

[tbnl-devel] Re: TBNL: URL-DECODE and UTF-8 parameters
by Edi Weitz 26 Sep '05

26 Sep '05

[Please use the mailing list - see Cc (and register first).] Hi Will! On Wed, 21 Sep 2005 23:52:41 -0700, Will <will(a)glozer.net> wrote: > CafeSpot came a problem in the URL-DECODE function of TBNL, it > doesn't decode UTF-8 encoded URLs correctly. I see there was a > thread on this in July, > http://common-lisp.net/pipermail/tbnl-devel/2005-July/000358.html, > but apparently no resolution. Enclosed is a new version of the > function, I'm a lisp newbie so it may not be ideal =) > > This particular function only works in Allegro, but it would work in > any lisp that has a function to convert a UTF-8 encoded octet array > to a string. I belive SBCL has a similar OCTETS-TO-STRING function, > I didn't see anything really obvious for LispWorks though. At the > moment I only have ACL. > > ---- > > (defun url-decode (string) > (let ((string-length (length string))) > (flet ((parse-hex-escape (start) > (if (<= (+ start 3) string-length) > (parse-integer string > :start (+ start 1) > :end (+ start 3) > :radix 16) > (error "invalid hex encoding in string '~A'" string)))) > (let ((vector (make-array string-length > :adjustable t > :element-type '(unsigned-byte 8) > :fill-pointer 0))) > (loop > for i below string-length > for char = (aref string i) > do (vector-push-extend > (case char > ((#\+) (char-code #\Space)) > ((#\%) (parse-hex-escape (prog1 i (incf i 2)))) > (otherwise (char-code char))) > vector)) > #+allegro (excl:octets-to-string vector :external-format > :utf-8))))) Thanks for that. I admit that the current version of URL-DECODE is not ideal but your version will break existing code. Note that browsers will use different URL encodings based on the charset of the HTML document they're responding to. For example, if the charset is ISO-8859-1 (which AFAIK is the default charset for Apache) the string "äöü" (that's umlaut a, umlaut o, umlaut u in case it doesn't make it through email) will be sent as %E4%F6%FC which the version of URL-DECODE above won't decode correctly - it'll expect %C3%A4%C3%B6%C3%BC instead. Unfortunately, the browsers don't tell you which charset they're using... :( The right way to do it would be to add a second optional argument for the charset to URL-DECODE and make the default value user-configurable on a per-request basis. Does that sound OK? I'll probably add something like this in the next days. Cheers, Edi. PS: For LispWorks use EXTERNAL-FORMAT:DECODE-EXTERNAL-STRING and EXTERNAL-FORMAT:ENCODE-LISP-STRING but see the recent discussion on the LW mailing list w.r.t. delivered applications: <http://thread.gmane.org/gmane.lisp.lispworks.general/4524>

2 15

[tbnl-devel] arbitrary per-request data?
by Zach Beane 17 Sep '05

17 Sep '05

I have an application that has a notion of a current user that is lazily established on a per-request basis. For now, I have been returning a handler that is really a lambda wrapping a real handler that lexically binds the special *current-user*: (defun page-handler (request) (multiple-value-bind (handler foundp) (gethash (script-name request) *handlers*) (when foundp (lambda () (let ((*current-user* *current-user-local-unbound-value*)) (funcall handler)))))) But it occurred to me that there is already the *request* structure. Would it make sense to be able to have a table of arbitrary keys and values in the request structure for application use? I was thinking of an accessor like this: request-data key &optional (request *request*) => value, foundp Then I could write CURRENT-USER something like: (defun current-user () (multiple-value-bind (value foundp) (request-data 'user) (if foundp value (setf (request-data 'user) (cookie-user))))) Right now it's a bit messier than that. What do you think? If this seems reasonable I can work out and submit a patch. Zach

3 5

Re: [tbnl-devel] socket problems
by Edi Weitz 10 Sep '05

10 Sep '05

[Please use the mailing list.] On Sat, 10 Sep 2005 14:50:32 -0400, Adam Thorsen <adam.thorsen(a)gmail.com> wrote: > I'm using cmucl on gentoo linux. I found that you are right, I have > to wait a few minutes -- just not sure if that is how it is supposed > to work. It is supposed to work this way, depending on how you open the socket - see the Google Groups link in my previous message. This doesn't happen for me with LispWorks, for example. If you don't want to have this behaviour with CMUCL you'll have to patch the code that opens the socket. I think it is in KMRCL somewhere. Cheers, Edi.

1 0

[tbnl-devel] socket problems
by Adam Thorsen 10 Sep '05

10 Sep '05

I am using tbnl with mod_lisp and apache. I've noticed that when I stop tbnl using (tbnl:stop-tbnl), then attempt to start it again, I get the following error: Error while trying to start listener on port 3000 Error in function CREATE-INET-LISTENER: Error binding socket to port 3000: No such file or directory Sometimes I can resolve this error by killing apache, but sometimes I have to reboot my machine. Any ideas? Thanks, -Adam

2 1

[tbnl-devel] New version 0.6.1
by Edi Weitz 09 Sep '05

09 Sep '05

ChangeLog: Version 0.6.1 2005-09-10 Robustified socket handling code Download: <http://weitz.de/files/tbnl.tar.gz> Cheers, Edi.

1 0