November 2005 - tbnl-devel@common-lisp.net

[tbnl-devel] tbnl freeze
by Steve Huffman 30 Apr '06

30 Apr '06

Hi all, I'm working on reddit.com, which uses TBNL as its web framework. For the most part, all is well, but I've been running into an error lately that is causing me to worry. Basically, the symptom of the problem is that our website appears to pause, and all requests just hang (eventually they'll timeout on the browser side). I work against our server using remote SLIME. The SLIME session does not hang, but in order to bring the website back to life I log into our web server, use attachtty to view the running lisp process, and hit ctrl + c a few times, after which a debugger will pop open in Emacs that I can abort. I'm running CMUCL 19a on a FreeBSD box. I use apache and mod_lisp in front of TBNL. I haven't been able to find out what causes this lockup, nor do I understand why I must open the process on the web server (when I'm already cruising in SLIME) to wake it up. Has anyone seen any issues like this before? Or perhaps know if this is even a TBNL issue? I've pasted the output I see from the lisp process (via attachtty) and in my emacs session (after I send an interrupt). Any help would be greatly appreciated, Steve Huffman In attachtty I'll see something like this: Interrupted at #x2811F14E. [Condition of type SIMPLE-CONDITION] Restarts: 0: [CONTINUE] Return from BREAK. 1: [DESTROY ] Destroy the process Debug (type H for help) (UNIX::SIGINT-HANDLER #<unused-arg> #<unused-arg> #.(SYSTEM:INT-SAP #x47FD789C)) Source: Error finding source: Error in function DEBUG::GET-FILE-TOP-LEVEL-FORM: Source file no longer exists: target:code/signal.lisp. 0] and in emacs I'll see something like this: Interrupted at #x2811F14E. [Condition of type SIMPLE-CONDITION] Restarts: 0: [CONTINUE] Return from BREAK. 1: [DESTROY] Destroy the process Backtrace: 0: (UNIX::SIGINT-HANDLER #<#1=unused-arg> #<#1#> #.(SYSTEM:INT-SAP #x47FD789C)) 1: (UNIX::SIGINT-HANDLER 3 #<#1=unused-arg> #<#1#> #.(SYSTEM:INT- SAP #x47FD789C))[:EXTERNAL] 2: ("Foreign function call land") 3: ("Foreign function call land") 4: ("Foreign function call land") 5: ("Foreign function call land") 6: ("Foreign function call land") 7: (LISP::FD-STREAM-READ-N-BYTES #<Stream for descriptor 8> "" 0 14 ...) 8: (LISP::FD-STREAM-READ-N-BYTES 5 #<Stream for descriptor 8> "" 0 ...)[:EXTERNAL] 9: (LISP::READ-INTO-SIMPLE-STRING "" #<Stream for descriptor 8> 0 14) 10: (READ-SEQUENCE "" #<Stream for descriptor 8> :START 0 ...) 11: ((METHOD INITIALIZE-INSTANCE (:AFTER) (TBNL::REQUEST)) (#(1 2 0 3 5 ...) . #()) #<#1=unused-arg> #<TBNL::REQUEST {49094BA5}> #<#1#>) 12: ((MAKE-INSTANCE TBNL::REQUEST :HEADERS-IN PCL::|.P0.|) (("content- stream" . #<Stream for descriptor 8>) ("content-length" . "14") ("content-type" . "application/x-www-form-urlencoded") ("remote-ip- addr" . "172.133.113.57") ("remote-ip-port" . "3332") ...)) 13: (TBNL::PROCESS-REQUEST (("content-stream" . #<Stream for descriptor 8>) ("content-length" . "14") ("content-type" . "application/x-www-form-urlencoded") ("remote-ip-addr" . "172.133.113.57") ("remote-ip-port" . "3332") ...)) 14: (TBNL::LISTEN-FOR-REQUEST #<Stream for descriptor 8> TBNL::PROCESS-REQUEST)

4 5

[tbnl-devel] Merged patches to Araneida (with one change)
by Alan Shields 26 Dec '05

26 Dec '05

Hello everyone, As Edi is out for a few days, he asked me to email the devel list instead. I've merged in the patches to Araneida to enable TBNL to work. I made a few modifications, however. I'd like someone to test out the changes to make sure they work. To test out the changes, do: darcs get http://code.microarray.omrf.org/darcs/alan-araneida-testing/ On the TBNL-side, instead of setting araneida::*standard-araneida* to nil, you need to set araneida:*araneida-mode* to :tbnl . Let me know if it works! Alan Shields

3 3

[tbnl-devel] Fixing binary uploads in SBCL / TBNL / mod_lisp2
by Travis Cross 20 Dec '05

20 Dec '05

Running SBCL 0.9.6 with TBNL 0.8.4 and Apache 2.0.54 with mod_lisp2, the image download examples work as expected, but uploading any binary file results in a 500 Internal Server Error being throw by Apache. No error is reported in Lisp, but the Apache log file error_log shows the following entry: [error] (70014)End of file found: error reading from Lisp Setting apache to log in debug mode doesn't provide any additional insight, but some testing and modification of the mod_lisp2.c code showed that the error is starting at line 588 where mod_lisp attempts to read the first of the headers. This leads back to read_lisp_line(), then deeper to fill_input_buffer(), where the failure seems to originate at the call to: RELAY_ERROR (((length = (sizeof (buffer->data))), (apr_recv (socket, (buffer->data), (&length))))); With *DEBUG-MODE* set to t, *COMMAND* contains seemingly plausible headers (shown below). I am not familiar enough with the internals to have much of an idea of what is causing the breakdown, though the C code seems to suggest that lisp is sending a different amount of data than is promised. I'm happy to dig into either the TBNL, KMRCL, or mod_lisp2.c code and come up with a patch for this, but it would be tremendously helpful if someone has a good idea of where to start and what the problem might be. Cheers, -- Travis *COMMAND* after failed file upload: (("content-stream" . #<SB-SYS:FD-STREAM for "a constant string" {9CEF2D9}>) ("server-protocol" . "HTTP/1.1") ("method" . "POST") ("url" . "/tbnl/test/upload.html") ("content-type" . "multipart/form-data; boundary=---------------------------130786897319483305451172113725") ("content-length" . "281039") ("server-ip-addr" . "127.0.0.1") ("server-ip-port" . "80") ("remote-ip-addr" . "127.0.0.1") ("script-filename" . "/usr/htdocs") ("remote-ip-port" . "48073") ("server-id" . "tbnl") ("server-baseversion" . "Apache/2.0.54") ("modlisp-version" . "1.2") ("modlisp-major-version" . "2") ("Host" . "localhost") ("User-Agent" . "Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.7.10) Gecko/20050829 Firefox/1.0.6") ("Accept" . "text/xml,application/xml,application/xhtml+xml,text/html;q=0.9,text/plain;q=0.8,image/png,*/*;q=0.5") ("Accept-Language" . "en-us,en;q=0.5") ("Accept-Encoding" . "gzip,deflate") ("Accept-Charset" . "ISO-8859-1,utf-8;q=0.7,*;q=0.7") ("Keep-Alive" . "300") ("Connection" . "keep-alive") ("Referer" . "http://localhost/tbnl/test/upload.html") ("Cookie" . "pumpkin=barking") ("Authorization" . "Basic bmFub29rOmlnbG9v") ("Content-Type" . "multipart/form-data; boundary=---------------------------130786897319483305451172113725") ("Content-Length" . "281039"))

2 2

[tbnl-devel] Content length with multibyte character encodings
by Ignas Mikalajunas 29 Nov '05

29 Nov '05

Content length is calculated by calling (length content) which produces wrong results with unicode characters in the string. Piso on #lisp proposed a solution - using (length (string-to-octets string :external-format :utf-8)) which translates to just (length (string-to-octets string :external-format)) in the code. The true way to solve this would be using (file-string-length), but the function is not working properly on sbcl yet. So could you please fix the (send-output), because with current setup browsers that strictly adhere to the content-lenght (IE 6.0, Opera) would trim 1 character of the responses body for each UTF-8 character in it. Ignas

2 3

[tbnl-devel] New version 0.8.6
by Edi Weitz 18 Nov '05

18 Nov '05

ChangeLog: Version 0.8.6 2005-11-18 Restored original stream-based code for multipart/form-data parsing (got lost somehow) Wrap REMOTE-ADDR with IGNORE-ERRORS (just in case) Download: <http://weitz.de/files/tbnl.tar.gz> Cheers, Edi.

1 0

[tbnl-devel] tbnl patch
by Jeff Caldwell 14 Nov '05

14 Nov '05

Hello, Here is a tiny patch for tbnl. The motivation is that I'm working with blocks of dispatch table entries that are added and withdrawn as modules without restarting tbnl. I'd also like reflective access to the dispatch table e.g. to show a web page of installed dispatch handlers. To affect the base distrubution as little as possible, I took the loop through the dispatch table that funcalls each entry and moved that loop into a defmethod. Now I can specialize on the method and have my own dispatch mechanisms. Jeff Caldwell __________________________________ Yahoo! Mail - PC Magazine Editors' Choice 2005 http://mail.yahoo.com

2 1

[tbnl-devel] sbcl 0.9.6 socket issue?
by Adam Thorsen 14 Nov '05

14 Nov '05

(This is to all of the sbcl users on the list -- I realize sbcl is unsupported by the maintainer) Versions: SBCL 0.9.6 TBNL 0.8.4 mod_lisp Platform: gentoo x86 Indications: After running (tbnl:start-tbnl), tbnl functions properly for about 30 seconds, then refuses to serve the default page (or any page). A stack trace (which follows) seems to me to indicate some issue with kmrcl. (note: bivalent streams has been added to features). 0: (SB-UNIX::SIGINT-HANDLER #<unavailable argument> #<unavailable argument> #.(SB-SYS:INT-SAP #XB7C63D30)$ 1: (SB-SYS:INVOKE-INTERRUPTION #<CLOSURE (LAMBDA NIL) {9A48BAD}>) 2: ("foreign function: call_into_lisp") 3: ("foreign function: funcall3") 4: ("foreign function: interrupt_handle_now") 5: ("foreign function: #x8052BB9") 6: ("bogus stack frame") 7: (SB-SYS:WAIT-UNTIL-FD-USABLE 9 :INPUT NIL) 8: (SB-IMPL::REFILL-BUFFER/FD #<SB-SYS:FD-STREAM for "a constant string" {9769299}>) 9: (SB-IMPL::INPUT-CHAR/ASCII #<SB-SYS:FD-STREAM for "a constant string" {9769299}> NIL NIL) 10: (READ-LINE #<SB-SYS:FD-STREAM for "a constant string" {9769299}> NIL NIL #<unused argument>) 11: (TBNL::GET-REQUEST-DATA) 12: (TBNL::LISTEN-FOR-REQUEST #<SB-SYS:FD-STREAM for "a constant string" {9769299}> TBNL::PROCESS-REQUEST) 13: ((LAMBDA NIL)) 14: (KMRCL::START-SOCKET-SERVER #<KMRCL:LISTENER port 3000>) 15: (KMRCL::START-SOCKET-SERVER #<KMRCL:LISTENER port 3000>) 16: (KMRCL::MAKE-SOCKET-SERVER #<KMRCL:LISTENER port 3000>) 17: (KMRCL::LISTENER-STARTUP #<KMRCL:LISTENER port 3000>) 18: (KMRCL:INIT/LISTENER #<unavailable argument> :START) 19: (SB-INT:EVAL-IN-LEXENV (TBNL:START-TBNL) #<NULL-LEXENV>) 20: (SWANK::EVAL-REGION "(tbnl:start-tbnl) " T)

1 0

[tbnl-devel] Jpg/png upload/download issues while using cvs SBCL and "stand-alone" TBNL
by Ignas Mikalajunas 03 Nov '05

03 Nov '05

Hi, I am not 100% sure that it is a bug in tbnl not in my setup though when using SBCL (cvs version 2005-10-07) it seems that tbnl refuses to serve jpg/png files ... I have tried launching the test application and it works fine except for the "Binary data, delivered from file (a picture)" "Binary data, delivered from RAM (same picture)" sections :/ I thought that the problem might be in the dispatcher, but i could not upload jpg/png files through "File Uploads" too (post script files uploaded/downloaded fine) i was just geting back to the upload page after clicking on the submit button. At the same time - the same set up worked fine on CMUCL, i mean i could see example image and could download/upload any files i want. I got no errors on the lisp side, so i can't send you any tracebacks. Ignas Mikalajūnas

3 6