April 2007 - drakma-devel@common-lisp.net

[drakma-devel] Lenient read-line*
by Sean 07 May '07

07 May '07

I've attached a small patch which makes chunga:read-line* a little more lenient with regards to line endings. Currently (drakma:http-request "http://news.ycombinator.com") fails with an EOF since the arc server doesn't respond with CRLF but only uses plain LF. The attached patch works around this by assuming that when a LineFeed is encountered it also designates the end of a line, although it is quite possibly the wrong thing. Cheers, Sean. -- ...Please don't assume Lisp is only useful for Animation and Graphics, AI, Bioinformatics, B2B and E-Commerce, Data Mining, EDA/Semiconductor applications, Expert Systems, Finance, Intelligent Agents, Knowledge Management, Mechanical CAD, Modeling and Simulation, Natural Language, Optimization, Research, Risk Analysis, Scheduling, Telecom, and Web Authoring just because these are the only things they happened to list. Kent Pitman.

5 14

[drakma-devel] drakma causes lisp connection close unexpectedly
by Mostafa Razavi 01 May '07

01 May '07

I'm starting to use Drakma in a program of mine, and it seems to work fine for me except in one strange case. I was trying to retrieve a page, with (drakma:http-request "http://cesa.iust.ac.ir/"), that I got "Lisp connection closed unexpectedly: exited abnormally with code 256". I set *header-stream* to see what's happening. This is the result: GET / HTTP/1.1 Host: cesa.iust.ac.ir User-Agent: Drakma/0.7.0 (SBCL 1.0.3; Linux; 2.6.20-15-generic; http://weitz.de/drakma/) Accept: */* Connection: close HTTP/1.1 302 Found Connection: close Date: Mon, 30 Apr 2007 22:52:19 GMT Server: Microsoft-IIS/6.0 X-Powered-By: ASP.NET X-AspNet-Version: 2.0.50727 Location: /Default.aspx?AspxAutoDetectCookieSupport=1 Set-Cookie: AspxAutoDetectCookieSupport=1; path=/ Cache-Control: private Content-Type: text/html GET /Default.aspx?AspxAutoDetectCookieSupport=1 HTTP/1.1 Host: cesa.iust.ac.ir User-Agent: Drakma/0.7.0 (SBCL 1.0.3; Linux; 2.6.20-15-generic; http://weitz.de/drakma/) Accept: */* Connection: close HTTP/1.1 302 Found Connection: close Date: Mon, 30 Apr 2007 22:52:28 GMT Server: Microsoft-IIS/6.0 X-Powered-By: ASP.NET X-AspNet-Version: 2.0.50727 Location: /(X(1)S(rmofw345wvkjbzjz54jnyu45))/Default.aspx?AspxAutoDetectCookieSupport=1 Cache-Control: private Content-Type: text/html; charset=utf-8 Content-Length: 194 GET /(X(1)S(rmofw345wvkjbzjz54jnyu45))/Default.aspx?AspxAutoDetectCookieSupport=1 HTTP/1.1 Host: cesa.iust.ac.ir User-Agent: Drakma/0.7.0 (SBCL 1.0.3; Linux; 2.6.20-15-generic; http://weitz.de/drakma/) Accept: */* Connection: close HTTP/1.1 200 OK Connection: close Date: Mon, 30 Apr 2007 22:52:34 GMT Server: Microsoft-IIS/6.0 X-Powered-By: ASP.NET X-AspNet-Version: 2.0.50727 Cache-Control: private Content-Type: text/html; charset=utf-8 Content-Length: 72459 Other web pages I have tested work fine, but this is the one page I'm going to work with. Any ideas? Thanks. Homayoon, (new-comer)

4 4

Re: [drakma-devel] Lenient read-line*
by Sean 30 Apr '07

30 Apr '07

On Mon, 2007-04-30 at 11:41 +0000, rm(a)tuxteam.de wrote: > Hmm - IIRC that was causing the problems in Java way back ... imagine > the sequence "blah blah<cr>" (some network delay "<lf>blub more bah". > And then there is "<cr><cr><lf>" (which i've seen at least once!). Is > this one or two or even three newlines. Iff your answer is > 1 than you > might start reading header lines as content .... It would be 2 here, and would quite possibly leave headers unconsumed, which is in error. The current behaviour is definitely preferred for this case (signalling an error) but my feeling is that this behaviour, while quite acceptable in this example, is not the best for all cases (news.ycombinator.com for example). In the same vein the approach I've suggested is definitely not the best for all cases, merely a method to workaround servers that do not honour RFC 2616[1]. Cheers, Sean. [1] Granted this is done by ascribing semantics to single CR's and LF's in an essentially ad hoc manner. -- ...Please don't assume Lisp is only useful for Animation and Graphics, AI, Bioinformatics, B2B and E-Commerce, Data Mining, EDA/Semiconductor applications, Expert Systems, Finance, Intelligent Agents, Knowledge Management, Mechanical CAD, Modeling and Simulation, Natural Language, Optimization, Research, Risk Analysis, Scheduling, Telecom, and Web Authoring just because these are the only things they happened to list. Kent Pitman.

1 0

[drakma-devel] drakma:http-request sometimes returns nil
by Andrei Stebakov 10 Apr '07

10 Apr '07

I am using SBCL 1.04. I've just upgraded to latest hunchentoot, drakma etc... It happens when I upload a file using POST request. Most of the times the http-request just works and returns the result which I parse and it's meaningful. Occasionally (1 out of 10 times) the http-request returns nil. To verify it, I tested it not from the web, but from the slime propt. It it took me a while to understand why my web app was misbehaving sometimes. For now I put a workaround like (loop for i from 0 to 5 while (not http-request-result) do (setq http-request-result (drakma:http-request ....)) which works. I'd like to know if it's an expected behavior of the http request or is there something I/we could do to fix it? Thank you, Andrew

2 3

[drakma-devel] Re: Portability of Drakma
by Edi Weitz 07 Apr '07

07 Apr '07

On Sun, 25 Feb 2007 14:38:02 +0100, "Erik Huelsmann" <ehuels(a)gmail.com> wrote: >> - The code should have been tested successfully on at least the >> Lisp/OS combinations that are currently supported by Drakma. > > Is there a list somewhere as a reference to what I'm getting into? No, unfortunately not. I myself use mostly LispWorks (Windows and Linux/x86) and SBCL (Linux/x86). (LispWorks shouldn't be a problem anyway as it's not affected by the switch.) I think that at least LispWorks, SBCL, AllegroCL, CMUCL, CLISP, and OpenMCL should be supported, everything else being a bonus. Operating systems: Windows (where applicable), Linux, OS X. If you don't want to test all of this for yourself, how about offering a tarball of Drakma which uses usocket for download? Send an announcement to this mailing list including an overview of what you've tested and what not. We can ask "interested parties" to try it out and we'll switch to the new version in four weeks, say, unless someone objects. Does that sound OK? Cheers, Edi.

3 20