drakma-devel April 2008

drakma-devel@common-lisp.net

6 participants
6 discussions

[drakma-devel] Re asdf install problem
by Marek Kowerski 11 Apr '08

11 Apr '08

Thank you for quick response! I have managed to install drakma using Lispy, and then cl-selenium using asdf-install. I know about gentoo overlay, but I have decided to use asdf-install, because this way I can always have latest versions, and all packages are installed in my home directory. And I don't need to use packages.keywords and remember to setup "~amd64" keywords for every possible lisp package. Because cl+ssl is not asdf-installable, I did (asdf:oos 'asdf:load-op 'cl+ssl). I have cl+ssl-2007-07-07, but it is from tarballs not cvs. Lispy have installed drakma-0.11.3 not 0.11.5. I think asdf-install is a great advantage of lisp, very convenient, just jak CPAN for perl. All packages should be asdf-insallabe and repository must be consistent if the CL wants to be more popular. Thank you again for your kind response, and for Hunchentoot, which the more I try the more I like. MK

2 2

[drakma-devel] Drakma asdf-install problem
by Marek Kowerski 10 Apr '08

10 Apr '08

I,m getting this error while installing drakma with asdf-install on gentoo-amd64 with sbcl 1.0.15: Downloading 42624 bytes from http://weitz.de/files/drakma.tar.gz ... Installing /root/DRAKMA.asdf-install-tmp in /usr/lib64/sbcl/site/,/usr/ lib64/sbcl/site-systems/ drakma-0.11.5/ drakma-0.11.5/CHANGELOG.txt drakma-0.11.5/cookies.lisp drakma-0.11.5/doc/ drakma-0.11.5/doc/index.html drakma-0.11.5/drakma.asd drakma-0.11.5/packages.lisp drakma-0.11.5/read.lisp drakma-0.11.5/request.lisp drakma-0.11.5/specials.lisp drakma-0.11.5/util.lisp ; compiling file "/usr/lib/sbcl/site/drakma-0.11.5/ request.lisp" (written 21 MAR 2008 11:40:04 PM): ; compiling (IN-PACKAGE :DRAKMA) ; compiling (DEFUN DETERMINE-BODY-FORMAT ...) ; compiling (DEFUN SEND-CONTENT ...) ; compiling (DEFUN MAKE-FORM-DATA-FUNCTION ...) ; compiling (DEFUN READ-BODY ...); compilation aborted because of fatal error: ; READ failure in COMPILE-FILE: ; SB-INT:SIMPLE-READER-PACKAGE- ERROR at 24225 (line 460, column 42) on #<SB-SYS:FD-STREAM for "file / usr/lib/sbcl/site/drakma-0.11.5/request.lisp" {1003824541}>: ; Symbol "STREAM-FD" not found in the CL+SSL package. ; compilation aborted after 0:00:01 I need drakma because it's dependency of cl-selenium. Please help.

3 2

Re: [drakma-devel] eof error
by Frank Schorr 04 Apr '08

04 Apr '08

> Another way of debugging this would be to try from another Lisp and/or > another OS. There's always a chance that what you're seeing is a bug > in your Lisp. Or, OMG, a bug in Drakma.... ok. I'm using 'pure' Drakma. I do not have access to other lisps and OSs. However, I replaced Drakma's http-request with that of aserve and received no errors, but an empty page sometimes and randomly. Now I'm sure the problem is outside of lisp and more on the side of the server, or somewhere in between. Now I handle the eof error and return an empty page, and drakma and aserve behave the same. If I receive an empty page, I repeat the request, what is ok for me. What I learned now is, that multi-threaded access to this particular server (Oracle application server) takes the same time as single threaded serial access. And this is disappointing. Thank you for your help and suggestions. _________________________________________________________________________ In 5 Schritten zur eigenen Homepage. Jetzt Domain sichern und gestalten! Nur 3,99 EUR/Monat! http://www.maildomain.web.de/?mc=021114

1 0

Re: [drakma-devel] eof error
by Frank Schorr 04 Apr '08

04 Apr '08

> > Is that a local server? Are you sure it can cope with parallel > requests? Are the different threads using the same session? Could > that be the problem? > It is a public server in the www which has many simultaneous users. I believe my session handling is correct, but it is not heavily tested. What makes me confident is that my program is sometimes successful. I'm always doing the same requests (apart from the session information) with 3 threads and about 20 requests in total. The eofs occur at random. My program has done some 10.000 requests from this site when run from the ide in the past. Do you believe the server could generate the error ? Wouldn't drakma handle it then ? May be this is a way to kick out a robot ? (They are using captchas at some places (which are not accessed by me)). I'm also not aware of using destructive operations... > > I will try to find a simple test case. > > That'd be the best. > I noticed that this is not easy. It appears that I will need some more time for this. ______________________________________________________ Bis 50 MB Dateianhänge? Kein Problem! http://freemail.web.de/club/landingpage.htm/?mc=025556

3 2

Re: [drakma-devel] eof error
by Frank Schorr 03 Apr '08

03 Apr '08

> > On Thu, 03 Apr 2008 22:34:59 +0200, Frank Schorr <franks-muc(a)web.de> wrote: > > > This is on win32/5.0.2 > > LispWorks, I assume. Yes (version 5.0.2) > > > I receive an eof error when accessing a web page. Backtrace below. > > > > This happens occasionally, every second or third call to > > HTTP-REQUEST, without regular pattern, when the call is made from a > > muproc thread. My code works fine when called from the ide. > > Hmm, hard to say without a reproducible test case. Does it happen > only with specific URLs or with arbitrary ones? > My code tries only one, parallel threads access the same web page, but different URLs, because sessions are tracked. But it works fine from the ide thread. I will try to find a simple test case. > > I suspect that the proper initial bindings should be made when the > > thread is spawned, but I was not able to get this done. > > Which initial bindings are you thinking of? see http://www.mu.dk/cl-muproc#muproc-spawn used to set up and initialize special variables in the new thread. I thought that every thread might want its own variable for things like a current stream or something similar to be independent from other threads. It was only guessing. _________________________________________________________________________ In 5 Schritten zur eigenen Homepage. Jetzt Domain sichern und gestalten! Nur 3,99 EUR/Monat! http://www.maildomain.web.de/?mc=021114

2 1

[drakma-devel] eof error
by Frank Schorr 03 Apr '08

03 Apr '08

This is on win32/5.0.2 I receive an eof error when accessing a web page. Backtrace below. This happens occasionally, every second or third call to HTTP-REQUEST, without regular pattern, when the call is made from a muproc thread. My code works fine when called from the ide. I suspect that the proper initial bindings should be made when the thread is spawned, but I was not able to get this done. Any help would be very welcome. Frank Error: End of file while reading stream #<FLEXI-STREAMS::FLEXI-BINARY-LATIN-1-IO-STREAM 2393B4BF>. 1 (abort) Quit process. Type :b for backtrace, :c <option number> to proceed, or :? for other options GPTO 1 : 1 > :< Call to INVOKE-DEBUGGER GPTO 2 : 1 > :b Call to INVOKE-DEBUGGER Call to SIGNAL Call to CHUNGA:READ-LINE* Call to DRAKMA::READ-STATUS-LINE Call to (HARLEQUIN-COMMON-LISP:SUBFUNCTION (LABELS DRAKMA::FINISH-REQUEST) DRAKMA:HTTP-REQUEST) Call to DRAKMA:HTTP-REQUEST Call to GET-PAGE-2 Call to CLIENT-SUBMIT-FORM Call to LET* Interpreted call to #:REMOTE-FUNCTION223724 Call to UTIL::WORKER Call to (HARLEQUIN-COMMON-LISP:SUBFUNCTION 1 UTIL::MAKE-PROCESS) Call to CL-MUPROC::MUPROC-PROCESS-FUNCTION Call to (HARLEQUIN-COMMON-LISP:SUBFUNCTION MP::PROCESS-SG-FUNCTION MP::INITIALIZE-PROCESS-STACK) _______________________________________________________________ Schon gehört? Der neue WEB.DE MultiMessenger kann`s mit allen: http://www.produkte.web.de/messenger/?did=3016

3 2

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

drakma-devel April 2008