drakma-devel

drakma-devel@common-lisp.net

182 discussions

[drakma-devel] Re: drakma-devel Digest, Vol 20, Issue 1
by Nico Garcia Belmonte 05 Jun '08

05 Jun '08

It works! Thanks a lot! On 6/5/08, drakma-devel-request(a)common-lisp.net < drakma-devel-request(a)common-lisp.net> wrote: > > Send drakma-devel mailing list submissions to > drakma-devel(a)common-lisp.net > > To subscribe or unsubscribe via the World Wide Web, visit > http://common-lisp.net/cgi-bin/mailman/listinfo/drakma-devel > or, via email, send a message with subject or body 'help' to > drakma-devel-request(a)common-lisp.net > > You can reach the person managing the list at > drakma-devel-owner(a)common-lisp.net > > When replying, please edit your Subject line so it is more specific > than "Re: Contents of drakma-devel digest..." > > > Today's Topics: > > 1. Handling chunked content (Nico Garcia Belmonte) > 2. Re: Handling chunked content (Edi Weitz) > > > ---------------------------------------------------------------------- > > Message: 1 > Date: Thu, 5 Jun 2008 02:43:48 +0200 > From: "Nico Garcia Belmonte" <philogb(a)gmail.com> > Subject: [drakma-devel] Handling chunked content > To: drakma-devel(a)common-lisp.net > Message-ID: > <4e2f5dc00806041743p7b2e6d29kc36dd8e84d4630ff(a)mail.gmail.com> > Content-Type: text/plain; charset="iso-8859-1" > > Hi, > > ...I'm kind of a newbie, so please forgive me if I make stupid questions. > I've been using drakma to request html pages and everything seems to work > fine. > > I'm now using drakma to make a request to the new youtube json api, and I > get chunked content: > > (http-request " > > http://gdata.youtube.com/feeds/api/videos/-/Music/?max-results=10&vq=bush&a… > ") > > ...chunked content... > > ((:CONTENT-TYPE . "application/json; charset=UTF-8") > (:CACHE-CONTROL . "max-age=0, must-revalidate, no-transform, private") > (:GDATA-VERSION . "1.0") (:LAST-MODIFIED . "Thu, 05 Jun 2008 00:20:27 > GMT") > (:TRANSFER-ENCODING . "chunked") (:DATE . "Thu, 05 Jun 2008 00:20:27 > GMT") > (:SERVER . "GFE/1.3") (:CONNECTION . "Close")) > #<PURI:URI > > http://gdata.youtube.com/feeds/api/videos/-/Music/?max-results=10&vq=bush&a… > > > #<FLEXI-STREAMS:FLEXI-IO-STREAM {B90E249}> > > The thing is that I need it to be a string in order to decode to json > format > using the cl-json lisp package. > I tried changing the external-output parameter without any good results. > > Do you have some advice on how I could serialize this content? > > Thanks at advanced! > > Your library is great! > > Nico. > > -- > I would never die for my beliefs because I might be wrong. > > Bertrand Russell >

1 0

[drakma-devel] Handling chunked content
by Nico Garcia Belmonte 05 Jun '08

05 Jun '08

Hi, ...I'm kind of a newbie, so please forgive me if I make stupid questions. I've been using drakma to request html pages and everything seems to work fine. I'm now using drakma to make a request to the new youtube json api, and I get chunked content: (http-request " http://gdata.youtube.com/feeds/api/videos/-/Music/?max-results=10&vq=bush&a… ") ...chunked content... ((:CONTENT-TYPE . "application/json; charset=UTF-8") (:CACHE-CONTROL . "max-age=0, must-revalidate, no-transform, private") (:GDATA-VERSION . "1.0") (:LAST-MODIFIED . "Thu, 05 Jun 2008 00:20:27 GMT") (:TRANSFER-ENCODING . "chunked") (:DATE . "Thu, 05 Jun 2008 00:20:27 GMT") (:SERVER . "GFE/1.3") (:CONNECTION . "Close")) #<PURI:URI http://gdata.youtube.com/feeds/api/videos/-/Music/?max-results=10&vq=bush&a… > #<FLEXI-STREAMS:FLEXI-IO-STREAM {B90E249}> The thing is that I need it to be a string in order to decode to json format using the cl-json lisp package. I tried changing the external-output parameter without any good results. Do you have some advice on how I could serialize this content? Thanks at advanced! Your library is great! Nico. -- I would never die for my beliefs because I might be wrong. Bertrand Russell

2 1

[drakma-devel] http-request returns nil
by Andrei Stebakov 29 May '08

29 May '08

I am using http-request to upload files on some web-site. The problem is that sometimes the function returns a nil response so I just have to repeat it again with the same parameters. Sometimes it take up to 8 retries to make the request return a non-nil response. I wonder if you saw it before or how can I debug it? The function doesn't take long to return with nil result. I mean the whole file upload can take 10 seconds, so the http-request may return nil within those 10 seconds. Is some timeout or the connection gets broken between the hosts? There is no exception raised as well, it just silently returns nil. Thank you, Andrew

3 7

[drakma-devel] Current development
by Edi Weitz 26 May '08

26 May '08

As common-lisp.net has been pretty unreliable in the last days, we've moved development over to the bknr.net server maintained by Hans. If you're interested in trying out the soon-to-be-released Hunchentoot version, get all of Hunchentoot, Chunga, and FLEXI-STREAMS from here: http://bknr.net/trac/browser/trunk/thirdparty If you're using Drakma, you'll have to grab it from bknr.net as well, as there are incompatible changes in Chunga. The previous development history can be seen at http://trac.common-lisp.net/tbnl/browser/branches whenever the server is up. Edi.

1 0

[drakma-devel] New Chunga release 0.4.3
by Edi Weitz 23 May '08

23 May '08

ChangeLog: Version 0.4.3 2008-05-23 Cleanup, reduce some consing Download: http://weitz.de/files/chunga.tar.gz

1 0

[drakma-devel] HTTPS through proxy
by Dave Lambert 20 May '08

20 May '08

Hi, I need to contact HTTPS servers through a proxy. I've managed to get this to work by having the http-request function issue an HTTP CONNECT commmand in order to tunnel SSL through the proxy: the patch is below (against 0.11.5). On the downside, it only works for Lispworks. Cheers, Dave --- a/request.lisp +++ b/request.lisp @@ -416,7 +416,8 @@ LispWorks 5.0 or higher." (t (setq content (alist-to-url-encoded-string parameters external-format-out) content-type "application/x-www-form-urlencoded"))))) - (let (http-stream must-close done) + (let ((proxying-https? (and proxy (eq :https (puri:uri-scheme uri)))) + http-stream raw-http-stream must-close done) (unwind-protect (progn (let ((host (or (and proxy (first proxy)) @@ -424,8 +425,8 @@ LispWorks 5.0 or higher." (port (cond (proxy (second proxy)) ((uri-port uri)) (t (default-port uri)))) - (use-ssl (or force-ssl - (eq (uri-scheme uri) :https)))) + (use-ssl (and (not proxying-https?) + (or force-ssl (eq (uri-scheme uri) :https))))) #+(and :lispworks5.0 :mswindows (not :lw-does-not-have-write-timeout)) (when use-ssl @@ -445,6 +446,7 @@ LispWorks 5.0 or higher." #-:lispworks (usocket:socket-stream (usocket:socket-connect host port :element-type 'octet)))) + (setq raw-http-stream http-stream) (when (and use-ssl ;; don't attach SSL to existing streams (not stream)) @@ -473,6 +475,24 @@ LispWorks 5.0 or higher." (format http-stream "~?~C~C" fmt args #\Return #\Linefeed)) (write-header (name value-fmt &rest value-args) (write-http-line "~A: ~?" name value-fmt value-args))) + (when proxying-https? + ;; Setup a tunnel through the proxy server to the + ;; final destination. + (write-http-line "CONNECT ~A:~A HTTP/1.1" (puri:uri-host uri) + (or (puri:uri-port uri) 443)) + (write-http-line "Host: ~A:~A" (puri:uri-host uri) + (or (puri:uri-port uri) 443)) + (write-http-line "") + (force-output http-stream) + ;; Check we get a 200 response before proceeding. + (let ((line (read-status-line http-stream *header-stream*))) + (unless (eq (second line) 200) + (error "Unable to establish HTTPS tunnel through proxy."))) + ;; Got a connection. We have to read a blank line, + ;; turn on SSL, and then we can transmit. + (read-line* http-stream) + #+:lispworks + (comm:attach-ssl raw-http-stream :ssl-side :client)) (when (and (not parameters-used-p) parameters) (setf (uri-query uri)

3 3

[drakma-devel] New Chunga release 0.4.2
by Edi Weitz 07 May '08

07 May '08

ChangeLog: Version 0.4.2 2008-05-07 Flush stream when switching chunking off (patch by Hans Hübner) Download: http://weitz.de/files/chunga.tar.gz

1 0

[drakma-devel] Re asdf install problem
by Marek Kowerski 11 Apr '08

11 Apr '08

Thank you for quick response! I have managed to install drakma using Lispy, and then cl-selenium using asdf-install. I know about gentoo overlay, but I have decided to use asdf-install, because this way I can always have latest versions, and all packages are installed in my home directory. And I don't need to use packages.keywords and remember to setup "~amd64" keywords for every possible lisp package. Because cl+ssl is not asdf-installable, I did (asdf:oos 'asdf:load-op 'cl+ssl). I have cl+ssl-2007-07-07, but it is from tarballs not cvs. Lispy have installed drakma-0.11.3 not 0.11.5. I think asdf-install is a great advantage of lisp, very convenient, just jak CPAN for perl. All packages should be asdf-insallabe and repository must be consistent if the CL wants to be more popular. Thank you again for your kind response, and for Hunchentoot, which the more I try the more I like. MK

2 2

[drakma-devel] Drakma asdf-install problem
by Marek Kowerski 10 Apr '08

10 Apr '08

I,m getting this error while installing drakma with asdf-install on gentoo-amd64 with sbcl 1.0.15: Downloading 42624 bytes from http://weitz.de/files/drakma.tar.gz ... Installing /root/DRAKMA.asdf-install-tmp in /usr/lib64/sbcl/site/,/usr/ lib64/sbcl/site-systems/ drakma-0.11.5/ drakma-0.11.5/CHANGELOG.txt drakma-0.11.5/cookies.lisp drakma-0.11.5/doc/ drakma-0.11.5/doc/index.html drakma-0.11.5/drakma.asd drakma-0.11.5/packages.lisp drakma-0.11.5/read.lisp drakma-0.11.5/request.lisp drakma-0.11.5/specials.lisp drakma-0.11.5/util.lisp ; compiling file "/usr/lib/sbcl/site/drakma-0.11.5/ request.lisp" (written 21 MAR 2008 11:40:04 PM): ; compiling (IN-PACKAGE :DRAKMA) ; compiling (DEFUN DETERMINE-BODY-FORMAT ...) ; compiling (DEFUN SEND-CONTENT ...) ; compiling (DEFUN MAKE-FORM-DATA-FUNCTION ...) ; compiling (DEFUN READ-BODY ...); compilation aborted because of fatal error: ; READ failure in COMPILE-FILE: ; SB-INT:SIMPLE-READER-PACKAGE- ERROR at 24225 (line 460, column 42) on #<SB-SYS:FD-STREAM for "file / usr/lib/sbcl/site/drakma-0.11.5/request.lisp" {1003824541}>: ; Symbol "STREAM-FD" not found in the CL+SSL package. ; compilation aborted after 0:00:01 I need drakma because it's dependency of cl-selenium. Please help.

3 2

Re: [drakma-devel] eof error
by Frank Schorr 04 Apr '08

04 Apr '08

> Another way of debugging this would be to try from another Lisp and/or > another OS. There's always a chance that what you're seeing is a bug > in your Lisp. Or, OMG, a bug in Drakma.... ok. I'm using 'pure' Drakma. I do not have access to other lisps and OSs. However, I replaced Drakma's http-request with that of aserve and received no errors, but an empty page sometimes and randomly. Now I'm sure the problem is outside of lisp and more on the side of the server, or somewhere in between. Now I handle the eof error and return an empty page, and drakma and aserve behave the same. If I receive an empty page, I repeat the request, what is ok for me. What I learned now is, that multi-threaded access to this particular server (Oracle application server) takes the same time as single threaded serial access. And this is disappointing. Thank you for your help and suggestions. _________________________________________________________________________ In 5 Schritten zur eigenen Homepage. Jetzt Domain sichern und gestalten! Nur 3,99 EUR/Monat! http://www.maildomain.web.de/?mc=021114

1 0

← Newer
1
...
7
8
9
10
11
12
13
...
19
Older →

Jump to page:

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

drakma-devel