September 2007 - drakma-devel@common-lisp.net

Re: [drakma-devel] utf-8 question
by Ross Jekel 11 Oct '07

11 Oct '07

Sorry for typing your name wrong... and thanks for trying this. I'll debug it on Linux here when I get a chance. Was gone most of the day. Here's my asdf directory which I think has the latest of everything. drwxr-xr-x 5 ross ross 4096 2007-08-14 07:33 asdf-install lrwxrwxrwx 1 ross ross 42 2007-09-28 22:13 asdf-install.asd -> asdf-install/asdf-install/asdf-install.asd drwxr-xr-x 3 ross ross 4096 2007-09-28 21:44 chunga-0.4.0 lrwxrwxrwx 1 ross ross 23 2007-09-28 22:14 chunga.asd -> chunga-0.4.0/chunga.asd drwxr-xr-x 2 ross ross 4096 2007-09-28 21:41 cl-base64-3.3.2 lrwxrwxrwx 1 ross ross 29 2007-09-28 22:14 cl-base64.asd -> cl-base64-3.3.2/cl-base64.asd drwxr-xr-x 3 ross ross 4096 2007-09-14 12:15 cl-log lrwxrwxrwx 1 ross ross 18 2007-09-28 22:14 cl-log.asd -> cl-log/cl-log.asdf drwxr-xr-x 3 ross ross 4096 2007-09-24 13:36 cl-utilities-1.2.4 lrwxrwxrwx 1 ross ross 35 2007-09-28 22:14 cl-utilities.asd -> cl-utilities-1.2.4/cl-utilities.asd drwxr-xr-x 3 ross ross 4096 2007-09-29 00:01 drakma-0.10.1 lrwxrwxrwx 1 ross ross 24 2007-09-28 22:14 drakma.asd -> drakma-0.10.1/drakma.asd drwxr-xr-x 4 ross ross 4096 2007-09-29 16:50 flexi-streams-0.13.0 lrwxrwxrwx 1 ross ross 38 2007-09-28 22:15 flexi-streams.asd -> flexi-streams-0.13.0/flexi-streams.asd drwxr-xr-x 2 ross ross 4096 2007-09-28 21:44 puri-1.5.1 lrwxrwxrwx 1 ross ross 19 2007-09-28 22:15 puri.asd -> puri-1.5.1/puri.asd drwxr-xr-x 3 ross ross 4096 2007-09-28 21:49 trivial-gray-streams-2006-09-16 lrwxrwxrwx 1 ross ross 56 2007-09-28 22:15 trivial-gray-streams.asd -> trivial-gray-streams-2006-09-16/trivial-gray-streams.asd drwxr-xr-x 6 ross ross 4096 2007-09-28 21:42 usocket-0.3.5 lrwxrwxrwx 1 ross ross 25 2007-09-28 22:16 usocket.asd -> usocket-0.3.5/usocket.asd drwxr-xr-x 2 ross ross 4096 2007-09-14 12:21 xml-emitter-1.0.2 lrwxrwxrwx 1 ross ross 33 2007-09-28 22:16 xml-emitter.asd -> xml-emitter-1.0.2/xml-emitter.asd Thanks, Ross ----- Original Message ----- From: "Edi Weitz" <edi(a)agharta.de> To: "General interest list for Drakma and Chunga" <drakma-devel(a)common-lisp.net> Sent: Saturday, September 29, 2007 12:55:33 PM (GMT-0800) America/Los_Angeles Subject: Re: [drakma-devel] utf-8 question On Sat, 29 Sep 2007 09:21:50 -0700 (PDT), Ross Jekel <ross(a)sourcelabs.com> wrote: > Thanks for your help, Eli. Edi... > Here's what I get. I'll try to debug this as well a bit later today. I also just tried with Allegro CL 8.1 (but I only have it on Windows). Works fine for me. Could you check if you're using the newest versions of all the dependencies, specifically of Chunga and FLEXI-STREAMS? _______________________________________________ drakma-devel mailing list drakma-devel(a)common-lisp.net http://common-lisp.net/cgi-bin/mailman/listinfo/drakma-devel

3 9

Re: [drakma-devel] utf-8 question
by Ross Jekel 29 Sep '07

29 Sep '07

>Do you get the same result with the URL above? (I'll leave it online >for testing purposes.) And can you send the headers sent back and >forth between Drakma and the server to the mailing list? How does >your HTTP-REQUEST call look like? Thanks for your help, Eli. Here's what I get. I'll try to debug this as well a bit later today. cg-user(10): (setf drakma:*header-stream* *standard-output*) #<listener-pane :listener-pane in IDE GUI @ #x71eded8a> cg-user(11): (drakma:http-request "http://zappa.agharta.de/test.xml") GET /test.xml HTTP/1.1 Host: zappa.agharta.de User-Agent: Drakma/0.10.1 (International Allegro CL Enterprise Edition 8.1 [Linux (x86)] (Sep 24, 2007 12:17); Linux (x86), glibc 2.3; Linux Xubuntu 2.6.17-12-generic #2 SMP Wed Aug 29 20:08:20 UTC 2007 i686 GNU/Linux; http://weitz.de/drakma/) Accept: */* Connection: close HTTP/1.1 200 OK Date: Sat, 29 Sep 2007 16:17:58 GMT Server: Apache Connection: close Transfer-Encoding: chunked Content-Type: text/xml; charset=utf-8 #(50 101 32 13 10 60 104 116 109 108 ...) 200 ((:DATE . "Sat, 29 Sep 2007 16:17:58 GMT") (:SERVER . "Apache") (:CONNECTION . "close") (:TRANSFER-ENCODING . "chunked") (:CONTENT-TYPE . "text/xml; charset=utf-8")) #<puri:uri http://zappa.agharta.de/test.xml> #<flexi-streams::flexi-latin-1-io-stream @ #x721f5362> t "OK" cg-user(12):

2 1

[drakma-devel] utf-8 question
by Ross Jekel 29 Sep '07

29 Sep '07

Hi, I'm using Drakma 0.10.1 with AllegroCL 8.1. When I make an http-request to get a wsdl file which returns the response header: Content-Type: text/xml; charset=utf-8 the contents returned are a vector of octets. I got the impression from the examples that it would autosense the content type and return a decoded-string. Am I doing something wrong? Thanks, Ross

2 1

[drakma-devel] http-request header issue
by Ross Jekel 29 Sep '07

29 Sep '07

Hi, I'm a first time user of Drakma and I so much appreciate this library. I've been using Aserve's client functions which so far have been nothing but frustrating. Unforunately, the first time I tried Drakma it fail for me. What I was trying to do was get the wsdl file from my localhost. The URL was something like http://localhost:1579/wsdl. The wsdl service on this box requires basic authentication for everything except getting the wsdl (go figure). The problem was that when Drakma sent the header it had a '?' in the GET request. GET /wsdl? HTTP/1.1 Just the presence of the '?' for this server caused it to send back: HTTP/1.0 401 Unauthorized Well, I looked at the code in request.lisp and around line 450 and it sure looks like it should leave off the '?': (format nil "~A~@[?~A~]" (or (uri-path uri) "/") (uri-query uri) Trouble is, a few lines above it setf's (uri-query uri) to an empty string "" if parameters-used-p is t but parameters is nil. (unless parameters-used-p (setf (uri-query uri) ;; append parameters to existing query of URI (format nil "~@[~A~]~:*~:[~;&~]~A" (uri-query uri) (alist-to-url-encoded-string parameters external-format-out)))) I was able to change the unless line to: (unless (or parameters-used-p (not parameters)) and now the GET header is: GET /wsdl HTTP/1.1 I didn't think this was a big enough change for a patch, but thought it might be useful. The way I wrote it might be hard to read (unless with a not...), but I was just trying it to see if it worked. (when (and (not parameters-used-p) parameters) Might read better. Thanks, Ross

2 1

[drakma-devel] parameters in post requests
by Jan Rychter 26 Sep '07

26 Sep '07

I'm about to release CL-SQS, an interface to the Amazon Web Services SQS service. It uses Drakma for HTTP requests. However, I have encountered one issue: Amazon SQS requires POST requests with URL parameters, and Drakma by default does not want to include any parameters with POST requests. Would it be possible to include this small modification in Drakma? diff -c /Users/jwr/lisp/site/drakma-0.10.0/request.lisp.original /Users/jwr/lisp/site/drakma-0.10.0/request.lisp --- /Users/jwr/lisp/site/drakma-0.10.0/request.lisp.original Tue Sep 25 13:02:42 2007 +++ /Users/jwr/lisp/site/drakma-0.10.0/request.lisp Tue Sep 25 13:03:19 2007 @@ -428,7 +428,7 @@ (format http-stream "~?~C~C" fmt args #\Return #\Linefeed)) (write-header (name value-fmt &rest value-args) (write-http-line "~A: ~?" name value-fmt value-args))) - (when (and parameters (not (eq method :post))) + (when parameters (setf (uri-query uri) ;; append parameters to existing query of URI (format nil "~@[~A~]~:*~:[~;&~]~A" thanks, --Jan

2 3

[drakma-devel] New release 0.10.0 (Was: Drakma and metaweb)
by Edi Weitz 20 Sep '07

20 Sep '07

On Mon, 17 Sep 2007 22:29:13 -0500, "Alexey Goldin" <alexey.goldin(a)gmail.com> wrote: > Sorry, could not find specific Drakma list so I send it to you > directly. Really? What did you try? I'd say the mailing list is hard to miss. > Below is the code I use (I use Lisp very episodically, so pardon my > style). I have problems with freebase-login function. Here is what > Metaweb sends me (etherial capture, cookies typed over with **** > just in case) Please try again with the latest versions of Chunga (0.4.0) and Drakma (0.10.0) and see if that fixes it. And please report back to the mailing list. Thanks, Edi.

2 2

[drakma-devel] Problem abouth POST HTTP request
by Nicolas Lamirault 18 Sep '07

18 Sep '07

hi, i've got this request : $> curl --data '{"author":"nicolas"}' http://localhost:8888/test -H "application/json" {"ok":true,"_id":"C97DCFBF09D32461D60F0D30BF3E807C","_rev":555997582}% i would like to make the same request using Drakma : CL-USER> (drakma:http-request "http://localhost:8888/test" :method :post :form-data t :external-format-out :UTF-8 :parameters '(("author" . "nicolas"))) POST /test HTTP/1.1 Host: localhost:8888 User-Agent: Drakma/0.9.1 (SBCL 1.0; Linux; 2.6.15-23-686; http://weitz.de/drakma/) Accept: */* Connection: close Content-Type: multipart/form-data; boundary=----------sUTYSe7i1UX7ONyEB68U4BbXyx2TZYZ0x1Qmx4vCVWyI9Bpb92 Content-Length: 188 HTTP/1.1 500 Internal Server Error Server: inets/develop Date: Tue, 18 Sep 2007 10:54:03 GMT Cache-Control: no-cache Pragma: no-cache Expires: Tue, 18 Sep 2007 10:54:03 GMT Damien: awesome Content-Type: text/plain; charset=utf-8 Transfer-Encoding: chunked Connection:close "{\"error\":{\"id\":\"EXIT\",\"reason\":\"{function_clause,[{cjson,tokenize_number,[[45,45,45,45,45,45,45,45,45,45,45,115,85,84,89,83,101,55,105,49,85,88,55,79,78,121,69,66,54,56,85,52,66,98,88,121,120,50,84,90,89,90,48,120,49,81,109,120,52,118,67,86,87,121,73,57,66,112,98,57,50,13,10,67,111,110,116,101,110,116,45,68,105,115,112,111,115,105,116,105,111,110,58,32,102,111,114,109,45,100,97,116,97,59,32,110,97,109,101,61,34,97,117,116,104,111,114,34,13,10,13,10,110,105,99,111,108,97,115,13,10,45,45,45,45,45,45,45,45,45,45,45,45,115,85,84,89,83,101,55,105,49,85,88,55,79,78,121,69,66,54,56,85,52,66,98,88,121,120,50,84,90,89,90,48,120,49,81,109,120,52,118,67,86,87,121,73,57,66,112,98,57,50,45,45,13,10],int,{decoder,utf8,null,1,2,any},[45]]},{cjson,tokenize,2},{cjson,decode1,2},{cjson,json_decode,2},{mod_couch,handle_db_request,3},{mod_couch,do,1},{httpd_response,traverse_modules,2},{httpd_response,generate_and_send_response,1}]}\"}}" 500 ((:SERVER . "inets/develop") (:DATE . "Tue, 18 Sep 2007 10:54:03 GMT") (:CACHE-CONTROL . "no-cache") (:PRAGMA . "no-cache") (:EXPIRES . "Tue, 18 Sep 2007 10:54:03 GMT") (:DAMIEN . "awesome") (:CONTENT-TYPE . "text/plain; charset=utf-8") (:TRANSFER-ENCODING . "chunked") (:CONNECTION . "close")) #<PURI:URI http://localhost:8888/test> #<FLEXI-STREAMS:FLEXI-IO-STREAM {BFB70A1}> T "Internal Server Error" i've got an error code 500. Due to a bad request i think. Someon knows what error i did in this request ? thanks. -- Nicolas Lamirault

2 4

[drakma-devel] New Chunga release 0.4.0
by Edi Weitz 18 Sep '07

18 Sep '07

ChangeLog: Version 0.4.0 2007-09-18 Added *TREAT-SEMICOLON-AS-CONTINUATION* [Note that Chunga's behaviour will be incompatible with previous versions in the rare case that you're reading headers which end with a semicolon. Use this variable to override.] Download: http://weitz.de/files/chunga.tar.gz

1 0

[drakma-devel] New Chunga release 0.3.1
by Edi Weitz 06 Sep '07

06 Sep '07

ChangeLog: Version 0.3.1 2007-09-07 Fixed bug in STREAM-LISTEN Download: http://weitz.de/files/chunga.tar.gz

1 0