June 2007 - iolib-devel - mailman3.common-lisp.net

[iolib-devel] test
by Stelian Ionescu 12 Jun '07

12 Jun '07

test -- (sign :name "Stelian Ionescu" :aka "fe[nl]ix" :quote "Quidquid latine dictum sit, altum videtur.")

1 0

[iolib-devel] #+lispworks missing in iolib/io.streams/pkgdcl.lisp
by binghe.lisp＠gmail.com 09 Jun '07

09 Jun '07

Hi, IOLib The line 31 of iolib/io.streams/pkgdcl.lisp miss a "lispworks" feature. This caused io.streams package cannot import symbols from lispworks' stream package, and cause a error when I use net.smtp-client: Error: The class #<STANDARD-CLASS IO.STREAMS:DUAL-CHANNEL-GRAY-STREAM 40D0347A5B> cannot be finalized because the following superclass is not defined: #<FORWARD-REFERENCED-CLASS IO.STREAMS:FUNDAMENTAL-BINARY-INPUT-STREAM 40D03479CB>. 1 (abort) Return to level 0. 2 Return to top loop level 0. Type :b for backtrace, :c <option number> to proceed, or :? for other options A trivial patch may fix this. --8<---------------cut here---------------start------------->8--- --- pkgdcl.lisp.orig 2007-06-08 02:12:43.910573918 +0800 +++ pkgdcl.lisp 2007-06-08 02:01:45.817445668 +0800 @@ -28,7 +28,7 @@ `(defpackage :io.streams (:use #:common-lisp #:cffi #:iolib-utils #:io.encodings) - #+(or sbcl cmu openmcl clisp allegro) + #+(or sbcl cmu openmcl clisp allegro lispworks) (:import-from #+sbcl #:sb-gray #+cmu #:ext #+openmcl #:ccl --8<---------------cut here---------------end--------------->8--- -- '()

2 4

[iolib-devel] (gcc-cpu-flags) in asdf-additions/unix-dso.lisp
by Chun Tian 07 Jun '07

07 Jun '07

Hi, iolib developers I'm not sure why need a (gcc-cpu-flags) function to detect a gcc compile flag (-m32/-m64) and use this to compile C files. First, use (cffi:foreign-type-size :int) to guess is wrong at least on amd64 Linux: (cffi:foreign-type-size :int) return 4 on amd64 Linux, so you guess wrong to 32-bit. Second, if you guess wrong, a 64-bit Lisp process will can not load a 32-bit library. If I disable this (gcc-cpu-flags), gcc with no -m32/-m64 can always do the right thing on both 32 and 64-bit platform, and the Lisp process can load this library. (I'm just doing this on Debian GNU/Linux amd64 and LispWorks 5.0.2 Enterprise Edition for AMD64 Linux.) Am I right? Thanks. Chun Tian (binghe)

4 3

[iolib-devel] Bug in asdf-additions-0.5.2: lispworks spell wrong
by Chun Tian (binghe) 06 Jun '07

06 Jun '07

Hi, iolib developers There's a small bug in asdf-additions-0.5.2: you spell "lispworks" to "lisworks", this caused cannot compile iolib in LispWorks, actually didn't start. A trivial patch in attach. Chun Tian (binghe)

2 1

[iolib-devel] crash with the current iolib
by Aycan iRiCAN 05 Jun '07

05 Jun '07

Hi, First I want to thank you for your great effort. I tried to stress the current iolib. Attached is a simple HTTP reply generator. I used sbcl 1.0.5 VM on a 32 bit AMD desktop machine. I used siege with lot's of concurrent connections. Here is the first inspection: This is my stupid test server with current iolib (with a small content size). aycan@zen ~ $ siege -b -c10 -t5S http://localhost:8001/ ** siege 2.61 ** Preparing 10 concurrent users for battle. The server is now under siege... Lifting the server siege.. done. Transactions: 6996 hits Availability: 100.00 % Elapsed time: 4.86 secs Data transferred: 615648 bytes Response time: 0.01 secs Transaction rate: 1439.51 trans/sec Throughput: 126676.54 bytes/sec Concurrency: 9.53 Successful transactions: 6996 Failed transactions: 0 Longest transaction: 4.25 Shortest transaction: 0.00 I got 1490 transactions per second. The performance is great (I got around 500 trans/sec with a threaded version) but when I repeat the test, SBCL crashes silently and eats all my cpu. I don't get any errors or some output. Also the :timeout parameter to add-fd should not be nil by default, if so I got type errors with lengthy content sizes. Here is the same siege parameters applied to *apache-tomcat-6-0-13* (the content size is around 7600 bytes): aycan@zen ~ $ siege -b -c100 -t5S http://localhost:8080/ ** siege 2.61 ** Preparing 100 concurrent users for battle. The server is now under siege... Lifting the server siege.. done. Transactions: 16083 hits Availability: 100.00 % Elapsed time: 6.71 secs Data transferred: 118274382 bytes Response time: 0.00 secs Transaction rate: 2396.87 trans/sec Throughput: 17626584.40 bytes/sec Concurrency: 10.63 Successful transactions: 16083 Failed transactions: 0 Longest transaction: 4.18 Shortest transaction: 0.00 Is it possible to outperform java io performance? -- aycan -- Aycan iRiCAN C0R3 Computer Security Group http://people.core.gen.tr/~aycan.irican/ (in-package :asdf) (eval-when (:compile-toplevel :load-toplevel) (asdf:oos 'asdf:load-op 'iolib)) (defpackage :iolib-problem (:use #:common-lisp #:net.sockets #:iomux)) (in-package :iolib-problem) (defparameter *server* nil) (defparameter *event-base* (make-instance 'iomux:event-base)) (defparameter *event-loop-thread* nil) (defparameter *server-event* nil) (defun handle-connection (sock handler) (unwind-protect (progn (funcall handler sock) (finish-output sock)) (close sock))) (defun make-server (port) (let ((sock (create-socket :address-family :internet :type :stream :connect :passive :ipv6 nil))) (bind-address sock +ipv4-unspecified+ :port port) (socket-listen sock) sock)) (defun add-connection-handler (event-base connection request-handler) (let ((handle)) (labels ((close-handler () (remove-event event-base handle) (close connection)) (handler (fd evtype) (declare (ignorable fd)) (handler-case (cond ((eq evtype :read) (funcall request-handler connection) (close-handler)) (t (close-handler))) (condition (c) (declare (ignorable c)) (describe c))) )) (setf handle (iomux:add-fd event-base (sockets::socket-fd connection) :read #'handler :persistent t :timeout 1))))) (defun add-single-threaded-server (event-base listener-socket request-handler) (labels ((handler (fd evtype) (declare (ignorable fd)) (case evtype (:read (let ((connection (accept-connection listener-socket))) (add-connection-handler event-base connection request-handler))) (:otherwise (break))))) (iomux::add-fd event-base (sockets::socket-fd listener-socket) :read #'handler :persistent t :timeout 1))) (defun start-server (port) (setf *server* (make-server port)) (setf *server-event* (add-single-threaded-server *event-base* *server* #'test-handler)) (event-dispatch *event-base*)) (defun stop-server () (close *server*) (remove-event *event-base* *server-event*) (setf *server* nil) (setf *server-event* nil)) (defparameter *response-body* "<HTML><HEAD><TITLE>Test</TITLE></HEAD><BODY>AAAAAAAAAAAAAAAAAAAAAAAAAAAAAA</BODY></HTML>") (defparameter *response-header* (format nil "HTTP/1.1 200 OK~%Content-Type: text/html~%Content-Length: ~A~%" (length *response-body*))) (defun test-handler (sock) (format sock "~A~%~A" *response-header* *response-body*))

2 1

[iolib-devel] New releases: iolib-posix-0.5.4 and iolib-0.5.3
by Stelian Ionescu 03 Jun '07

03 Jun '07

I've just made a new round of releases. Changes WRT the previous version are: * NET.SOCKETS: TCP socket options for Linux and FreeBSD have been added, so now you can set options like TCP_MAXSEG and TCP_NODELAY * NET.SOCKETS: calling BIND-ADDRESS on active sockets now works, although probably it is seldom needed * NET.SOCKETS: the function MAKE-SOCKET have been renamed to CREATE-SOCKET, and an implementation of MAKE-SOCKET compatible with Allegro 8 has been added basically you can now do something like this: (make-socket :address-family :internet :type :stream :connect :passive :reuse-address t :local-host host :local-port port) * NET.SOCKETS: it is now possible to specify an active socket's external format in MAKE-SOCKET and setting it through (SETF EXTERNAL-FORMAT-OF) works better; accepted values are: - keywords: either :default or the name of an encoding, :utf-8 or :ascii for instance - lists specifying the encoding and the end-of-line flavour(:unix, :mac or :dos): '(:utf-8 :line-terminator :dos) - EXTERNAL-FORMAT structures, as returned by IOENC:MAKE-EXTERNAL-FORMAT * a modified version of CL-SMTP has been added in package NET.SMTP-CLIENT the system depends on CL-BASE64 and has only one external symbol: the function SEND-EMAIL * NET.SOCKETS: the INVALID-ADDRESS condition has been eliminated, the address conversion functions(like DOTTED-TO-VECTOR, VECTOR-TO-COLON-SEPARATED ...) now signal only TYPE-ERROR or PARSE-ERROR * IO.MULTIPLEX: EVENT-DISPATCH has been improved, and two more functions have been exported: EXIT-EVENT-LOOP and EVENT-BASE-EMPTY-P(which returns T when no events are being monitored by an event base) A special variable *MAXIMUM-EVENT-LOOP-TIMEOUT* has been exported: it serves to limit the poll time of the event loop in case a thread other than the one of the event loop accesses the event base. Defaults to 1 (in seconds) but can also be bound to NIL which means no timeout(or infinity) -- (sign :name "Stelian Ionescu" :aka "fe[nl]ix" :quote "Quidquid latine dictum sit, altum videtur.")

1 0

[iolib-devel] event handlers not working
by Aycan iRiCAN 01 Jun '07

01 Jun '07

I'm trying to write a simple example. But I cannot make the event handler work. Could you please check this code (mostly stolen from philip-jose). (in-package :asdf) (defpackage :iolib-test (:use #:common-lisp #:net.sockets #:iomux #:bordeaux-threads)) (in-package :iolib-test) (defparameter *server* nil) (defparameter *event-base* (make-instance 'iomux:event-base)) (defparameter *server-event* nil) (defun handle-connection (sock handler) (unwind-protect (progn (apply handler sock) (finish-output sock)) (close sock))) (defun make-server (port) (let ((sock (make-socket :address-family :internet :type :stream :connect :passive :ipv6 nil))) (bind-address sock +ipv4-unspecified+ :port port) (socket-listen sock) sock)) (defun make-connection-worker (socket handler) #'(lambda () (break) (apply #'handle-connection socket handler))) (defun connection-spawner (listener-socket handler) #'(lambda (fd evtype) (if (eql evtype :read) (let ((connection (accept-connection listener-socket))) (make-thread (make-connection-worker connection handler)) :name "connection worker") (format t "Error on FD ~A" fd)))) (defun add-multi-threaded-server (event-base listener-socket handler) (iomux::add-fd event-base (sockets::socket-fd listener-socket) :read (connection-spawner listener-socket handler) :persistent t)) (defun start-server (port) (setf *server* (make-server port)) (setf *server-event* (add-multi-threaded-server *event-base* *server* #'test-handler))) (defun stop-server () (close *server*) (remove-event *event-base* *server-event*) (setf *server* nil) (setf *server-event* nil)) (defun test-handler (sock) (write "<HTML><HEAD><TITLE>Test</TITLE></HEAD><BODY><P>Hello, World!</P></BODY></HTML>" :stream sock)) Best Regards, -- Aycan iRiCAN http://people.core.gen.tr/~aycan.irican/

2 2