- iolib-devel - mailman3.common-lisp.net

[iolib-devel] Bug in asdf-additions-0.5.2: lispworks spell wrong
by Chun Tian (binghe) 06 Jun '07

06 Jun '07

Hi, iolib developers There's a small bug in asdf-additions-0.5.2: you spell "lispworks" to "lisworks", this caused cannot compile iolib in LispWorks, actually didn't start. A trivial patch in attach. Chun Tian (binghe)

2 1

[iolib-devel] crash with the current iolib
by Aycan iRiCAN 05 Jun '07

05 Jun '07

Hi, First I want to thank you for your great effort. I tried to stress the current iolib. Attached is a simple HTTP reply generator. I used sbcl 1.0.5 VM on a 32 bit AMD desktop machine. I used siege with lot's of concurrent connections. Here is the first inspection: This is my stupid test server with current iolib (with a small content size). aycan@zen ~ $ siege -b -c10 -t5S http://localhost:8001/ ** siege 2.61 ** Preparing 10 concurrent users for battle. The server is now under siege... Lifting the server siege.. done. Transactions: 6996 hits Availability: 100.00 % Elapsed time: 4.86 secs Data transferred: 615648 bytes Response time: 0.01 secs Transaction rate: 1439.51 trans/sec Throughput: 126676.54 bytes/sec Concurrency: 9.53 Successful transactions: 6996 Failed transactions: 0 Longest transaction: 4.25 Shortest transaction: 0.00 I got 1490 transactions per second. The performance is great (I got around 500 trans/sec with a threaded version) but when I repeat the test, SBCL crashes silently and eats all my cpu. I don't get any errors or some output. Also the :timeout parameter to add-fd should not be nil by default, if so I got type errors with lengthy content sizes. Here is the same siege parameters applied to *apache-tomcat-6-0-13* (the content size is around 7600 bytes): aycan@zen ~ $ siege -b -c100 -t5S http://localhost:8080/ ** siege 2.61 ** Preparing 100 concurrent users for battle. The server is now under siege... Lifting the server siege.. done. Transactions: 16083 hits Availability: 100.00 % Elapsed time: 6.71 secs Data transferred: 118274382 bytes Response time: 0.00 secs Transaction rate: 2396.87 trans/sec Throughput: 17626584.40 bytes/sec Concurrency: 10.63 Successful transactions: 16083 Failed transactions: 0 Longest transaction: 4.18 Shortest transaction: 0.00 Is it possible to outperform java io performance? -- aycan -- Aycan iRiCAN C0R3 Computer Security Group http://people.core.gen.tr/~aycan.irican/ (in-package :asdf) (eval-when (:compile-toplevel :load-toplevel) (asdf:oos 'asdf:load-op 'iolib)) (defpackage :iolib-problem (:use #:common-lisp #:net.sockets #:iomux)) (in-package :iolib-problem) (defparameter *server* nil) (defparameter *event-base* (make-instance 'iomux:event-base)) (defparameter *event-loop-thread* nil) (defparameter *server-event* nil) (defun handle-connection (sock handler) (unwind-protect (progn (funcall handler sock) (finish-output sock)) (close sock))) (defun make-server (port) (let ((sock (create-socket :address-family :internet :type :stream :connect :passive :ipv6 nil))) (bind-address sock +ipv4-unspecified+ :port port) (socket-listen sock) sock)) (defun add-connection-handler (event-base connection request-handler) (let ((handle)) (labels ((close-handler () (remove-event event-base handle) (close connection)) (handler (fd evtype) (declare (ignorable fd)) (handler-case (cond ((eq evtype :read) (funcall request-handler connection) (close-handler)) (t (close-handler))) (condition (c) (declare (ignorable c)) (describe c))) )) (setf handle (iomux:add-fd event-base (sockets::socket-fd connection) :read #'handler :persistent t :timeout 1))))) (defun add-single-threaded-server (event-base listener-socket request-handler) (labels ((handler (fd evtype) (declare (ignorable fd)) (case evtype (:read (let ((connection (accept-connection listener-socket))) (add-connection-handler event-base connection request-handler))) (:otherwise (break))))) (iomux::add-fd event-base (sockets::socket-fd listener-socket) :read #'handler :persistent t :timeout 1))) (defun start-server (port) (setf *server* (make-server port)) (setf *server-event* (add-single-threaded-server *event-base* *server* #'test-handler)) (event-dispatch *event-base*)) (defun stop-server () (close *server*) (remove-event *event-base* *server-event*) (setf *server* nil) (setf *server-event* nil)) (defparameter *response-body* "<HTML><HEAD><TITLE>Test</TITLE></HEAD><BODY>AAAAAAAAAAAAAAAAAAAAAAAAAAAAAA</BODY></HTML>") (defparameter *response-header* (format nil "HTTP/1.1 200 OK~%Content-Type: text/html~%Content-Length: ~A~%" (length *response-body*))) (defun test-handler (sock) (format sock "~A~%~A" *response-header* *response-body*))

2 1

[iolib-devel] New releases: iolib-posix-0.5.4 and iolib-0.5.3
by Stelian Ionescu 03 Jun '07

03 Jun '07

I've just made a new round of releases. Changes WRT the previous version are: * NET.SOCKETS: TCP socket options for Linux and FreeBSD have been added, so now you can set options like TCP_MAXSEG and TCP_NODELAY * NET.SOCKETS: calling BIND-ADDRESS on active sockets now works, although probably it is seldom needed * NET.SOCKETS: the function MAKE-SOCKET have been renamed to CREATE-SOCKET, and an implementation of MAKE-SOCKET compatible with Allegro 8 has been added basically you can now do something like this: (make-socket :address-family :internet :type :stream :connect :passive :reuse-address t :local-host host :local-port port) * NET.SOCKETS: it is now possible to specify an active socket's external format in MAKE-SOCKET and setting it through (SETF EXTERNAL-FORMAT-OF) works better; accepted values are: - keywords: either :default or the name of an encoding, :utf-8 or :ascii for instance - lists specifying the encoding and the end-of-line flavour(:unix, :mac or :dos): '(:utf-8 :line-terminator :dos) - EXTERNAL-FORMAT structures, as returned by IOENC:MAKE-EXTERNAL-FORMAT * a modified version of CL-SMTP has been added in package NET.SMTP-CLIENT the system depends on CL-BASE64 and has only one external symbol: the function SEND-EMAIL * NET.SOCKETS: the INVALID-ADDRESS condition has been eliminated, the address conversion functions(like DOTTED-TO-VECTOR, VECTOR-TO-COLON-SEPARATED ...) now signal only TYPE-ERROR or PARSE-ERROR * IO.MULTIPLEX: EVENT-DISPATCH has been improved, and two more functions have been exported: EXIT-EVENT-LOOP and EVENT-BASE-EMPTY-P(which returns T when no events are being monitored by an event base) A special variable *MAXIMUM-EVENT-LOOP-TIMEOUT* has been exported: it serves to limit the poll time of the event loop in case a thread other than the one of the event loop accesses the event base. Defaults to 1 (in seconds) but can also be bound to NIL which means no timeout(or infinity) -- (sign :name "Stelian Ionescu" :aka "fe[nl]ix" :quote "Quidquid latine dictum sit, altum videtur.")

1 0

[iolib-devel] event handlers not working
by Aycan iRiCAN 01 Jun '07

01 Jun '07

I'm trying to write a simple example. But I cannot make the event handler work. Could you please check this code (mostly stolen from philip-jose). (in-package :asdf) (defpackage :iolib-test (:use #:common-lisp #:net.sockets #:iomux #:bordeaux-threads)) (in-package :iolib-test) (defparameter *server* nil) (defparameter *event-base* (make-instance 'iomux:event-base)) (defparameter *server-event* nil) (defun handle-connection (sock handler) (unwind-protect (progn (apply handler sock) (finish-output sock)) (close sock))) (defun make-server (port) (let ((sock (make-socket :address-family :internet :type :stream :connect :passive :ipv6 nil))) (bind-address sock +ipv4-unspecified+ :port port) (socket-listen sock) sock)) (defun make-connection-worker (socket handler) #'(lambda () (break) (apply #'handle-connection socket handler))) (defun connection-spawner (listener-socket handler) #'(lambda (fd evtype) (if (eql evtype :read) (let ((connection (accept-connection listener-socket))) (make-thread (make-connection-worker connection handler)) :name "connection worker") (format t "Error on FD ~A" fd)))) (defun add-multi-threaded-server (event-base listener-socket handler) (iomux::add-fd event-base (sockets::socket-fd listener-socket) :read (connection-spawner listener-socket handler) :persistent t)) (defun start-server (port) (setf *server* (make-server port)) (setf *server-event* (add-multi-threaded-server *event-base* *server* #'test-handler))) (defun stop-server () (close *server*) (remove-event *event-base* *server-event*) (setf *server* nil) (setf *server-event* nil)) (defun test-handler (sock) (write "<HTML><HEAD><TITLE>Test</TITLE></HEAD><BODY><P>Hello, World!</P></BODY></HTML>" :stream sock)) Best Regards, -- Aycan iRiCAN http://people.core.gen.tr/~aycan.irican/

2 2

[iolib-devel] iolib fails to compile
by Faré 17 May '07

17 May '07

With the latest iolib, iolib-posix and cffi from darcs, trying to load the fasl for file io-multiplex/utils.lisp fails miserably. Does iolib depend on some non-committed things in iolib-posix? Or on a special branch of cffi? Unknown CFFI type: :TIME. [Condition of type SIMPLE-ERROR] Restarts: 0: [RETRY] Retry performing #<ASDF:LOAD-OP (:VERBOSE T) {2856581}> on #<ASDF:CL-SOURCE-FILE "util$ 1: [ACCEPT] Continue, treating #<ASDF:LOAD-OP (:VERBOSE T) {2856581}> on #<ASDF:CL-SOURCE-FILE "u$ 2: [ABORT-REQUEST] Abort handling SLIME request. 3: [TERMINATE-THREAD] Terminate this thread (#<THREAD "repl-thread" {2DBA269}>) Backtrace: 0: (CFFI::PARSE-TYPE :TIME) 1: (SB-FASL::FOP-FUNCALL) 1: (SB-FASL::FOP-FUNCALL) 2: (SB-FASL::LOAD-FASL-GROUP #<SB-SYS:FD-STREAM for "file /home/fare/.cache/lisp-fasl/sbcl-1.0.4.109.ita.4-linux-x86/home/fare/fare/lisp/philip-jose/utilities.fasl" {3DF22F1}>) [ François-René ÐVB Rideau | Reflection&Cybernethics | http://fare.tunes.org ] I have many lucky numbers: 45, 357, 9, etc etc etc. but 911 is NOT one of them - I440r

2 1

[iolib-devel] Additions to iolib-posix
by Faré 02 May '07

02 May '07

;; (1) this code should be moved to iolib-posix and exported under some name... (defun fsleep (delay) (when (plusp delay) (multiple-value-bind (i d) (floor delay) (unless (zerop i) ;; TODO: here insert check for overflow... (et::sleep i)) (unless (zerop d) (et::usleep (floor (* d 1000000)))))) nil) ;; (2) et::gettime should be exported ;; (3) unless we don't care about the inefficiency of calling gettime many times, we should expose the deadline in polling, etc., because that's what the application wants, anyway. At least mine. [ François-René ÐVB Rideau | Reflection&Cybernethics | http://fare.tunes.org ] The hacker: someone who figured things out and made something cool happen. -- Alan Schmitt

1 0

Re: [iolib-devel] Re: Liberating cffi-grovel
by Sean 27 Apr '07

27 Apr '07

On Thu, 2007-04-26 at 23:15 +0200, Stelian Ionescu wrote: > On Wed, Apr 25, 2007 at 02:04:42PM +0100, Sean wrote: > >I know it is late coming but here is one of the promised patches. > > >This adds support for Lispworks to cffi-grovel. > could you make the patch against iolib-posix ? you seem here to have > patched cffi-net instead; also this patch is reversed, it removes code > instead of adding Sorry about that, I don't where my head was. I've attached a darcs patch against iolib-posix, I hope it's what you are expecting. Cheers, Sean. -- ...Please don't assume Lisp is only useful for Animation and Graphics, AI, Bioinformatics, B2B and E-Commerce, Data Mining, EDA/Semiconductor applications, Expert Systems, Finance, Intelligent Agents, Knowledge Management, Mechanical CAD, Modeling and Simulation, Natural Language, Optimization, Research, Risk Analysis, Scheduling, Telecom, and Web Authoring just because these are the only things they happened to list. Kent Pitman.

2 1

[iolib-devel] Liberating cffi-grovel
by Sean 27 Apr '07

27 Apr '07

Hi all, I've noticed that cffi-grovel has (recently?) been superseded (along with the rest of cffi-net) by iolib-grovel. I've been using cffi-grovel for a while now and am My current thoughts are that a) cffi-grovel is a nice descriptive name and b) this is the kind of package that should be asdf-install'able on it's own. Are there any plans for liberating cffi-grovel and making it standalone project? Cheers, Sean. -- ...Please don't assume Lisp is only useful for Animation and Graphics, AI, Bioinformatics, B2B and E-Commerce, Data Mining, EDA/Semiconductor applications, Expert Systems, Finance, Intelligent Agents, Knowledge Management, Mechanical CAD, Modeling and Simulation, Natural Language, Optimization, Research, Risk Analysis, Scheduling, Telecom, and Web Authoring just because these are the only things they happened to list. Kent Pitman.

3 7

[iolib-devel] socket example
by Mikhail Shevchuk 26 Apr '07

26 Apr '07

Hello, Is there any examples of how can I connect to a remote machine and print/send messages via IOlib? -- A vivid and creative mind characterizes you.

2 2

[iolib-devel] Trivial patch to iolib
by Faré 26 Apr '07

26 Apr '07

This patch * moves a misplaced (disabled) conditionally-compiled extra test to where it ought to be, in unread-char. * fixes some whitespace [ François-René ÐVB Rideau | Reflection&Cybernethics | http://fare.tunes.org ] The American Republic will endure, until politicians realize they can bribe the people with their own money. -- Alexis de Tocqueville

2 1