January 2010 - iolib-devel - mailman3.common-lisp.net

[iolib-devel] Introductory tcp client/server examples
by Peter Keller 14 May '10

14 May '10

Hello, I've been writing a tutorial for how to use IOLib loosely following the second edition of the unix network programming book by Richard Stevens. Attached to this mail is a tarball of a collection of example programs I've written which illustrate certain concepts in using IOLib. It is intended that this tutorial go all the way from the simple iterative daytime server example, all the way to nonblocking and multiplexed network i/o for a server with many clients. I am not finished with this work at all (such as the tutorial is simply an outline and I only have a small collection of example programs!), but Stelian wanted to see examples of the code I had written and thought the list would be a good place for it. Thank you. -pete

2 2

[iolib-devel] Patch for a nil callback invocation.
by Peter Keller 07 Mar '10

07 Mar '10

Hello, Under the conditions where there are two or more handlers registered for a single fd in the multiplexer and one of the handlers removes all the fd's callbacks and other callbacks for that fd should have been invoked in the same event-dispath iteration, there is an invocation of a nil callback in event-dispatch. To the best of my knowledge, this patch below fixes it. Thank you. -pete diff --git a/src/multiplex/event-loop.lisp b/src/multiplex/event-loop.lisp index 35879fd..4afba32 100644 --- a/src/multiplex/event-loop.lisp +++ b/src/multiplex/event-loop.lisp @@ -306,7 +306,8 @@ within the extent of BODY. Closes VAR." (setf expired-events nil) (setf (values eventsp deletion-list) (dispatch-fd-events-once event-base poll-timeout now)) - (%remove-handlers event-base deletion-list) + (unless (equal '(nil nil) deletion-list) + (%remove-handlers event-base deletion-list)) (when (expire-pending-timers fd-timers now) (setf eventsp t)) (dispatch-fd-timeouts expired-events) (when (expire-pending-timers timers now) (setf eventsp t)) @@ -352,13 +353,14 @@ within the extent of BODY. Closes VAR." (defun %dispatch-event (fd-entry event-type errorp now) (let ((ev (fd-entry-handler fd-entry event-type))) - (funcall (fd-handler-callback ev) - (fd-entry-fd fd-entry) - event-type - (if errorp :error nil)) - (when-let (timer (fd-handler-timer ev)) - (reschedule-timer-relative-to-now timer now)) - (fd-handler-one-shot-p ev))) + (when ev + (funcall (fd-handler-callback ev) + (fd-entry-fd fd-entry) + event-type + (if errorp :error nil)) + (when-let (timer (fd-handler-timer ev)) + (reschedule-timer-relative-to-now timer now)) + (fd-handler-one-shot-p ev)))) (defun dispatch-fd-timeouts (events) (dolist (ev events)

2 3

[iolib-devel] New patches: 19-Jan-2010
by Stelian Ionescu 20 Jan '10

20 Jan '10

commit bafe0d3f4a561b227387e3c50d6a951aec092b03 Author: Stelian Ionescu <sionescu(a)cddr.org> Date: Tue Jan 19 17:50:32 2010 +0100 Fix docstrings src/os/os-unix.lisp | 45 ++++++++++++++++++++++----------------------- 1 files changed, 22 insertions(+), 23 deletions(-) commit 211906763f03bda278a480f6918d6c7eca33649c Author: Stelian Ionescu <sionescu(a)cddr.org> Date: Thu Jan 14 17:42:14 2010 +0100 Signal SUBTYPE-ERROR when a MEMORY-ZSTREAM is initialized with data inconsistent with the specified elementh-type. src/streams/zeta/stream.lisp | 8 +++++--- 1 files changed, 5 insertions(+), 3 deletions(-) commit b6be014d6b2d86080e4e0e4f9253cb993d3d7fb9 Author: Stelian Ionescu <sionescu(a)cddr.org> Date: Thu Jan 14 17:09:48 2010 +0100 Fix typo and untabify. src/streams/zeta/stream.lisp | 4 ++-- 1 files changed, 2 insertions(+), 2 deletions(-) commit a93a08d16a86f535dd63d9e331553e3d22ef1092 Author: Stelian Ionescu <sionescu(a)cddr.org> Date: Thu Jan 14 17:09:24 2010 +0100 Rename IOLIB.ZETA-STREAMS -> IOLIB.ZSTREAMS src/iolib.zeta-streams.asd | 29 ----------------------------- src/iolib.zstreams.asd | 29 +++++++++++++++++++++++++++++ src/streams/zeta/conditions.lisp | 2 +- src/streams/zeta/device.lisp | 2 +- src/streams/zeta/ffi-functions-unix.lisp | 2 +- src/streams/zeta/file-unix.lisp | 2 +- src/streams/zeta/iobuf.lisp | 2 +- src/streams/zeta/pkgdcl.lisp | 2 +- src/streams/zeta/stream.lisp | 2 +- src/streams/zeta/types.lisp | 2 +- 10 files changed, 37 insertions(+), 37 deletions(-) An updated tarball of IOLib's source can be downloaded here: http://common-lisp.net/project/iolib/files/snapshots/iolib-20100119.tar.gz Gitweb URL: http://repo.or.cz/w/iolib.git

1 0

[iolib-devel] event-dispatch
by Peter Keller 20 Jan '10

20 Jan '10

Hello, Under what conditions does event-dispatch return? For example, if I set up a read and write handler on one fd and through the course of the network protocol, one of the handlers decides to close the connection. If this handler calls remove-fd-handlers for the socket's underlying fd in question, is this sufficient to make event-dispath return? Thanks. -pete

1 1

[iolib-devel] New patches: 13-Jan-2010
by Stelian Ionescu 14 Jan '10

14 Jan '10

commit cf90ef5196f64994be1f6dde7caa455223d280de Author: Stelian Ionescu <sionescu(a)cddr.org> Date: Wed Jan 13 22:05:14 2010 +0100 Fix DELETE-FILES: pass correct closure to WALK-DIRECTORY. Bug spotted by Levente Mészáros. src/os/os-unix.lisp | 4 ++-- 1 files changed, 2 insertions(+), 2 deletions(-) commit 336ed5627fb2d84d819906db72ac1f8a57c2ccc1 Author: Stelian Ionescu <sionescu(a)cddr.org> Date: Tue Jan 12 19:02:32 2010 +0100 Use package :iolib.sockets in :iolib.trivial-sockets. src/sockets/trivial-sockets.lisp | 52 +++++++++++++++++++------------------- 1 files changed, 26 insertions(+), 26 deletions(-) commit 70c07b60d33d90885cfe1b5cf2b066be6b3b6e04 Author: Stelian Ionescu <sionescu(a)cddr.org> Date: Tue Jan 12 01:48:55 2010 +0100 Delete spurious .gitignore src/streams/.gitignore | 15 --------------- 1 files changed, 0 insertions(+), 15 deletions(-) commit d44e8f9de268bd7659308bdc9e2407f324862940 Author: Stelian Ionescu <sionescu(a)cddr.org> Date: Tue Jan 12 01:45:35 2010 +0100 Replace EQ with EQL. src/base/scl-gray-streams.lisp | 2 +- src/iolib/pkgdcl.lisp | 4 ++-- src/os/os-unix.lisp | 4 ++-- src/sockets/dns/lookup.lisp | 4 ++-- src/sockets/dns/query.lisp | 6 +++--- src/sockets/make-socket.lisp | 2 +- src/sockets/namedb/services.lisp | 4 ++-- src/sockets/socket-methods.lisp | 2 +- src/sockets/socket-options.lisp | 4 ++-- src/sockets/trivial-sockets.lisp | 8 ++++---- src/streams/gray/gray-stream-methods.lisp | 22 +++++++++++----------- 11 files changed, 31 insertions(+), 31 deletions(-) commit 6cf587bb302a38a0efe019811ba28f329cdea596 Author: Stelian Ionescu <sionescu(a)cddr.org> Date: Tue Jan 12 01:20:59 2010 +0100 PRINT-OBJECT for INET-ADDRESS now respects *PACKAGE*. src/sockets/address.lisp | 2 +- 1 files changed, 1 insertions(+), 1 deletions(-) commit 90b85eda8d1bedadbb9020a58c8116a78e21e627 Author: Stelian Ionescu <sionescu(a)cddr.org> Date: Tue Jan 12 01:19:55 2010 +0100 Pass OS environment as optional arg not keyword arg. src/os/os-unix.lisp | 8 ++++---- 1 files changed, 4 insertions(+), 4 deletions(-) commit dcecc4adc34ec57cef79dc073d24c6d701eaa30b Author: Stelian Ionescu <sionescu(a)cddr.org> Date: Fri Jan 8 17:51:58 2010 +0100 Style changes in .asd files: don't qualify ASDF symbols since the file is already loaded into its own *package* that uses ASDF. src/iolib.asd | 10 +++---- src/iolib.base.asd | 4 +- src/iolib.multiplex.asd | 14 ++++------ src/iolib.os.asd | 8 ++---- src/iolib.pathnames.asd | 7 +---- src/iolib.sockets.asd | 53 ++++++++++++++++++++--------------------- src/iolib.streams.asd | 6 +--- src/iolib.syscalls.asd | 21 +++++----------- src/iolib.trivial-sockets.asd | 4 +-- src/iolib.zeta-streams.asd | 11 ++------ 10 files changed, 56 insertions(+), 82 deletions(-) An updated tarball of IOLib's source can be downloaded here: http://common-lisp.net/project/iolib/files/snapshots/iolib-20100113.tar.gz Gitweb URL: http://repo.or.cz/w/iolib.git

1 0

[iolib-devel] accept question
by Peter Keller 13 Jan '10

13 Jan '10

Hello, I have a few questions... On a busy server, sometimes a connection to a server aborts before the accept returns. An example is: client calls connect, server gets SYN, sends back SYN,ack, connect returns in the client, the connection is ESTABLISHED, then some time passes, the client sends RST, and *then* the server calls accept. At this point the accept returns ECONNABORTED (well, it depends on the unix distro, actually). Does iolib internally catch this and restart the accept, is there a signaled condition? what does it do? Also, related, how does iolib, or the underlying implementation's accept, deal with EINTR in the various calls? Especially with a nonblocking connect, which usually requires a trip through select() in order to deal with the socket? And, finally, is there any stable interface to the abstracted multiplexer so I can do nonblocking i/o between multiple clients? If not, the only solution left to me is threading, and I'm not sure how sbcl scales to ten thousand+ threads. Instead of the callback method, is there a "give a pile of read/write/except sockets to a fake select which implements the select semantic with real select/pool/kqueue"? Additionally, is there any means to do nonblocking i/o on *standard-input* or *standard-output*? Thank you. -pete

1 0

[iolib-devel] Serial devices extension: switching from mercurial to git
by marsijanin＠gmail.com 09 Jan '10

09 Jan '10

Good ${current_time_of_day} again! I converted my repo from mercurial to git using `fast-export` (http://repo.or.cz/w/fast-export.git) and placed new git repo at github: http://github.com/marsijanin/iolib.termios/. Hooping that git migration will be useful for future collaboration, Nikolay V. Razbegaiev

1 0