November 2010 - armedbear-devel - mailman3.common-lisp.net

[armedbear-devel] [ANNOUNCE] ABCL 0.23.0
by Erik Huelsmann 25 Nov '10

25 Nov '10

On behalf of the developers of ABCL (Armed Bear Common Lisp) I'm glad to be able to announce the 0.23.0 release. ABCL is a Common Lisp implementation implemented in Java and running on the JVM, featuring both an interpreter and a compiler. The compiler targets the JVM directly meaning that its output is runnable JVM bytecode. The fact that ABCL is written in Java allows for relatively easy embedding in larger applications. For integration with existing applications ABCL implements Java Specification Request (JSR) 223: Java scripting API. This release features - among lots of other things - CLOS thread safety fixes and concurrency improvements, support for Oracle's JRockit JVM, and a new (generic) class file writer. In addition, this is the first release to complete the Maxima test suite without failures, thanks to close cooperation between our projects. You can find the full release notes at: http://common-lisp.net/project/armedbear/release-notes-0.23.shtml and the list of changes at: http://trac.common-lisp.net/armedbear/browser/trunk/abcl/CHANGES If you have questions regarding use or licensing, or you find issues, please report back to the development list: armedbear-devel at common-lisp dot net Source distribution archives can be downloaded in ZIP or gzipped tar form: http://common-lisp.net/project/armedbear/releases/abcl-src-0.23.0.tar.gz http://common-lisp.net/project/armedbear/releases/abcl-src-0.23.0.zip Signatures are available under: http://common-lisp.net/project/armedbear/releases/abcl-src-0.23.0.tar.gz.asc http://common-lisp.net/project/armedbear/releases/abcl-src-0.23.0.zip.asc In addition, binaries are also available: http://common-lisp.net/project/armedbear/releases/abcl-bin-0.23.0.tar.gz http://common-lisp.net/project/armedbear/releases/abcl-bin-0.23.0.zip With associated signatures: http://common-lisp.net/project/armedbear/releases/abcl-bin-0.23.0.tar.gz.asc http://common-lisp.net/project/armedbear/releases/abcl-bin-0.23.0.zip.asc

1 1

[armedbear-devel] ANSI regressions in proposed 0.23.x
by Mark Evenson 25 Nov '10

25 Nov '10

Unfortunately, I'm seeing the following regressions in the ANSI test suite from 0.22.0 to the 0.23.x branch. I think that we can ignore the PRINT.SYMBOL.RANDOM.3 failure, as that has been present intermittently for a while. ANSI> (REPORT 'compileit '0.22.0 '0.23.0) 0.23.0[SATURN] --> 0.22.0[SATURN] additional failures: (STANDARD-METHOD-CPL ALL-EXPORTED-CL-CLASS-NAMES-ARE-VALID TYPES.9A TYPES.3 FLET.45) NIL ANSI> (REPORT 'doit '0.22.0 '0.23.0) 0.23.0[SATURN] --> 0.22.0[SATURN] additional failures: (PRINT.SYMBOL.RANDOM.3 STANDARD-METHOD-CPL ALL-EXPORTED-CL-CLASS-NAMES-ARE-VALID TYPES.9A TYPES.3) NIL (compileit 0.22.0 :id saturn :uname "x64-solaris-2.11.snv_111b" :jvm "jdk-1.6.0_22" (REINITIALIZE-INSTANCE.ERROR.1 DEFGENERIC.ERROR.20 DEFGENERIC.ERROR.21 DEFGENERIC.30 CALL-NEXT-METHOD.ERROR.1 CALL-NEXT-METHOD.ERROR.2 DEFMETHOD.ERROR.14 DEFMETHOD.ERROR.15 INVOKE-DEBUGGER.1 MAKE-CONDITION.3 MAKE-CONDITION.4 DELETE-PACKAGE.5 DELETE-PACKAGE.6 MAP.48 TYPE-OF.1 TYPE-OF.4 MAKE-PATHNAME.9 PRINT.RANDOM-STATE.1 PPRINT-FILL.14 PPRINT-FILL.15 PPRINT-LINEAR.14 PPRINT-TABULAR.13 PPRINT-LOGICAL-BLOCK.17 PPRINT-POP.7 PPRINT-POP.8 FORMAT.LOGICAL-BLOCK.CIRCLE.1 FORMAT.LOGICAL-BLOCK.CIRCLE.2 FORMAT.LOGICAL-BLOCK.CIRCLE.3 COMPILE-FILE.16 TRACE.8)) (doit 0.22.0 :id saturn (REINITIALIZE-INSTANCE.ERROR.1 DEFGENERIC.ERROR.20 DEFGENERIC.ERROR.21 DEFGENERIC.30 CALL-NEXT-METHOD.ERROR.1 CALL-NEXT-METHOD.ERROR.2 DEFMETHOD.ERROR.14 DEFMETHOD.ERROR.15 INVOKE-DEBUGGER.1 MAKE-CONDITION.3 MAKE-CONDITION.4 DELETE-PACKAGE.5 DELETE-PACKAGE.6 MAP.48 TYPE-OF.1 TYPE-OF.4 MAKE-PATHNAME.9 PRINT.SYMBOL.RANDOM.2 PRINT.STRING.RANDOM.1 PRINT.RANDOM-STATE.1 PPRINT-FILL.14 PPRINT-FILL.15 PPRINT-LINEAR.14 PPRINT-TABULAR.13 PPRINT-LOGICAL-BLOCK.17 PPRINT-POP.7 PPRINT-POP.8 FORMAT.LOGICAL-BLOCK.CIRCLE.1 FORMAT.LOGICAL-BLOCK.CIRCLE.2 FORMAT.LOGICAL-BLOCK.CIRCLE.3 COMPILE-FILE.16)) (compileit 0.23.0 :id saturn (FLET.45 REINITIALIZE-INSTANCE.ERROR.1 DEFGENERIC.ERROR.20 DEFGENERIC.ERROR.21 DEFGENERIC.30 CALL-NEXT-METHOD.ERROR.1 CALL-NEXT-METHOD.ERROR.2 DEFMETHOD.ERROR.14 DEFMETHOD.ERROR.15 INVOKE-DEBUGGER.1 MAKE-CONDITION.3 MAKE-CONDITION.4 DELETE-PACKAGE.5 DELETE-PACKAGE.6 MAP.48 TYPES.3 TYPES.9A ALL-EXPORTED-CL-CLASS-NAMES-ARE-VALID TYPE-OF.1 TYPE-OF.4 STANDARD-METHOD-CPL MAKE-PATHNAME.9 PRINT.RANDOM-STATE.1 PPRINT-FILL.14 PPRINT-FILL.15 PPRINT-LINEAR.14 PPRINT-TABULAR.13 PPRINT-LOGICAL-BLOCK.17 PPRINT-POP.7 PPRINT-POP.8 FORMAT.LOGICAL-BLOCK.CIRCLE.1 FORMAT.LOGICAL-BLOCK.CIRCLE.2 FORMAT.LOGICAL-BLOCK.CIRCLE.3 COMPILE-FILE.16 TRACE.8)) (doit 0.23.0 :id saturn (REINITIALIZE-INSTANCE.ERROR.1 DEFGENERIC.ERROR.20 DEFGENERIC.ERROR.21 DEFGENERIC.30 CALL-NEXT-METHOD.ERROR.1 CALL-NEXT-METHOD.ERROR.2 DEFMETHOD.ERROR.14 DEFMETHOD.ERROR.15 INVOKE-DEBUGGER.1 MAKE-CONDITION.3 MAKE-CONDITION.4 DELETE-PACKAGE.5 DELETE-PACKAGE.6 MAP.48 TYPES.3 TYPES.9A ALL-EXPORTED-CL-CLASS-NAMES-ARE-VALID TYPE-OF.1 TYPE-OF.4 STANDARD-METHOD-CPL MAKE-PATHNAME.9 PRINT.SYMBOL.RANDOM.2 PRINT.SYMBOL.RANDOM.3 PRINT.STRING.RANDOM.1 PRINT.RANDOM-STATE.1 PPRINT-FILL.14 PPRINT-FILL.15 PPRINT-LINEAR.14 PPRINT-TABULAR.13 PPRINT-LOGICAL-BLOCK.17 PPRINT-POP.7 PPRINT-POP.8 FORMAT.LOGICAL-BLOCK.CIRCLE.1 FORMAT.LOGICAL-BLOCK.CIRCLE.2 FORMAT.LOGICAL-BLOCK.CIRCLE.3 COMPILE-FILE.16)) -- "A screaming comes across the sky. It has happened before, but there is nothing to compare to it now."

3 3

[armedbear-devel] defun return value is not conforming.
by pjb＠informatimago.com 23 Nov '10

23 Nov '10

CLHS says: Macro DEFUN Syntax: defun function-name lambda-list [[declaration* | documentation]] form* => function-name Arguments and Values: function-name---a function name. and the glossary: function name n. 1. (in an environment) A symbol or a list (setf symbol) that is the name of a function in that environment. 2. A symbol or a list (setf symbol). Therefore (defun f () ...) should return the symbol F, not the function F. Unfortunately, after having loaded quicklisp, it looks like abcl switches to another definition, which returns a function instead of a name: (macroexpand '(defun (x) (1+ x))) Before: (SYSTEM:%DEFUN (QUOTE F) (LAMBDA (X) (BLOCK F (1+ X)))) (correct) After: (PROGN (SYSTEM:%DEFUN (QUOTE F) (SYSTEM:NAMED-LAMBDA F (X) (BLOCK F (1+ X))))) WRONG. -- __Pascal Bourguignon__ http://www.informatimago.com/ A bad day in () is better than a good day in {}.

3 7

[armedbear-devel] New classwriter no longer preserves Lisp source line numbers
by Mark Evenson 22 Nov '10

22 Nov '10

I just noticed that I no longer see Lisp source line numbers in our backtraces. I'm assuming this is a property of the new classwriter. For debugging, this seems like a serious regression as we already had a paucity of debug information (no way to inspect the frames, no stepped, etc.) Having the line number of the form associated with the stack frame at least gave a bit of a clue as to where to look for the source of a condition. Is my presumption if the lossage stemming from the new classwriter correct? Would it be easy to restore? We seem to be including the ordinal of the top level form in the class name (i.e. "org.armedbear.lisp.ASDF_TMP_installer_51.execute(installer.lisp)" contains the result of compiling the 51st top-level form in 'installer.lisp'), so it should be fairly easy to include a single entry in the LineNumberTable attribute linking the start of the class code with the Lisp source. -- "A screaming comes across the sky. It has happened before, but there is nothing to compare to it now."

2 1

[armedbear-devel] patch to compile with ecl
by pjb＠informatimago.com 22 Nov '10

22 Nov '10

Here is a patch to allow ecl compile abcl (it fails however). I also had problems with ZEROP stumbling on NIL, so I rather brutishly replaced most of its occurences with EQUAL 0. run-shell-command will need some work... [pjb@kuiper :0.0 abcl-svn]$ svn diff Index: build-abcl.lisp =================================================================== --- build-abcl.lisp (revision 13040) +++ build-abcl.lisp (working copy) @@ -69,9 +69,9 @@ #+clisp (cond ((member :win32 *features*) :windows) - ((zerop (ext:run-shell-command "uname | grep -i darwin" :output nil)) + ((equal 0 (ext:run-shell-command "uname | grep -i darwin" :output nil)) :darwin) - ((zerop (ext:run-shell-command "uname | grep -i linux" :output nil)) + ((equal 0 (ext:run-shell-command "uname | grep -i linux" :output nil)) :linux) (t :unknown))) @@ -94,7 +94,7 @@ "\" && " command))) (sb-ext:process-exit-code - (sb-ext:run-program + (sb-ext:run-program "/bin/sh" (list "-c" command) :input nil :output output))) @@ -168,7 +168,24 @@ (declare (ignore status)) exitcode)) -#+(or sbcl cmu lispworks openmcl) +#+ecl +(defun run-shell-command (command &key directory (output *standard-output*)) + (when directory + (setf command (concatenate 'string + "\\cd \"" + (namestring (pathname directory)) + "\" && " + command))) + (let ((result (si:run-program + "/bin/sh" + (list "-c" command) + :input nil :output output))) + (if (null result) + -1 + result))) + + +#+(or sbcl cmu lispworks openmcl ecl) (defun probe-directory (pathspec) (let* ((truename (probe-file pathspec)) ; TRUENAME is a pathname. (namestring (and truename (namestring truename)))) ; NAMESTRING is a string. @@ -285,7 +302,7 @@ (defun java-compile-file (source-file) (let ((cmdline (build-javac-command-line source-file))) - (zerop (run-shell-command cmdline :directory *abcl-dir*)))) + (equal 0 (run-shell-command cmdline :directory *abcl-dir*)))) (defun make-classes (force batch) (let* ((source-files @@ -330,7 +347,7 @@ s) (princ #\space s)))) (status (run-shell-command cmdline :directory *abcl-dir*))) - (zerop status))) + (equal 0 status))) (t (ensure-directories-exist *build-root*) (dolist (source-file source-files t) @@ -350,7 +367,7 @@ (copy-with-substitutions source-file target-file substitutions-alist) (ensure-directories-exist *dist-root*) (let ((status (run-shell-command command :directory *tree-root*))) - (unless (zerop status) + (unless (equal 0 status) (format t "~A returned ~S~%" command status)) status)))) @@ -489,13 +506,13 @@ (when (or full compile-system) (let* ((zip (if (or full jar) nil t)) (status (do-compile-system :zip zip))) - (unless (zerop status) + (unless (equal 0 status) (format t "Build failed.~%") (return-from build-abcl nil)))) ;; abcl.jar (when (or full jar) (let ((status (make-jar))) - (unless (zerop status) + (unless (equal 0 status) (format t "Build failed.~%") (return-from build-abcl nil)))) ;; abcl/abcl.bat @@ -518,7 +535,7 @@ (princ #\space s))) (princ "--main=org.armedbear.lisp.Main -o lisp" s))) (result (run-shell-command cmdline :directory *abcl-dir*))) - (zerop result))) + (equal 0 result))) (defvar *copy-verbose* nil) @@ -591,11 +608,11 @@ (namestring parent-dir) version-string version-string)) (status (run-shell-command command :directory parent-dir))) - (unless (zerop status) + (unless (equal 0 status) (format t "~A returned ~S~%" command status))) (let* ((command (format nil "zip -q -r ~A~A.zip ~A" (namestring parent-dir) version-string version-string)) (status (run-shell-command command :directory parent-dir))) - (unless (zerop status) + (unless (equal 0 status) (format t "~A returned ~S~%" command status))))) Index: build-from-lisp.sh =================================================================== --- build-from-lisp.sh (revision 13040) +++ build-from-lisp.sh (working copy) @@ -72,6 +72,11 @@ exec "$1" --load "$2" --eval "(progn $3 (ext:quit))" } +ecl() +{ + exec "$1" -norc -load "$2" -eval "(progn $3 (ext:quit))" +} + clisp() { exec "$1" -ansi -q -norc -i "$2" -x "(progn $3 (ext:quit))" @@ -120,7 +125,7 @@ gcl*) notimplemented "$IMPL" "$FILE" "$FORM" ;; ecl*) - notimplemented "$IMPL" "$FILE" "$FORM" ;; + ecl "$IMPL" "$FILE" "$FORM" ;; alisp*) notimplemented "$IMPL" "$FILE" "$FORM" ;; *) -- __Pascal Bourguignon__ http://www.informatimago.com/ A bad day in () is better than a good day in {}.

3 7

[armedbear-devel] There is no way to compile abcl-src-0.22.0
by pjb＠informatimago.com 22 Nov '10

22 Nov '10

There is no way to compile abcl-src-0.22.0, whatever the lisp implementation used: Armed Bear Common Lisp --> "0.20.0" Clozure Common Lisp --> "Version 1.6-RC1-r14432M (LinuxX8664)" CLISP --> "2.49 (2010-07-07) (built 3499053122) (memory 3499054130)" CMU Common Lisp --> "19c (19C)" ECL --> "10.7.1" SBCL --> "1.0.19-gentoo" [pjb@kuiper :0.0 abcl-src-0.22.0]$ sh build-from-lisp.sh abcl Armed Bear Common Lisp 0.20.0 Java 1.6.0_22 Sun Microsystems Inc. Java HotSpot(TM) Server VM Low-level initialization completed in 0.272 seconds. Startup completed in 0.71 seconds. Platform: Linux JDK: /opt/sun-jdk-1.6.0.22/ Java compiler: /opt/sun-jdk-1.6.0.22/bin/javac Compiler options: -g Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: JavaObject.java uses unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. Armed Bear Common Lisp 0.22.0 Java 1.6.0_22 Sun Microsystems Inc. Java HotSpot(TM) 64-Bit Server VM Low-level initialization completed in 0.232 seconds. Startup completed in 2.678 seconds. #<THREAD "interpreter" {664310D0}>: Debugger invoked on condition of type ERROR Failed to find loadable system file 'system' in boot classpath. C-c C-c [pjb@kuiper :0.0 abcl-src-0.22.0]$ sh build-from-lisp.sh ccl ;Compiler warnings for "/data/src/languages/abcl/abcl-src-0.22.0/build-abcl.lisp" : ; In SAFE-NAMESTRING: Unused lexical variable LEN Platform: Linux JDK: /opt/sun-jdk-1.6.0.22/ Java compiler: /opt/sun-jdk-1.6.0.22/bin/javac Compiler options: -g Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: JavaObject.java uses unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. Armed Bear Common Lisp 0.22.0 Java 1.6.0_22 Sun Microsystems Inc. Java HotSpot(TM) 64-Bit Server VM Low-level initialization completed in 0.227 seconds. Startup completed in 2.638 seconds. #<THREAD "interpreter" {548997D1}>: Debugger invoked on condition of type ERROR Failed to find loadable system file 'system' in boot classpath. [1] CL-USER(1): Build completed successfully in 7.132986 seconds. [pjb@kuiper :0.0 abcl-src-0.22.0]$ sh build-from-lisp.sh clisp ;; Loading file build-abcl.lisp ... ;; Loaded file build-abcl.lisp ;; Loading file /data/src/languages/abcl/abcl-src-0.22.0/customizations.lisp ... ;; Loaded file /data/src/languages/abcl/abcl-src-0.22.0/customizations.lisp Platform: gcc -g -O2 -W -Wswitch -Wcomment -Wpointer-arith -Wimplicit -Wreturn-type -Wmissing-declarations -Wno-sign-compare -Wno-format-nonliteral -O -falign-functions=4 -DENABLE_UNICODE -DDYNAMIC_FFI -DDYNAMIC_MODULES -I. -lreadline -lncurses -ldl -lavcall -lcallback -lsigsegv libgnu_cl.a SAFETY=0 TYPECODES WIDE_HARD GENERATIONAL_GC SPVW_BLOCKS SPVW_MIXED TRIVIALMAP_MEMORY libsigsegv 2.8 libreadline 6.0 JDK: /opt/sun-jdk-1.6.0.22/ Java compiler: /opt/sun-jdk-1.6.0.22/bin/javac Compiler options: -g Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: JavaObject.java uses unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. Armed Bear Common Lisp 0.22.0 Java 1.6.0_22 Sun Microsystems Inc. Java HotSpot(TM) 64-Bit Server VM Low-level initialization completed in 0.233 seconds. Startup completed in 2.651 seconds. #<THREAD "interpreter" {1137D4A4}>: Debugger invoked on condition of type ERROR Failed to find loadable system file 'system' in boot classpath. [1] CL-USER(1): (quit) Build completed successfully in 11.080321 seconds. [pjb@kuiper :0.0 abcl-src-0.22.0]$ sh build-from-lisp.sh lisp ; Loading #P"/data/src/languages/abcl/abcl-src-0.22.0/build-abcl.lisp". ; In: LAMBDA (PATHNAME) ; (LET* (# #) ; (WHEN # ; #) ; STRING) ; Note: Variable BUILD-ABCL::LEN defined but never used. Platform: Linux ; [GC threshold exceeded with 12,010,408 bytes in use. Commencing GC.] ; [GC completed with 1,294,232 bytes retained and 10,716,176 bytes freed.] ; [GC will next occur when at least 13,294,232 bytes are in use.] JDK: /opt/sun-jdk-1.6.0.22/ Java compiler: /opt/sun-jdk-1.6.0.22/bin/javac Compiler options: -g Error in function UNIX::SIGSEGV-HANDLER: Segmentation Violation at #x0. [Condition of type SIMPLE-ERROR] Restarts: 0: [ABORT] Skip remaining initializations. Debug (type H for help) (UNIX::SIGSEGV-HANDLER #<unused-arg> #<unused-arg> #.(SYSTEM:INT-SAP #x3FFFC554)) Source: Error finding source: Error in function DEBUG::GET-FILE-TOP-LEVEL-FORM: Source file no longer exists: target:code/signal.lisp. 0] (unix:unix-exit) Error in function UNIX::SIGSEGV-HANDLER: Segmentation Violation at #x0. [Condition of type SIMPLE-ERROR] Restarts: 0: [ABORT] Skip remaining initializations. Debug (type H for help) (UNIX::SIGSEGV-HANDLER #<unused-arg> #<unused-arg> #.(SYSTEM:INT-SAP #x3FFFC554)) Source: Error finding source: Error in function DEBUG::GET-FILE-TOP-LEVEL-FORM: Source file no longer exists: target:code/signal.lisp. 0] (unix:unix-exit 1) Build completed successfully in 33.49 seconds. ; [pjb@kuiper :0.0 abcl-src-0.22.0]$ [pjb@kuiper :0.0 abcl-src-0.22.0]$ sh build-from-lisp.sh ecl ;;; Loading "/data/src/languages/abcl/abcl-src-0.22.0/build-abcl.lisp" ;;; Loading "/data/src/languages/abcl/abcl-src-0.22.0/customizations.lisp" Platform: Linux JDK: /opt/sun-jdk-1.6.0.22/ Java compiler: /opt/sun-jdk-1.6.0.22/bin/javac Compiler options: -g Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: JavaObject.java uses unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. Build failed. [pjb@kuiper :0.0 abcl-src-0.22.0]$ sh build-from-lisp.sh sbcl This is SBCL 1.0.19-gentoo, an implementation of ANSI Common Lisp. More information about SBCL is available at <http://www.sbcl.org/>. SBCL is free software, provided as is, with absolutely no warranty. It is mostly in the public domain; some portions are provided under BSD-style licenses. See the CREDITS and COPYING files in the distribution for more information. ; loading system definition from ; /usr/share/common-lisp/systems/asdf-binary-locations.asd into ; #<PACKAGE "ASDF0"> ; registering #<SYSTEM ASDF-BINARY-LOCATIONS {1002BFE1B1}> as ; ASDF-BINARY-LOCATIONS ; in: LAMBDA NIL ; (LET* ((STRING (NAMESTRING PATHNAME)) (BUILD-ABCL::LEN (LENGTH STRING))) ; (WHEN (POSITION #\ STRING) ; (SETF STRING ; (CONCATENATE 'STRING "\"" (BUILD-ABCL::COMP STRING #\\) "\""))) ; STRING) ; ; caught STYLE-WARNING: ; The variable LEN is defined but never used. ; ; compilation unit finished ; caught 1 STYLE-WARNING condition Platform: Linux JDK: /opt/sun-jdk-1.6.0.22/ Java compiler: /opt/sun-jdk-1.6.0.22/bin/javac Compiler options: -g Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: JavaObject.java uses unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. Armed Bear Common Lisp 0.22.0 Java 1.6.0_22 Sun Microsystems Inc. Java HotSpot(TM) 64-Bit Server VM Low-level initialization completed in 0.231 seconds. Startup completed in 2.547 seconds. #<THREAD "interpreter" {73EB904D}>: Debugger invoked on condition of type ERROR Failed to find loadable system file 'system' in boot classpath. [1] CL-USER(1): Build completed successfully in 7.044 seconds. [pjb@kuiper :0.0 abcl-src-0.22.0]$ -- __Pascal Bourguignon__ http://www.informatimago.com/ A bad day in () is better than a good day in {}.

5 5

[armedbear-devel] Conformity and convenience problems with pathnames
by pjb＠informatimago.com 21 Nov '10

21 Nov '10

Hello, It is well known that implementations of CL pathnames have been greatly implementation dependant. However, the standard still specifies clear behavior for logical pathnames, for one thing, and for the other, since there are several implementations working on the same POSIX systems (unix including linux and MacOSX; and MS-Windows), it is desirable that all implementations converge in their handling of pathnames on these plateforms. Personnaly, I resolved to use logical pathnames and logical-pathname translations as much as possible, and to use make-pathname to build portably physical pathnames. However, most implementations have problems dealing with these two aspects. To improve the situation, I wrote a little script to check the behavior of implementations in these two aspects. The script can be found at: ftp://ftp.informatimago.com/users/pjb/lisp/check-pathnames.lisp Since I'm sending a similar message to most implementation lists, it might be better, if there is any need for 'language lawyer' discussions, to direct them to news:comp.lang.lisp. Here are the results for the latest abcl (from svn): ------------------------------------------------------------------------ [pjb@kuiper :0.0 lisp]$ abcl --noinit --load check-pathnames.lisp Armed Bear Common Lisp 0.24.0-dev Java 1.6.0_22 Sun Microsystems Inc. Java HotSpot(TM) 64-Bit Server VM Low-level initialization completed in 0.244 seconds. Startup completed in 0.766 seconds. check-pathnames of Armed Bear Common Lisp (0.24.0-dev) ================================================================================ Test and probe conforming logical pathnames, and their translation to unix physical pathnames. We want to check the good working of logical pathnames, and the translation of logical pathnames to physical pathnames, in a semi-standard way on unix systems. Namely, given the logical host and its translations: (setf (logical-pathname-translations "LOGICAL") nil) (setf (logical-pathname-translations "LOGICAL") '((#P"LOGICAL:**;*.*" #P"/tmp/**/*.*") (#P"LOGICAL:**;*" #P"/tmp/**/*"))) #P"LOGICAL:DIR;SUBDIR;NAME.TYPE.NEWEST" must be the same as (make-pathname :host "LOGICAL" :directory '(:absolute "DIR" "SUBDIR") :name "NAME" :type "TYPE" :version :newest :case :common) and must translate to: #P"/tmp/dir/subdir/name.type" on unix. Merging physical pathnames specified with :case :common is also tested: (merge-pathnames (make-pathname :directory '(:relative "DIR" "SUBDIR") :name "NAME" :type "TYPE" :version :newest :case :common :default #1=#P"/tmp/") #1# nil) must give #P"/tmp/dir/subdir/name.type" on unix. ================================================================================ -------------------------------------------------------------------------------- Failed assertion: (IMPLY (EQL CUSTOMARY-CASE-1 :UPPER) (EQL CUSTOMARY-CASE-2 :UPPER)) with: (EQL CUSTOMARY-CASE-1 :UPPER) = T and: (EQL CUSTOMARY-CASE-2 :UPPER) = NIL CUSTOMARY-CASE-1 = :UPPER CUSTOMARY-CASE-2 = :LOWER The customary case for the file system of Armed Bear Common Lisp (0.24.0-dev) seems to be lower case. *FEATURES* = (:X86-64 :JAVA-1.6 :ARMEDBEAR :ABCL :COMMON-LISP :ANSI-CL :UNIX :LINUX :CDR6) ================================================================================ (MAKE-PATHNAME :HOST "LOGICAL" :DEVICE :UNSPECIFIC :DIRECTORY (:ABSOLUTE "DIR" "SUBDIR") :NAME "NAME" :TYPE "TYPE" :VERSION :NEWEST :CASE :COMMON) LOGICAL-PATHNAME #P"LOGICAL:DIR;SUBDIR;NAME.TYPE.NEWEST" -------------------- :case :local (default) Host : "LOGICAL" Device : :UNSPECIFIC Directory : (:ABSOLUTE "DIR" "SUBDIR") Name : "NAME" Type : "TYPE" Version : :NEWEST -------------------- :case :common Host : "LOGICAL" Device : :UNSPECIFIC Directory : (:ABSOLUTE "DIR" "SUBDIR") Name : "NAME" Type : "TYPE" Version : :NEWEST -------------------- -------------------------------------------------------------------------------- Failed assertion: (STRING= (PATHNAME-HOST PATH :CASE :LOCAL) (POP EXPECTED-VALUES)) with: (PATHNAME-HOST PATH :CASE :LOCAL) = "LOGICAL" and: (POP EXPECTED-VALUES) = "logical" 19.2.2.1.2 makes no exception for pathname-host of logical pathnames. -------------------------------------------------------------------------------- Failed assertion: (DIRLIST= (PATHNAME-DIRECTORY PATH :CASE :LOCAL) (POP EXPECTED-VALUES)) with: (PATHNAME-DIRECTORY PATH :CASE :LOCAL) = (:ABSOLUTE "DIR" "SUBDIR") and: (POP EXPECTED-VALUES) = (:ABSOLUTE "dir" "subdir") -------------------------------------------------------------------------------- Failed assertion: (STRING= (PATHNAME-NAME PATH :CASE :LOCAL) (POP EXPECTED-VALUES)) with: (PATHNAME-NAME PATH :CASE :LOCAL) = "NAME" and: (POP EXPECTED-VALUES) = "name" -------------------------------------------------------------------------------- Failed assertion: (STRING= (PATHNAME-TYPE PATH :CASE :LOCAL) (POP EXPECTED-VALUES)) with: (PATHNAME-TYPE PATH :CASE :LOCAL) = "TYPE" and: (POP EXPECTED-VALUES) = "type" ================================================================================ (MAKE-PATHNAME :HOST "logical" :DEVICE :UNSPECIFIC :DIRECTORY (:ABSOLUTE "dir" "subdir") :NAME "name" :TYPE "type" :VERSION :NEWEST :CASE :LOCAL) LOGICAL-PATHNAME #P"LOGICAL:DIR;SUBDIR;NAME.TYPE.NEWEST" -------------------- :case :local (default) Host : "LOGICAL" Device : :UNSPECIFIC Directory : (:ABSOLUTE "DIR" "SUBDIR") Name : "NAME" Type : "TYPE" Version : :NEWEST -------------------- :case :common Host : "LOGICAL" Device : :UNSPECIFIC Directory : (:ABSOLUTE "DIR" "SUBDIR") Name : "NAME" Type : "TYPE" Version : :NEWEST -------------------- -------------------------------------------------------------------------------- Failed assertion: (STRING= (PATHNAME-HOST PATH :CASE :LOCAL) (POP EXPECTED-VALUES)) with: (PATHNAME-HOST PATH :CASE :LOCAL) = "LOGICAL" and: (POP EXPECTED-VALUES) = "logical" 19.2.2.1.2 makes no exception for pathname-host of logical pathnames. -------------------------------------------------------------------------------- Failed assertion: (DIRLIST= (PATHNAME-DIRECTORY PATH :CASE :LOCAL) (POP EXPECTED-VALUES)) with: (PATHNAME-DIRECTORY PATH :CASE :LOCAL) = (:ABSOLUTE "DIR" "SUBDIR") and: (POP EXPECTED-VALUES) = (:ABSOLUTE "dir" "subdir") -------------------------------------------------------------------------------- Failed assertion: (STRING= (PATHNAME-NAME PATH :CASE :LOCAL) (POP EXPECTED-VALUES)) with: (PATHNAME-NAME PATH :CASE :LOCAL) = "NAME" and: (POP EXPECTED-VALUES) = "name" -------------------------------------------------------------------------------- Failed assertion: (STRING= (PATHNAME-TYPE PATH :CASE :LOCAL) (POP EXPECTED-VALUES)) with: (PATHNAME-TYPE PATH :CASE :LOCAL) = "TYPE" and: (POP EXPECTED-VALUES) = "type" -------------------------------------------------------------------------------- Failed assertion: ((LAMBDA (DIRLIST PATH) (EQUAL DIRLIST (PATHNAME-DIRECTORY PATH :CASE :LOCAL))) '(:ABSOLUTE "tmp" "dir" "subdir") (MERGE-PATHNAMES (MAKE-PATHNAME :DIRECTORY '(:RELATIVE "DIR" "SUBDIR") :NAME "NAME" :TYPE "TYPE" :CASE :COMMON :DEFAULTS #P"/tmp/") #P"/tmp/" NIL)) with: '(:ABSOLUTE "tmp" "dir" "subdir") = (:ABSOLUTE "tmp" "dir" "subdir") and: (MERGE-PATHNAMES (MAKE-PATHNAME :DIRECTORY '(:RELATIVE "DIR" "SUBDIR") :NAME "NAME" :TYPE "TYPE" :CASE :COMMON :DEFAULTS #P"/tmp/") #P"/tmp/" NIL) = #P"/tmp/DIR/SUBDIR/NAME.TYPE" PATHNAME #P"/tmp/DIR/SUBDIR/NAME.TYPE" -------------------- :case :local (default) Host : NIL Device : NIL Directory : (:ABSOLUTE "tmp" "DIR" "SUBDIR") Name : "NAME" Type : "TYPE" Version : NIL -------------------- :case :common Host : NIL Device : NIL Directory : (:ABSOLUTE "tmp" "DIR" "SUBDIR") Name : "NAME" Type : "TYPE" Version : NIL -------------------- -------------------------------------------------------------------------------- Failed assertion: ((LAMBDA (NAME PATH) (EQUAL NAME (PATHNAME-NAME PATH :CASE :LOCAL))) "name" (MERGE-PATHNAMES (MAKE-PATHNAME :DIRECTORY '(:RELATIVE "DIR" "SUBDIR") :NAME "NAME" :TYPE "TYPE" :CASE :COMMON :DEFAULTS #P"/tmp/") #P"/tmp/" NIL)) with: "name" = "name" and: (MERGE-PATHNAMES (MAKE-PATHNAME :DIRECTORY '(:RELATIVE "DIR" "SUBDIR") :NAME "NAME" :TYPE "TYPE" :CASE :COMMON :DEFAULTS #P"/tmp/") #P"/tmp/" NIL) = #P"/tmp/DIR/SUBDIR/NAME.TYPE" PATHNAME #P"/tmp/DIR/SUBDIR/NAME.TYPE" -------------------- :case :local (default) Host : NIL Device : NIL Directory : (:ABSOLUTE "tmp" "DIR" "SUBDIR") Name : "NAME" Type : "TYPE" Version : NIL -------------------- :case :common Host : NIL Device : NIL Directory : (:ABSOLUTE "tmp" "DIR" "SUBDIR") Name : "NAME" Type : "TYPE" Version : NIL -------------------- -------------------------------------------------------------------------------- Failed assertion: ((LAMBDA (TYPE PATH) (EQUAL TYPE (PATHNAME-TYPE PATH :CASE :LOCAL))) "type" (MERGE-PATHNAMES (MAKE-PATHNAME :DIRECTORY '(:RELATIVE "DIR" "SUBDIR") :NAME "NAME" :TYPE "TYPE" :CASE :COMMON :DEFAULTS #P"/tmp/") #P"/tmp/" NIL)) with: "type" = "type" and: (MERGE-PATHNAMES (MAKE-PATHNAME :DIRECTORY '(:RELATIVE "DIR" "SUBDIR") :NAME "NAME" :TYPE "TYPE" :CASE :COMMON :DEFAULTS #P"/tmp/") #P"/tmp/" NIL) = #P"/tmp/DIR/SUBDIR/NAME.TYPE" PATHNAME #P"/tmp/DIR/SUBDIR/NAME.TYPE" -------------------- :case :local (default) Host : NIL Device : NIL Directory : (:ABSOLUTE "tmp" "DIR" "SUBDIR") Name : "NAME" Type : "TYPE" Version : NIL -------------------- :case :common Host : NIL Device : NIL Directory : (:ABSOLUTE "tmp" "DIR" "SUBDIR") Name : "NAME" Type : "TYPE" Version : NIL -------------------- Type ":help" for a list of available commands. CL-USER(1): (quit) [pjb@kuiper :0.0 lisp]$ -- __Pascal Bourguignon__ http://www.informatimago.com/ A bad day in () is better than a good day in {}.

1 0

[armedbear-devel] How to load a lisp file containing non ascii characters encoded in utf-8?
by pjb＠informatimago.com 20 Nov '10

20 Nov '10

What should be done in abcl to be able to load a lisp file containing non ascii characters encoded in utf-8? CL-USER(3): (load "test.lisp") Error loading /home/pjb/test.lisp at line 2 (offset 46) #<THREAD "interpreter" {74CB02}>: Debugger invoked on condition of type STREAM-ERROR Input value 0xffc3 is malformed while recoding with charset US-ASCII Restarts: 0: TOP-LEVEL Return to top level. [1] CL-USER(4): (lisp-implementation-version) "0.20.0" test.lisp is: ------------------------------------------------------------------------ ;; -*- mode:lisp;coding:utf-8 -*- (defvar *a* "é") ------------------------------------------------------------------------ -- __Pascal Bourguignon__ http://www.informatimago.com/ A bad day in () is better than a good day in {}.

1 0

[armedbear-devel] Patch to get BORDEAUX-THREADS working on post abcl-0.23.0
by Mark Evenson 20 Nov '10

20 Nov '10

As part of my ongoing task of keeping Hunchentoot working with ABCL, I noticed BORDEAUX-THREADS currently (as of 0.8.0) doesn't work with abcl-0.23 or later as we deprecated the thread interface it relies on. I've [created patch][1] that fixes this as well as actually providing an implementation of the CONDITION-WAIT/CONDITION-NOTIFY primitives, which had stopped working due to bit rot in BORDEAUX-THREADS. There is still a little funkiness in the bordeaux-threads-test suite which sometimes seems to generate errors, but I think this is from MOP issues in the fiveam, but I'm not exactly sure. [1]: http://slack.net/~evenson/abcl/hunchentoot/bordeaux-threads-abcl-20101120a.… -- "A screaming comes across the sky. It has happened before, but there is nothing to compare to it now."

1 0

[armedbear-devel] asdf-install strangeness
by Kevin Raison 19 Nov '10

19 Nov '10

I recently started using abcl 0.22.0 but have run into issues installing packages using asdf-install. Here is an example error message. Does anyone know of a solution to this? CL-USER(7): (asdf-install:install 'hunchentoot) Install where? 1) System-wide install: System in /usr/local/asdf-install/site-systems/ Files in /usr/local/asdf-install/site/ 2) Personal installation: System in /home/raison/.asdf-install-dir/systems/ Files in /home/raison/.asdf-install-dir/site/ 0) Abort installation. --> 2 ;;; ASDF-INSTALL: Downloading 139617 bytes from http://weitz.de/files/hunchentoot.tar.gz to /home/raison/asdf-install-0.asdf-install-tmp ... #<THREAD "interpreter" {4DA42824}>: Debugger invoked on condition of type STREAM-ERROR Input value 0xdc4a is malformed while recoding with charset UTF-8 Restarts: 0: TOP-LEVEL Return to top level. [1] CL-USER(8): 0 CL-USER(9): Thanks! Kevin

3 5