cmucl-cvs August 2010

cmucl-cvs@common-lisp.net

2 participants
28 discussions

[cmucl-cvs] CMUCL commit: RELEASE-20B-BRANCH src/code (extfmts.lisp)
by Raymond Toy 04 Aug '10

04 Aug '10

Date: Wednesday, August 4, 2010 @ 08:12:09 Author: rtoy Path: /project/cmucl/cvsroot/src/code Tag: RELEASE-20B-BRANCH Modified: extfmts.lisp Merge some change from HEAD to keep compiler quieter when compiling external formats. --------------+ extfmts.lisp | 32 ++++++++++++++++++++------------ 1 file changed, 20 insertions(+), 12 deletions(-) Index: src/code/extfmts.lisp diff -u src/code/extfmts.lisp:1.35 src/code/extfmts.lisp:1.35.4.1 --- src/code/extfmts.lisp:1.35 Mon Jul 12 09:58:42 2010 +++ src/code/extfmts.lisp Wed Aug 4 08:12:09 2010 @@ -5,7 +5,7 @@ ;;; domain. ;;; (ext:file-comment - "$Header: /project/cmucl/cvsroot/src/code/extfmts.lisp,v 1.35 2010-07-12 13:58:42 rtoy Exp $") + "$Header: /project/cmucl/cvsroot/src/code/extfmts.lisp,v 1.35.4.1 2010-08-04 12:12:09 rtoy Exp $") ;;; ;;; ********************************************************************** ;;; @@ -753,11 +753,15 @@ ;; illegal. So are codepoints that are too large. (if ,error (if (lisp::surrogatep code) - (funcall ,error - (format nil (intl:gettext "Surrogate codepoint #x~~4,'0X is illegal for ~A") - ,external-format) - code nil) - (funcall ,error (intl:gettext "Illegal codepoint on input: #x~X") code nil)) + (locally + (declare (optimize (ext:inhibit-warnings 3))) + (funcall ,error + (format nil (intl:gettext "Surrogate codepoint #x~~4,'0X is illegal for ~A") + ,external-format) + code nil)) + (locally + (declare (optimize (ext:inhibit-warnings 3))) + (funcall ,error (intl:gettext "Illegal codepoint on input: #x~X") code nil))) #-(and unicode (not unicode-bootstrap)) #\? #+(and unicode (not unicode-bootstrap)) #\U+FFFD)) #+unicode @@ -788,18 +792,22 @@ (,wryte (if (lisp::surrogatep (char-code ,nchar) :low) (surrogates-to-codepoint (car ,nstate) ,nchar) (if ,error - (funcall ,error - (intl:gettext "Cannot convert invalid surrogate #x~X to character") - ,nchar) + (locally + (declare (optimize (ext:inhibit-warnings 3))) + (funcall ,error + (intl:gettext "Cannot convert invalid surrogate #x~X to character") + ,nchar)) +replacement-character-code+))) (setf (car ,nstate) nil)) ;; A lone trailing (low) surrogate gets replaced with ;; the replacement character. (,wryte (if (lisp::surrogatep (char-code ,nchar) :low) (if ,error - (funcall ,error - (intl:gettext "Cannot convert lone trailing surrogate #x~X to character") - ,nchar) + (locally + (declare (optimize (ext:inhibit-warnings 3))) + (funcall ,error + (intl:gettext "Cannot convert lone trailing surrogate #x~X to character") + ,nchar)) +replacement-character-code+) (char-code ,nchar)))))))))

1 0

[cmucl-cvs] CMUCL commit: RELEASE-20B-BRANCH src (3 files)
by Raymond Toy 04 Aug '10

04 Aug '10

Date: Wednesday, August 4, 2010 @ 08:08:24 Author: rtoy Path: /project/cmucl/cvsroot/src Tag: RELEASE-20B-BRANCH Modified: code/exports.lisp docs/cmu-user/unicode.tex general-info/release-20b.txt Merge some changes from HEAD that we should have done before the 20b pre1. code/exports.lisp: o Export DESCRIBE-EXTERNAL-FORMAT docs/cmu-user/unicode.tex: o Update docs general-info/release-20b.txt: o Remove work-in-progress. ------------------------------+ code/exports.lisp | 3 + docs/cmu-user/unicode.tex | 66 ++++++++++++++++++++++++++++++++++++----- general-info/release-20b.txt | 2 - 3 files changed, 60 insertions(+), 11 deletions(-) Index: src/code/exports.lisp diff -u src/code/exports.lisp:1.299 src/code/exports.lisp:1.299.4.1 --- src/code/exports.lisp:1.299 Tue Jul 13 19:43:39 2010 +++ src/code/exports.lisp Wed Aug 4 08:08:20 2010 @@ -5,7 +5,7 @@ ;;; Carnegie Mellon University, and has been placed in the public domain. ;;; (ext:file-comment - "$Header: /project/cmucl/cvsroot/src/code/exports.lisp,v 1.299 2010-07-13 23:43:39 rtoy Exp $") + "$Header: /project/cmucl/cvsroot/src/code/exports.lisp,v 1.299.4.1 2010-08-04 12:08:20 rtoy Exp $") ;;; ;;; ********************************************************************** ;;; @@ -1489,6 +1489,7 @@ "DESCRIBE-EXTERNAL-FORMAT") ;; Unicode (:export "STRING-TO-OCTETS" "OCTETS-TO-STRING" "*DEFAULT-EXTERNAL-FORMAT*" + "DESCRIBE-EXTERNAL-FORMATS" "LIST-ALL-EXTERNAL-FORMATS" "STRING-ENCODE" "STRING-DECODE" "SET-SYSTEM-EXTERNAL-FORMAT")) Index: src/docs/cmu-user/unicode.tex diff -u src/docs/cmu-user/unicode.tex:1.11 src/docs/cmu-user/unicode.tex:1.11.4.1 --- src/docs/cmu-user/unicode.tex:1.11 Mon Jul 12 09:58:42 2010 +++ src/docs/cmu-user/unicode.tex Wed Aug 4 08:08:23 2010 @@ -80,14 +80,6 @@ parameter to specify the format. The default external format is \kwd{default}. -\begin{defun}{stream:}{set-system-external-format}{\var{terminal} \ampoptional{} \var{filenames}} - This function changes the external format used for - \var{*standard-input*}, \var{*standard-output*}, and - \var{*standard-error*} to the external format specified by - \var{terminal}. Additionally, the Unix file name encoding can be - set to the value specified by \var{filenames} if non-\nil. -\end{defun} - \subsection{Available External Formats} The available external formats are listed below in @@ -451,8 +443,66 @@ \file{ext-formats:unidata.bin}. If this file is not found, Unicode support is severely reduced; you can only use ASCII characters. +\begin{defun}{}{open}{\args \var{filename} \amprest \var{options} + \keys{\kwd{direction} \kwd{element-type} \kwd{if-exists} + \kwd{if-does-not-exist} \morekeys \kwd{class} \kwd{mapped} + \kwd{input-handle} \kwd{output-handle} + \yetmorekeys \kwd{external-format} \kwd{decoding-error} + \kwd{encoding-error}} + + The main options are covered elsewhere. Here we describe the + options specific to Unicode. The option \kwd{external-format} + specifies the external format to use for reading and writing the + file. The external format is a keyword. + + The options \kwd{decoding-error} and \kwd{encoding-error} are used + to specify how encoding and decoding errors are handled. The + default value on \nil means the external format handles errors + itself and typically replaces invalid sequences with the Unicode + replacement character. + + Otherwise, the value for \code{decoding-error} is either a + character, a symbol or a function. If a character is + specified. it is used as the replacement character for any invalid + decoding. If a symbol or a function is given, it must be a + function of three arguments: a message string to be printed, the + offending octet, and the number of octets read. If the function + returns, it should return two values: the code point to use as the + replacement character and the number of octets read. In addition, + \true{} may be specified. This indicates that a continuable error + is signaled, which, if continued, the Unicode replacement + character is used. + + For \code{encoding-error}, a character, symbol, or function can be + specified, like \code{decoding-error}, with the same meaning. The + function, however, takes two arguments: a format message string + and the incorrect codepoint. If the function returns, it should + be the replacement codepoint. +\end{defun} + \subsubsection{Utilities} +\begin{defun}{stream:}{set-system-external-format}{\var{terminal} \ampoptional{} \var{filenames}} + This function changes the external format used for + \var{*standard-input*}, \var{*standard-output*}, and + \var{*standard-error*} to the external format specified by + \var{terminal}. Additionally, the Unix file name encoding can be + set to the value specified by \var{filenames} if non-\nil. +\end{defun} + +\begin{defun}{extensions:}{list-all-external-formats}{} + list all of the vailable external formats. A list is returned where + each element is a list of the external format name and a list of + aliases for the format. No distinction is made between external + formats and composing external formats. +\end{defun} + +\begin{defun}{extensions:}{describe-external-format}{external-format} + Print a description of the given \var{external-format}. This may + cause the external format to be loaded (silently) if it is not + already loaded. +\end{defun} + Since strings are UTF-16 and hence may contain surrogate pairs, some utility functions are provided to make access easier. Index: src/general-info/release-20b.txt diff -u src/general-info/release-20b.txt:1.41 src/general-info/release-20b.txt:1.41.2.1 --- src/general-info/release-20b.txt:1.41 Sat Jul 31 09:45:33 2010 +++ src/general-info/release-20b.txt Wed Aug 4 08:08:23 2010 @@ -1,7 +1,5 @@ ========================== C M U C L 20 b ============================= -[--- WORK IN PROGRESS ---] - The CMUCL project is pleased to announce the release of CMUCL 20b. This is a major release which contains numerous enhancements and bug fixes from the 19f release.

1 0

[cmucl-cvs] CMUCL commit: src/general-info (release-20b.txt)
by Raymond Toy 04 Aug '10

04 Aug '10

Date: Tuesday, August 3, 2010 @ 23:46:18 Author: rtoy Path: /project/cmucl/cvsroot/src/general-info Modified: release-20b.txt Forgot to remove the work-in-progress line. -----------------+ release-20b.txt | 2 -- 1 file changed, 2 deletions(-) Index: src/general-info/release-20b.txt diff -u src/general-info/release-20b.txt:1.41 src/general-info/release-20b.txt:1.42 --- src/general-info/release-20b.txt:1.41 Sat Jul 31 09:45:33 2010 +++ src/general-info/release-20b.txt Tue Aug 3 23:46:18 2010 @@ -1,7 +1,5 @@ ========================== C M U C L 20 b ============================= -[--- WORK IN PROGRESS ---] - The CMUCL project is pleased to announce the release of CMUCL 20b. This is a major release which contains numerous enhancements and bug fixes from the 19f release.

1 0

[cmucl-cvs] CMUCL commit: src/code (exports.lisp)
by Raymond Toy 04 Aug '10

04 Aug '10

Date: Tuesday, August 3, 2010 @ 23:41:51 Author: rtoy Path: /project/cmucl/cvsroot/src/code Modified: exports.lisp Forgot to export DESCRIBE-EXTERNAL-FORMAT from the EXTENSIONS package. --------------+ exports.lisp | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-) Index: src/code/exports.lisp diff -u src/code/exports.lisp:1.299 src/code/exports.lisp:1.300 --- src/code/exports.lisp:1.299 Tue Jul 13 19:43:39 2010 +++ src/code/exports.lisp Tue Aug 3 23:41:51 2010 @@ -5,7 +5,7 @@ ;;; Carnegie Mellon University, and has been placed in the public domain. ;;; (ext:file-comment - "$Header: /project/cmucl/cvsroot/src/code/exports.lisp,v 1.299 2010-07-13 23:43:39 rtoy Exp $") + "$Header: /project/cmucl/cvsroot/src/code/exports.lisp,v 1.300 2010-08-04 03:41:51 rtoy Exp $") ;;; ;;; ********************************************************************** ;;; @@ -1489,6 +1489,7 @@ "DESCRIBE-EXTERNAL-FORMAT") ;; Unicode (:export "STRING-TO-OCTETS" "OCTETS-TO-STRING" "*DEFAULT-EXTERNAL-FORMAT*" + "DESCRIBE-EXTERNAL-FORMATS" "LIST-ALL-EXTERNAL-FORMATS" "STRING-ENCODE" "STRING-DECODE" "SET-SYSTEM-EXTERNAL-FORMAT"))

1 0

[cmucl-cvs] CMUCL commit: src/docs/cmu-user (unicode.tex)
by Raymond Toy 04 Aug '10

04 Aug '10

Date: Tuesday, August 3, 2010 @ 23:39:07 Author: rtoy Path: /project/cmucl/cvsroot/src/docs/cmu-user Modified: unicode.tex o Document the parameters to OPEN that are specific to Unicode. o Document LIST-ALL-EXTERNAL-FORMATS and DESCRIBE-EXTERNAL-FORMAT. -------------+ unicode.tex | 66 ++++++++++++++++++++++++++++++++++++++++++++++++++-------- 1 file changed, 58 insertions(+), 8 deletions(-) Index: src/docs/cmu-user/unicode.tex diff -u src/docs/cmu-user/unicode.tex:1.11 src/docs/cmu-user/unicode.tex:1.12 --- src/docs/cmu-user/unicode.tex:1.11 Mon Jul 12 09:58:42 2010 +++ src/docs/cmu-user/unicode.tex Tue Aug 3 23:39:07 2010 @@ -80,14 +80,6 @@ parameter to specify the format. The default external format is \kwd{default}. -\begin{defun}{stream:}{set-system-external-format}{\var{terminal} \ampoptional{} \var{filenames}} - This function changes the external format used for - \var{*standard-input*}, \var{*standard-output*}, and - \var{*standard-error*} to the external format specified by - \var{terminal}. Additionally, the Unix file name encoding can be - set to the value specified by \var{filenames} if non-\nil. -\end{defun} - \subsection{Available External Formats} The available external formats are listed below in @@ -451,8 +443,66 @@ \file{ext-formats:unidata.bin}. If this file is not found, Unicode support is severely reduced; you can only use ASCII characters. +\begin{defun}{}{open}{\args \var{filename} \amprest \var{options} + \keys{\kwd{direction} \kwd{element-type} \kwd{if-exists} + \kwd{if-does-not-exist} \morekeys \kwd{class} \kwd{mapped} + \kwd{input-handle} \kwd{output-handle} + \yetmorekeys \kwd{external-format} \kwd{decoding-error} + \kwd{encoding-error}} + + The main options are covered elsewhere. Here we describe the + options specific to Unicode. The option \kwd{external-format} + specifies the external format to use for reading and writing the + file. The external format is a keyword. + + The options \kwd{decoding-error} and \kwd{encoding-error} are used + to specify how encoding and decoding errors are handled. The + default value on \nil means the external format handles errors + itself and typically replaces invalid sequences with the Unicode + replacement character. + + Otherwise, the value for \code{decoding-error} is either a + character, a symbol or a function. If a character is + specified. it is used as the replacement character for any invalid + decoding. If a symbol or a function is given, it must be a + function of three arguments: a message string to be printed, the + offending octet, and the number of octets read. If the function + returns, it should return two values: the code point to use as the + replacement character and the number of octets read. In addition, + \true{} may be specified. This indicates that a continuable error + is signaled, which, if continued, the Unicode replacement + character is used. + + For \code{encoding-error}, a character, symbol, or function can be + specified, like \code{decoding-error}, with the same meaning. The + function, however, takes two arguments: a format message string + and the incorrect codepoint. If the function returns, it should + be the replacement codepoint. +\end{defun} + \subsubsection{Utilities} +\begin{defun}{stream:}{set-system-external-format}{\var{terminal} \ampoptional{} \var{filenames}} + This function changes the external format used for + \var{*standard-input*}, \var{*standard-output*}, and + \var{*standard-error*} to the external format specified by + \var{terminal}. Additionally, the Unix file name encoding can be + set to the value specified by \var{filenames} if non-\nil. +\end{defun} + +\begin{defun}{extensions:}{list-all-external-formats}{} + list all of the vailable external formats. A list is returned where + each element is a list of the external format name and a list of + aliases for the format. No distinction is made between external + formats and composing external formats. +\end{defun} + +\begin{defun}{extensions:}{describe-external-format}{external-format} + Print a description of the given \var{external-format}. This may + cause the external format to be loaded (silently) if it is not + already loaded. +\end{defun} + Since strings are UTF-16 and hence may contain surrogate pairs, some utility functions are provided to make access easier.

1 0

[cmucl-cvs] CMUCL commit: src/code (fd-stream.lisp)
by Raymond Toy 04 Aug '10

04 Aug '10

Date: Tuesday, August 3, 2010 @ 23:37:51 Author: rtoy Path: /project/cmucl/cvsroot/src/code Modified: fd-stream.lisp Correct the docstring for OPEN for the :ENCODING-ERROR and :DECODING-ERROR arguments. ----------------+ fd-stream.lisp | 26 +++++++++++++++++--------- 1 file changed, 17 insertions(+), 9 deletions(-) Index: src/code/fd-stream.lisp diff -u src/code/fd-stream.lisp:1.114 src/code/fd-stream.lisp:1.115 --- src/code/fd-stream.lisp:1.114 Tue Jul 20 18:53:11 2010 +++ src/code/fd-stream.lisp Tue Aug 3 23:37:51 2010 @@ -5,7 +5,7 @@ ;;; Carnegie Mellon University, and has been placed in the public domain. ;;; (ext:file-comment - "$Header: /project/cmucl/cvsroot/src/code/fd-stream.lisp,v 1.114 2010-07-20 22:53:11 rtoy Exp $") + "$Header: /project/cmucl/cvsroot/src/code/fd-stream.lisp,v 1.115 2010-08-04 03:37:51 rtoy Exp $") ;;; ;;; ********************************************************************** ;;; @@ -2201,15 +2201,23 @@ :if-does-not-exist - one of :error, :create or nil :external-format - an external format name :decoding-error - How to handle decoding errors from the external format. - Should be a symbol or function of 3 arguments. If it - returns, it should return a code point to use as the - replacment. NIL means use the default replacement scheme - specified by the external format. The function arguments - are a format message string, the offending octet, and the - number of octets read in the current encoding. + If a character, then that character is used as + the replacment character for all errors. If T, + then a continuable error is signaled. If + continued, the Unicode replacement character is + used. Otherwise, it should be a symbol or + function of 3 arguments. If it returns, it + should return a code point to use as the + replacment. The function arguments are a + format message string, the offending octet, and + the number of octets read in the current + encoding. :encoding-error - Like :decoding-error, but for errors when encoding the - stream. The function arguments are a format message - string and the incorrect codepoint. + stream. If a character, that character is used + as the replacment code point. Otherwise, it + should be a symbol or function oof two + arguments: a format message string and the + incorrect codepoint. See the manual for details." (declare (ignore element-type external-format input-handle output-handle

1 0

[cmucl-cvs] CMUCL commit: src/code (extfmts.lisp)
by Raymond Toy 04 Aug '10

04 Aug '10

Date: Tuesday, August 3, 2010 @ 22:56:36 Author: rtoy Path: /project/cmucl/cvsroot/src/code Modified: extfmts.lisp Inhibit warnings around funcalls to error. This was generating too compiler noise for something we don't really care if it's slow. --------------+ extfmts.lisp | 32 ++++++++++++++++++++------------ 1 file changed, 20 insertions(+), 12 deletions(-) Index: src/code/extfmts.lisp diff -u src/code/extfmts.lisp:1.35 src/code/extfmts.lisp:1.36 --- src/code/extfmts.lisp:1.35 Mon Jul 12 09:58:42 2010 +++ src/code/extfmts.lisp Tue Aug 3 22:56:36 2010 @@ -5,7 +5,7 @@ ;;; domain. ;;; (ext:file-comment - "$Header: /project/cmucl/cvsroot/src/code/extfmts.lisp,v 1.35 2010-07-12 13:58:42 rtoy Exp $") + "$Header: /project/cmucl/cvsroot/src/code/extfmts.lisp,v 1.36 2010-08-04 02:56:36 rtoy Exp $") ;;; ;;; ********************************************************************** ;;; @@ -753,11 +753,15 @@ ;; illegal. So are codepoints that are too large. (if ,error (if (lisp::surrogatep code) - (funcall ,error - (format nil (intl:gettext "Surrogate codepoint #x~~4,'0X is illegal for ~A") - ,external-format) - code nil) - (funcall ,error (intl:gettext "Illegal codepoint on input: #x~X") code nil)) + (locally + (declare (optimize (ext:inhibit-warnings 3))) + (funcall ,error + (format nil (intl:gettext "Surrogate codepoint #x~~4,'0X is illegal for ~A") + ,external-format) + code nil)) + (locally + (declare (optimize (ext:inhibit-warnings 3))) + (funcall ,error (intl:gettext "Illegal codepoint on input: #x~X") code nil))) #-(and unicode (not unicode-bootstrap)) #\? #+(and unicode (not unicode-bootstrap)) #\U+FFFD)) #+unicode @@ -788,18 +792,22 @@ (,wryte (if (lisp::surrogatep (char-code ,nchar) :low) (surrogates-to-codepoint (car ,nstate) ,nchar) (if ,error - (funcall ,error - (intl:gettext "Cannot convert invalid surrogate #x~X to character") - ,nchar) + (locally + (declare (optimize (ext:inhibit-warnings 3))) + (funcall ,error + (intl:gettext "Cannot convert invalid surrogate #x~X to character") + ,nchar)) +replacement-character-code+))) (setf (car ,nstate) nil)) ;; A lone trailing (low) surrogate gets replaced with ;; the replacement character. (,wryte (if (lisp::surrogatep (char-code ,nchar) :low) (if ,error - (funcall ,error - (intl:gettext "Cannot convert lone trailing surrogate #x~X to character") - ,nchar) + (locally + (declare (optimize (ext:inhibit-warnings 3))) + (funcall ,error + (intl:gettext "Cannot convert lone trailing surrogate #x~X to character") + ,nchar)) +replacement-character-code+) (char-code ,nchar)))))))))

1 0

[cmucl-cvs] CMUCL commit: cmucl-www/cmucl-www/www (index.html news/index.html)
by Raymond Toy 03 Aug '10

03 Aug '10

Date: Tuesday, August 3, 2010 @ 14:21:18 Author: rtoy Path: /project/cmucl/cvsroot/cmucl-www/cmucl-www/www Modified: index.html news/index.html Add news about the 20b prerelease 1 and 2010-08 snapshot (and lack thereof). -----------------+ index.html | 68 ++++++++++++++++++++++++++++++++++++++++++++++-------- news/index.html | 64 ++++++++++++++++++++++++++++++++++++++++++++++++++ 2 files changed, 123 insertions(+), 9 deletions(-) Index: cmucl-www/cmucl-www/www/index.html diff -u cmucl-www/cmucl-www/www/index.html:1.9 cmucl-www/cmucl-www/www/index.html:1.10 --- cmucl-www/cmucl-www/www/index.html:1.9 Sat Jul 31 10:57:29 2010 +++ cmucl-www/cmucl-www/www/index.html Tue Aug 3 14:21:18 2010 @@ -68,17 +68,67 @@ Also see <a href="news/index.html">News</a> for older news. <dl> -<dt>2010-07 snapshot</dt> +<dt>2010-08 snapshot and 20b prerelease 1</dt> <dd> + CMUCL 20b prelease 1 has been released, in preparation for the + upcoming 20b release. Therefore there will not + be a 2010-08 snapshot. <ul> - <li> DELETE-FILE, ENSURE-DIRECTORIES-EXIST, FILE-AUTHOR, - FILE-WRITE-DATE, and OPEN now merge the given pathname with - *DEFAULT-PATHNAME-DEFAULTS* as required by CLHS sec 19.2.3. - </li> - <li> When printing out argument values in the debugger and also - during TRACE, the incorrect values were returned for the SSE2 core. - This was caused by using the x87 values instead of the sse2 values - in the sigcontext. This is fixed now. </li> + <li> Error handling has been added to external formats. Previously, + all external formats would silently replace bad encodings with a + suitable replacement character. Now, the user can specify how + the errors are handled by using the <tt>:DECODING-ERROR</tt> and + <tt>:ENCODING-ERROR</tt> parameters to <tt>OPEN</tt>. The default is the previous + behavior. + + For decoding-error, a character, symbol, or function + can be given. If a character, then that character is used as + the replacement character. For a symbol or function, it must be + a function of 3 arguments: a message string, the offending + octet (or nil), and the number of octets read in the encoding. + If the function returns, it must be the codepoint of the desired + replacement. + + For encoding-error, a character, symbol, or function can be + given. If a character, then that character is used as the + replacement character. For a symbol or function, it must be a + function of 2 arguments: a message string and the offending + codepoint. If the function returns, it must be the codepoint of + the desired replacement. + </li> + <li> Add <tt>EXT:LIST-ALL-EXTERNAL-FORMATS</tt> to list all known external + formats and their aliases. + </li> + <li> ADD <tt>EXT:DESCRIBE-EXTERNAL-FORMAT</tt> to print a description of the + specified exernal format. To support this, the macros + <tt>DEFINE-EXTERNAL-FORMAT</tt> and <tt>DEFINE-COMPOSING-EXTERNAL-FORMAT</tt> have + changed. + </li> + <li> The sparc port now supports the :executable feature.</li> + <li> The Mac OS X port now support the :executable feature.</li> + <li> A critical bug in the fast unicode stream buffering routine has + been fixed. This bug manifests itself by causing valid + sequences to be incorrectly decoded, resulting in a replacement + character. + <li> UTF-8 correctly catches overlong sequences now. Previously, + overlong sequences were missed. + <li> When UTF-8 decoder encounters an overlong sequence, a surrogate + code point, or a too-large codepoint, the entire sequence is + converted to the replacement character. Previously, all of the + octets except the first were put back, and the data read again. + <li> Some GC improvements for sparc and ppc. (Changes for ppc + untested). GC could incorrectly move the PC and other + registers, causing a segfault. + <li> A bug inadvertently introduced in the 2010-04 non-unicode + snapshot has been fixed. The bug prevented the non-unicode + versions of CMUCL from loading the external format aliases + file. + <li> With SSE2, the imaginary part of a (complex single-float) is now + returned correctly. + <li> The method used to create executable images for Linux has been + cleaned up and should be far more robust against different + versions of the OS. The same is true on sparc as well as Mac OS + X. </ul> </dd> </dl> Index: cmucl-www/cmucl-www/www/news/index.html diff -u cmucl-www/cmucl-www/www/news/index.html:1.35 cmucl-www/cmucl-www/www/news/index.html:1.36 --- cmucl-www/cmucl-www/www/news/index.html:1.35 Sat Jul 31 10:57:29 2010 +++ cmucl-www/cmucl-www/www/news/index.html Tue Aug 3 14:21:18 2010 @@ -11,6 +11,70 @@ <dl> +<dt>2010-08 snapshot and 20b prerelease 1</dt> +<dd> + CMUCL 20b prelease 1 has been released, in preparation for the + upcoming 20b release. Therefore there will not + be a 2010-08 snapshot. + <ul> + <li> Error handling has been added to external formats. Previously, + all external formats would silently replace bad encodings with a + suitable replacement character. Now, the user can specify how + the errors are handled by using the <tt>:DECODING-ERROR</tt> and + <tt>:ENCODING-ERROR</tt> parameters to <tt>OPEN</tt>. The default is the previous + behavior. + + For decoding-error, a character, symbol, or function + can be given. If a character, then that character is used as + the replacement character. For a symbol or function, it must be + a function of 3 arguments: a message string, the offending + octet (or nil), and the number of octets read in the encoding. + If the function returns, it must be the codepoint of the desired + replacement. + + For encoding-error, a character, symbol, or function can be + given. If a character, then that character is used as the + replacement character. For a symbol or function, it must be a + function of 2 arguments: a message string and the offending + codepoint. If the function returns, it must be the codepoint of + the desired replacement. + </li> + <li> Add <tt>EXT:LIST-ALL-EXTERNAL-FORMATS</tt> to list all known external + formats and their aliases. + </li> + <li> ADD <tt>EXT:DESCRIBE-EXTERNAL-FORMAT</tt> to print a description of the + specified exernal format. To support this, the macros + <tt>DEFINE-EXTERNAL-FORMAT</tt> and <tt>DEFINE-COMPOSING-EXTERNAL-FORMAT</tt> have + changed. + </li> + <li> The sparc port now supports the :executable feature.</li> + <li> The Mac OS X port now support the :executable feature.</li> + <li> A critical bug in the fast unicode stream buffering routine has + been fixed. This bug manifests itself by causing valid + sequences to be incorrectly decoded, resulting in a replacement + character. + <li> UTF-8 correctly catches overlong sequences now. Previously, + overlong sequences were missed. + <li> When UTF-8 decoder encounters an overlong sequence, a surrogate + code point, or a too-large codepoint, the entire sequence is + converted to the replacement character. Previously, all of the + octets except the first were put back, and the data read again. + <li> Some GC improvements for sparc and ppc. (Changes for ppc + untested). GC could incorrectly move the PC and other + registers, causing a segfault. + <li> A bug inadvertently introduced in the 2010-04 non-unicode + snapshot has been fixed. The bug prevented the non-unicode + versions of CMUCL from loading the external format aliases + file. + <li> With SSE2, the imaginary part of a (complex single-float) is now + returned correctly. + <li> The method used to create executable images for Linux has been + cleaned up and should be far more robust against different + versions of the OS. The same is true on sparc as well as Mac OS + X. + </ul> +</dd> + <dt>2010-07 snapshot</dt> <dd> <ul>

1 0

[cmucl-cvs] CMUCL commit: src/docs/cmu-user (.cvsignore)
by Raymond Toy 03 Aug '10

03 Aug '10

Date: Tuesday, August 3, 2010 @ 08:00:20 Author: rtoy Path: /project/cmucl/cvsroot/src/docs/cmu-user Modified: .cvsignore Ignore some more filess created from running tex and/or hevea. ------------+ .cvsignore | 6 ++++++ 1 file changed, 6 insertions(+) Index: src/docs/cmu-user/.cvsignore diff -u src/docs/cmu-user/.cvsignore:1.7 src/docs/cmu-user/.cvsignore:1.8 --- src/docs/cmu-user/.cvsignore:1.7 Wed Jun 30 12:42:43 2010 +++ src/docs/cmu-user/.cvsignore Tue Aug 3 08:00:19 2010 @@ -17,3 +17,9 @@ *.vnd cmu-user-html.tgz cmu-user-letter.ps +cmu-user.haux +cmu-user.hcnd +cmu-user.hfnd +cmu-user.htnd +cmu-user.htoc +cmu-user.hvnd

1 0

[cmucl-cvs] CMUCL commit: src/docs/cmu-user (extensions.tex)
by Raymond Toy 03 Aug '10

03 Aug '10

Date: Monday, August 2, 2010 @ 20:44:03 Author: rtoy Path: /project/cmucl/cvsroot/src/docs/cmu-user Modified: extensions.tex o Add entry for ld-library-path search-list. o Add documentation for static arrays. ----------------+ extensions.tex | 52 +++++++++++++++++++++++++++++++++++++++++++++++++++- 1 file changed, 51 insertions(+), 1 deletion(-) Index: src/docs/cmu-user/extensions.tex diff -u src/docs/cmu-user/extensions.tex:1.46 src/docs/cmu-user/extensions.tex:1.47 --- src/docs/cmu-user/extensions.tex:1.46 Sat Jul 31 09:36:48 2010 +++ src/docs/cmu-user/extensions.tex Mon Aug 2 20:44:03 2010 @@ -1561,7 +1561,7 @@ variable). \item[\code{path:}] The Unix command path (\code{PATH} environment variable). -\item[\code{ld-library-path:}] The Unix \code{LD_LIBRARY_PATH} +\item[\code{ld-library-path:}] The Unix \code{LD\_LIBRARY\_PATH} environment variable. \item[\code{target:}] The root of the tree where \cmucl{} was compiled. \item[\code{modules:}] The list of directories where \cmucl{}'s @@ -3007,3 +3007,53 @@ gettext at \href{http://www.gnu.org/software/gettext/manual/gettext.html}{\texttt{http://www.gnu.org/software/gettext/manual/gettext.html}}. \fi + +\section{Static Arrays} +\label{sec:static-arrays} + +\cmucl{} supports static arrays which are arrays that are not moved by +the garbage collector. To create such an array, use the +\kwd{allocation} option to \code{make-array} with a value of +\kwd{malloc}. These arrays appear as normal Lisp arrays, but are +actually allocated from the \code{C} heap (hence the \kwd{malloc}). +Thus, the number and size of such arrays are limited by the available +\code{C} heap. + +Also, only certain types of arrays can be allocated. The static array +cannot be adjustable and cannot be displaced to. The array must also +be a \code{simple-array} of one dimension. The element type is also +constrained to be one of the types in +Table~\ref{tbl:static-array-types}. + +\begin{table}[tbhp] + \begin{center} + \begin{tabular}{|c|} + \hline + \code{(unsigned-byte 8)} \\ + \hline + \code{(unsigned-byte 16)} \\ + \hline + \code{(unsigned-byte 32)} \\ + \hline + \code{(signed-byte 8)} \\ + \hline + \code{(signed-byte 16)} \\ + \hline + \code{(signed-byte 32)} \\ + \hline + \code{single-float} \\ + \hline + \code{double-float} \\ + \hline + \code{(complex single-float)} \\ + \hline + \code{(complex double-float)} \\ + \hline + \end{tabular} + \caption{Allowed element types for static arrays} + \label{tbl:static-array-types} + \end{center} +\end{table} + +The arrays are properly handled by GC. GC will not move the arrays, +but they will be properly removed up if they become garbage.

1 0

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

cmucl-cvs August 2010