- cmucl-cvs - mailman3.common-lisp.net

[cmucl-cvs] CMUCL commit: src/general-info (release-20b.txt)
by Raymond Toy 04 Aug '10

04 Aug '10

Date: Wednesday, August 4, 2010 @ 10:28:23 Author: rtoy Path: /project/cmucl/cvsroot/src/general-info Modified: release-20b.txt Fix some typos. -----------------+ release-20b.txt | 20 ++++++++++---------- 1 file changed, 10 insertions(+), 10 deletions(-) Index: src/general-info/release-20b.txt diff -u src/general-info/release-20b.txt:1.42 src/general-info/release-20b.txt:1.43 --- src/general-info/release-20b.txt:1.42 Tue Aug 3 23:46:18 2010 +++ src/general-info/release-20b.txt Wed Aug 4 10:28:23 2010 @@ -41,10 +41,10 @@ - FROUND and FTRUNCATE are much faster for single and double float numbers. This is not currently available for x87 (due to potential roundoff errors), but is available everywhere else. - - Support for internalization/localization added. Messages from - CMUCL can be translated, but currently only a few messages in - Korean are translated. For fun, there is a full Pig Latin - translation (done by machine). + - Support for internationalization/localization added. Messages + from CMUCL can be translated, but currently only a few messages + in Korean are translated. For fun, there is a full Pig Latin + translation (done by machine). - Source information (file) for defstructs and deftypes is now provided. DESCRIBE will now print out the name of the file where the defstruct/deftype was defined. @@ -80,7 +80,7 @@ - Add EXT:LIST-ALL-EXTERNAL-FORMATS to list all known external formats and their aliases. - ADD EXT:DESCRIBE-EXTERNAL-FORMAT to print a description of the - specified exernal format. To support this, the macros + specified external format. To support this, the macros DEFINE-EXTERNAL-FORMAT and DEFINE-COMPOSING-EXTERNAL-FORMAT have changed. - The sparc port now supports the :executable feature. @@ -104,7 +104,7 @@ DEFINE-METHOD-COMBINATION is NIL, not "". - DEFINE-COMPILER-MACRO no longer sets the wrong block name for SETF functions. We also check that the name is a valid function - name; an error is signaled if it's invalid. + name; an error is signalled if it's invalid. - DELETE-FILE, ENSURE-DIRECTORIES-EXIST, FILE-AUTHOR, FILE-WRITE-DATE, and OPEN now merge the given pathname with *DEFAULT-PATHNAME-DEFAULTS* as required by CLHS sec 19.2.3. @@ -123,9 +123,9 @@ - When continuing from the INTEXP-LIMIT-ERROR condition (for raising an integer to a large integer power) and setting a new limit, the limit was set to the power. We really wanted the - absolute valie of the power to used as the new limit. + absolute value of the power to used as the new limit. - FILE-POSITION was returning incorrect values for file streams on - unicode builds. This is fixed now. But also see the known + Unicode builds. This is fixed now. But also see the known issue listed above. - The error-output and trace-file files for COMPILE-FILE are now opened using the same external format as specified in @@ -134,7 +134,7 @@ information if the default format could not represent the characters in the source file. - Handling of source files in the debugger is better now for - unicode builds. The source files are opened using the same + Unicode builds. The source files are opened using the same format as used to compile them. Previously, the default format was used, which would be wrong if the file is in a different format. @@ -176,7 +176,7 @@ during TRACE, the incorrect values were returned for the SSE2 core. This was caused by using the x87 values instead of the sse2 values in the sigcontext. This is fixed now. - - A critical bug in the fast unicode stream buffering routine has + - A critical bug in the fast Unicode stream buffering routine has been fixed. This bug manifests itself by causing valid sequences to be incorrectly decoded, resulting in a replacement character.

1 0

[cmucl-cvs] CMUCL commit: RELEASE-20B-BRANCH src/code (extfmts.lisp)
by Raymond Toy 04 Aug '10

04 Aug '10

Date: Wednesday, August 4, 2010 @ 08:12:09 Author: rtoy Path: /project/cmucl/cvsroot/src/code Tag: RELEASE-20B-BRANCH Modified: extfmts.lisp Merge some change from HEAD to keep compiler quieter when compiling external formats. --------------+ extfmts.lisp | 32 ++++++++++++++++++++------------ 1 file changed, 20 insertions(+), 12 deletions(-) Index: src/code/extfmts.lisp diff -u src/code/extfmts.lisp:1.35 src/code/extfmts.lisp:1.35.4.1 --- src/code/extfmts.lisp:1.35 Mon Jul 12 09:58:42 2010 +++ src/code/extfmts.lisp Wed Aug 4 08:12:09 2010 @@ -5,7 +5,7 @@ ;;; domain. ;;; (ext:file-comment - "$Header: /project/cmucl/cvsroot/src/code/extfmts.lisp,v 1.35 2010-07-12 13:58:42 rtoy Exp $") + "$Header: /project/cmucl/cvsroot/src/code/extfmts.lisp,v 1.35.4.1 2010-08-04 12:12:09 rtoy Exp $") ;;; ;;; ********************************************************************** ;;; @@ -753,11 +753,15 @@ ;; illegal. So are codepoints that are too large. (if ,error (if (lisp::surrogatep code) - (funcall ,error - (format nil (intl:gettext "Surrogate codepoint #x~~4,'0X is illegal for ~A") - ,external-format) - code nil) - (funcall ,error (intl:gettext "Illegal codepoint on input: #x~X") code nil)) + (locally + (declare (optimize (ext:inhibit-warnings 3))) + (funcall ,error + (format nil (intl:gettext "Surrogate codepoint #x~~4,'0X is illegal for ~A") + ,external-format) + code nil)) + (locally + (declare (optimize (ext:inhibit-warnings 3))) + (funcall ,error (intl:gettext "Illegal codepoint on input: #x~X") code nil))) #-(and unicode (not unicode-bootstrap)) #\? #+(and unicode (not unicode-bootstrap)) #\U+FFFD)) #+unicode @@ -788,18 +792,22 @@ (,wryte (if (lisp::surrogatep (char-code ,nchar) :low) (surrogates-to-codepoint (car ,nstate) ,nchar) (if ,error - (funcall ,error - (intl:gettext "Cannot convert invalid surrogate #x~X to character") - ,nchar) + (locally + (declare (optimize (ext:inhibit-warnings 3))) + (funcall ,error + (intl:gettext "Cannot convert invalid surrogate #x~X to character") + ,nchar)) +replacement-character-code+))) (setf (car ,nstate) nil)) ;; A lone trailing (low) surrogate gets replaced with ;; the replacement character. (,wryte (if (lisp::surrogatep (char-code ,nchar) :low) (if ,error - (funcall ,error - (intl:gettext "Cannot convert lone trailing surrogate #x~X to character") - ,nchar) + (locally + (declare (optimize (ext:inhibit-warnings 3))) + (funcall ,error + (intl:gettext "Cannot convert lone trailing surrogate #x~X to character") + ,nchar)) +replacement-character-code+) (char-code ,nchar)))))))))

1 0

[cmucl-cvs] CMUCL commit: RELEASE-20B-BRANCH src (3 files)
by Raymond Toy 04 Aug '10

04 Aug '10

Date: Wednesday, August 4, 2010 @ 08:08:24 Author: rtoy Path: /project/cmucl/cvsroot/src Tag: RELEASE-20B-BRANCH Modified: code/exports.lisp docs/cmu-user/unicode.tex general-info/release-20b.txt Merge some changes from HEAD that we should have done before the 20b pre1. code/exports.lisp: o Export DESCRIBE-EXTERNAL-FORMAT docs/cmu-user/unicode.tex: o Update docs general-info/release-20b.txt: o Remove work-in-progress. ------------------------------+ code/exports.lisp | 3 + docs/cmu-user/unicode.tex | 66 ++++++++++++++++++++++++++++++++++++----- general-info/release-20b.txt | 2 - 3 files changed, 60 insertions(+), 11 deletions(-) Index: src/code/exports.lisp diff -u src/code/exports.lisp:1.299 src/code/exports.lisp:1.299.4.1 --- src/code/exports.lisp:1.299 Tue Jul 13 19:43:39 2010 +++ src/code/exports.lisp Wed Aug 4 08:08:20 2010 @@ -5,7 +5,7 @@ ;;; Carnegie Mellon University, and has been placed in the public domain. ;;; (ext:file-comment - "$Header: /project/cmucl/cvsroot/src/code/exports.lisp,v 1.299 2010-07-13 23:43:39 rtoy Exp $") + "$Header: /project/cmucl/cvsroot/src/code/exports.lisp,v 1.299.4.1 2010-08-04 12:08:20 rtoy Exp $") ;;; ;;; ********************************************************************** ;;; @@ -1489,6 +1489,7 @@ "DESCRIBE-EXTERNAL-FORMAT") ;; Unicode (:export "STRING-TO-OCTETS" "OCTETS-TO-STRING" "*DEFAULT-EXTERNAL-FORMAT*" + "DESCRIBE-EXTERNAL-FORMATS" "LIST-ALL-EXTERNAL-FORMATS" "STRING-ENCODE" "STRING-DECODE" "SET-SYSTEM-EXTERNAL-FORMAT")) Index: src/docs/cmu-user/unicode.tex diff -u src/docs/cmu-user/unicode.tex:1.11 src/docs/cmu-user/unicode.tex:1.11.4.1 --- src/docs/cmu-user/unicode.tex:1.11 Mon Jul 12 09:58:42 2010 +++ src/docs/cmu-user/unicode.tex Wed Aug 4 08:08:23 2010 @@ -80,14 +80,6 @@ parameter to specify the format. The default external format is \kwd{default}. -\begin{defun}{stream:}{set-system-external-format}{\var{terminal} \ampoptional{} \var{filenames}} - This function changes the external format used for - \var{*standard-input*}, \var{*standard-output*}, and - \var{*standard-error*} to the external format specified by - \var{terminal}. Additionally, the Unix file name encoding can be - set to the value specified by \var{filenames} if non-\nil. -\end{defun} - \subsection{Available External Formats} The available external formats are listed below in @@ -451,8 +443,66 @@ \file{ext-formats:unidata.bin}. If this file is not found, Unicode support is severely reduced; you can only use ASCII characters. +\begin{defun}{}{open}{\args \var{filename} \amprest \var{options} + \keys{\kwd{direction} \kwd{element-type} \kwd{if-exists} + \kwd{if-does-not-exist} \morekeys \kwd{class} \kwd{mapped} + \kwd{input-handle} \kwd{output-handle} + \yetmorekeys \kwd{external-format} \kwd{decoding-error} + \kwd{encoding-error}} + + The main options are covered elsewhere. Here we describe the + options specific to Unicode. The option \kwd{external-format} + specifies the external format to use for reading and writing the + file. The external format is a keyword. + + The options \kwd{decoding-error} and \kwd{encoding-error} are used + to specify how encoding and decoding errors are handled. The + default value on \nil means the external format handles errors + itself and typically replaces invalid sequences with the Unicode + replacement character. + + Otherwise, the value for \code{decoding-error} is either a + character, a symbol or a function. If a character is + specified. it is used as the replacement character for any invalid + decoding. If a symbol or a function is given, it must be a + function of three arguments: a message string to be printed, the + offending octet, and the number of octets read. If the function + returns, it should return two values: the code point to use as the + replacement character and the number of octets read. In addition, + \true{} may be specified. This indicates that a continuable error + is signaled, which, if continued, the Unicode replacement + character is used. + + For \code{encoding-error}, a character, symbol, or function can be + specified, like \code{decoding-error}, with the same meaning. The + function, however, takes two arguments: a format message string + and the incorrect codepoint. If the function returns, it should + be the replacement codepoint. +\end{defun} + \subsubsection{Utilities} +\begin{defun}{stream:}{set-system-external-format}{\var{terminal} \ampoptional{} \var{filenames}} + This function changes the external format used for + \var{*standard-input*}, \var{*standard-output*}, and + \var{*standard-error*} to the external format specified by + \var{terminal}. Additionally, the Unix file name encoding can be + set to the value specified by \var{filenames} if non-\nil. +\end{defun} + +\begin{defun}{extensions:}{list-all-external-formats}{} + list all of the vailable external formats. A list is returned where + each element is a list of the external format name and a list of + aliases for the format. No distinction is made between external + formats and composing external formats. +\end{defun} + +\begin{defun}{extensions:}{describe-external-format}{external-format} + Print a description of the given \var{external-format}. This may + cause the external format to be loaded (silently) if it is not + already loaded. +\end{defun} + Since strings are UTF-16 and hence may contain surrogate pairs, some utility functions are provided to make access easier. Index: src/general-info/release-20b.txt diff -u src/general-info/release-20b.txt:1.41 src/general-info/release-20b.txt:1.41.2.1 --- src/general-info/release-20b.txt:1.41 Sat Jul 31 09:45:33 2010 +++ src/general-info/release-20b.txt Wed Aug 4 08:08:23 2010 @@ -1,7 +1,5 @@ ========================== C M U C L 20 b ============================= -[--- WORK IN PROGRESS ---] - The CMUCL project is pleased to announce the release of CMUCL 20b. This is a major release which contains numerous enhancements and bug fixes from the 19f release.

1 0

[cmucl-cvs] CMUCL commit: src/general-info (release-20b.txt)
by Raymond Toy 04 Aug '10

04 Aug '10

Date: Tuesday, August 3, 2010 @ 23:46:18 Author: rtoy Path: /project/cmucl/cvsroot/src/general-info Modified: release-20b.txt Forgot to remove the work-in-progress line. -----------------+ release-20b.txt | 2 -- 1 file changed, 2 deletions(-) Index: src/general-info/release-20b.txt diff -u src/general-info/release-20b.txt:1.41 src/general-info/release-20b.txt:1.42 --- src/general-info/release-20b.txt:1.41 Sat Jul 31 09:45:33 2010 +++ src/general-info/release-20b.txt Tue Aug 3 23:46:18 2010 @@ -1,7 +1,5 @@ ========================== C M U C L 20 b ============================= -[--- WORK IN PROGRESS ---] - The CMUCL project is pleased to announce the release of CMUCL 20b. This is a major release which contains numerous enhancements and bug fixes from the 19f release.

1 0

[cmucl-cvs] CMUCL commit: src/code (exports.lisp)
by Raymond Toy 04 Aug '10

04 Aug '10

Date: Tuesday, August 3, 2010 @ 23:41:51 Author: rtoy Path: /project/cmucl/cvsroot/src/code Modified: exports.lisp Forgot to export DESCRIBE-EXTERNAL-FORMAT from the EXTENSIONS package. --------------+ exports.lisp | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-) Index: src/code/exports.lisp diff -u src/code/exports.lisp:1.299 src/code/exports.lisp:1.300 --- src/code/exports.lisp:1.299 Tue Jul 13 19:43:39 2010 +++ src/code/exports.lisp Tue Aug 3 23:41:51 2010 @@ -5,7 +5,7 @@ ;;; Carnegie Mellon University, and has been placed in the public domain. ;;; (ext:file-comment - "$Header: /project/cmucl/cvsroot/src/code/exports.lisp,v 1.299 2010-07-13 23:43:39 rtoy Exp $") + "$Header: /project/cmucl/cvsroot/src/code/exports.lisp,v 1.300 2010-08-04 03:41:51 rtoy Exp $") ;;; ;;; ********************************************************************** ;;; @@ -1489,6 +1489,7 @@ "DESCRIBE-EXTERNAL-FORMAT") ;; Unicode (:export "STRING-TO-OCTETS" "OCTETS-TO-STRING" "*DEFAULT-EXTERNAL-FORMAT*" + "DESCRIBE-EXTERNAL-FORMATS" "LIST-ALL-EXTERNAL-FORMATS" "STRING-ENCODE" "STRING-DECODE" "SET-SYSTEM-EXTERNAL-FORMAT"))

1 0

[cmucl-cvs] CMUCL commit: src/docs/cmu-user (unicode.tex)
by Raymond Toy 04 Aug '10

04 Aug '10

Date: Tuesday, August 3, 2010 @ 23:39:07 Author: rtoy Path: /project/cmucl/cvsroot/src/docs/cmu-user Modified: unicode.tex o Document the parameters to OPEN that are specific to Unicode. o Document LIST-ALL-EXTERNAL-FORMATS and DESCRIBE-EXTERNAL-FORMAT. -------------+ unicode.tex | 66 ++++++++++++++++++++++++++++++++++++++++++++++++++-------- 1 file changed, 58 insertions(+), 8 deletions(-) Index: src/docs/cmu-user/unicode.tex diff -u src/docs/cmu-user/unicode.tex:1.11 src/docs/cmu-user/unicode.tex:1.12 --- src/docs/cmu-user/unicode.tex:1.11 Mon Jul 12 09:58:42 2010 +++ src/docs/cmu-user/unicode.tex Tue Aug 3 23:39:07 2010 @@ -80,14 +80,6 @@ parameter to specify the format. The default external format is \kwd{default}. -\begin{defun}{stream:}{set-system-external-format}{\var{terminal} \ampoptional{} \var{filenames}} - This function changes the external format used for - \var{*standard-input*}, \var{*standard-output*}, and - \var{*standard-error*} to the external format specified by - \var{terminal}. Additionally, the Unix file name encoding can be - set to the value specified by \var{filenames} if non-\nil. -\end{defun} - \subsection{Available External Formats} The available external formats are listed below in @@ -451,8 +443,66 @@ \file{ext-formats:unidata.bin}. If this file is not found, Unicode support is severely reduced; you can only use ASCII characters. +\begin{defun}{}{open}{\args \var{filename} \amprest \var{options} + \keys{\kwd{direction} \kwd{element-type} \kwd{if-exists} + \kwd{if-does-not-exist} \morekeys \kwd{class} \kwd{mapped} + \kwd{input-handle} \kwd{output-handle} + \yetmorekeys \kwd{external-format} \kwd{decoding-error} + \kwd{encoding-error}} + + The main options are covered elsewhere. Here we describe the + options specific to Unicode. The option \kwd{external-format} + specifies the external format to use for reading and writing the + file. The external format is a keyword. + + The options \kwd{decoding-error} and \kwd{encoding-error} are used + to specify how encoding and decoding errors are handled. The + default value on \nil means the external format handles errors + itself and typically replaces invalid sequences with the Unicode + replacement character. + + Otherwise, the value for \code{decoding-error} is either a + character, a symbol or a function. If a character is + specified. it is used as the replacement character for any invalid + decoding. If a symbol or a function is given, it must be a + function of three arguments: a message string to be printed, the + offending octet, and the number of octets read. If the function + returns, it should return two values: the code point to use as the + replacement character and the number of octets read. In addition, + \true{} may be specified. This indicates that a continuable error + is signaled, which, if continued, the Unicode replacement + character is used. + + For \code{encoding-error}, a character, symbol, or function can be + specified, like \code{decoding-error}, with the same meaning. The + function, however, takes two arguments: a format message string + and the incorrect codepoint. If the function returns, it should + be the replacement codepoint. +\end{defun} + \subsubsection{Utilities} +\begin{defun}{stream:}{set-system-external-format}{\var{terminal} \ampoptional{} \var{filenames}} + This function changes the external format used for + \var{*standard-input*}, \var{*standard-output*}, and + \var{*standard-error*} to the external format specified by + \var{terminal}. Additionally, the Unix file name encoding can be + set to the value specified by \var{filenames} if non-\nil. +\end{defun} + +\begin{defun}{extensions:}{list-all-external-formats}{} + list all of the vailable external formats. A list is returned where + each element is a list of the external format name and a list of + aliases for the format. No distinction is made between external + formats and composing external formats. +\end{defun} + +\begin{defun}{extensions:}{describe-external-format}{external-format} + Print a description of the given \var{external-format}. This may + cause the external format to be loaded (silently) if it is not + already loaded. +\end{defun} + Since strings are UTF-16 and hence may contain surrogate pairs, some utility functions are provided to make access easier.

1 0

[cmucl-cvs] CMUCL commit: src/code (fd-stream.lisp)
by Raymond Toy 04 Aug '10

04 Aug '10

Date: Tuesday, August 3, 2010 @ 23:37:51 Author: rtoy Path: /project/cmucl/cvsroot/src/code Modified: fd-stream.lisp Correct the docstring for OPEN for the :ENCODING-ERROR and :DECODING-ERROR arguments. ----------------+ fd-stream.lisp | 26 +++++++++++++++++--------- 1 file changed, 17 insertions(+), 9 deletions(-) Index: src/code/fd-stream.lisp diff -u src/code/fd-stream.lisp:1.114 src/code/fd-stream.lisp:1.115 --- src/code/fd-stream.lisp:1.114 Tue Jul 20 18:53:11 2010 +++ src/code/fd-stream.lisp Tue Aug 3 23:37:51 2010 @@ -5,7 +5,7 @@ ;;; Carnegie Mellon University, and has been placed in the public domain. ;;; (ext:file-comment - "$Header: /project/cmucl/cvsroot/src/code/fd-stream.lisp,v 1.114 2010-07-20 22:53:11 rtoy Exp $") + "$Header: /project/cmucl/cvsroot/src/code/fd-stream.lisp,v 1.115 2010-08-04 03:37:51 rtoy Exp $") ;;; ;;; ********************************************************************** ;;; @@ -2201,15 +2201,23 @@ :if-does-not-exist - one of :error, :create or nil :external-format - an external format name :decoding-error - How to handle decoding errors from the external format. - Should be a symbol or function of 3 arguments. If it - returns, it should return a code point to use as the - replacment. NIL means use the default replacement scheme - specified by the external format. The function arguments - are a format message string, the offending octet, and the - number of octets read in the current encoding. + If a character, then that character is used as + the replacment character for all errors. If T, + then a continuable error is signaled. If + continued, the Unicode replacement character is + used. Otherwise, it should be a symbol or + function of 3 arguments. If it returns, it + should return a code point to use as the + replacment. The function arguments are a + format message string, the offending octet, and + the number of octets read in the current + encoding. :encoding-error - Like :decoding-error, but for errors when encoding the - stream. The function arguments are a format message - string and the incorrect codepoint. + stream. If a character, that character is used + as the replacment code point. Otherwise, it + should be a symbol or function oof two + arguments: a format message string and the + incorrect codepoint. See the manual for details." (declare (ignore element-type external-format input-handle output-handle

1 0

[cmucl-cvs] CMUCL commit: src/code (extfmts.lisp)
by Raymond Toy 04 Aug '10

04 Aug '10

Date: Tuesday, August 3, 2010 @ 22:56:36 Author: rtoy Path: /project/cmucl/cvsroot/src/code Modified: extfmts.lisp Inhibit warnings around funcalls to error. This was generating too compiler noise for something we don't really care if it's slow. --------------+ extfmts.lisp | 32 ++++++++++++++++++++------------ 1 file changed, 20 insertions(+), 12 deletions(-) Index: src/code/extfmts.lisp diff -u src/code/extfmts.lisp:1.35 src/code/extfmts.lisp:1.36 --- src/code/extfmts.lisp:1.35 Mon Jul 12 09:58:42 2010 +++ src/code/extfmts.lisp Tue Aug 3 22:56:36 2010 @@ -5,7 +5,7 @@ ;;; domain. ;;; (ext:file-comment - "$Header: /project/cmucl/cvsroot/src/code/extfmts.lisp,v 1.35 2010-07-12 13:58:42 rtoy Exp $") + "$Header: /project/cmucl/cvsroot/src/code/extfmts.lisp,v 1.36 2010-08-04 02:56:36 rtoy Exp $") ;;; ;;; ********************************************************************** ;;; @@ -753,11 +753,15 @@ ;; illegal. So are codepoints that are too large. (if ,error (if (lisp::surrogatep code) - (funcall ,error - (format nil (intl:gettext "Surrogate codepoint #x~~4,'0X is illegal for ~A") - ,external-format) - code nil) - (funcall ,error (intl:gettext "Illegal codepoint on input: #x~X") code nil)) + (locally + (declare (optimize (ext:inhibit-warnings 3))) + (funcall ,error + (format nil (intl:gettext "Surrogate codepoint #x~~4,'0X is illegal for ~A") + ,external-format) + code nil)) + (locally + (declare (optimize (ext:inhibit-warnings 3))) + (funcall ,error (intl:gettext "Illegal codepoint on input: #x~X") code nil))) #-(and unicode (not unicode-bootstrap)) #\? #+(and unicode (not unicode-bootstrap)) #\U+FFFD)) #+unicode @@ -788,18 +792,22 @@ (,wryte (if (lisp::surrogatep (char-code ,nchar) :low) (surrogates-to-codepoint (car ,nstate) ,nchar) (if ,error - (funcall ,error - (intl:gettext "Cannot convert invalid surrogate #x~X to character") - ,nchar) + (locally + (declare (optimize (ext:inhibit-warnings 3))) + (funcall ,error + (intl:gettext "Cannot convert invalid surrogate #x~X to character") + ,nchar)) +replacement-character-code+))) (setf (car ,nstate) nil)) ;; A lone trailing (low) surrogate gets replaced with ;; the replacement character. (,wryte (if (lisp::surrogatep (char-code ,nchar) :low) (if ,error - (funcall ,error - (intl:gettext "Cannot convert lone trailing surrogate #x~X to character") - ,nchar) + (locally + (declare (optimize (ext:inhibit-warnings 3))) + (funcall ,error + (intl:gettext "Cannot convert lone trailing surrogate #x~X to character") + ,nchar)) +replacement-character-code+) (char-code ,nchar)))))))))

1 0

[cmucl-cvs] CMUCL commit: cmucl-www/cmucl-www/www (index.html news/index.html)
by Raymond Toy 03 Aug '10

03 Aug '10

Date: Tuesday, August 3, 2010 @ 14:21:18 Author: rtoy Path: /project/cmucl/cvsroot/cmucl-www/cmucl-www/www Modified: index.html news/index.html Add news about the 20b prerelease 1 and 2010-08 snapshot (and lack thereof). -----------------+ index.html | 68 ++++++++++++++++++++++++++++++++++++++++++++++-------- news/index.html | 64 ++++++++++++++++++++++++++++++++++++++++++++++++++ 2 files changed, 123 insertions(+), 9 deletions(-) Index: cmucl-www/cmucl-www/www/index.html diff -u cmucl-www/cmucl-www/www/index.html:1.9 cmucl-www/cmucl-www/www/index.html:1.10 --- cmucl-www/cmucl-www/www/index.html:1.9 Sat Jul 31 10:57:29 2010 +++ cmucl-www/cmucl-www/www/index.html Tue Aug 3 14:21:18 2010 @@ -68,17 +68,67 @@ Also see <a href="news/index.html">News</a> for older news. <dl> -<dt>2010-07 snapshot</dt> +<dt>2010-08 snapshot and 20b prerelease 1</dt> <dd> + CMUCL 20b prelease 1 has been released, in preparation for the + upcoming 20b release. Therefore there will not + be a 2010-08 snapshot. <ul> - <li> DELETE-FILE, ENSURE-DIRECTORIES-EXIST, FILE-AUTHOR, - FILE-WRITE-DATE, and OPEN now merge the given pathname with - *DEFAULT-PATHNAME-DEFAULTS* as required by CLHS sec 19.2.3. - </li> - <li> When printing out argument values in the debugger and also - during TRACE, the incorrect values were returned for the SSE2 core. - This was caused by using the x87 values instead of the sse2 values - in the sigcontext. This is fixed now. </li> + <li> Error handling has been added to external formats. Previously, + all external formats would silently replace bad encodings with a + suitable replacement character. Now, the user can specify how + the errors are handled by using the <tt>:DECODING-ERROR</tt> and + <tt>:ENCODING-ERROR</tt> parameters to <tt>OPEN</tt>. The default is the previous + behavior. + + For decoding-error, a character, symbol, or function + can be given. If a character, then that character is used as + the replacement character. For a symbol or function, it must be + a function of 3 arguments: a message string, the offending + octet (or nil), and the number of octets read in the encoding. + If the function returns, it must be the codepoint of the desired + replacement. + + For encoding-error, a character, symbol, or function can be + given. If a character, then that character is used as the + replacement character. For a symbol or function, it must be a + function of 2 arguments: a message string and the offending + codepoint. If the function returns, it must be the codepoint of + the desired replacement. + </li> + <li> Add <tt>EXT:LIST-ALL-EXTERNAL-FORMATS</tt> to list all known external + formats and their aliases. + </li> + <li> ADD <tt>EXT:DESCRIBE-EXTERNAL-FORMAT</tt> to print a description of the + specified exernal format. To support this, the macros + <tt>DEFINE-EXTERNAL-FORMAT</tt> and <tt>DEFINE-COMPOSING-EXTERNAL-FORMAT</tt> have + changed. + </li> + <li> The sparc port now supports the :executable feature.</li> + <li> The Mac OS X port now support the :executable feature.</li> + <li> A critical bug in the fast unicode stream buffering routine has + been fixed. This bug manifests itself by causing valid + sequences to be incorrectly decoded, resulting in a replacement + character. + <li> UTF-8 correctly catches overlong sequences now. Previously, + overlong sequences were missed. + <li> When UTF-8 decoder encounters an overlong sequence, a surrogate + code point, or a too-large codepoint, the entire sequence is + converted to the replacement character. Previously, all of the + octets except the first were put back, and the data read again. + <li> Some GC improvements for sparc and ppc. (Changes for ppc + untested). GC could incorrectly move the PC and other + registers, causing a segfault. + <li> A bug inadvertently introduced in the 2010-04 non-unicode + snapshot has been fixed. The bug prevented the non-unicode + versions of CMUCL from loading the external format aliases + file. + <li> With SSE2, the imaginary part of a (complex single-float) is now + returned correctly. + <li> The method used to create executable images for Linux has been + cleaned up and should be far more robust against different + versions of the OS. The same is true on sparc as well as Mac OS + X. </ul> </dd> </dl> Index: cmucl-www/cmucl-www/www/news/index.html diff -u cmucl-www/cmucl-www/www/news/index.html:1.35 cmucl-www/cmucl-www/www/news/index.html:1.36 --- cmucl-www/cmucl-www/www/news/index.html:1.35 Sat Jul 31 10:57:29 2010 +++ cmucl-www/cmucl-www/www/news/index.html Tue Aug 3 14:21:18 2010 @@ -11,6 +11,70 @@ <dl> +<dt>2010-08 snapshot and 20b prerelease 1</dt> +<dd> + CMUCL 20b prelease 1 has been released, in preparation for the + upcoming 20b release. Therefore there will not + be a 2010-08 snapshot. + <ul> + <li> Error handling has been added to external formats. Previously, + all external formats would silently replace bad encodings with a + suitable replacement character. Now, the user can specify how + the errors are handled by using the <tt>:DECODING-ERROR</tt> and + <tt>:ENCODING-ERROR</tt> parameters to <tt>OPEN</tt>. The default is the previous + behavior. + + For decoding-error, a character, symbol, or function + can be given. If a character, then that character is used as + the replacement character. For a symbol or function, it must be + a function of 3 arguments: a message string, the offending + octet (or nil), and the number of octets read in the encoding. + If the function returns, it must be the codepoint of the desired + replacement. + + For encoding-error, a character, symbol, or function can be + given. If a character, then that character is used as the + replacement character. For a symbol or function, it must be a + function of 2 arguments: a message string and the offending + codepoint. If the function returns, it must be the codepoint of + the desired replacement. + </li> + <li> Add <tt>EXT:LIST-ALL-EXTERNAL-FORMATS</tt> to list all known external + formats and their aliases. + </li> + <li> ADD <tt>EXT:DESCRIBE-EXTERNAL-FORMAT</tt> to print a description of the + specified exernal format. To support this, the macros + <tt>DEFINE-EXTERNAL-FORMAT</tt> and <tt>DEFINE-COMPOSING-EXTERNAL-FORMAT</tt> have + changed. + </li> + <li> The sparc port now supports the :executable feature.</li> + <li> The Mac OS X port now support the :executable feature.</li> + <li> A critical bug in the fast unicode stream buffering routine has + been fixed. This bug manifests itself by causing valid + sequences to be incorrectly decoded, resulting in a replacement + character. + <li> UTF-8 correctly catches overlong sequences now. Previously, + overlong sequences were missed. + <li> When UTF-8 decoder encounters an overlong sequence, a surrogate + code point, or a too-large codepoint, the entire sequence is + converted to the replacement character. Previously, all of the + octets except the first were put back, and the data read again. + <li> Some GC improvements for sparc and ppc. (Changes for ppc + untested). GC could incorrectly move the PC and other + registers, causing a segfault. + <li> A bug inadvertently introduced in the 2010-04 non-unicode + snapshot has been fixed. The bug prevented the non-unicode + versions of CMUCL from loading the external format aliases + file. + <li> With SSE2, the imaginary part of a (complex single-float) is now + returned correctly. + <li> The method used to create executable images for Linux has been + cleaned up and should be far more robust against different + versions of the OS. The same is true on sparc as well as Mac OS + X. + </ul> +</dd> + <dt>2010-07 snapshot</dt> <dd> <ul>

1 0

[cmucl-cvs] CMUCL commit: src/docs/cmu-user (.cvsignore)
by Raymond Toy 03 Aug '10

03 Aug '10

Date: Tuesday, August 3, 2010 @ 08:00:20 Author: rtoy Path: /project/cmucl/cvsroot/src/docs/cmu-user Modified: .cvsignore Ignore some more filess created from running tex and/or hevea. ------------+ .cvsignore | 6 ++++++ 1 file changed, 6 insertions(+) Index: src/docs/cmu-user/.cvsignore diff -u src/docs/cmu-user/.cvsignore:1.7 src/docs/cmu-user/.cvsignore:1.8 --- src/docs/cmu-user/.cvsignore:1.7 Wed Jun 30 12:42:43 2010 +++ src/docs/cmu-user/.cvsignore Tue Aug 3 08:00:19 2010 @@ -17,3 +17,9 @@ *.vnd cmu-user-html.tgz cmu-user-letter.ps +cmu-user.haux +cmu-user.hcnd +cmu-user.hfnd +cmu-user.htnd +cmu-user.htoc +cmu-user.hvnd

1 0