- cmucl-cvs - mailman3.common-lisp.net

[cmucl-cvs] CMUCL commit: src/compiler/x86 (insts.lisp)
by Raymond Toy 06 Aug '10

06 Aug '10

Date: Friday, August 6, 2010 @ 15:01:42 Author: rtoy Path: /project/cmucl/cvsroot/src/compiler/x86 Modified: insts.lisp The packed shift instructions must have an xmm register as the destination and either an xmm register or integer for the source. Add declarations to enforce this, so we don't do silently accept stupid things like psllq <eax>, 32 as was done in */complex-double-float. (Should probably add more checks of this type.) ------------+ insts.lisp | 5 +++-- 1 file changed, 3 insertions(+), 2 deletions(-) Index: src/compiler/x86/insts.lisp diff -u src/compiler/x86/insts.lisp:1.35 src/compiler/x86/insts.lisp:1.36 --- src/compiler/x86/insts.lisp:1.35 Fri Mar 19 11:19:01 2010 +++ src/compiler/x86/insts.lisp Fri Aug 6 15:01:42 2010 @@ -7,7 +7,7 @@ ;;; Scott Fahlman or slisp-group(a)cs.cmu.edu. ;;; (ext:file-comment - "$Header: /project/cmucl/cvsroot/src/compiler/x86/insts.lisp,v 1.35 2010-03-19 15:19:01 rtoy Exp $") + "$Header: /project/cmucl/cvsroot/src/compiler/x86/insts.lisp,v 1.36 2010-08-06 19:01:42 rtoy Exp $") ;;; ;;; ********************************************************************** ;;; @@ -3495,6 +3495,8 @@ ((packed-shift (name imm-op reg-op reg) ;; We don't support the MMX version. `(define-instruction ,name (segment dst src) + (:declare (type (satisfies xmm-register-p) dst) + (type (or fixnum (satisfies xmm-register-p)) src)) (:printer ext-xmm-mem ((prefix #x66) (op ,reg-op))) (:printer ext-xmm-mem ((prefix #x66) (op ,imm-op) (reg ,reg) @@ -3508,7 +3510,6 @@ (emit-mod-reg-r/m-byte segment #b11 ,reg (reg-tn-encoding dst)) (emit-byte segment src)) (t - (assert (xmm-register-p src)) (emit-regular-sse-inst segment dst src #x66 ,reg-op))))))) (packed-shift psrlq #x73 #xd3 2) (packed-shift psrld #x72 #xd2 2)

1 0

[cmucl-cvs] CMUCL commit: RELEASE-20B-BRANCH src/compiler/x86 (float-sse2.lisp)
by Raymond Toy 06 Aug '10

06 Aug '10

Date: Friday, August 6, 2010 @ 14:02:03 Author: rtoy Path: /project/cmucl/cvsroot/src/compiler/x86 Tag: RELEASE-20B-BRANCH Modified: float-sse2.lisp Merge fix from HEAD branch to fix typo in */complex-double-float. -----------------+ float-sse2.lisp | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) Index: src/compiler/x86/float-sse2.lisp diff -u src/compiler/x86/float-sse2.lisp:1.16 src/compiler/x86/float-sse2.lisp:1.16.2.1 --- src/compiler/x86/float-sse2.lisp:1.16 Fri Jul 23 07:53:37 2010 +++ src/compiler/x86/float-sse2.lisp Fri Aug 6 14:02:03 2010 @@ -7,7 +7,7 @@ ;;; Scott Fahlman or slisp-group(a)cs.cmu.edu. ;;; (ext:file-comment - "$Header: /project/cmucl/cvsroot/src/compiler/x86/float-sse2.lisp,v 1.16 2010-07-23 11:53:37 rtoy Exp $") + "$Header: /project/cmucl/cvsroot/src/compiler/x86/float-sse2.lisp,v 1.16.2.1 2010-08-06 18:02:03 rtoy Exp $") ;;; ;;; ********************************************************************** ;;; @@ -2169,7 +2169,7 @@ (inst shufpd t2 t2 1) ; t2 = a*d|b*d (inst mov tmp #x80000000) (inst movd t0 tmp) ; t0 = 0|0|0|#x80000000 - (inst psllq tmp 32) ; t0 = 0|#x80000000,00000000 + (inst psllq t0 32) ; t0 = 0|#x80000000,00000000 (inst xorpd t2 t0) ; t2 = a*d|-b*d (inst addpd t2 t1) ; t2 = a*d+b*c | a*c-b*d (inst movapd r t2)))

1 0

[cmucl-cvs] CMUCL commit: src/compiler/x86 (float-sse2.lisp)
by Raymond Toy 06 Aug '10

06 Aug '10

Date: Friday, August 6, 2010 @ 05:41:41 Author: rtoy Path: /project/cmucl/cvsroot/src/compiler/x86 Modified: float-sse2.lisp Fix typo. -----------------+ float-sse2.lisp | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) Index: src/compiler/x86/float-sse2.lisp diff -u src/compiler/x86/float-sse2.lisp:1.16 src/compiler/x86/float-sse2.lisp:1.17 --- src/compiler/x86/float-sse2.lisp:1.16 Fri Jul 23 07:53:37 2010 +++ src/compiler/x86/float-sse2.lisp Fri Aug 6 05:41:41 2010 @@ -7,7 +7,7 @@ ;;; Scott Fahlman or slisp-group(a)cs.cmu.edu. ;;; (ext:file-comment - "$Header: /project/cmucl/cvsroot/src/compiler/x86/float-sse2.lisp,v 1.16 2010-07-23 11:53:37 rtoy Exp $") + "$Header: /project/cmucl/cvsroot/src/compiler/x86/float-sse2.lisp,v 1.17 2010-08-06 09:41:41 rtoy Exp $") ;;; ;;; ********************************************************************** ;;; @@ -2169,7 +2169,7 @@ (inst shufpd t2 t2 1) ; t2 = a*d|b*d (inst mov tmp #x80000000) (inst movd t0 tmp) ; t0 = 0|0|0|#x80000000 - (inst psllq tmp 32) ; t0 = 0|#x80000000,00000000 + (inst psllq t0 32) ; t0 = 0|#x80000000,00000000 (inst xorpd t2 t0) ; t2 = a*d|-b*d (inst addpd t2 t1) ; t2 = a*d+b*c | a*c-b*d (inst movapd r t2)))

1 0

[cmucl-cvs] CMUCL commit: RELEASE-20B-BRANCH src/general-info (release-20b.txt)
by Raymond Toy 05 Aug '10

05 Aug '10

Date: Wednesday, August 4, 2010 @ 21:58:21 Author: rtoy Path: /project/cmucl/cvsroot/src/general-info Tag: RELEASE-20B-BRANCH Modified: release-20b.txt Merge some change from HEAD to fix some typos. -----------------+ release-20b.txt | 20 ++++++++++---------- 1 file changed, 10 insertions(+), 10 deletions(-) Index: src/general-info/release-20b.txt diff -u src/general-info/release-20b.txt:1.41.2.1 src/general-info/release-20b.txt:1.41.2.2 --- src/general-info/release-20b.txt:1.41.2.1 Wed Aug 4 08:08:23 2010 +++ src/general-info/release-20b.txt Wed Aug 4 21:58:21 2010 @@ -41,10 +41,10 @@ - FROUND and FTRUNCATE are much faster for single and double float numbers. This is not currently available for x87 (due to potential roundoff errors), but is available everywhere else. - - Support for internalization/localization added. Messages from - CMUCL can be translated, but currently only a few messages in - Korean are translated. For fun, there is a full Pig Latin - translation (done by machine). + - Support for internationalization/localization added. Messages + from CMUCL can be translated, but currently only a few messages + in Korean are translated. For fun, there is a full Pig Latin + translation (done by machine). - Source information (file) for defstructs and deftypes is now provided. DESCRIBE will now print out the name of the file where the defstruct/deftype was defined. @@ -80,7 +80,7 @@ - Add EXT:LIST-ALL-EXTERNAL-FORMATS to list all known external formats and their aliases. - ADD EXT:DESCRIBE-EXTERNAL-FORMAT to print a description of the - specified exernal format. To support this, the macros + specified external format. To support this, the macros DEFINE-EXTERNAL-FORMAT and DEFINE-COMPOSING-EXTERNAL-FORMAT have changed. - The sparc port now supports the :executable feature. @@ -104,7 +104,7 @@ DEFINE-METHOD-COMBINATION is NIL, not "". - DEFINE-COMPILER-MACRO no longer sets the wrong block name for SETF functions. We also check that the name is a valid function - name; an error is signaled if it's invalid. + name; an error is signalled if it's invalid. - DELETE-FILE, ENSURE-DIRECTORIES-EXIST, FILE-AUTHOR, FILE-WRITE-DATE, and OPEN now merge the given pathname with *DEFAULT-PATHNAME-DEFAULTS* as required by CLHS sec 19.2.3. @@ -123,9 +123,9 @@ - When continuing from the INTEXP-LIMIT-ERROR condition (for raising an integer to a large integer power) and setting a new limit, the limit was set to the power. We really wanted the - absolute valie of the power to used as the new limit. + absolute value of the power to used as the new limit. - FILE-POSITION was returning incorrect values for file streams on - unicode builds. This is fixed now. But also see the known + Unicode builds. This is fixed now. But also see the known issue listed above. - The error-output and trace-file files for COMPILE-FILE are now opened using the same external format as specified in @@ -134,7 +134,7 @@ information if the default format could not represent the characters in the source file. - Handling of source files in the debugger is better now for - unicode builds. The source files are opened using the same + Unicode builds. The source files are opened using the same format as used to compile them. Previously, the default format was used, which would be wrong if the file is in a different format. @@ -176,7 +176,7 @@ during TRACE, the incorrect values were returned for the SSE2 core. This was caused by using the x87 values instead of the sse2 values in the sigcontext. This is fixed now. - - A critical bug in the fast unicode stream buffering routine has + - A critical bug in the fast Unicode stream buffering routine has been fixed. This bug manifests itself by causing valid sequences to be incorrectly decoded, resulting in a replacement character.

1 0

[cmucl-cvs] CMUCL commit: src/general-info (release-20b.txt)
by Raymond Toy 04 Aug '10

04 Aug '10

Date: Wednesday, August 4, 2010 @ 10:28:23 Author: rtoy Path: /project/cmucl/cvsroot/src/general-info Modified: release-20b.txt Fix some typos. -----------------+ release-20b.txt | 20 ++++++++++---------- 1 file changed, 10 insertions(+), 10 deletions(-) Index: src/general-info/release-20b.txt diff -u src/general-info/release-20b.txt:1.42 src/general-info/release-20b.txt:1.43 --- src/general-info/release-20b.txt:1.42 Tue Aug 3 23:46:18 2010 +++ src/general-info/release-20b.txt Wed Aug 4 10:28:23 2010 @@ -41,10 +41,10 @@ - FROUND and FTRUNCATE are much faster for single and double float numbers. This is not currently available for x87 (due to potential roundoff errors), but is available everywhere else. - - Support for internalization/localization added. Messages from - CMUCL can be translated, but currently only a few messages in - Korean are translated. For fun, there is a full Pig Latin - translation (done by machine). + - Support for internationalization/localization added. Messages + from CMUCL can be translated, but currently only a few messages + in Korean are translated. For fun, there is a full Pig Latin + translation (done by machine). - Source information (file) for defstructs and deftypes is now provided. DESCRIBE will now print out the name of the file where the defstruct/deftype was defined. @@ -80,7 +80,7 @@ - Add EXT:LIST-ALL-EXTERNAL-FORMATS to list all known external formats and their aliases. - ADD EXT:DESCRIBE-EXTERNAL-FORMAT to print a description of the - specified exernal format. To support this, the macros + specified external format. To support this, the macros DEFINE-EXTERNAL-FORMAT and DEFINE-COMPOSING-EXTERNAL-FORMAT have changed. - The sparc port now supports the :executable feature. @@ -104,7 +104,7 @@ DEFINE-METHOD-COMBINATION is NIL, not "". - DEFINE-COMPILER-MACRO no longer sets the wrong block name for SETF functions. We also check that the name is a valid function - name; an error is signaled if it's invalid. + name; an error is signalled if it's invalid. - DELETE-FILE, ENSURE-DIRECTORIES-EXIST, FILE-AUTHOR, FILE-WRITE-DATE, and OPEN now merge the given pathname with *DEFAULT-PATHNAME-DEFAULTS* as required by CLHS sec 19.2.3. @@ -123,9 +123,9 @@ - When continuing from the INTEXP-LIMIT-ERROR condition (for raising an integer to a large integer power) and setting a new limit, the limit was set to the power. We really wanted the - absolute valie of the power to used as the new limit. + absolute value of the power to used as the new limit. - FILE-POSITION was returning incorrect values for file streams on - unicode builds. This is fixed now. But also see the known + Unicode builds. This is fixed now. But also see the known issue listed above. - The error-output and trace-file files for COMPILE-FILE are now opened using the same external format as specified in @@ -134,7 +134,7 @@ information if the default format could not represent the characters in the source file. - Handling of source files in the debugger is better now for - unicode builds. The source files are opened using the same + Unicode builds. The source files are opened using the same format as used to compile them. Previously, the default format was used, which would be wrong if the file is in a different format. @@ -176,7 +176,7 @@ during TRACE, the incorrect values were returned for the SSE2 core. This was caused by using the x87 values instead of the sse2 values in the sigcontext. This is fixed now. - - A critical bug in the fast unicode stream buffering routine has + - A critical bug in the fast Unicode stream buffering routine has been fixed. This bug manifests itself by causing valid sequences to be incorrectly decoded, resulting in a replacement character.

1 0

[cmucl-cvs] CMUCL commit: RELEASE-20B-BRANCH src/code (extfmts.lisp)
by Raymond Toy 04 Aug '10

04 Aug '10

Date: Wednesday, August 4, 2010 @ 08:12:09 Author: rtoy Path: /project/cmucl/cvsroot/src/code Tag: RELEASE-20B-BRANCH Modified: extfmts.lisp Merge some change from HEAD to keep compiler quieter when compiling external formats. --------------+ extfmts.lisp | 32 ++++++++++++++++++++------------ 1 file changed, 20 insertions(+), 12 deletions(-) Index: src/code/extfmts.lisp diff -u src/code/extfmts.lisp:1.35 src/code/extfmts.lisp:1.35.4.1 --- src/code/extfmts.lisp:1.35 Mon Jul 12 09:58:42 2010 +++ src/code/extfmts.lisp Wed Aug 4 08:12:09 2010 @@ -5,7 +5,7 @@ ;;; domain. ;;; (ext:file-comment - "$Header: /project/cmucl/cvsroot/src/code/extfmts.lisp,v 1.35 2010-07-12 13:58:42 rtoy Exp $") + "$Header: /project/cmucl/cvsroot/src/code/extfmts.lisp,v 1.35.4.1 2010-08-04 12:12:09 rtoy Exp $") ;;; ;;; ********************************************************************** ;;; @@ -753,11 +753,15 @@ ;; illegal. So are codepoints that are too large. (if ,error (if (lisp::surrogatep code) - (funcall ,error - (format nil (intl:gettext "Surrogate codepoint #x~~4,'0X is illegal for ~A") - ,external-format) - code nil) - (funcall ,error (intl:gettext "Illegal codepoint on input: #x~X") code nil)) + (locally + (declare (optimize (ext:inhibit-warnings 3))) + (funcall ,error + (format nil (intl:gettext "Surrogate codepoint #x~~4,'0X is illegal for ~A") + ,external-format) + code nil)) + (locally + (declare (optimize (ext:inhibit-warnings 3))) + (funcall ,error (intl:gettext "Illegal codepoint on input: #x~X") code nil))) #-(and unicode (not unicode-bootstrap)) #\? #+(and unicode (not unicode-bootstrap)) #\U+FFFD)) #+unicode @@ -788,18 +792,22 @@ (,wryte (if (lisp::surrogatep (char-code ,nchar) :low) (surrogates-to-codepoint (car ,nstate) ,nchar) (if ,error - (funcall ,error - (intl:gettext "Cannot convert invalid surrogate #x~X to character") - ,nchar) + (locally + (declare (optimize (ext:inhibit-warnings 3))) + (funcall ,error + (intl:gettext "Cannot convert invalid surrogate #x~X to character") + ,nchar)) +replacement-character-code+))) (setf (car ,nstate) nil)) ;; A lone trailing (low) surrogate gets replaced with ;; the replacement character. (,wryte (if (lisp::surrogatep (char-code ,nchar) :low) (if ,error - (funcall ,error - (intl:gettext "Cannot convert lone trailing surrogate #x~X to character") - ,nchar) + (locally + (declare (optimize (ext:inhibit-warnings 3))) + (funcall ,error + (intl:gettext "Cannot convert lone trailing surrogate #x~X to character") + ,nchar)) +replacement-character-code+) (char-code ,nchar)))))))))

1 0

[cmucl-cvs] CMUCL commit: RELEASE-20B-BRANCH src (3 files)
by Raymond Toy 04 Aug '10

04 Aug '10

Date: Wednesday, August 4, 2010 @ 08:08:24 Author: rtoy Path: /project/cmucl/cvsroot/src Tag: RELEASE-20B-BRANCH Modified: code/exports.lisp docs/cmu-user/unicode.tex general-info/release-20b.txt Merge some changes from HEAD that we should have done before the 20b pre1. code/exports.lisp: o Export DESCRIBE-EXTERNAL-FORMAT docs/cmu-user/unicode.tex: o Update docs general-info/release-20b.txt: o Remove work-in-progress. ------------------------------+ code/exports.lisp | 3 + docs/cmu-user/unicode.tex | 66 ++++++++++++++++++++++++++++++++++++----- general-info/release-20b.txt | 2 - 3 files changed, 60 insertions(+), 11 deletions(-) Index: src/code/exports.lisp diff -u src/code/exports.lisp:1.299 src/code/exports.lisp:1.299.4.1 --- src/code/exports.lisp:1.299 Tue Jul 13 19:43:39 2010 +++ src/code/exports.lisp Wed Aug 4 08:08:20 2010 @@ -5,7 +5,7 @@ ;;; Carnegie Mellon University, and has been placed in the public domain. ;;; (ext:file-comment - "$Header: /project/cmucl/cvsroot/src/code/exports.lisp,v 1.299 2010-07-13 23:43:39 rtoy Exp $") + "$Header: /project/cmucl/cvsroot/src/code/exports.lisp,v 1.299.4.1 2010-08-04 12:08:20 rtoy Exp $") ;;; ;;; ********************************************************************** ;;; @@ -1489,6 +1489,7 @@ "DESCRIBE-EXTERNAL-FORMAT") ;; Unicode (:export "STRING-TO-OCTETS" "OCTETS-TO-STRING" "*DEFAULT-EXTERNAL-FORMAT*" + "DESCRIBE-EXTERNAL-FORMATS" "LIST-ALL-EXTERNAL-FORMATS" "STRING-ENCODE" "STRING-DECODE" "SET-SYSTEM-EXTERNAL-FORMAT")) Index: src/docs/cmu-user/unicode.tex diff -u src/docs/cmu-user/unicode.tex:1.11 src/docs/cmu-user/unicode.tex:1.11.4.1 --- src/docs/cmu-user/unicode.tex:1.11 Mon Jul 12 09:58:42 2010 +++ src/docs/cmu-user/unicode.tex Wed Aug 4 08:08:23 2010 @@ -80,14 +80,6 @@ parameter to specify the format. The default external format is \kwd{default}. -\begin{defun}{stream:}{set-system-external-format}{\var{terminal} \ampoptional{} \var{filenames}} - This function changes the external format used for - \var{*standard-input*}, \var{*standard-output*}, and - \var{*standard-error*} to the external format specified by - \var{terminal}. Additionally, the Unix file name encoding can be - set to the value specified by \var{filenames} if non-\nil. -\end{defun} - \subsection{Available External Formats} The available external formats are listed below in @@ -451,8 +443,66 @@ \file{ext-formats:unidata.bin}. If this file is not found, Unicode support is severely reduced; you can only use ASCII characters. +\begin{defun}{}{open}{\args \var{filename} \amprest \var{options} + \keys{\kwd{direction} \kwd{element-type} \kwd{if-exists} + \kwd{if-does-not-exist} \morekeys \kwd{class} \kwd{mapped} + \kwd{input-handle} \kwd{output-handle} + \yetmorekeys \kwd{external-format} \kwd{decoding-error} + \kwd{encoding-error}} + + The main options are covered elsewhere. Here we describe the + options specific to Unicode. The option \kwd{external-format} + specifies the external format to use for reading and writing the + file. The external format is a keyword. + + The options \kwd{decoding-error} and \kwd{encoding-error} are used + to specify how encoding and decoding errors are handled. The + default value on \nil means the external format handles errors + itself and typically replaces invalid sequences with the Unicode + replacement character. + + Otherwise, the value for \code{decoding-error} is either a + character, a symbol or a function. If a character is + specified. it is used as the replacement character for any invalid + decoding. If a symbol or a function is given, it must be a + function of three arguments: a message string to be printed, the + offending octet, and the number of octets read. If the function + returns, it should return two values: the code point to use as the + replacement character and the number of octets read. In addition, + \true{} may be specified. This indicates that a continuable error + is signaled, which, if continued, the Unicode replacement + character is used. + + For \code{encoding-error}, a character, symbol, or function can be + specified, like \code{decoding-error}, with the same meaning. The + function, however, takes two arguments: a format message string + and the incorrect codepoint. If the function returns, it should + be the replacement codepoint. +\end{defun} + \subsubsection{Utilities} +\begin{defun}{stream:}{set-system-external-format}{\var{terminal} \ampoptional{} \var{filenames}} + This function changes the external format used for + \var{*standard-input*}, \var{*standard-output*}, and + \var{*standard-error*} to the external format specified by + \var{terminal}. Additionally, the Unix file name encoding can be + set to the value specified by \var{filenames} if non-\nil. +\end{defun} + +\begin{defun}{extensions:}{list-all-external-formats}{} + list all of the vailable external formats. A list is returned where + each element is a list of the external format name and a list of + aliases for the format. No distinction is made between external + formats and composing external formats. +\end{defun} + +\begin{defun}{extensions:}{describe-external-format}{external-format} + Print a description of the given \var{external-format}. This may + cause the external format to be loaded (silently) if it is not + already loaded. +\end{defun} + Since strings are UTF-16 and hence may contain surrogate pairs, some utility functions are provided to make access easier. Index: src/general-info/release-20b.txt diff -u src/general-info/release-20b.txt:1.41 src/general-info/release-20b.txt:1.41.2.1 --- src/general-info/release-20b.txt:1.41 Sat Jul 31 09:45:33 2010 +++ src/general-info/release-20b.txt Wed Aug 4 08:08:23 2010 @@ -1,7 +1,5 @@ ========================== C M U C L 20 b ============================= -[--- WORK IN PROGRESS ---] - The CMUCL project is pleased to announce the release of CMUCL 20b. This is a major release which contains numerous enhancements and bug fixes from the 19f release.

1 0

[cmucl-cvs] CMUCL commit: src/general-info (release-20b.txt)
by Raymond Toy 04 Aug '10

04 Aug '10

Date: Tuesday, August 3, 2010 @ 23:46:18 Author: rtoy Path: /project/cmucl/cvsroot/src/general-info Modified: release-20b.txt Forgot to remove the work-in-progress line. -----------------+ release-20b.txt | 2 -- 1 file changed, 2 deletions(-) Index: src/general-info/release-20b.txt diff -u src/general-info/release-20b.txt:1.41 src/general-info/release-20b.txt:1.42 --- src/general-info/release-20b.txt:1.41 Sat Jul 31 09:45:33 2010 +++ src/general-info/release-20b.txt Tue Aug 3 23:46:18 2010 @@ -1,7 +1,5 @@ ========================== C M U C L 20 b ============================= -[--- WORK IN PROGRESS ---] - The CMUCL project is pleased to announce the release of CMUCL 20b. This is a major release which contains numerous enhancements and bug fixes from the 19f release.

1 0

[cmucl-cvs] CMUCL commit: src/code (exports.lisp)
by Raymond Toy 04 Aug '10

04 Aug '10

Date: Tuesday, August 3, 2010 @ 23:41:51 Author: rtoy Path: /project/cmucl/cvsroot/src/code Modified: exports.lisp Forgot to export DESCRIBE-EXTERNAL-FORMAT from the EXTENSIONS package. --------------+ exports.lisp | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-) Index: src/code/exports.lisp diff -u src/code/exports.lisp:1.299 src/code/exports.lisp:1.300 --- src/code/exports.lisp:1.299 Tue Jul 13 19:43:39 2010 +++ src/code/exports.lisp Tue Aug 3 23:41:51 2010 @@ -5,7 +5,7 @@ ;;; Carnegie Mellon University, and has been placed in the public domain. ;;; (ext:file-comment - "$Header: /project/cmucl/cvsroot/src/code/exports.lisp,v 1.299 2010-07-13 23:43:39 rtoy Exp $") + "$Header: /project/cmucl/cvsroot/src/code/exports.lisp,v 1.300 2010-08-04 03:41:51 rtoy Exp $") ;;; ;;; ********************************************************************** ;;; @@ -1489,6 +1489,7 @@ "DESCRIBE-EXTERNAL-FORMAT") ;; Unicode (:export "STRING-TO-OCTETS" "OCTETS-TO-STRING" "*DEFAULT-EXTERNAL-FORMAT*" + "DESCRIBE-EXTERNAL-FORMATS" "LIST-ALL-EXTERNAL-FORMATS" "STRING-ENCODE" "STRING-DECODE" "SET-SYSTEM-EXTERNAL-FORMAT"))

1 0

[cmucl-cvs] CMUCL commit: src/docs/cmu-user (unicode.tex)
by Raymond Toy 04 Aug '10

04 Aug '10

Date: Tuesday, August 3, 2010 @ 23:39:07 Author: rtoy Path: /project/cmucl/cvsroot/src/docs/cmu-user Modified: unicode.tex o Document the parameters to OPEN that are specific to Unicode. o Document LIST-ALL-EXTERNAL-FORMATS and DESCRIBE-EXTERNAL-FORMAT. -------------+ unicode.tex | 66 ++++++++++++++++++++++++++++++++++++++++++++++++++-------- 1 file changed, 58 insertions(+), 8 deletions(-) Index: src/docs/cmu-user/unicode.tex diff -u src/docs/cmu-user/unicode.tex:1.11 src/docs/cmu-user/unicode.tex:1.12 --- src/docs/cmu-user/unicode.tex:1.11 Mon Jul 12 09:58:42 2010 +++ src/docs/cmu-user/unicode.tex Tue Aug 3 23:39:07 2010 @@ -80,14 +80,6 @@ parameter to specify the format. The default external format is \kwd{default}. -\begin{defun}{stream:}{set-system-external-format}{\var{terminal} \ampoptional{} \var{filenames}} - This function changes the external format used for - \var{*standard-input*}, \var{*standard-output*}, and - \var{*standard-error*} to the external format specified by - \var{terminal}. Additionally, the Unix file name encoding can be - set to the value specified by \var{filenames} if non-\nil. -\end{defun} - \subsection{Available External Formats} The available external formats are listed below in @@ -451,8 +443,66 @@ \file{ext-formats:unidata.bin}. If this file is not found, Unicode support is severely reduced; you can only use ASCII characters. +\begin{defun}{}{open}{\args \var{filename} \amprest \var{options} + \keys{\kwd{direction} \kwd{element-type} \kwd{if-exists} + \kwd{if-does-not-exist} \morekeys \kwd{class} \kwd{mapped} + \kwd{input-handle} \kwd{output-handle} + \yetmorekeys \kwd{external-format} \kwd{decoding-error} + \kwd{encoding-error}} + + The main options are covered elsewhere. Here we describe the + options specific to Unicode. The option \kwd{external-format} + specifies the external format to use for reading and writing the + file. The external format is a keyword. + + The options \kwd{decoding-error} and \kwd{encoding-error} are used + to specify how encoding and decoding errors are handled. The + default value on \nil means the external format handles errors + itself and typically replaces invalid sequences with the Unicode + replacement character. + + Otherwise, the value for \code{decoding-error} is either a + character, a symbol or a function. If a character is + specified. it is used as the replacement character for any invalid + decoding. If a symbol or a function is given, it must be a + function of three arguments: a message string to be printed, the + offending octet, and the number of octets read. If the function + returns, it should return two values: the code point to use as the + replacement character and the number of octets read. In addition, + \true{} may be specified. This indicates that a continuable error + is signaled, which, if continued, the Unicode replacement + character is used. + + For \code{encoding-error}, a character, symbol, or function can be + specified, like \code{decoding-error}, with the same meaning. The + function, however, takes two arguments: a format message string + and the incorrect codepoint. If the function returns, it should + be the replacement codepoint. +\end{defun} + \subsubsection{Utilities} +\begin{defun}{stream:}{set-system-external-format}{\var{terminal} \ampoptional{} \var{filenames}} + This function changes the external format used for + \var{*standard-input*}, \var{*standard-output*}, and + \var{*standard-error*} to the external format specified by + \var{terminal}. Additionally, the Unix file name encoding can be + set to the value specified by \var{filenames} if non-\nil. +\end{defun} + +\begin{defun}{extensions:}{list-all-external-formats}{} + list all of the vailable external formats. A list is returned where + each element is a list of the external format name and a list of + aliases for the format. No distinction is made between external + formats and composing external formats. +\end{defun} + +\begin{defun}{extensions:}{describe-external-format}{external-format} + Print a description of the given \var{external-format}. This may + cause the external format to be loaded (silently) if it is not + already loaded. +\end{defun} + Since strings are UTF-16 and hence may contain surrogate pairs, some utility functions are provided to make access easier.

1 0