- cmucl-cvs - mailman3.common-lisp.net

[Git][cmucl/cmucl] Pushed new tag snapshot-2016-09
by Raymond Toy 05 Sep '16

05 Sep '16

Raymond Toy pushed new tag snapshot-2016-09 at cmucl / cmucl

1 0

[Git][cmucl/cmucl][master] Update from logs.
by Raymond Toy 05 Sep '16

05 Sep '16

Raymond Toy pushed to branch master at cmucl / cmucl Commits: 9f2f0330 by Raymond Toy at 2016-09-05T13:08:16-07:00 Update from logs. Also add some tickets that were fixed but weren't listed. - - - - - 1 changed file: - src/general-info/release-21a.txt Changes: ===================================== src/general-info/release-21a.txt ===================================== --- a/src/general-info/release-21a.txt +++ b/src/general-info/release-21a.txt @@ -100,6 +100,20 @@ New in this release: * Issue #3: Shadowing compiler macro functions. * Issue #7: Local functions and get-setf-expansions * Issue #8: Constants and top-level code + * Issue #10: (setf aref) on (simple-array (unsigned-byte 4) (*)) + with constant index is incorrect. + * Issue #11: Merge unix-glibc2.lisp into unix.lisp + * Issue #14: (asinh 0d0) signals inexact on linux + * Issue #16: pathname-match-p doesn't handle search lists + * Issue #18: Fix docstring for *environment-list* + * Issue #18: Add better description to :env option for run-program + * Issue #19: Make min version for OSX be 10.6 + * Issue #22: Incorrect coercion to float + * Issue #12: unable to build master/$HEAD with 2015-12 darwin snapshot + * Issue #25: Issue with ext:run-program and string streams + (related to character sizes?) + * Issue #27: Regression: ASDF test failures + * Issue #28: Recursive function definition during cross-compile * Other changes: * Cross compile scripts from x86 to sparc and ppc updated to work View it on GitLab: https://gitlab.common-lisp.net/cmucl/cmucl/commit/9f2f0330804a623d887c7969e…

1 0

[Git][cmucl/cmucl][master] 3 commits: Fix #27: PATHNAME-MATCH-P loops for logical pathnames
by Raymond Toy 04 Sep '16

04 Sep '16

Raymond Toy pushed to branch master at cmucl / cmucl Commits: c07cad4b by Raymond Toy at 2016-09-03T19:51:47-07:00 Fix #27: PATHNAME-MATCH-P loops for logical pathnames When support for search-lists was added to PATHNAME-MATCH-P, support for logical pathnames was broken because PATHNAME-MATCH-P eventually calls TRANSLATE-LOGICAL-PATHNAME which calls PATHNAME-MATCH-P with logical pathnames. This caused infinite recursion. So add back the original PATHNAME-MATCH-P, but rename to %PATHNAME-MATCH-P and use that in TRANSLATE-LOGICAL-PATHNAME and friends. Add test for this case too. - - - - - 37c549c6 by Raymond Toy at 2016-09-04T13:43:03-07:00 Factor out the common part of pathname-match-p. - - - - - efc9519f by Raymond Toy at 2016-09-04T20:48:35+00:00 Merge branch 'rtoy-fix-27-pathname-match-p' into 'master' Fix #27: pathname-match-p infinite recursion When support for search-lists was added to `PATHNAME-MATCH-P`, support for logical pathnames was broken because `PATHNAME-MATCH-P` eventually calls `TRANSLATE-LOGICAL-PATHNAME` which calls `PATHNAME-MATCH-P` with logical pathnames. This caused infinite recursion. So add back the original `PATHNAME-MATCH-P`, but rename to `%PATHNAME-MATCH-P` and use that in `TRANSLATE-LOGICAL-PATHNAME` and friends. Add test for this case too. See merge request !10 - - - - - 2 changed files: - src/code/pathname.lisp - tests/pathname.lisp Changes: ===================================== src/code/pathname.lisp ===================================== --- a/src/code/pathname.lisp +++ b/src/code/pathname.lisp @@ -1219,6 +1219,32 @@ a host-structure or string." (:version (frob (%pathname-version pathname))))))) +(defun %%pathname-match-p (pathname wildname) + (macrolet ((frob (field &optional (op 'components-match )) + `(or (null (,field wildname)) + (,op (,field pathname) (,field wildname))))) + (and (or (null (%pathname-host wildname)) + (eq (%pathname-host wildname) (%pathname-host pathname))) + (frob %pathname-device) + (frob %pathname-directory directory-components-match) + (frob %pathname-name) + (frob %pathname-type) + (frob %pathname-version)))) + +;; Like PATHNAME-MATCH-P but the pathnames should not be search-lists. +;; Primarily intended for TRANSLATE-LOGICAL-PATHNAME and friends, +;; because PATHNAME-MATCH-P calls TRANSLATE-LOGICAL-PATHNAME, causing +;; infinite recursion. +(defun %pathname-match-p (in-pathname in-wildname) + "Pathname matches the wildname template?" + (declare (type path-designator in-pathname) + ;; Not path-designator because a file-stream can't have a + ;; wild pathname. + (type (or string pathname) in-wildname)) + (with-pathname (pathname in-pathname) + (with-pathname (wildname in-wildname) + (%%pathname-match-p pathname wildname)))) + ;;; PATHNAME-MATCH-P -- Interface ;;; (defun pathname-match-p (in-pathname in-wildname) @@ -1231,17 +1257,8 @@ a host-structure or string." (enumerate-search-list (pathname in-path) (with-pathname (in-wild in-wildname) (enumerate-search-list (wildname in-wild) - (macrolet ((frob (field &optional (op 'components-match )) - `(or (null (,field wildname)) - (,op (,field pathname) (,field wildname))))) - (when (and (or (null (%pathname-host wildname)) - (eq (%pathname-host wildname) (%pathname-host pathname))) - (frob %pathname-device) - (frob %pathname-directory directory-components-match) - (frob %pathname-name) - (frob %pathname-type) - (frob %pathname-version)) - (return-from pathname-match-p pathname)))))))) + (when (%%pathname-match-p pathname wildname) + (return-from pathname-match-p pathname))))))) ;;; SUBSTITUTE-INTO -- Internal @@ -1476,7 +1493,7 @@ a host-structure or string." (with-pathname (source source) (with-pathname (from from-wildname) (with-pathname (to to-wildname) - (unless (pathname-match-p source from) + (unless (%pathname-match-p source from) (didnt-match-error source from)) (let* ((source-host (%pathname-host source)) (to-host (%pathname-host to)) @@ -2171,7 +2188,7 @@ a host-structure or string." :format-control (intl:gettext "No translation for ~S") :format-arguments (list pathname))) (destructuring-bind (from to) x - (when (pathname-match-p pathname from) + (when (%pathname-match-p pathname from) (return (translate-logical-pathname (translate-pathname pathname from to))))))) (pathname pathname) ===================================== tests/pathname.lisp ===================================== --- a/tests/pathname.lisp +++ b/tests/pathname.lisp @@ -41,3 +41,35 @@ ;; Tests where both args are search-lists. (assert-true "foo:foo.lisp" "bar:*")) + +;; Verify PATHNAME-MATCH-P works with logical pathnames. (Issue 27) +;; This test modeled after a test from asdf +(defun setup-logical-host () + (let ((root *default-pathname-defaults*) + (bin-type (pathname-type (compile-file-pathname "foo.lisp")))) + (setf (logical-pathname-translations "ASDFTEST") + `((,(format nil "**;*.~a" bin-type) + ,(merge-pathnames (make-pathname :directory '(:relative :wild-inferiors) + :name :wild :type bin-type :version nil))) + (,(format nil "**;*.~a.*" bin-type) + ,(merge-pathnames (make-pathname :directory '(:relative "asdf-bin" :wild-inferiors) + :name :wild :type bin-type + :defaults root))) + ("**;*.*.*" + ,(merge-pathnames (make-pathname :directory '(:relative "asdf-src" :wild-inferiors) + :name :wild :type :wild :version :wild))) + ("**;*.*" + ,(merge-pathnames (make-pathname :directory '(:relative "asdf-src" :wild-inferiors) + :name :wild :type :wild :version nil))) + ("**;*" + ,(merge-pathnames (make-pathname :directory '(:relative "asdf-src" :wild-inferiors) + :name :wild :type nil :version nil))))))) +(setup-logical-host) + +(define-test pathname-match-p.logical-pathname + (assert-true (pathname-match-p + (make-pathname :host "ASDFTEST" + :directory '(:absolute "system2" "module4") + :name nil :type nil) + (parse-namestring "ASDFTEST:system2;module4;")))) + View it on GitLab: https://gitlab.common-lisp.net/cmucl/cmucl/compare/a8934d1590ee605e2f4f0207…

1 0

[Git][cmucl/cmucl] Pushed new branch rtoy-fix-27-pathname-match-p
by Raymond Toy 04 Sep '16

04 Sep '16

Raymond Toy pushed new branch rtoy-fix-27-pathname-match-p at cmucl / cmucl

1 0

[Git][cmucl/cmucl][master] 3 commits: Fix #28: Recursive function definition in cross-compile
by Raymond Toy 03 Sep '16

03 Sep '16

Raymond Toy pushed to branch master at cmucl / cmucl Commits: 2482e5f0 by Raymond Toy at 2016-09-03T10:55:25-07:00 Fix #28: Recursive function definition in cross-compile The recursive definition comes from %single-float and %double-float trying to coerce a double-double-float to a single or double. Not sure the best place to fix this, but added a special case here for %single-float and %double-float to convert the double-double-float to a double that can then be coerced to the appropriate type. (Could have added a deftransform for coerce to handle double-doubles, but doing it here makes it easier to follow the code.) Verified that x86->x86 and sparc->sparc cross-compiles no longer have the warning. Also verified that sparc->sparc actually cross-compiles and loads successfully and that the result will compile itself successfully. - - - - - 6c86016d by Raymond Toy at 2016-09-03T10:59:29-07:00 Add comment. - - - - - a8934d15 by Raymond Toy at 2016-09-03T18:01:25+00:00 Merge branch 'rtoy-28-fix-recursive-fcn-defn' into 'master' Fix #28: Recursive function definition Convert a `double-double` to a double before coercing to a `single-float` or `double-float`. See merge request !9 - - - - - 1 changed file: - src/code/float.lisp Changes: ===================================== src/code/float.lisp ===================================== --- a/src/code/float.lisp +++ b/src/code/float.lisp @@ -1047,9 +1047,15 @@ (number-dispatch ((x real)) (((foreach single-float double-float #+long-float long-float - #+double-double double-double-float fixnum)) (coerce x ',type)) + #+double-double + ((double-double-float) + ;; Convert the double-double to a double before + ;; coercing to the appropriate type. + (coerce (+ (double-double-hi x) + (double-double-lo x)) + ',type)) ((bignum) (bignum-to-float x ',type)) ((ratio) View it on GitLab: https://gitlab.common-lisp.net/cmucl/cmucl/compare/5beb6431855908e9010c36bc…

1 0

[Git][cmucl/cmucl][rtoy-28-fix-recursive-fcn-defn] Add comment.
by Raymond Toy 03 Sep '16

03 Sep '16

Raymond Toy pushed to branch rtoy-28-fix-recursive-fcn-defn at cmucl / cmucl Commits: 6c86016d by Raymond Toy at 2016-09-03T10:59:29-07:00 Add comment. - - - - - 1 changed file: - src/code/float.lisp Changes: ===================================== src/code/float.lisp ===================================== --- a/src/code/float.lisp +++ b/src/code/float.lisp @@ -1051,6 +1051,8 @@ (coerce x ',type)) #+double-double ((double-double-float) + ;; Convert the double-double to a double before + ;; coercing to the appropriate type. (coerce (+ (double-double-hi x) (double-double-lo x)) ',type)) View it on GitLab: https://gitlab.common-lisp.net/cmucl/cmucl/commit/6c86016d677e5a39fc3fe2ddc…

1 0

[Git][cmucl/cmucl] Pushed new branch rtoy-28-fix-recursive-fcn-defn
by Raymond Toy 03 Sep '16

03 Sep '16

Raymond Toy pushed new branch rtoy-28-fix-recursive-fcn-defn at cmucl / cmucl

1 0

[Git][cmucl/cmucl][master] 2 commits: Fix #25: Handle unicode strings more consistently.
by Raymond Toy 25 Aug '16

25 Aug '16

Raymond Toy pushed to branch master at cmucl / cmucl Commits: a8c27cfa by Raymond Toy at 2016-08-21T14:38:34-07:00 Fix #25: Handle unicode strings more consistently. When writing a string to the program too few octets were written because strings are now 16-bits wide. To fix this, only write the low 8-bits of each character. This matches what reading does. This pretty much implies that the caller should use STREAM:STRING-ENCODE and STREAM::STRING-DECODE on the strings. Add several tests to verify the expected results. - - - - - 5beb6431 by Raymond Toy at 2016-08-25T02:26:43+00:00 Merge branch 'rtoy-fix-issue-25' into 'master' Fix #25: Handle unicode strings more consistently. When writing a string to the program too few octets were written because strings are now 16-bits wide. To fix this, only write the low 8-bits of each character. This matches what reading does. This pretty much implies that the caller should use STREAM:STRING-ENCODE and STREAM::STRING-DECODE on the strings. Add several tests to verify the expected results. See merge request !8 - - - - - 2 changed files: - src/code/run-program.lisp - tests/issues.lisp Changes: ===================================== src/code/run-program.lisp ===================================== --- a/src/code/run-program.lisp +++ b/src/code/run-program.lisp @@ -749,7 +749,13 @@ (read-line object nil nil) (unless line (return)) - (unix:unix-write fd line 0 (length line)) + ;; Take just the low 8 bits of each char + ;; (code) of the string and write that out to + ;; the descriptor. + (let ((output (make-array (length line) :element-type '(unsigned-byte 8)))) + (dotimes (k (length output)) + (setf (aref output k) (ldb (byte 8 0) (char-code (aref line k))))) + (unix:unix-write fd output 0 (length output))) (if no-cr (return) (unix:unix-write fd newline 0 1))))) ===================================== tests/issues.lisp ===================================== --- a/tests/issues.lisp +++ b/tests/issues.lisp @@ -210,3 +210,91 @@ (assert-eql 3d0 (funcall tester 3d0)) (assert-eql 4w0 (funcall tester 4w0)))) +(define-test issue.25a + (:tag :issues) + ;; The original test from issue 25, modified slightly for lisp-unit + ;; testing. + (let* ((in-string (format nil "A line.~%And another.~%"))) + (with-output-to-string (out-stream nil) + (with-input-from-string (in-stream in-string) + (ext:run-program "cat" nil + :wait t + :input in-stream + :output out-stream)) + (let ((out-string (get-output-stream-string out-stream))) + (assert-eql (length in-string) (length out-string)) + (assert-equal in-string out-string))))) + +(define-test issue.25b + (:tag :issues) + ;; Modified test to verify that we only write the low 8-bits of each + ;; string character to run-program. + (let* ((in-string (concatenate 'string '(#\greek_small_letter_alpha + #\greek_small_letter_beta))) + (expected (map 'string #'(lambda (c) + (code-char (ldb (byte 8 0) (char-code c)))) + in-string))) + (with-output-to-string (out-stream nil) + (with-input-from-string (in-stream in-string) + (ext:run-program "cat" nil + :wait t + :input in-stream + :output out-stream)) + (let ((out-string (get-output-stream-string out-stream))) + (assert-eql (length out-string) (length out-string)) + ;; For comparison, convert the strings to codes so failures are easier to read + (assert-equal (map 'list #'char-code out-string) + (map 'list #'char-code expected)))))) + +(define-test issue.25c + (:tag :issues) + ;; Modified test to verify that each octet read from run-program is + ;; read into the low 8-bits of each character of the resulting + ;; string. + (let* ((in-string (concatenate 'string '(#\greek_small_letter_alpha + #\greek_small_letter_beta))) + (expected (stream:string-encode in-string :utf16-be)) + (path #p"issue25c.txt")) + (with-open-file (s path :direction :output :if-exists :supersede :external-format :utf16-be) + (write-string in-string s) + (force-output s) + (file-position s 0) + (with-open-file (s1 path :direction :input :element-type '(unsigned-byte 8)) + (with-output-to-string (out-stream) + (ext:run-program "cat" nil + :wait t + :input s1 + :output out-stream) + (let ((out-string (get-output-stream-string out-stream))) + (assert-equal (length out-string) (length expected)) + (assert-equal (map 'list #'char-code out-string) + (map 'list #'char-code expected)))))))) + + +(define-test issue.25d + (:tag :issues) + ;; The original test from issue 25, but using non-ascii characters + ;; and using string-encode/decode to verify that the output and the + ;; input match. + (let* ((in-string (concatenate 'string '(#\greek_small_letter_alpha + #\greek_small_letter_beta + #\greek_small_letter_gamma + #\greek_small_letter_delta + #\greek_small_letter_epsilon + #\greek_small_letter_zeta + #\greek_small_letter_eta + #\greek_small_letter_theta + #\greek_small_letter_iota + #\greek_small_letter_kappa + #\greek_small_letter_lamda)))) + (with-output-to-string (out-stream nil) + (with-input-from-string (in-stream (stream:string-encode in-string :utf8)) + (ext:run-program "cat" nil + :wait t + :input in-stream + :output out-stream)) + (let ((out-string (stream:string-decode (get-output-stream-string out-stream) + :utf8))) + (assert-eql (length in-string) (length out-string)) + (assert-equal in-string out-string))))) + View it on GitLab: https://gitlab.common-lisp.net/cmucl/cmucl/compare/774abc703a5c0a287d528f06…

1 0

[Git][cmucl/cmucl] Pushed new branch rtoy-fix-issue-25
by Raymond Toy 21 Aug '16

21 Aug '16

Raymond Toy pushed new branch rtoy-fix-issue-25 at cmucl / cmucl

1 0

[Git][cmucl/cmucl] Pushed new tag snapshot-2016-06
by Raymond Toy 30 May '16

30 May '16

Raymond Toy pushed new tag snapshot-2016-06 at cmucl / cmucl

1 0