- asdf-devel - mailman3.common-lisp.net

clisp testing on linux
by Robert Goldman 19 Dec '18

19 Dec '18

The latest tweak was followed by a Jenkins (linux) test failure for clisp on `test-encodings.script`, with a segmentation fault. I cannot reliably replicate this, and I don't see any reason to assume that this is ASDF's fault, rather than clisp's. I'm not sure that there is anything I can do about this, but thought I would ask for suggestions: ``` Test TEST-FILE-ENCODING-U8: should be UTF-8 ; Registering system test-file-encoding-u8 *** - handle_fault error2 ! address = 0x55f6cc8871d0 not in [0x55db332bd000,0x55db336926d8) ! SIGSEGV cannot be cured. Fault address = 0x55f6cc8871d0. GC count: 203 Space collected by GC: 304757408 Run time: 3 915662 Real time: 4 586182 GC time: 0 693431 Permanently allocated: 165368 bytes. Currently in use: 8753400 bytes. Free space: 1903262 bytes. Segmentation fault (core dumped) Using clisp, test-encodings.script failed ```

2 3

wild-package-inferred-system
by Hugo Ishimaru 18 Dec '18

18 Dec '18

Hi all, I have made an extension of package-inferred-system that interprets star `*' and globstar `**' in a package name, which I will use in the future for my library. https://github.com/privet-kitty/wild-package-inferred-system (My motivation is to eliminate the need for manually creating `foo/.../all'-type subsystems that exist only to use-reexport all .lisp files.) In accordance with the ASDF Best Practices by Faré, I let you know the non-exported facilities of ASDF I had to used: PRIMARY-SYSTEM-P, *DEFPACKAGE-FORMS*, *PACKAGE-INFERRED-SYSTEMS*, AROUND-COMPILE-HOOK, RELATIVE-PATHNAME. I would appreciate any suggestion or correction for the design and implementation of this extension, of course. Regards Hugo Ishimaru

2 1

why does ASDF ask to please only define system/test?
by Mark H. David 14 Dec '18

14 Dec '18

It seems that any system Y associated with a name X must have its name be of the form X/Y. For example, when you build "cl-ppcre", you get this warning: Please only define "cl-ppcre" and secondary systems with a name starting with "cl-ppcre/" (e.g. "cl-ppcre/test") in that file. I've seen this complaint for quite a few systems already. What's the need for this, and is it really worth nagging users of all these systems that have existed in many cases for years and have worked perfectly well without following the new convention? What great functionality are we getting for this? Thanks, -Mark

7 12

Timing compilation
by Didier Verna 05 Dec '18

05 Dec '18

Hello, I would like to collect information about the time it takes to compile an ASDF system (possibly also load it), dependencies excluded. I'm thinking there's probably a way to do this by :around'ing compile-op, or something like that, but if someone already has a clear view on how to make this happen, I'd be grateful for the time spared! Thanks. -- Resistance is futile. You will be jazzimilated. Lisp, Jazz, Aïkido: http://www.didierverna.info

3 7

Re: ASDF 3 on WIn 10 doesn't find component
by Robert Goldman 18 Sep '18

18 Sep '18

Can you tell us what version of asdf you have? `(asdf:asdf-version)`? Will you please also report what `user-homedir-pathname` returns? It should be the parent of your `common-lisp` directory (I.e., the same as the value of `%LOCALAPPDATA%`; if not, we have found your problem. If so, we need to look further. On 18 Sep 2018, at 11:11, Mitch Berkson wrote: > This is with LW 7.1.1 and Win 10. > > > I don't know how to get ASDF to find a file. My environment variable > %LOCALAPPDATA% is C:\Users\Mitch\AppData\Local > > I have the files test.asd and test.lisp in > c:\Users\Mitch\AppData\Local\common-lisp\test.asd > > ;;; test.asd -------------------------------- > (defsystem "test" > :components ((:file "test"))) > ;;; -------------------------------------------- > > ;;; test.lisp ------------------------------------ > > > (defpackage :test > (:use :common-lisp)) > > (in-package :test) > > (defconstant *golden-ratio* 1.6180339887) > ;;; -------------------------------------------- > > In LW, I do: > CL-USER 1 > (require "asdf") > CL-USER 2 > (asdf:load-system "test") > > and get: > Error: Component "test" not found > > Thanks for any advice. > > Mitch > > > _______________________________________________ Lisp Hug - the mailing > list for LispWorks users lisp-hug(a)lispworks.com > http://www.lispworks.com/support/lisp-hug.html Robert P. Goldman Research Fellow Smart Information Flow Technologies (d/b/a SIFT, LLC) 319 N. First Ave., Suite 400 Minneapolis, MN 55401 Voice: (612) 326-3934 Email: rpgoldman(a)SIFT.net

2 5

Oddities in ECL tests on Linux
by Robert Goldman 12 Sep '18

12 Sep '18

My Jenkins job is failing to test ECL successfully. What's interesting is that it looks like the tests are successful, but the checker is failing. Here's what I see in the transcript: These two expressions fail comparison with EQUAL: (UIOP/UTILITY:NEST (LISP-INVOCATION/LISP-INVOCATION:INVOKE-LISP :IMPLEMENTATION-TYPE (LISP-INVOCATION/ALLEGRO-VARIANTS:CURRENT-LISP-VARIANT) :CROSS-COMPILE NIL :IMAGE-PATH (UIOP/FILESYSTEM:NATIVE-NAMESTRING ASDF-TEST::IMG) :CONSOLE T :EVAL "(uiop:restore-image :entry-point 'hello:entry-point :lisp-interaction nil)" :RUN-PROGRAM-ARGS '(:OUTPUT :LINES :ERROR-OUTPUT T))) evaluates to ("No restarts available." "" "Top level in: #<process TOP-LEVEL>." "> ") '("hello, world") evaluates to ("hello, world") Oddly, when I try to run this at the command line, ECL throws to the interactive debugger on various signals and I have to restart it, before make test l=ecl will terminate successfully. I think I have seen this before, and it may be that ECL implicitly assumes that there will be some kind of C compilation tool chain present that I don't have, but I'm not sure about that. Suggestions for debugging would be welcom.

3 11

Re: Oddities in ECL tests on Linux
by Robert Goldman 02 Sep '18

02 Sep '18

On 31 Aug 2018, at 10:35, Marius Gerbershagen wrote: > This is most likely a bug in ECL. I recommend trying out a newer > version > of ecl (16.1.3 or the current develop branch from the git repository). I see your point, but have two comments: 1. If this really *is* an ECL bug, then shouldn't the Ubuntu package be updated and fixed? ASDF is supposed to work on the ECL that users will have, not only on the one that developers have. 2. I don't see a way to get a new ECL except by pulling from Gitlab and building. I do not have the time to run around building all available lisp implementations from source (and, again, ASDF should work on the versions of the implementations that users actually have, which means the ones provided by the packaging systems on the platforms). I build only SBCL, because that's an implementation I build anyway, for my work needs. Faré had the energy to play with all the different implementations in a substantial way, but I do not. So if the released version of an implementation is broken, I will simply regard that implementation as broken. If the *released version* of an implementation is broken for long enough (I'm looking at you, clisp), it will become unsupported by ASDF. Unsupported means "patches will be accepted, but I will no longer run the tests, and test failure on an unsupported implementation will not be a reason to hold up an ASDF release." Note that at the moment *all* implementations are essentially unsupported on Windows, since I have lost my Windows VM, and even if I got it back, I would have no way to develop on Windows. If you are a Windows user and this bothers you, I would be happy to support you in setting up a test environment, and even more happy to help you learn to patch ASDF. But even someone who doesn't want to patch ASDF, but who would be willing to run the test suite (or help figure out how it could be run through, e.g., Travis), would be a great help. > > Am 30.08.2018 um 21:51 schrieb Robert Goldman: >> I'm experimenting with your changes now but, for some reason that I >> don't understand, when I run the tests as |make l=ecl| interactively >> on >> Ubuntu (using the Ubuntu ECL package |16.1.2-3|), signals are >> throwing >> me into the interactive debugger, instead of being caught. I have no >> idea why this started happening, because I used to be able to run ECL >> successfully, and I don't believe I have changed the package >> (although >> Ubuntu might have upgraded it). >> >> Actually /usr/bin/ecl is crashing with SIGABRT when running programs, >> apparently, on my Ubuntu box. (|SIGABRT in si_run_program()|). I'll >> try >> uninstalling and reinstalling ECL in the hopes that fixes this, but >> unless I get some help, I will not be able to continue testing ASDF >> on >> ECL on Linux. >> >> On 30 Aug 2018, at 13:22, Marius Gerbershagen wrote: >> >> No, I don't think so. The sockets module has been part of ECL >> since >> version 0.9f from 2005. Please note, that this test can fail >> anyway if >> ECL is built without support for the respective module (be it :rt >> or >> :sockets). The change only prevents it from failing on a default >> build >> configuration. >> >> Am 30.08.2018 um 19:53 schrieb Robert Goldman: >> >> Thank you very much for these, Marius. I will look into >> fixing them >> directly. One question - do I need to check for ECL version >> number when >> requiring sockets in the test? I.e., to I need to test with >> |:rt| in >> older versions and |:sockets| in newer? Or will |:sockets| >> work >> in older >> versions of ECL, as well? >> >> Best, >> R >> >> On 30 Aug 2018, at 12:46, Marius Gerbershagen wrote: >> >> Harmless in the sense that ECL doesn't crash or throw me in >> the >> interactive debugger. Besides, the test failures seem to be >> easily >> fixed. The test-require.script test fails because it tries to >> require >> the :rt module which is deprecated on the develop branch and >> no >> longer >> build by default. A simple fix is to use the :sockets module >> instead: >> >> diff --git a/test/test-require.script >> b/test/test-require.script >> index e5f70857..1ef84e8c 100644 >> --- a/test/test-require.script >> +++ b/test/test-require.script >> @@ -178,7 +178,7 @@ >> #+allegro :sax >> #+clisp (first (remove "asdf" *dynmod-list* :test 'equal)) >> #+(or clozure cmucl) :defsystem >> - #+ecl :rt ;; loads faster than :ecl-quicklisp >> + #+ecl :sockets >> #+lispworks "comm" >> #+mkcl :walker >> #+sbcl :sb-md5 >> >> The test-program.script test seems to fail to include uiop >> because of an >> error in the linkable-system function. Tracing it shows that >> the >> function returns nil for the uiop system object, >> 1> (ASDF/BUNDLE::LINKABLE-SYSTEM #<system "uiop">) >> <1 (ASDF/BUNDLE::LINKABLE-SYSTEM NIL) >> which seems to be caused by a missing call to coerce-name: >> >> diff --git a/bundle.lisp b/bundle.lisp >> index 2ff56f93..42034c9f 100644 >> --- a/bundle.lisp >> +++ b/bundle.lisp >> @@ -529,7 +529,7 @@ which is probably not what you want; you >> probably >> need to tweak your output tran >> ;; If an ASDF upgrade is available from source, but not a >> UIOP >> upgrade to that, >> ;; then use the asdf/driver system instead of >> ;; the UIOP that was disabled by check-not-old-asdf-system. >> - (if-let (s (and (equal x "uiop") (output-files 'lib-op >> "asdf") >> (find-system "asdf/driver"))) >> + (if-let (s (and (equal (coerce-name x) "uiop") >> (output-files >> 'lib-op "asdf") (find-system "asdf/driver"))) >> (and (output-files 'lib-op s) s)) >> ;; If there was no source upgrade, look for modules provided >> by >> the implementation. >> (if-let (p (system-module-pathname (coerce-name x))) >> >> >> Am 29.08.2018 um 01:22 schrieb Faré: >> >> I can't reproduce this, for me the tests run fine without >> being thrown >> in the debugger. I only get two harmlessly looking test >> failures >> (test-program.script and test-require.script). >> >> No test failure is harmless. The test-program.script failure >> is what >> Robert saw, that I can reproduce. I didn't reproduce a >> failure with >> test-require. I had more problems with ECL from the develop >> branch, >> but maybe it was a bad idea to use the develop branch. >> >> —♯ƒ • François-René ÐVB Rideau >> •Reflection&Cybernethics• >> http://fare.tunes.org >> There are two kinds of people, those who do the work >> and those who take the credit. Try to be in the first group; >> there is less competition there >> — Indira Gandhi. >>

2 4

bootstrapping asdf
by Faré 06 Aug '18

06 Aug '18

In case anyone takes over maintenance of ASDF in the future, I wrote this mind dump on some of its more stuble "magic" behavior: https://fare.livejournal.com/190738.html Thanks to Eric Timmons for the prompting... PS: there are relatedly a few bug fixes in 3.3.2.5 — thanks and congratulations again to Robert Goldman for his careful reviewing and testing. —♯ƒ • François-René ÐVB Rideau •Reflection&Cybernethics• http://fare.tunes.org It is deplorable that many people think that the best way to improve the world is to forbid something. However, they're morally more advanced than the people who think the best way to improve the world is to kill somebody. — John McCarthy

2 2

Is anyone actually using the deferred warnings code?
by Robert Goldman 06 Aug '18

06 Aug '18

AFAICT, it is disabled by default, and it is not documented in the ASDF manual. So is this code even live, except for in the test scripts? It was pretty painful to get this to work because it relies on unexported (and hence unstable) SBCL internals. My *guess* is that this was originally done as a way to dispense with `WITH-COMPILATION-UNIT` and hence potentially parallelize the compilations. If no one is even using it, I am tempted to move it to be a contrib and drop it from the tests and maintenance as part of core ASDF. Maybe it would be better as a part of a POIU extension to ASDF, and relieve me of dealing with these SBCL compiler internals? Cheers, r

3 3

Another apology...
by Robert Goldman 31 Jul '18

31 Jul '18

I accidentally committed something with a stupid typo. I force-pushed the last push to keep the history clean. Thanks

1 0