06.01.2013, 19:41, "Faré" fahree@gmail.com:
And to (asdf:initialize-source-registry '(:source-registry :ignore-inherited-configuration)) to make sure I'm testing what's in quicklisp and now my own source checkouts? (or are you doing that part already?)
I didn't know it is necessary, but added it right now, so it is solved.
I probably do NOT want my cl-test-grid results to be mixed with the usual results, since I want to run with my own version of ASDF which will skew the results. But I DO want to compare my results to an existing baseline. How do I achieve this effect?
Where in cl-test-grid is the correct place to hook a call to asdf:upgrade-asdf before trying to load stuff?
I thought you can have a directory quicklisp-patched/ with quicklisp patched to have newer version of ASDF and also changed (defvar *required-asdf-version* "2.<your version>") in the quicklisp-patched/setup.lisp file, line 26. This will enforce asdf upgrade by quicklisp.
Then, if you setup test-grid-agent as described at https://github.com/cl-test-grid/cl-test-grid, instead of calling test-grid-agent:main in your run-agent.lisp script, you do:
(setf (test-grid-agent::result-storage-name *agent*) "asdf") (test-grid-agent::test-patched-quicklisp *agent* #p"quicklisp-patched/" "quicklisp 2012-12-23+asdf-patch-01")
This will run tests on all the lisp-exe's you configured and upload test results to online storage named "asdf". Without the above customization the results are uploaded into the storage named "main". So your results will not be mixed with usual results.
Test results are represented as a simple p-list, so we will be able to extract result from main storage and compare with your results. On the other hand it may be more reliable that you run tests for not-patched quicklisp on your machine too, so that patched and unpatched quicklisp. (test-grid-agent::test-patched-quicklisp *agent* #p"quicklisp/" "quicklisp 2012-12-23")
I can assist with all this. We can setup a chat, or skype call to help you to start the tests. After tests are finished, we can contact again and I will show how to access the results and compare them.
Just looking ahead, to access the results from online storage the following functions are is used:
;; create local replica (defparameter *r* (test-grid-storage:make-replica "asdf" "db-asdf-snapshot.lisp")) ;; fetch the changes (test-grid-storage:sync *r*) ;; access the data (test-grid-storage:data *r*)
Best regards, - Anton