[Gsll-devel] Status of status.text
Dear Liam, I just pulled the latest version of gsll. Apparently you have busy as there are quite a few changes. That is great, keep up the good work! With all the recent e-mail on the test suite I'm wondering how up to date is the status.text file? When I run the test suite on an x86-64 box running Ubuntu 10.04 with SBCL 1.0.39 and a custom built gsl library (mostly some CFLAGS tweaks) I get the following two failures: EXPONENTIAL: (MULTIPLE-VALUE-LIST (LET ((RNG (MAKE-RANDOM-NUMBER-GENERATOR +MT19937+ 0))) (LOOP FOR I FROM 0 TO 10 COLLECT (SAMPLE RNG :EXPONENTIAL :MU 10.0d0)))) failed: Expected ((0.0025828444588394794d0 18.145581427987647d0 12.636598054339759d0 0.5424387252062355d0 14.624994234158105d0 7.236607929535993d0 0.4345362449683603d0 2.95303920904529d0 6.161052939065796d0 3.011686333539114d0 2.7451079819355364d0)) but saw ((82.61578216370394d0 1.77823538531874d0 3.3214653339021365d0 29.412645812312775d0 2.6351843583734817d0 6.635371453335953d0 31.57709150859036d0 13.637712930094189d0 7.766237034468241d0 13.468928238240315d0 14.268822088229632d0)) EXPONENTIAL: 11 assertions passed, 1 failed. and: LU: (MULTIPLE-VALUE-LIST (TEST-LU-SOLVE-DIM (CREATE-COMPLEX-MATRIX 7))) failed: Expected (#2m(#C(24.0717272023734d0 -9.84612797621247d0) #C(-269.338853034031d0 87.5455232472528d0) #C(2966.61356736296d0 -1026.24473923993d0) #C(-18207.3812124749d0 5673.8447304241d0) #C(55769.3879019068d0 -16154.0963210502d0) #C(-78894.1207561151d0 19505.3812987858d0) #C(39554.8551241728d0 -7765.93696255317d0))) but saw (#2m(#C(-81.70598196064235d0 -81.70599595009693d0) #C(3354.209927435102d0 3354.278264591346d0) #C(-31954.85554225817d0 -31956.353685805567d0) #C(119027.61090077131d0 119037.36678048137d0) #C(-203627.71695137964d0 -203653.92708809028d0) #C(160626.5466779804d0 160657.2640539496d0) #C(-47344.00882810219d0 -47357.00253607087d0))) LU: 11 assertions passed, 1 failed. TOTAL: 4014 assertions passed, 2 failed, 0 execution errors. a few quick tests of the LU decomp routine seem to suggest that it is working fine so I'm wondering if this is the kind of "numeric fuzz" you were alluding to in a previous post. With regards, Jason
Yeah status.text is way out of date, at the very least there are 4000+ tests now, not ~1200. Most of the recent changes have been to consolidate foreign array handling into GSD, based on static-vectors where available. On the surface there isn't much change, but internally there are substantial changes as you've noticed. The major benefit from a user's perspective is that it should be a lot easier to use grids in different libraries, say computing an array in GSL and passing it to another foreign library. As for the two errors you are seeing, these are exactly the errors I see. The basic problem with the test suite is that most of it was made up by me without proper epsilons. After I discovered that GSL had a complete suite of tests, I started porting those tests, and they include an epsilon for all float results. Therefore, if one of those tests fails then it ought to fail in GSL too. So the sensible thing is to eliminate my made-up tests and replace them with the GSL tests. That's what really needs to be done with those failing tests. That's the long-range plan, but it's very tedious work, so I will put a burst of effort in and then get fed up with it. That happened in early June, and is the reason the number of tests grew by ~2000; my meager random distribution tests were failing so I did a wholesale port of the GSL tests. Liam On Tue, Jul 20, 2010 at 8:14 PM, Jason Nielsen <jdn@math.carleton.ca> wrote:
Dear Liam,
I just pulled the latest version of gsll. Apparently you have busy as there are quite a few changes. That is great, keep up the good work!
With all the recent e-mail on the test suite I'm wondering how up to date is the status.text file? When I run the test suite on an x86-64 box running Ubuntu 10.04 with SBCL 1.0.39 and a custom built gsl library (mostly some CFLAGS tweaks) I get the following two failures:
EXPONENTIAL: (MULTIPLE-VALUE-LIST (LET ((RNG (MAKE-RANDOM-NUMBER-GENERATOR +MT19937+ 0))) (LOOP FOR I FROM 0 TO 10 COLLECT (SAMPLE RNG :EXPONENTIAL :MU 10.0d0)))) failed: Expected ((0.0025828444588394794d0 18.145581427987647d0 12.636598054339759d0 0.5424387252062355d0 14.624994234158105d0 7.236607929535993d0 0.4345362449683603d0 2.95303920904529d0 6.161052939065796d0 3.011686333539114d0 2.7451079819355364d0)) but saw ((82.61578216370394d0 1.77823538531874d0 3.3214653339021365d0 29.412645812312775d0 2.6351843583734817d0 6.635371453335953d0 31.57709150859036d0 13.637712930094189d0 7.766237034468241d0 13.468928238240315d0 14.268822088229632d0)) EXPONENTIAL: 11 assertions passed, 1 failed.
and:
LU: (MULTIPLE-VALUE-LIST (TEST-LU-SOLVE-DIM (CREATE-COMPLEX-MATRIX 7))) failed: Expected (#2m(#C(24.0717272023734d0 -9.84612797621247d0) #C(-269.338853034031d0 87.5455232472528d0) #C(2966.61356736296d0 -1026.24473923993d0) #C(-18207.3812124749d0 5673.8447304241d0) #C(55769.3879019068d0 -16154.0963210502d0) #C(-78894.1207561151d0 19505.3812987858d0) #C(39554.8551241728d0 -7765.93696255317d0))) but saw (#2m(#C(-81.70598196064235d0 -81.70599595009693d0) #C(3354.209927435102d0 3354.278264591346d0) #C(-31954.85554225817d0 -31956.353685805567d0) #C(119027.61090077131d0 119037.36678048137d0) #C(-203627.71695137964d0 -203653.92708809028d0) #C(160626.5466779804d0 160657.2640539496d0) #C(-47344.00882810219d0 -47357.00253607087d0))) LU: 11 assertions passed, 1 failed.
TOTAL: 4014 assertions passed, 2 failed, 0 execution errors.
a few quick tests of the LU decomp routine seem to suggest that it is working fine so I'm wondering if this is the kind of "numeric fuzz" you were alluding to in a previous post.
With regards, Jason
_______________________________________________ Gsll-devel mailing list Gsll-devel@common-lisp.net http://common-lisp.net/cgi-bin/mailman/listinfo/gsll-devel
You deserve a medal, a GP (giga pint) of some favorite beverage, or some other token of our appreciation. On Wed, Jul 21, 2010 at 9:22 AM, Liam Healy <lhealy@common-lisp.net> wrote:
Yeah status.text is way out of date, at the very least there are 4000+ tests now, not ~1200.
Most of the recent changes have been to consolidate foreign array handling into GSD, based on static-vectors where available. On the surface there isn't much change, but internally there are substantial changes as you've noticed. The major benefit from a user's perspective is that it should be a lot easier to use grids in different libraries, say computing an array in GSL and passing it to another foreign library.
As for the two errors you are seeing, these are exactly the errors I see. The basic problem with the test suite is that most of it was made up by me without proper epsilons. After I discovered that GSL had a complete suite of tests, I started porting those tests, and they include an epsilon for all float results. Therefore, if one of those tests fails then it ought to fail in GSL too.
So the sensible thing is to eliminate my made-up tests and replace them with the GSL tests. That's what really needs to be done with those failing tests. That's the long-range plan, but it's very tedious work, so I will put a burst of effort in and then get fed up with it. That happened in early June, and is the reason the number of tests grew by ~2000; my meager random distribution tests were failing so I did a wholesale port of the GSL tests.
Liam
On Tue, Jul 20, 2010 at 8:14 PM, Jason Nielsen <jdn@math.carleton.ca> wrote:
Dear Liam,
I just pulled the latest version of gsll. Apparently you have busy as there are quite a few changes. That is great, keep up the good work!
With all the recent e-mail on the test suite I'm wondering how up to date is the status.text file? When I run the test suite on an x86-64 box running Ubuntu 10.04 with SBCL 1.0.39 and a custom built gsl library (mostly some CFLAGS tweaks) I get the following two failures:
EXPONENTIAL: (MULTIPLE-VALUE-LIST (LET ((RNG (MAKE-RANDOM-NUMBER-GENERATOR +MT19937+ 0))) (LOOP FOR I FROM 0 TO 10 COLLECT (SAMPLE RNG :EXPONENTIAL :MU 10.0d0)))) failed: Expected ((0.0025828444588394794d0 18.145581427987647d0 12.636598054339759d0 0.5424387252062355d0 14.624994234158105d0 7.236607929535993d0 0.4345362449683603d0 2.95303920904529d0 6.161052939065796d0 3.011686333539114d0 2.7451079819355364d0)) but saw ((82.61578216370394d0 1.77823538531874d0 3.3214653339021365d0 29.412645812312775d0 2.6351843583734817d0 6.635371453335953d0 31.57709150859036d0 13.637712930094189d0 7.766237034468241d0 13.468928238240315d0 14.268822088229632d0)) EXPONENTIAL: 11 assertions passed, 1 failed.
and:
LU: (MULTIPLE-VALUE-LIST (TEST-LU-SOLVE-DIM (CREATE-COMPLEX-MATRIX 7))) failed: Expected (#2m(#C(24.0717272023734d0 -9.84612797621247d0) #C(-269.338853034031d0 87.5455232472528d0) #C(2966.61356736296d0 -1026.24473923993d0) #C(-18207.3812124749d0 5673.8447304241d0) #C(55769.3879019068d0 -16154.0963210502d0) #C(-78894.1207561151d0 19505.3812987858d0) #C(39554.8551241728d0 -7765.93696255317d0))) but saw (#2m(#C(-81.70598196064235d0 -81.70599595009693d0) #C(3354.209927435102d0 3354.278264591346d0) #C(-31954.85554225817d0 -31956.353685805567d0) #C(119027.61090077131d0 119037.36678048137d0) #C(-203627.71695137964d0 -203653.92708809028d0) #C(160626.5466779804d0 160657.2640539496d0) #C(-47344.00882810219d0 -47357.00253607087d0))) LU: 11 assertions passed, 1 failed.
TOTAL: 4014 assertions passed, 2 failed, 0 execution errors.
a few quick tests of the LU decomp routine seem to suggest that it is working fine so I'm wondering if this is the kind of "numeric fuzz" you were alluding to in a previous post.
With regards, Jason
_______________________________________________ Gsll-devel mailing list Gsll-devel@common-lisp.net http://common-lisp.net/cgi-bin/mailman/listinfo/gsll-devel
_______________________________________________ Gsll-devel mailing list Gsll-devel@common-lisp.net http://common-lisp.net/cgi-bin/mailman/listinfo/gsll-devel
On Wed, Jul 21, 2010 at 04:16:08PM +0100, Leo wrote:
On 2010-07-21 14:47 +0100, Mirko Vukovic wrote:
You deserve a medal, a GP (giga pint) of some favorite beverage, or some other token of our appreciation.
I second this ;)
I fully support this motion. What's the plan of action? Sumant
On Wed, Jul 21, 2010 at 11:28 AM, Sumant Oemrawsingh <soemraws@xs4all.nl> wrote:
On Wed, Jul 21, 2010 at 04:16:08PM +0100, Leo wrote:
On 2010-07-21 14:47 +0100, Mirko Vukovic wrote:
You deserve a medal, a GP (giga pint) of some favorite beverage, or some other token of our appreciation.
I second this ;)
I fully support this motion. What's the plan of action?
First we start a tweet chain singing praises to Liam. Next, facebook Third, ..., ok, maybe not. Fourth, if Liam is the `Liam M Healy' on the Amazon wish list (http://www.amazon.com/gp/registry/search.html/ref=cm_gift_wl_teaser?type=wishlist&field-lastname=&field-firstname=&_po_type=wishlist&field-name=liam+healy&x=0&y=0), we have struck gold. Cheers, Mirko
Sumant
_______________________________________________ Gsll-devel mailing list Gsll-devel@common-lisp.net http://common-lisp.net/cgi-bin/mailman/listinfo/gsll-devel
On Wed, Jul 21, 2010 at 12:10:34PM -0400, Mirko Vukovic wrote:
On Wed, Jul 21, 2010 at 11:28 AM, Sumant Oemrawsingh <soemraws@xs4all.nl> wrote:
On Wed, Jul 21, 2010 at 04:16:08PM +0100, Leo wrote:
On 2010-07-21 14:47 +0100, Mirko Vukovic wrote:
You deserve a medal, a GP (giga pint) of some favorite beverage, or some other token of our appreciation.
I second this ;)
I fully support this motion. What's the plan of action?
First we start a tweet chain singing praises to Liam. Next, facebook Third, ..., ok, maybe not.
Fourth, if Liam is the `Liam M Healy' on the Amazon wish list (http://www.amazon.com/gp/registry/search.html/ref=cm_gift_wl_teaser?type=wishlist&field-lastname=&field-firstname=&_po_type=wishlist&field-name=liam+healy&x=0&y=0), we have struck gold.
If it is, then I suggest you get him "The Rough Guide to New Zealand Map (Rough Guide Country/Region Map)" which is only 3 cents short of $1000.- That has to be the most awesome guide in the history of mankind! In any case, if it is him, I agree, this is an excellent find! Sumant
On Wed, Jul 21, 2010 at 1:23 PM, Sumant Oemrawsingh <soemraws@xs4all.nl> wrote:
On Wed, Jul 21, 2010 at 12:10:34PM -0400, Mirko Vukovic wrote:
On Wed, Jul 21, 2010 at 11:28 AM, Sumant Oemrawsingh <soemraws@xs4all.nl> wrote:
On Wed, Jul 21, 2010 at 04:16:08PM +0100, Leo wrote:
On 2010-07-21 14:47 +0100, Mirko Vukovic wrote:
You deserve a medal, a GP (giga pint) of some favorite beverage, or some other token of our appreciation.
I second this ;)
I fully support this motion. What's the plan of action?
First we start a tweet chain singing praises to Liam. Next, facebook Third, ..., ok, maybe not.
Fourth, if Liam is the `Liam M Healy' on the Amazon wish list (http://www.amazon.com/gp/registry/search.html/ref=cm_gift_wl_teaser?type=wishlist&field-lastname=&field-firstname=&_po_type=wishlist&field-name=liam+healy&x=0&y=0), we have struck gold.
If it is, then I suggest you get him "The Rough Guide to New Zealand Map (Rough Guide Country/Region Map)" which is only 3 cents short of $1000.- That has to be the most awesome guide in the history of mankind!
In any case, if it is him, I agree, this is an excellent find!
Sumant
Oddly enough, it is me, but like I said, that list is really out of date. At one time I thought about biking in NZ, but I haven't in the last few years. So save your money!
On Wed, Jul 21, 2010 at 12:10 PM, Mirko Vukovic <mirko.vukovic@gmail.com> wrote:
On Wed, Jul 21, 2010 at 11:28 AM, Sumant Oemrawsingh <soemraws@xs4all.nl> wrote:
On Wed, Jul 21, 2010 at 04:16:08PM +0100, Leo wrote:
On 2010-07-21 14:47 +0100, Mirko Vukovic wrote:
You deserve a medal, a GP (giga pint) of some favorite beverage, or some other token of our appreciation.
I second this ;)
I fully support this motion. What's the plan of action?
First we start a tweet chain singing praises to Liam. Next, facebook Third, ..., ok, maybe not.
Fourth, if Liam is the `Liam M Healy' on the Amazon wish list (http://www.amazon.com/gp/registry/search.html/ref=cm_gift_wl_teaser?type=wishlist&field-lastname=&field-firstname=&_po_type=wishlist&field-name=liam+healy&x=0&y=0), we have struck gold.
Cheers,
Mirko
Sumant
If I have a wishlist on Amazon, it's likely more out of date than status.text! Seriously, for anyone with C and/or Lisp skills, here's how you can contribute: help port some of the GSL tests to GSLL. The first thing you need to do is to download the GSL source. Do the usual building process, then run "make check". That will make all the tests and run them. Then find the test files, figure out what they do, and port them. For example, in gsl/specfunc/test_gamma.c the first executable line of test_gamma is TEST_SF(s, gsl_sf_lngamma_e, (-0.1, &r), 2.368961332728788655 , TEST_TOL0, GSL_SUCCESS); which got ported to (ASSERT-TO-TOLERANCE (LOG-GAMMA -0.1d0) 2.368961332728788655d0 +TEST-TOL0+) in gsll/tests/gamma.lisp. There are some definitions in gsll/test-unit/convert.lisp that help in this porting process. They are not loaded with GSLL (requires cl-ppcre, alexandria, and iterate). They are more geared toward the special function and random distribution tests, those being the ones that are present in massive bulk in GSL, but could be useful for other tests. Some of the GSL tests are fiendishly hard to pull out of source. I've found gcc -E useful sometimes; it is a "macroexpand all" for C. Even if you're just able to identify where and how certain tests are defined, it would be quite helpful; then it's easier to write the translation. Liam PS. I've updated status.text be removing obsolete information, and I did a minor fix to convert.lisp so that it doesn't rely on a private system I have. So do another pull before trying this.
On Wed, Jul 21, 2010 at 01:36:47PM -0400, Liam Healy wrote:
Seriously, for anyone with C and/or Lisp skills, here's how you can contribute: help port some of the GSL tests to GSLL. The first thing
And I still have a bunch of half-finished tests for the FFT part. I constantly get side-tracked with other things, but I'll get there (eventually), I promise! Sumant
On 7/21/10, Sumant Oemrawsingh <soemraws@xs4all.nl> wrote:
On Wed, Jul 21, 2010 at 04:16:08PM +0100, Leo wrote:
On 2010-07-21 14:47 +0100, Mirko Vukovic wrote:
You deserve a medal, a GP (giga pint) of some favorite beverage, or some other token of our appreciation.
I second this ;)
I fully support this motion. What's the plan of action?
hint: about 3,000 years ago Phoenicians invented money. -- Sam Steingold <http://sds.podval.org>
On Wed, Jul 21, 2010 at 12:48 PM, Sam Steingold <sds@gnu.org> wrote:
On 7/21/10, Sumant Oemrawsingh <soemraws@xs4all.nl> wrote:
On Wed, Jul 21, 2010 at 04:16:08PM +0100, Leo wrote: > On 2010-07-21 14:47 +0100, Mirko Vukovic wrote: > > You deserve a medal, a GP (giga pint) of some favorite beverage, or > > some other token of our appreciation. > > I second this ;)
I fully support this motion. What's the plan of action?
hint: about 3,000 years ago Phoenicians invented money.
-- Sam Steingold <http://sds.podval.org>
... and yet nowadays the coin of the realm is code! Liam
participants (6)
-
Jason Nielsen -
Leo -
Liam Healy -
Mirko Vukovic -
Sam Steingold -
Sumant Oemrawsingh