I am not sure what to think about assertion failures for gsll. Does this mean I should not use gsll? Point me in the direction of the right reading material or let me know. I am on Linux Mint 17 64-bit. I ran the tests under Clozure version 1.10 64-bit, using slime in gnu emacs 24.3.1. Here is what I got:
Unit Test Summary | 4007 assertions total | 3992 passed | 15 failed | 1 execution errors | 0 missing tests
| Failed Form: (MULTIPLE-VALUE-LIST (PASCAL-PDF 5 0.4 12)) | Expected (0.0056984767089869) but saw (0.005698476708986905) | | Failed Form: (MULTIPLE-VALUE-LIST (NEGATIVE-BINOMIAL-PDF 5 0.4 12.0)) | Expected (0.0056984767089869) but saw (0.005698476708986905) | NEGATIVE-BINOMIAL: 6 assertions passed, 2 failed.
| Failed Form: (MULTIPLE-VALUE-LIST (NONLINEAR-LEAST-SQUARES-EXAMPLE 40 +LEVENBERG-MARQUARDT+ NIL)) | Expected ((5.045357801443204 0.10404905892045835 1.0192487061031013)) | but saw ((5.04535778186662 0.10404905770554014 1.0192487099440282)) | NONLINEAR-LEAST-SQUARES: 0 assertions passed, 1 failed.
| Failed Form: (MULTIPLE-VALUE-LIST (LET ((RNG (MAKE-RANDOM-NUMBER-GENERATOR +MT19937+ 0))) (LOOP FOR I FROM 0 TO 10 COLLECT (SAMPLE RNG :EXPONENTIAL :MU 10.0)))) | Expected ((0.0025828444588394794 18.145581427987647 12.636598054339759 0.5424387252062355 14.624994234158105 7.236607929535993 0.4345362449683603 2.95303920904529 6.161052939065796 3.011686333539114 2.7451079819355364)) | but saw ((82.61578216370394 1.77823538531874 3.3214653339021365 29.412645812312775 2.6351843583734817 6.635371453335953 31.57709150859036 13.637712930094189 7.766237034468241 13.468928238240315 14.268822088229632)) | EXPONENTIAL: 11 assertions passed, 1 failed.
| Failed Form: (MULTIPLE-VALUE-LIST (LET ((V1 (GRID:MAKE-FOREIGN-ARRAY '(COMPLEX DOUBLE-FLOAT) :DIMENSIONS '3))) (GRID:COPY-TO (SET-ALL V1 #C(-34.5 8.24))))) | Expected (#(#C(-34.5 8.24) #C(-34.5 8.24) #C(-34.5 8.24))) | but saw (#(#C(6.93808738500125E-310 6.93808738500125E-310) #C(0.0 0.0) #C(2.2610866479751355E-4 1.9369301518129228E-4))) | | Failed Form: (MULTIPLE-VALUE-LIST (LET ((V1 (GRID:MAKE-FOREIGN-ARRAY '(COMPLEX SINGLE-FLOAT) :DIMENSIONS '3))) (GRID:COPY-TO (SET-ALL V1 #C(-34.5S0 8.24S0))))) | Expected (#(#C(-34.5S0 8.24S0) #C(-34.5S0 8.24S0) #C(-34.5S0 8.24S0))) | but saw (#(#C(9.860902S-32 4.5816855S-41) #C(9.860902S-32 4.5816855S-41) #C(0.0S0 0.0S0))) | VECTOR-SET-ALL: 10 assertions passed, 2 failed.
| Failed Form: (MULTIPLE-VALUE-LIST (RANDOM-WALK-VEGAS-EXAMPLE)) | Expected (1.3931632739551914 1.4981164744582692E-4) | but saw (1.3931632739552706 1.498116474436285E-4) | | Failed Form: (MULTIPLE-VALUE-LIST (RANDOM-WALK-MISER-EXAMPLE)) | Expected (1.3895297058825096 0.0050106269732269415) | but saw (1.3895297058825093 0.005010626973226931) | | Failed Form: (MULTIPLE-VALUE-LIST (RANDOM-WALK-PLAIN-EXAMPLE)) | Expected (1.4122087033540667 0.013435861456267064) | but saw (1.4122087033540713 0.013435861456268945) | MONTE-CARLO: 0 assertions passed, 3 failed.
| Failed Form: (MULTIPLE-VALUE-LIST (LET ((V1 (GRID:MAKE-FOREIGN-ARRAY '(COMPLEX DOUBLE-FLOAT) :INITIAL-CONTENTS '(#C(-34.5 8.24) #C(3.29 -8.93) #C(34.12 -6.15) #C(49.27 -13.49) #C(32.5 42.73) #C(-17.24 43.31) #C(-16.12 -8.25) #C(21.44 -49.08)))) (SCALAR #C(32.5 42.73))) (GRID:COPY-TO (SCALE SCALAR V1)))) | Expected (#(#C(-1473.3452 -1206.385) #C(488.5039 -149.64329999999998) #C(1371.6895 1258.0725999999997) #C(2177.7027 1666.8821) #C(-769.6028999999996 2777.45) #C(-2410.9363 670.9098000000001) #C(-171.3775 -956.9326) #C(2793.9883999999997 -678.9687999999999))) | but saw (#(#C(-34.5 8.24) #C(3.29 -8.93) #C(34.12 -6.15) #C(49.27 -13.49) #C(32.5 42.73) #C(-17.24 43.31) #C(-16.12 -8.25) #C(21.44 -49.08))) | | Failed Form: (MULTIPLE-VALUE-LIST (LET ((V1 (GRID:MAKE-FOREIGN-ARRAY '(COMPLEX SINGLE-FLOAT) :INITIAL-CONTENTS '(#C(-34.5S0 8.24S0) #C(3.29S0 -8.93S0) #C(34.12S0 -6.15S0) #C(49.27S0 -13.49S0) #C(32.5S0 42.73S0) #C(-17.24S0 43.31S0) #C(-16.12S0 -8.25S0) #C(21.44S0 -49.08S0)))) (SCALAR #C(32.5S0 42.73S0))) (GRID:COPY-TO (SCALE SCALAR V1)))) | Expected (#(#C(-1473.3452S0 -1206.385S0) #C(488.5039S0 -149.64331S0) #C(1371.6895S0 1258.0725S0) #C(2177.7026S0 1666.8821S0) #C(-769.6029S0 2777.45S0) #C(-2410.9363S0 670.9099S0) #C(-171.37753S0 -956.9326S0) #C(2793.9885S0 -678.9689S0))) | but saw (#(#C(-34.5S0 8.24S0) #C(3.29S0 -8.93S0) #C(34.12S0 -6.15S0) #C(49.27S0 -13.49S0) #C(32.5S0 42.73S0) #C(-17.24S0 43.31S0) #C(-16.12S0 -8.25S0) #C(21.44S0 -49.08S0))) | SCALE: 4 assertions passed, 2 failed.
| Failed Form: (MULTIPLE-VALUE-LIST (INTEGRATION-QAGIU (INTEGRATION-TEST-F15 5.0) 0.0 0.0 1.0E-7 1000)) | Expected (65536.00000000025 7.121667184124547E-4) | but saw (65536.00000000025 7.121667220555405E-4) | NUMERICAL-INTEGRATION: 41 assertions passed, 1 failed.
| Failed Form: (MULTIPLE-VALUE-LIST (LET ((M1 (GRID:MAKE-FOREIGN-ARRAY '(COMPLEX DOUBLE-FLOAT) :DIMENSIONS '(3 3)))) (GRID:COPY-TO (SET-ALL M1 #C(-34.5 8.24))))) | Expected (#2A((#C(-34.5 8.24) #C(-34.5 8.24) #C(-34.5 8.24)) (#C(-34.5 8.24) #C(-34.5 8.24) #C(-34.5 8.24)) (#C(-34.5 8.24) #C(-34.5 8.24) #C(-34.5 8.24)))) | but saw (#2A((#C(6.93808738500125E-310 6.93808738500125E-310) #C(0.0 0.0) #C(0.0 0.0)) (#C(0.0 0.0) #C(0.0 0.0) #C(0.0 0.0)) (#C(0.0 0.0) #C(0.0 0.0) #C(0.0 0.0)))) | | Failed Form: (MULTIPLE-VALUE-LIST (LET ((M1 (GRID:MAKE-FOREIGN-ARRAY '(COMPLEX SINGLE-FLOAT) :DIMENSIONS '(3 3)))) (GRID:COPY-TO (SET-ALL M1 #C(-34.5S0 8.24S0))))) | Expected (#2A((#C(-34.5S0 8.24S0) #C(-34.5S0 8.24S0) #C(-34.5S0 8.24S0)) (#C(-34.5S0 8.24S0) #C(-34.5S0 8.24S0) #C(-34.5S0 8.24S0)) (#C(-34.5S0 8.24S0) #C(-34.5S0 8.24S0) #C(-34.5S0 8.24S0)))) | but saw (#2A((#C(0.0S0 0.0S0) #C(-1.9980458S+7 2.2836375S0) #C(-0.24403502S0 1.7918347S0)) (#C(-54862.137S0 2.2802413S0) #C(-2.8170395S-11 -2.6114688S0) #C(-1.8720056S+36 2.430557S0)) (#C(-60954.11S0 -2.0077076S0) #C(-5.3453843S-19 2.1910214S0) #C(5.721449S+18 1.6339746S0)))) | MATRIX-SET-ALL: 10 assertions passed, 2 failed.
| Failed Form: (MULTIPLE-VALUE-LIST (COUPLING-3J 0 1 1 0 1 -1)) | Expected (0.7071067811865475 3.14018491736755E-16) | but saw (0.7071067811865476 7.850462293418876E-16) | COUPLING: 2 assertions passed, 1 failed.
That's pretty much a normal number of failures, though the execution error shouldn't happen. The decision on whether to use GSLL is up to you, you have to evaluate the failures and decide whether they're relevant to your intended application. Note that most of them are slight numerical imprecision. The tests aren't perfectly crafted, so they may not actually be problems at all.
Liam
On Mon, Dec 29, 2014 at 12:05 PM, DJ Penton djp@arqux.com wrote:
I am not sure what to think about assertion failures for gsll. Does this mean I should not use gsll? Point me in the direction of the right reading material or let me know. I am on Linux Mint 17 64-bit. I ran the tests under Clozure version 1.10 64-bit, using slime in gnu emacs 24.3.1. Here is what I got:
Unit Test Summary | 4007 assertions total | 3992 passed | 15 failed | 1 execution errors | 0 missing tests
| Failed Form: (MULTIPLE-VALUE-LIST (PASCAL-PDF 5 0.4 12)) | Expected (0.0056984767089869) but saw (0.005698476708986905) | | Failed Form: (MULTIPLE-VALUE-LIST (NEGATIVE-BINOMIAL-PDF 5 0.4 12.0)) | Expected (0.0056984767089869) but saw (0.005698476708986905) | NEGATIVE-BINOMIAL: 6 assertions passed, 2 failed.
| Failed Form: (MULTIPLE-VALUE-LIST (NONLINEAR-LEAST-SQUARES-EXAMPLE 40 +LEVENBERG-MARQUARDT+ NIL)) | Expected ((5.045357801443204 0.10404905892045835 1.0192487061031013)) | but saw ((5.04535778186662 0.10404905770554014 1.0192487099440282)) | NONLINEAR-LEAST-SQUARES: 0 assertions passed, 1 failed.
| Failed Form: (MULTIPLE-VALUE-LIST (LET ((RNG (MAKE-RANDOM-NUMBER-GENERATOR +MT19937+ 0))) (LOOP FOR I FROM 0 TO 10 COLLECT (SAMPLE RNG :EXPONENTIAL :MU 10.0)))) | Expected ((0.0025828444588394794 18.145581427987647 12.636598054339759 0.5424387252062355 14.624994234158105 7.236607929535993 0.4345362449683603 2.95303920904529 6.161052939065796 3.011686333539114 2.7451079819355364)) | but saw ((82.61578216370394 1.77823538531874 3.3214653339021365 29.412645812312775 2.6351843583734817 6.635371453335953 31.57709150859036 13.637712930094189 7.766237034468241 13.468928238240315 14.268822088229632)) | EXPONENTIAL: 11 assertions passed, 1 failed.
| Failed Form: (MULTIPLE-VALUE-LIST (LET ((V1 (GRID:MAKE-FOREIGN-ARRAY '(COMPLEX DOUBLE-FLOAT) :DIMENSIONS '3))) (GRID:COPY-TO (SET-ALL V1 #C(-34.5 8.24))))) | Expected (#(#C(-34.5 8.24) #C(-34.5 8.24) #C(-34.5 8.24))) | but saw (#(#C(6.93808738500125E-310 6.93808738500125E-310) #C(0.0 0.0) #C(2.2610866479751355E-4 1.9369301518129228E-4))) | | Failed Form: (MULTIPLE-VALUE-LIST (LET ((V1 (GRID:MAKE-FOREIGN-ARRAY '(COMPLEX SINGLE-FLOAT) :DIMENSIONS '3))) (GRID:COPY-TO (SET-ALL V1 #C(-34.5S0 8.24S0))))) | Expected (#(#C(-34.5S0 8.24S0) #C(-34.5S0 8.24S0) #C(-34.5S0 8.24S0))) | but saw (#(#C(9.860902S-32 4.5816855S-41) #C(9.860902S-32 4.5816855S-41) #C(0.0S0 0.0S0))) | VECTOR-SET-ALL: 10 assertions passed, 2 failed.
| Failed Form: (MULTIPLE-VALUE-LIST (RANDOM-WALK-VEGAS-EXAMPLE)) | Expected (1.3931632739551914 1.4981164744582692E-4) | but saw (1.3931632739552706 1.498116474436285E-4) | | Failed Form: (MULTIPLE-VALUE-LIST (RANDOM-WALK-MISER-EXAMPLE)) | Expected (1.3895297058825096 0.0050106269732269415) | but saw (1.3895297058825093 0.005010626973226931) | | Failed Form: (MULTIPLE-VALUE-LIST (RANDOM-WALK-PLAIN-EXAMPLE)) | Expected (1.4122087033540667 0.013435861456267064) | but saw (1.4122087033540713 0.013435861456268945) | MONTE-CARLO: 0 assertions passed, 3 failed.
| Failed Form: (MULTIPLE-VALUE-LIST (LET ((V1 (GRID:MAKE-FOREIGN-ARRAY '(COMPLEX DOUBLE-FLOAT) :INITIAL-CONTENTS '(#C(-34.5 8.24) #C(3.29 -8.93) #C(34.12 -6.15) #C(49.27 -13.49) #C(32.5 42.73) #C(-17.24 43.31) #C(-16.12 -8.25) #C(21.44 -49.08)))) (SCALAR #C(32.5 42.73))) (GRID:COPY-TO (SCALE SCALAR V1)))) | Expected (#(#C(-1473.3452 -1206.385) #C(488.5039 -149.64329999999998) #C(1371.6895 1258.0725999999997) #C(2177.7027 1666.8821) #C(-769.6028999999996 2777.45) #C(-2410.9363 670.9098000000001) #C(-171.3775 -956.9326) #C(2793.9883999999997 -678.9687999999999))) | but saw (#(#C(-34.5 8.24) #C(3.29 -8.93) #C(34.12 -6.15) #C(49.27 -13.49) #C(32.5 42.73) #C(-17.24 43.31) #C(-16.12 -8.25) #C(21.44 -49.08))) | | Failed Form: (MULTIPLE-VALUE-LIST (LET ((V1 (GRID:MAKE-FOREIGN-ARRAY '(COMPLEX SINGLE-FLOAT) :INITIAL-CONTENTS '(#C(-34.5S0 8.24S0) #C(3.29S0 -8.93S0) #C(34.12S0 -6.15S0) #C(49.27S0 -13.49S0) #C(32.5S0 42.73S0) #C(-17.24S0 43.31S0) #C(-16.12S0 -8.25S0) #C(21.44S0 -49.08S0)))) (SCALAR #C(32.5S0 42.73S0))) (GRID:COPY-TO (SCALE SCALAR V1)))) | Expected (#(#C(-1473.3452S0 -1206.385S0) #C(488.5039S0 -149.64331S0) #C(1371.6895S0 1258.0725S0) #C(2177.7026S0 1666.8821S0) #C(-769.6029S0 2777.45S0) #C(-2410.9363S0 670.9099S0) #C(-171.37753S0 -956.9326S0) #C(2793.9885S0 -678.9689S0))) | but saw (#(#C(-34.5S0 8.24S0) #C(3.29S0 -8.93S0) #C(34.12S0 -6.15S0) #C(49.27S0 -13.49S0) #C(32.5S0 42.73S0) #C(-17.24S0 43.31S0) #C(-16.12S0 -8.25S0) #C(21.44S0 -49.08S0))) | SCALE: 4 assertions passed, 2 failed.
| Failed Form: (MULTIPLE-VALUE-LIST (INTEGRATION-QAGIU (INTEGRATION-TEST-F15 5.0) 0.0 0.0 1.0E-7 1000)) | Expected (65536.00000000025 7.121667184124547E-4) | but saw (65536.00000000025 7.121667220555405E-4) | NUMERICAL-INTEGRATION: 41 assertions passed, 1 failed.
| Failed Form: (MULTIPLE-VALUE-LIST (LET ((M1 (GRID:MAKE-FOREIGN-ARRAY '(COMPLEX DOUBLE-FLOAT) :DIMENSIONS '(3 3)))) (GRID:COPY-TO (SET-ALL M1 #C(-34.5 8.24))))) | Expected (#2A((#C(-34.5 8.24) #C(-34.5 8.24) #C(-34.5 8.24)) (#C(-34.5 8.24) #C(-34.5 8.24) #C(-34.5 8.24)) (#C(-34.5 8.24) #C(-34.5 8.24) #C(-34.5 8.24)))) | but saw (#2A((#C(6.93808738500125E-310 6.93808738500125E-310) #C(0.0 0.0) #C(0.0 0.0)) (#C(0.0 0.0) #C(0.0 0.0) #C(0.0 0.0)) (#C(0.0 0.0) #C(0.0 0.0) #C(0.0 0.0)))) | | Failed Form: (MULTIPLE-VALUE-LIST (LET ((M1 (GRID:MAKE-FOREIGN-ARRAY '(COMPLEX SINGLE-FLOAT) :DIMENSIONS '(3 3)))) (GRID:COPY-TO (SET-ALL M1 #C(-34.5S0 8.24S0))))) | Expected (#2A((#C(-34.5S0 8.24S0) #C(-34.5S0 8.24S0) #C(-34.5S0 8.24S0)) (#C(-34.5S0 8.24S0) #C(-34.5S0 8.24S0) #C(-34.5S0 8.24S0)) (#C(-34.5S0 8.24S0) #C(-34.5S0 8.24S0) #C(-34.5S0 8.24S0)))) | but saw (#2A((#C(0.0S0 0.0S0) #C(-1.9980458S+7 2.2836375S0) #C(-0.24403502S0 1.7918347S0)) (#C(-54862.137S0 2.2802413S0) #C(-2.8170395S-11 -2.6114688S0) #C(-1.8720056S+36 2.430557S0)) (#C(-60954.11S0 -2.0077076S0) #C(-5.3453843S-19 2.1910214S0) #C(5.721449S+18 1.6339746S0)))) | MATRIX-SET-ALL: 10 assertions passed, 2 failed.
| Failed Form: (MULTIPLE-VALUE-LIST (COUPLING-3J 0 1 1 0 1 -1)) | Expected (0.7071067811865475 3.14018491736755E-16) | but saw (0.7071067811865476 7.850462293418876E-16) | COUPLING: 2 assertions passed, 1 failed.
Gsll-devel mailing list Gsll-devel@common-lisp.net http://mailman.common-lisp.net/cgi-bin/mailman/listinfo/gsll-devel