Hi there,

arrays.lisp is the odd benchmark group out when it comes to specifying the number of runs: It has optional RUNS arguments in the defuns in files/arrays.lisp. That makes it a bit of a pain to keep the run numbers in sync with run times on modern machines. Also, it means these benchmarks keep their setup code inside the benchmark function: not a good thing.

The attached patch aims to fix this by defining a cl-bench.arrays::bench-<something>-setup function that initializes the arrays bound in a LET form surrounding the actual benchmark defun. At least in my limited setup, it caused a slight reduction of test run length variances, and it makes things a lot easier to maintain.

Cheers,