wiki:HowFastAreWe

Version 3 (modified by bvanevery, 4 years ago) (diff)

move performance notes to top

Benchmarking Results

The following benchmark is from the  Cliki Performance Benchmarks. Note that for these data, Reference should be read as OpenMCL 1.1. The Reference column is presented in elapsed time, while the other columns (OpenMCL 1.1 (PPC64), SBCL, and OpenMCL 1.0 (PPC32)) are relative to the Reference column. In other words, for the non-Reference columns, scores below 1.0 indicate superior performance, while scores above 1.0 indicates worse performance. See also these notes on  performance.

; loading system definition from ccl:tools;asdf-install;asdf-install.asd.newest into #<Package "ASDF0">
; registering #<SYSTEM ASDF-INSTALL #x858162E> as ASDF-INSTALL
Benchmark                 Reference   OpenMCL64  SBCL
                                      (1.1PPC) 
-------------------------------------------------------------------------------------
COMPILER                 [      1.76]   1.46     2.88
LOAD-FASL                [      0.91]   1.45     1.88
SUM-PERMUTATIONS         [      3.76]   5.22     0.78
WALK-LIST/SEQ            [      0.09]   0.72     0.30
WALK-LIST/MESS           [      0.06]   0.66     1.72
BOYER                    [     10.74]   3.52     0.78
BROWSE                   [      0.66]   3.32     1.47
DDERIV                   [      0.48]   1.62     1.50
DERIV                    [      0.58]   1.46     1.35
DESTRUCTIVE              [      0.54]   1.26     1.55
DIV2-TEST-1              [      0.53]   2.01     1.84
DIV2-TEST-2              [      0.63]   1.90     1.90
FFT                      [      0.21]   1.85     0.30
FRPOLY/FIXNUM            [      0.68]   3.08     1.49
FRPOLY/BIGNUM            [      0.81]   5.43     1.13
FRPOLY/FLOAT             [      2.44]   1.57     0.55
PUZZLE                   [      0.84]   1.02     0.34
TAK                      [      0.38]   1.00     1.48
CTAK                     [      0.74]   0.95     0.90
TRTAK                    [      0.38]   1.01     1.49
TAKL                     [      1.41]   1.04     0.49
STAK                     [      0.85]   1.02     0.52
FPRINT/UGLY              [      5.06]   1.16     0.40
FPRINT/PRETTY            [      4.50]   1.15     1.06
TRAVERSE                 [      1.13]   3.59     0.86
TRIANGLE                 [      1.33]   1.03     0.57
RICHARDS                 [      1.54]   1.11     1.05
FACTORIAL                [      1.52]   1.41     0.67
FIB                      [      0.28]   0.94     3.41
FIB-RATIO                [      0.12]   1.36     1.40
ACKERMANN                [      1.82]   1.97     4.21
MANDELBROT/COMPLEX       [      0.67]   1.13     2.14
MANDELBROT/DFLOAT        [      0.33]   1.09     0.17
MRG32K3A                 [     48.27]   3.74     0.03
CRC40                    [     46.89]   0.05     0.50
BIGNUM/ELEM-100-1000     [      0.95]   2.67     0.34
BIGNUM/ELEM-1000-100     [      4.22]   3.59     0.13
BIGNUM/ELEM-10000-1      [      6.60]   2.55     0.08
BIGNUM/PARI-100-10       [      0.96]   1.55     0.10
BIGNUM/PARI-200-5        [     11.21]   3.65     0.03
PI-DECIMAL/SMALL         [     17.48]   0.40     0.26
PI-DECIMAL/BIG           [     43.72]   0.22     0.07
PI-ATAN                  [      4.43]   1.49     1.63
PI-RATIOS                [      6.50]   2.61     0.56
HASH-STRINGS             [      1.74]   1.71     0.48
HASH-INTEGERS            [      1.80]   1.32     0.82
SLURP-LINES              [      9.73]   1.12     0.69
BOEHM-GC                 [      8.70]   7.10     0.45
DEFLATE-FILE             [      1.17]   1.38     1.09
1D-ARRAYS                [      0.05]   1.09     5.22
2D-ARRAYS                [      1.47]   1.55     0.49
3D-ARRAYS                [      3.78]   1.35     0.57
BITVECTORS               [     28.13]   1.64     0.04
BENCH-STRINGS            [      4.80]   1.06     0.23
fill-strings/adjustable  [     48.62]   2.59     0.80
STRING-CONCAT            [    100.21]   1.07     0.89
SEARCH-SEQUENCE          [      3.94]   1.11     0.13
CLOS/defclass            [      0.30]   2.12    14.48
CLOS/defmethod           [      0.14]   1.29    31.07
CLOS/instantiate         [      9.80]   1.25     3.23
CLOS/simple-instantiate  [     29.95]   1.10     0.08
CLOS/methodcalls         [      6.33]   1.52     0.49
CLOS/method+after        [      3.18]   1.64     0.85
CLOS/complex-methods     [      1.52]   1.05     2.27
EQL-SPECIALIZED-FIB      [      1.17]   1.34     0.66
Reference time in first column is in seconds; other columns are relative
Reference implementation: OpenMCL Version 1.1-pre-070408 (DarwinPPC32)
Impl OpenM: OpenMCL Version 1.1-pre-070408 (DarwinPPC64)
Impl SBCL : SBCL 1.0.3
=== Test machine ===
   Machine-type: Power Macintosh
   Machine-version: PowerMac8,1