← Back to index

2021-06-10 06:18

Download Archive

Contents of config.yml 
#shrinkBatchSources: 30
batchSamples: 3
warmupIterations: 3
benchmarkIterations: 3
variants:
  - standard
  - elkhound
  - incremental
languages:
  - id: java
    name: Java
    extension: java
    parseTable:
      repo: https://github.com/metaborg/java-front.git
      subDir: lang.java
    sources:
      incremental:
        - id: apache-commons-lang-stringutils
          name: StringUtils
          repo: https://github.com/apache/commons-lang.git
          files:
            - src/main/java/org/apache/commons/lang3/StringUtils.java
          versions: 3 # 16
        - id: gson
          repo: https://github.com/google/gson.git
          versions: 3 # 16
        - id: slf4j
          repo: https://github.com/qos-ch/slf4j.git
          versions: 3 # 16
  - id: webdsl
    name: WebDSL
    extension: app
    parseTable:
      repo: https://github.com/webdsl/webdsl-statix.git
      subDir: webdslstatix
    sources:
      incremental:
        - id: webdsl-builtin
          name: builtin.app
          repo: https://github.com/webdsl/webdsl
          fetchOptions:
            - '--shallow-since="2011-02-16 14:00:00 +0000"' # From this point in time on, the file parses without errors
          files:
            - src/org/webdsl/dsl/project/template-webdsl/built-in.app
          versions: 16
        - id: webdsl-yellowgrass-incremental
          name: YellowGrass
          repo: https://github.com/webdsl/yellowgrass
          fetchOptions:
            - '--depth=200'
          versions: 3 # 16
        - id: webdsl-elib-utils
          name: elib-utils
          repo: https://github.com/webdsl/elib-utils
          versions: 3 # 16
  - id: sdf3
    name: SDF3
    extension: sdf3
    parseTable:
      repo: https://github.com/metaborg/sdf.git
      subDir: org.metaborg.meta.lang.template
    sources:
      incremental:
        - id: nabl
          name: NaBL
          repo: https://github.com/metaborg/nabl
          versions: 3 # 16
        - id: dynsem
          name: DynSem
          repo: https://github.com/metaborg/dynsem
          versions: 3 # 16
        - id: flowspec
          name: FlowSpec
          repo: https://github.com/metaborg/flowspec
          versions: 3 # 16
        - id: stratego
          name: Stratego
          repo: https://github.com/metaborg/stratego
          versions: 3 # 16
        - id: webdsl
          name: WebDSL
          repo: https://github.com/webdsl/webdsl-statix.git
          versions: 3 # 16

Iterations: 3/3

Spoofax version: master
JSGLR version: incremental
SDF version: master

Language Parse Nodes Character
Nodes
Count
Count Ambi­guous Irre­usable
Average 587489 0.33% 27.20% 336952
Java 1447027 0.00% 19.09% 849194
WebDSL 202954 0.00% 21.29% 103613
SDF3 112485 1.00% 41.21% 58048
Language Parse Nodes Shift Breakdown
Created Reused Rebuilt Parse Node Character Node Count Contains Change Irre­usable No Actions Wrong State
Average 6113 99.35% 0.38% 471 746 0.54% 42.72% 55.14% 0.00% 2.14%
Java 9921 99.75% 0.11% 693 1137 0.17% 53.69% 45.18% 0.00% 1.13%
WebDSL 4287 99.35% 0.23% 472 505 0.46% 55.95% 41.29% 0.00% 2.76%
SDF3 4130 98.97% 0.82% 248 597 0.98% 18.53% 78.94% 0.00% 2.53%

Per Language

Source Parse Nodes Character
Nodes
Count
Count Ambi­guous Irre­usable
Average 1447027 0.00% 19.09% 849194
StringUtils 572580 0.00% 15.27% 396935
gson 2310611 0.00% 23.36% 1268065
slf4j 1457890 0.00% 18.64% 882583
Source Parse Nodes Shift Breakdown
Created Reused Rebuilt Parse Node Character Node Count Contains Change Irre­usable No Actions Wrong State
Average 9921 99.75% 0.11% 693 1137 0.17% 53.69% 45.18% 0.00% 1.13%
StringUtils 15426 99.42% 0.30% 1246 809 0.45% 40.43% 57.98% 0.00% 1.59%
gson 9424 99.88% 0.02% 408 1302 0.04% 63.72% 35.51% 0.00% 0.77%
slf4j 4914 99.94% 0.01% 425 1300 0.03% 56.94% 42.04% 0.00% 1.02%

Sources

Version Parse Nodes Character
Nodes
Count
Count Ambi­guous Irre­usable
Average (0..1) 572580 0
(0.00%)		 87440
(15.27%)		 396935

0 572909 0
(0.00%)		 87432
(15.26%)		 397077
1 572251 0
(0.00%)		 87448
(15.28%)		 396792
2 572267 0
(0.00%)		 87424
(15.28%)		 396796
Version Parse Nodes Shift Breakdown
Created Reused Rebuilt Parse Node Character Node Count Contains Change Irre­usable No Actions Wrong State
Average (1..2) 15426 569246
(99.42%)		 1721
(0.30%)		 1246 809 2597
(0.45%)		 810
(40.43%)		 1715
(57.98%)		 0
(0.00%)		 73
(1.59%)
   -> 0 1052719 0 397078
0 -> 1 26360 566932
(98.96%)		 3135
(0.55%)		 2026 1459 4550
(0.79%)		 1280
(28.13%)		 3125
(68.68%)		 0
(0.00%)		 145
(3.19%)
1 -> 2 4491 571559
(99.88%)		 307
(0.05%)		 465 158 643
(0.11%)		 339
(52.72%)		 304
(47.28%)		 0
(0.00%)		 0
(0.00%)

Version Parse Nodes Character
Nodes
Count
Count Ambi­guous Irre­usable
Average (0..1) 2310611 0
(0.00%)		 539793
(23.36%)		 1268065

0 2309965 0
(0.00%)		 539656
(23.36%)		 1267740
1 2311257 0
(0.00%)		 539929
(23.36%)		 1268390
2 2310257 0
(0.00%)		 539672
(23.36%)		 1268008
Version Parse Nodes Shift Breakdown
Created Reused Rebuilt Parse Node Character Node Count Contains Change Irre­usable No Actions Wrong State
Average (1..2) 9424 2307921
(99.88%)		 351
(0.02%)		 408 1302 975
(0.04%)		 624
(63.72%)		 344
(35.51%)		 0
(0.00%)		 8
(0.77%)
   -> 0 6387913 0 1267945
0 -> 1 11558 2307585
(99.90%)		 397
(0.02%)		 441 1737 1145
(0.05%)		 748
(65.33%)		 388
(33.89%)		 0
(0.00%)		 9
(0.79%)
1 -> 2 7289 2308257
(99.87%)		 304
(0.01%)		 375 866 805
(0.03%)		 500
(62.11%)		 299
(37.14%)		 0
(0.00%)		 6
(0.75%)

Version Parse Nodes Character
Nodes
Count
Count Ambi­guous Irre­usable
Average (0..1) 1457890 0
(0.00%)		 271710
(18.64%)		 882583

0 1456563 0
(0.00%)		 271528
(18.64%)		 881618
1 1459217 0
(0.00%)		 271891
(18.63%)		 883547
2 1458960 0
(0.00%)		 271825
(18.63%)		 883490
Version Parse Nodes Shift Breakdown
Created Reused Rebuilt Parse Node Character Node Count Contains Change Irre­usable No Actions Wrong State
Average (1..2) 4914 1457059
(99.94%)		 164
(0.01%)		 425 1300 407
(0.03%)		 260
(56.94%)		 143
(42.04%)		 0
(0.00%)		 5
(1.02%)
   -> 0 3428545 0 881857
0 -> 1 7226 1455937
(99.96%)		 137
(0.01%)		 404 2192 247
(0.02%)		 97
(39.27%)		 148
(59.92%)		 0
(0.00%)		 2
(0.81%)
1 -> 2 2602 1458180
(99.93%)		 190
(0.01%)		 445 407 567
(0.04%)		 423
(74.60%)		 137
(24.16%)		 0
(0.00%)		 7
(1.23%)

Source Parse Nodes Character
Nodes
Count
Count Ambi­guous Irre­usable
Average 202954 0.00% 21.29% 103613
builtin.app 182107 0.00% 23.09% 98145
YellowGrass 344427 0.00% 19.64% 172543
elib-utils 82328 0.00% 21.15% 40151
Source Parse Nodes Shift Breakdown
Created Reused Rebuilt Parse Node Character Node Count Contains Change Irre­usable No Actions Wrong State
Average 4287 99.35% 0.23% 472 505 0.46% 55.95% 41.29% 0.00% 2.76%
builtin.app 2693 99.28% 0.15% 457 343 0.27% 56.16% 39.28% 0.00% 4.56%
YellowGrass 5065 99.79% 0.12% 534 637 0.20% 55.91% 40.84% 0.00% 3.25%
elib-utils 5102 98.98% 0.40% 425 534 0.92% 55.79% 43.75% 0.00% 0.46%

Sources

Version Parse Nodes Character
Nodes
Count
Count Ambi­guous Irre­usable
Average (6..14) 182107 0
(0.00%)		 42046
(23.09%)		 98145

6 186944 0
(0.00%)		 43193
(23.10%)		 100882
7 180226 0
(0.00%)		 41560
(23.06%)		 97219
8 181858 0
(0.00%)		 42160
(23.18%)		 98047
9 182288 0
(0.00%)		 42160
(23.13%)		 98231
10 181241 0
(0.00%)		 41808
(23.07%)		 97627
11 181366 0
(0.00%)		 41853
(23.08%)		 97683
12 181437 0
(0.00%)		 41867
(23.08%)		 97721
13 181783 0
(0.00%)		 41902
(23.05%)		 97935
14 181824 0
(0.00%)		 41909
(23.05%)		 97956
15 182132 0
(0.00%)		 41944
(23.03%)		 98172
Version Parse Nodes Shift Breakdown
Created Reused Rebuilt Parse Node Character Node Count Contains Change Irre­usable No Actions Wrong State
Average (7..15) 2693 180774
(99.28%)		 277
(0.15%)		 457 343 497
(0.27%)		 222
(56.16%)		 247
(39.28%)		 0
(0.00%)		 28
(4.56%)
   -> 6 479900 0 100883
6 -> 7 249 180143
(96.36%)		 78
(0.04%)		 121 11 120
(0.06%)		 95
(79.17%)		 18
(15.00%)		 0
(0.00%)		 7
(5.83%)
7 -> 8 5078 180026
(99.89%)		 59
(0.03%)		 303 883 199
(0.11%)		 143
(71.86%)		 49
(24.62%)		 0
(0.00%)		 7
(3.52%)
8 -> 9 3060 181400
(99.75%)		 208
(0.11%)		 291 308 447
(0.25%)		 338
(75.62%)		 88
(19.69%)		 0
(0.00%)		 21
(4.70%)
  9 -> 10 6365 179810
(98.64%)		 1174
(0.64%)		 943 963 1653
(0.91%)		 516
(31.22%)		 988
(59.77%)		 0
(0.00%)		 149
(9.01%)
10 -> 11 605 181126
(99.94%)		 24
(0.01%)		 198 66 114
(0.06%)		 89
(78.07%)		 18
(15.79%)		 0
(0.00%)		 7
(6.14%)
11 -> 12 1855 180898
(99.74%)		 212
(0.12%)		 538 124 467
(0.26%)		 203
(43.47%)		 255
(54.60%)		 0
(0.00%)		 9
(1.93%)
12 -> 13 2865 180846
(99.67%)		 320
(0.18%)		 724 308 590
(0.33%)		 230
(38.98%)		 323
(54.75%)		 0
(0.00%)		 37
(6.27%)
13 -> 14 1773 181355
(99.76%)		 181
(0.10%)		 519 103 427
(0.23%)		 204
(47.78%)		 214
(50.12%)		 0
(0.00%)		 9
(2.11%)
14 -> 15 2387 181361
(99.75%)		 236
(0.13%)		 474 318 456
(0.25%)		 179
(39.25%)		 270
(59.21%)		 0
(0.00%)		 7
(1.54%)

Version Parse Nodes Character
Nodes
Count
Count Ambi­guous Irre­usable
Average (0..1) 344427 0
(0.00%)		 67646
(19.64%)		 172543

0 344461 0
(0.00%)		 67646
(19.64%)		 172557
1 344393 0
(0.00%)		 67646
(19.64%)		 172529
2 346034 0
(0.00%)		 67997
(19.65%)		 173274
Version Parse Nodes Shift Breakdown
Created Reused Rebuilt Parse Node Character Node Count Contains Change Irre­usable No Actions Wrong State
Average (1..2) 5065 343700
(99.79%)		 426
(0.12%)		 534 637 682
(0.20%)		 273
(55.91%)		 385
(40.84%)		 0
(0.00%)		 25
(3.25%)
   -> 0 761639 0 172611
0 -> 1 420 344235
(99.93%)		 41
(0.01%)		 121 72 142
(0.04%)		 108
(76.06%)		 30
(21.13%)		 0
(0.00%)		 4
(2.82%)
1 -> 2 9710 343164
(99.64%)		 810
(0.24%)		 947 1202 1222
(0.35%)		 437
(35.76%)		 740
(60.56%)		 0
(0.00%)		 45
(3.68%)

Version Parse Nodes Character
Nodes
Count
Count Ambi­guous Irre­usable
Average (0..1) 82328 0
(0.00%)		 17411
(21.15%)		 40151

0 81539 0
(0.00%)		 17296
(21.21%)		 39821
1 83116 0
(0.00%)		 17526
(21.09%)		 40480
2 83373 0
(0.00%)		 17615
(21.13%)		 40589
Version Parse Nodes Shift Breakdown
Created Reused Rebuilt Parse Node Character Node Count Contains Change Irre­usable No Actions Wrong State
Average (1..2) 5102 81492
(98.98%)		 327
(0.40%)		 425 534 751
(0.92%)		 365
(55.79%)		 385
(43.75%)		 0
(0.00%)		 1
(0.46%)
   -> 0 191149 0 39838
0 -> 1 8686 80084
(98.22%)		 569
(0.70%)		 742 900 1285
(1.58%)		 587
(45.68%)		 698
(54.32%)		 0
(0.00%)		 0
(0.00%)
1 -> 2 1518 82900
(99.74%)		 84
(0.10%)		 108 168 217
(0.26%)		 143
(65.90%)		 72
(33.18%)		 0
(0.00%)		 2
(0.92%)

Source Parse Nodes Character
Nodes
Count
Count Ambi­guous Irre­usable
Average 112485 1.00% 41.21% 58048
NaBL 197596 0.87% 39.75% 100132
DynSem 21531 1.22% 40.38% 10138
FlowSpec 27218 1.06% 47.66% 13760
Stratego 152742 0.72% 36.96% 79752
WebDSL 163338 1.15% 41.31% 86457
Source Parse Nodes Shift Breakdown
Created Reused Rebuilt Parse Node Character Node Count Contains Change Irre­usable No Actions Wrong State
Average 4130 98.97% 0.82% 248 597 0.98% 18.53% 78.94% 0.00% 2.53%
NaBL 2915 99.61% 0.15% 205 402 0.22% 37.54% 56.30% 0.00% 6.16%
DynSem 2078 98.53% 1.10% 121 263 1.47% 16.55% 83.29% 0.00% 0.16%
FlowSpec 3480 98.48% 1.25% 95 487 1.48% 19.65% 79.34% 0.00% 1.01%
Stratego 7031 99.02% 0.85% 465 829 0.95% 15.02% 79.87% 0.00% 5.11%
WebDSL 5145 99.19% 0.76% 352 1002 0.81% 3.86% 95.90% 0.00% 0.24%

Sources

Version Parse Nodes Character
Nodes
Count
Count Ambi­guous Irre­usable
Average (0..1) 197596 1717
(0.87%)		 78553
(39.75%)		 100132

0 197574 1717
(0.87%)		 78553
(39.76%)		 100115
1 197617 1717
(0.87%)		 78553
(39.75%)		 100148
2 197574 1717
(0.87%)		 78553
(39.76%)		 100115
Version Parse Nodes Shift Breakdown
Created Reused Rebuilt Parse Node Character Node Count Contains Change Irre­usable No Actions Wrong State
Average (1..2) 2915 196829
(99.61%)		 291
(0.15%)		 205 402 438
(0.22%)		 167
(37.54%)		 244
(56.30%)		 0
(0.00%)		 28
(6.16%)
   -> 0 527025 0 100242
0 -> 1 2793 196875
(99.65%)		 242
(0.12%)		 202 394 337
(0.17%)		 118
(35.01%)		 200
(59.35%)		 0
(0.00%)		 19
(5.64%)
1 -> 2 3036 196783
(99.58%)		 340
(0.17%)		 207 410 539
(0.27%)		 216
(40.07%)		 287
(53.25%)		 0
(0.00%)		 36
(6.68%)

Version Parse Nodes Character
Nodes
Count
Count Ambi­guous Irre­usable
Average (0..1) 21531 263
(1.22%)		 8694
(40.38%)		 10138

0 21312 259
(1.22%)		 8602
(40.36%)		 10027
1 21750 267
(1.23%)		 8785
(40.39%)		 10248
2 21750 267
(1.23%)		 8785
(40.39%)		 10248
Version Parse Nodes Shift Breakdown
Created Reused Rebuilt Parse Node Character Node Count Contains Change Irre­usable No Actions Wrong State
Average (1..2) 2078 21215
(98.53%)		 237
(1.10%)		 121 263 316
(1.47%)		 53
(16.55%)		 263
(83.29%)		 0
(0.00%)		 1
(0.16%)
   -> 0 56142 0 10031
0 -> 1 2630 20990
(98.49%)		 234
(1.10%)		 148 360 321
(1.51%)		 66
(20.56%)		 254
(79.13%)		 0
(0.00%)		 1
(0.31%)
1 -> 2 1525 21440
(98.57%)		 239
(1.10%)		 93 166 311
(1.43%)		 39
(12.54%)		 272
(87.46%)		 0
(0.00%)		 0
(0.00%)

Version Parse Nodes Character
Nodes
Count
Count Ambi­guous Irre­usable
Average (0..1) 27218 289
(1.06%)		 12973
(47.66%)		 13760

0 26820 283
(1.06%)		 12790
(47.69%)		 13540
1 27616 295
(1.07%)		 13156
(47.64%)		 13980
2 28023 295
(1.05%)		 13267
(47.34%)		 14154
Version Parse Nodes Shift Breakdown
Created Reused Rebuilt Parse Node Character Node Count Contains Change Irre­usable No Actions Wrong State
Average (1..2) 3480 26809
(98.48%)		 337
(1.25%)		 95 487 399
(1.48%)		 60
(19.65%)		 335
(79.34%)		 0
(0.00%)		 4
(1.01%)
   -> 0 77718 0 13560
0 -> 1 5218 26220
(97.76%)		 530
(1.98%)		 98 693 599
(2.23%)		 63
(10.52%)		 530
(88.48%)		 0
(0.00%)		 6
(1.00%)
1 -> 2 1741 27397
(99.21%)		 143
(0.52%)		 92 280 198
(0.72%)		 57
(28.79%)		 139
(70.20%)		 0
(0.00%)		 2
(1.01%)

Version Parse Nodes Character
Nodes
Count
Count Ambi­guous Irre­usable
Average (0..1) 152742 1104
(0.72%)		 56460
(36.96%)		 79752

0 152430 1100
(0.72%)		 56287
(36.93%)		 79672
1 153053 1108
(0.72%)		 56632
(37.00%)		 79832
2 153054 1108
(0.72%)		 56633
(37.00%)		 79833
Version Parse Nodes Shift Breakdown
Created Reused Rebuilt Parse Node Character Node Count Contains Change Irre­usable No Actions Wrong State
Average (1..2) 7031 151240
(99.02%)		 1297
(0.85%)		 465 829 1450
(0.95%)		 234
(15.02%)		 1102
(79.87%)		 0
(0.00%)		 115
(5.11%)
   -> 0 410868 0 79736
0 -> 1 13306 149645
(98.17%)		 2431
(1.59%)		 804 1562 2681
(1.76%)		 438
(16.34%)		 2018
(75.27%)		 0
(0.00%)		 225
(8.39%)
1 -> 2 756 152835
(99.86%)		 163
(0.11%)		 125 96 219
(0.14%)		 30
(13.70%)		 185
(84.47%)		 0
(0.00%)		 4
(1.83%)

Version Parse Nodes Character
Nodes
Count
Count Ambi­guous Irre­usable
Average (0..1) 163338 1876
(1.15%)		 67470
(41.31%)		 86457

0 163210 1876
(1.15%)		 67445
(41.32%)		 86370
1 163466 1876
(1.15%)		 67495
(41.29%)		 86543
2 163466 1876
(1.15%)		 67495
(41.29%)		 86538
Version Parse Nodes Shift Breakdown
Created Reused Rebuilt Parse Node Character Node Count Contains Change Irre­usable No Actions Wrong State
Average (1..2) 5145 162012
(99.19%)		 1244
(0.76%)		 352 1002 1317
(0.81%)		 46
(3.86%)		 1266
(95.90%)		 0
(0.00%)		 6
(0.24%)
   -> 0 424915 0 86396
0 -> 1 1606 162913
(99.82%)		 279
(0.17%)		 99 412 296
(0.18%)		 13
(4.39%)		 283
(95.61%)		 0
(0.00%)		 0
(0.00%)
1 -> 2 8683 161111
(98.56%)		 2208
(1.35%)		 605 1591 2337
(1.43%)		 78
(3.34%)		 2248
(96.19%)		 0
(0.00%)		 11
(0.47%)

Per Language