2021-05-26 02:31

Contents of config.yml

#shrinkBatchSources: 30
batchSamples: 3
warmupIterations: 3
benchmarkIterations: 3
jsglr2variants:
  - standard
  - elkhound
  - incremental
languages:
  - id: java
    name: Java
    extension: java
    parseTable:
      repo: https://github.com/metaborg/java-front.git
      subDir: lang.java
    sources:
      incremental:
        - id: apache-commons-lang-stringutils
          name: StringUtils
          repo: https://github.com/apache/commons-lang.git
          files:
            - src/main/java/org/apache/commons/lang3/StringUtils.java
          versions: 3 # 16
        - id: gson
          repo: https://github.com/google/gson.git
          versions: 3 # 16
        - id: slf4j
          repo: https://github.com/qos-ch/slf4j.git
          versions: 3 # 16
  - id: webdsl
    name: WebDSL
    extension: app
    parseTable:
      file: ../parsetables/WebDSL.tbl
      subDir: webdslstatix
    sources:
      incremental:
        - id: webdsl-yellowgrass-incremental
          name: YellowGrass
          repo: https://github.com/webdsl/yellowgrass
          fetchOptions:
            - '--depth=200'
          versions: 3 # 16
        - id: webdsl-elib-utils
          name: elib-utils
          repo: https://github.com/webdsl/elib-utils
          versions: 3 # 16
  - id: sdf3
    name: SDF3
    extension: sdf3
    parseTable:
      repo: https://github.com/metaborg/sdf.git
      subDir: org.metaborg.meta.lang.template
    sources:
      incremental:
        - id: nabl
          name: NaBL
          repo: https://github.com/metaborg/nabl
          versions: 3 # 16
        - id: dynsem
          name: DynSem
          repo: https://github.com/metaborg/dynsem
          versions: 3 # 16
        - id: flowspec
          name: FlowSpec
          repo: https://github.com/metaborg/flowspec
          versions: 3 # 16
        - id: webdsl
          name: WebDSL
          repo: https://github.com/webdsl/webdsl-statix.git
          versions: 3 # 16
        - id: java
          name: Java
          repo: https://github.com/metaborg/java-front.git
          versions: 3 # 16

Iterations: 3/3

Spoofax version: master
JSGLR version: reuse-mess-7
SDF version: reuse-mess-6

Language	Parse Nodes			Character Nodes Count
Language	Count	Ambiguous	Irreusable	Character Nodes Count
Average	597126	0.35%	26.67%	333369
Java	1447027	0.00%	19.09%	849194
WebDSL	246661	0.06%	18.79%	99696
SDF3	97689	1.00%	42.14%	51218

Language	Parse Nodes			Shift		Breakdown
Language	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average	9573	99.34%	0.43%	729	1102	0.47%	91.83%	0.00%	0.00%	8.17%
Java	21058	99.42%	0.40%	1564	2154	0.44%	89.65%	0.00%	0.00%	10.35%
WebDSL	5307	99.35%	0.34%	492	786	0.38%	90.35%	0.00%	0.00%	9.65%
SDF3	2354	99.24%	0.56%	130	365	0.60%	95.51%	0.00%	0.00%	4.49%

Per Language

Source	Parse Nodes			Character Nodes Count
Source	Count	Ambiguous	Irreusable	Character Nodes Count
Average	1447027	0.00%	19.09%	849194
StringUtils	572580	0.00%	15.27%	396935
gson	2310611	0.00%	23.36%	1268065
slf4j	1457890	0.00%	18.64%	882583

Source	Parse Nodes			Shift		Breakdown
Source	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average	21058	99.42%	0.40%	1564	2154	0.44%	89.65%	0.00%	0.00%	10.35%
StringUtils	38670	98.56%	1.06%	2836	3005	1.17%	92.18%	0.00%	0.00%	7.82%
gson	11992	99.86%	0.03%	659	1456	0.04%	90.81%	0.00%	0.00%	9.19%
slf4j	12512	99.83%	0.10%	1198	2002	0.12%	85.95%	0.00%	0.00%	14.05%

Sources

Version	Parse Nodes			Character Nodes Count
Version	Count	Ambiguous	Irreusable	Character Nodes Count
Average (0..1)	572580	0 (0.00%)	87440 (15.27%)	396935

0	572909	0 (0.00%)	87432 (15.26%)	397077
1	572251	0 (0.00%)	87448 (15.28%)	396792
2	572267	0 (0.00%)	87424 (15.28%)	396796

Version	Parse Nodes			Shift		Breakdown
Version	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average (1..2)	38670	564315 (98.56%)	6067 (1.06%)	2836	3005	6724 (1.17%)	6202 (92.18%)	0 (0.00%)	0 (0.00%)	522 (7.82%)
-> 0	1052719			0	397078
0 -> 1	56908	560813 (97.89%)	8418 (1.47%)	3970	4014	9393 (1.64%)	8672 (92.32%)	0 (0.00%)	0 (0.00%)	721 (7.68%)
1 -> 2	20432	567817 (99.23%)	3715 (0.65%)	1702	1995	4055 (0.71%)	3732 (92.03%)	0 (0.00%)	0 (0.00%)	323 (7.97%)

Version	Parse Nodes			Character Nodes Count
Version	Count	Ambiguous	Irreusable	Character Nodes Count
Average (0..1)	2310611	0 (0.00%)	539793 (23.36%)	1268065

0	2309965	0 (0.00%)	539656 (23.36%)	1267740
1	2311257	0 (0.00%)	539929 (23.36%)	1268390
2	2310257	0 (0.00%)	539672 (23.36%)	1268008

Version	Parse Nodes			Shift		Breakdown
Version	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average (1..2)	11992	2307430 (99.86%)	697 (0.03%)	659	1456	858 (0.04%)	775 (90.81%)	0 (0.00%)	0 (0.00%)	83 (9.19%)
-> 0	6387913			0	1267945
0 -> 1	14571	2306962 (99.87%)	848 (0.04%)	785	1958	1026 (0.04%)	909 (88.60%)	0 (0.00%)	0 (0.00%)	117 (11.40%)
1 -> 2	9413	2307897 (99.85%)	545 (0.02%)	532	954	689 (0.03%)	641 (93.03%)	0 (0.00%)	0 (0.00%)	48 (6.97%)

Version	Parse Nodes			Character Nodes Count
Version	Count	Ambiguous	Irreusable	Character Nodes Count
Average (0..1)	1457890	0 (0.00%)	271710 (18.64%)	882583

0	1456563	0 (0.00%)	271528 (18.64%)	881618
1	1459217	0 (0.00%)	271891 (18.63%)	883547
2	1458960	0 (0.00%)	271825 (18.63%)	883490

Version	Parse Nodes			Shift		Breakdown
Version	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average (1..2)	12512	1455436 (99.83%)	1494 (0.10%)	1198	2002	1771 (0.12%)	1522 (85.95%)	0 (0.00%)	0 (0.00%)	249 (14.05%)
-> 0	3428545			0	881857
0 -> 1	14608	1454393 (99.85%)	1411 (0.10%)	1158	2849	1694 (0.12%)	1449 (85.54%)	0 (0.00%)	0 (0.00%)	245 (14.46%)
1 -> 2	10415	1456479 (99.81%)	1577 (0.11%)	1238	1154	1847 (0.13%)	1595 (86.36%)	0 (0.00%)	0 (0.00%)	252 (13.64%)

Source	Parse Nodes			Character Nodes Count
Source	Count	Ambiguous	Irreusable	Character Nodes Count
Average	246661	0.06%	18.79%	99696
YellowGrass	391440	0.07%	17.81%	159241
elib-utils	101881	0.05%	19.78%	40151

Source	Parse Nodes			Shift		Breakdown
Source	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average	5307	99.35%	0.34%	492	786	0.38%	90.35%	0.00%	0.00%	9.65%
YellowGrass	7519	99.53%	0.37%	547	1042	0.38%	85.96%	0.00%	0.00%	14.04%
elib-utils	3094	99.18%	0.32%	436	529	0.37%	94.74%	0.00%	0.00%	5.26%

Version	Parse Nodes			Character Nodes Count
Version	Count	Ambiguous	Irreusable	Character Nodes Count
Average (0..1)	391440	272 (0.07%)	69698 (17.81%)	159241

0	391488	272 (0.07%)	69698 (17.80%)	159255
1	391392	272 (0.07%)	69698 (17.81%)	159227
2	393245	272 (0.07%)	70053 (17.81%)	159948

Version	Parse Nodes			Shift		Breakdown
Version	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average (1..2)	7519	389587 (99.53%)	1444 (0.37%)	547	1042	1485 (0.38%)	1366 (85.96%)	0 (0.00%)	0 (0.00%)	119 (14.04%)
-> 0	684076			0	159307
0 -> 1	7530	389083 (99.39%)	2053 (0.52%)	159	935	2140 (0.55%)	2133 (99.67%)	0 (0.00%)	0 (0.00%)	7 (0.33%)
1 -> 2	7508	390090 (99.67%)	835 (0.21%)	934	1149	829 (0.21%)	599 (72.26%)	0 (0.00%)	0 (0.00%)	230 (27.74%)

Version	Parse Nodes			Character Nodes Count
Version	Count	Ambiguous	Irreusable	Character Nodes Count
Average (0..1)	101881	48 (0.05%)	20154 (19.78%)	40151

0	101002	48 (0.05%)	20046 (19.85%)	39821
1	102759	48 (0.05%)	20262 (19.72%)	40480
2	103029	48 (0.05%)	20322 (19.72%)	40589

Version	Parse Nodes			Shift		Breakdown
Version	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average (1..2)	3094	101046 (99.18%)	319 (0.32%)	436	529	376 (0.37%)	373 (94.74%)	0 (0.00%)	0 (0.00%)	3 (5.26%)
-> 0	181055			0	39838
0 -> 1	5185	99545 (98.56%)	567 (0.56%)	751	900	694 (0.69%)	694 (100.00%)	0 (0.00%)	0 (0.00%)	0 (0.00%)
1 -> 2	1002	102547 (99.79%)	71 (0.07%)	120	158	57 (0.06%)	51 (89.47%)	0 (0.00%)	0 (0.00%)	6 (10.53%)

Source	Parse Nodes			Character Nodes Count
Source	Count	Ambiguous	Irreusable	Character Nodes Count
Average	97689	1.00%	42.14%	51218
NaBL	197596	0.87%	39.75%	100132
DynSem	21531	1.22%	40.38%	10138
FlowSpec	27218	1.06%	47.66%	13760
WebDSL	163111	1.15%	41.35%	86308
Java	78990	0.72%	41.56%	45752

Source	Parse Nodes			Shift		Breakdown
Source	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average	2354	99.24%	0.56%	130	365	0.60%	95.51%	0.00%	0.00%	4.49%
NaBL	3123	99.58%	0.18%	209	438	0.17%	89.73%	0.00%	0.00%	10.27%
DynSem	2079	98.53%	1.10%	120	266	1.23%	99.62%	0.00%	0.00%	0.38%
FlowSpec	3480	98.48%	1.25%	95	487	1.28%	97.86%	0.00%	0.00%	2.14%
WebDSL	2269	99.63%	0.29%	162	398	0.31%	94.81%	0.00%	0.00%	5.19%
Java	819			65	238

Sources

Version	Parse Nodes			Character Nodes Count
Version	Count	Ambiguous	Irreusable	Character Nodes Count
Average (0..1)	197596	1717 (0.87%)	78553 (39.75%)	100132

0	197574	1717 (0.87%)	78553 (39.76%)	100115
1	197617	1717 (0.87%)	78553 (39.75%)	100148
2	197574	1717 (0.87%)	78553 (39.76%)	100115

Version	Parse Nodes			Shift		Breakdown
Version	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average (1..2)	3123	196762 (99.58%)	350 (0.18%)	209	438	342 (0.17%)	307 (89.73%)	0 (0.00%)	0 (0.00%)	36 (10.27%)
-> 0	527025			0	100242
0 -> 1	3112	196774 (99.60%)	331 (0.17%)	208	449	323 (0.16%)	296 (91.64%)	0 (0.00%)	0 (0.00%)	27 (8.36%)
1 -> 2	3133	196750 (99.56%)	369 (0.19%)	210	427	361 (0.18%)	317 (87.81%)	0 (0.00%)	0 (0.00%)	44 (12.19%)

Version	Parse Nodes			Character Nodes Count
Version	Count	Ambiguous	Irreusable	Character Nodes Count
Average (0..1)	21531	263 (1.22%)	8694 (40.38%)	10138

0	21312	259 (1.22%)	8602 (40.36%)	10027
1	21750	267 (1.23%)	8785 (40.39%)	10248
2	21750	267 (1.23%)	8785 (40.39%)	10248

Version	Parse Nodes			Shift		Breakdown
Version	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average (1..2)	2079	21215 (98.53%)	237 (1.10%)	120	266	265 (1.23%)	264 (99.62%)	0 (0.00%)	0 (0.00%)	1 (0.38%)
-> 0	56142			0	10031
0 -> 1	2630	20990 (98.49%)	234 (1.10%)	148	360	255 (1.20%)	254 (99.61%)	0 (0.00%)	0 (0.00%)	1 (0.39%)
1 -> 2	1528	21439 (98.57%)	240 (1.10%)	92	172	275 (1.26%)	274 (99.64%)	0 (0.00%)	0 (0.00%)	1 (0.36%)

Version	Parse Nodes			Character Nodes Count
Version	Count	Ambiguous	Irreusable	Character Nodes Count
Average (0..1)	27218	289 (1.06%)	12973 (47.66%)	13760

0	26820	283 (1.06%)	12790 (47.69%)	13540
1	27616	295 (1.07%)	13156 (47.64%)	13980
2	28023	295 (1.05%)	13267 (47.34%)	14154

Version	Parse Nodes			Shift		Breakdown
Version	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average (1..2)	3480	26809 (98.48%)	337 (1.25%)	95	487	346 (1.28%)	339 (97.86%)	0 (0.00%)	0 (0.00%)	8 (2.14%)
-> 0	77718			0	13560
0 -> 1	5218	26220 (97.76%)	530 (1.98%)	98	693	548 (2.04%)	536 (97.81%)	0 (0.00%)	0 (0.00%)	12 (2.19%)
1 -> 2	1741	27397 (99.21%)	143 (0.52%)	92	280	144 (0.52%)	141 (97.92%)	0 (0.00%)	0 (0.00%)	3 (2.08%)

Version	Parse Nodes			Character Nodes Count
Version	Count	Ambiguous	Irreusable	Character Nodes Count
Average (0..1)	163111	1872 (1.15%)	67441 (41.35%)	86308

0	163063	1868 (1.15%)	67436 (41.36%)	86285
1	163158	1876 (1.15%)	67445 (41.34%)	86330
2	163210	1876 (1.15%)	67445 (41.32%)	86370

Version	Parse Nodes			Shift		Breakdown
Version	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average (1..2)	2269	162502 (99.63%)	473 (0.29%)	162	398	513 (0.31%)	484 (94.81%)	0 (0.00%)	0 (0.00%)	29 (5.19%)
-> 0	424999			0	86311
0 -> 1	2905	162226 (99.49%)	622 (0.38%)	192	514	680 (0.42%)	637 (93.68%)	0 (0.00%)	0 (0.00%)	43 (6.32%)
1 -> 2	1632	162778 (99.77%)	324 (0.20%)	132	281	345 (0.21%)	331 (95.94%)	0 (0.00%)	0 (0.00%)	14 (4.06%)

Version	Parse Nodes			Character Nodes Count
Version	Count	Ambiguous	Irreusable	Character Nodes Count
Average (0..1)	78990	568 (0.72%)	32826 (41.56%)	45752

0	78990	568 (0.72%)	32826 (41.56%)	45752
1	78990	568 (0.72%)	32826 (41.56%)	45752
2	79810	581 (0.73%)	33085 (41.45%)	46227

Version	Parse Nodes			Shift		Breakdown
Version	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average (1..2)	819	78990 (100.00%)	5 (0.01%)	65	238	0 (0.00%)	0 (NaN%)	0 (NaN%)	0 (NaN%)	0 (NaN%)
-> 0	210915			0	45817
0 -> 1	0			65	0
1 -> 2	1637			65	476