2021-04-23 22:19

Contents of config.yml

#shrinkBatchSources: 30
batchSamples: 3
warmupIterations: 3
benchmarkIterations: 3
jsglr2variants:
  - standard
  - elkhound
  - incremental
languages:
  - id: java
    name: Java
    extension: java
    parseTable:
      repo: https://github.com/metaborg/java-front.git
      subDir: lang.java
    sources:
      incremental:
        - id: apache-commons-lang-stringutils
          name: StringUtils
          repo: https://github.com/apache/commons-lang.git
          files:
            - src/main/java/org/apache/commons/lang3/StringUtils.java
          versions: 3 # 16
        - id: gson
          repo: https://github.com/google/gson.git
          versions: 3 # 16
        - id: slf4j
          repo: https://github.com/qos-ch/slf4j.git
          versions: 3 # 16
  - id: webdsl
    name: WebDSL
    extension: app
    parseTable:
      file: ../parsetables/WebDSL.tbl
      subDir: webdslstatix
    sources:
      incremental:
        - id: webdsl-yellowgrass-incremental
          name: YellowGrass
          repo: https://github.com/webdsl/yellowgrass
          fetchOptions:
            - '--depth=200'
          versions: 3 # 16
        - id: webdsl-elib-utils
          name: elib-utils
          repo: https://github.com/webdsl/elib-utils
          versions: 3 # 16
  - id: sdf3
    name: SDF3
    extension: sdf3
    parseTable:
      repo: https://github.com/metaborg/sdf.git
      subDir: org.metaborg.meta.lang.template
    sources:
      incremental:
        - id: nabl
          name: NaBL
          repo: https://github.com/metaborg/nabl
          versions: 3 # 16
        - id: dynsem
          name: DynSem
          repo: https://github.com/metaborg/dynsem
          versions: 3 # 16
        - id: flowspec
          name: FlowSpec
          repo: https://github.com/metaborg/flowspec
          versions: 3 # 16
        - id: webdsl
          name: WebDSL
          repo: https://github.com/webdsl/webdsl-statix.git
          versions: 3 # 16
        - id: java
          name: Java
          repo: https://github.com/metaborg/java-front.git
          versions: 3 # 16

Iterations: 3/3

Spoofax version: master
JSGLR version: reuse-mess-2
SDF version: develop/jsglr2

Language	Parse Nodes			Character Nodes Count
Language	Count	Ambiguous	Irreusable	Character Nodes Count
Average	595582	0.36%	26.52%	332994
Java	1443909	0.00%	18.92%	849158
WebDSL	246893	0.06%	18.78%	99773
SDF3	95945	1.01%	41.87%	50051

Language	Parse Nodes			Shift		Breakdown
Language	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average	83495	93.32%	5.94%	4086	9128	6.61%	56.29%	0.00%	4.14%	39.58%
Java	221537	91.47%	7.73%	11035	23298	8.47%	43.44%	0.00%	0.76%	55.80%
WebDSL	10030	98.20%	1.42%	464	1474	1.68%	62.45%	0.00%	8.59%	28.96%
SDF3	18919	90.30%	8.68%	760	2613	9.70%	62.97%	0.00%	3.06%	33.96%

Per Language

Source	Parse Nodes			Character Nodes Count
Source	Count	Ambiguous	Irreusable	Character Nodes Count
Average	1443909	0.00%	18.92%	849158
StringUtils	571226	0.00%	15.07%	396935
gson	2305879	0.00%	23.22%	1267956
slf4j	1454623	0.00%	18.47%	882583

Source	Parse Nodes			Shift		Breakdown
Source	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average	221537	91.47%	7.73%	11035	23298	8.47%	43.44%	0.00%	0.76%	55.80%
StringUtils	583579	75.60%	22.19%	28920	60136	24.25%	43.47%	0.00%	0.51%	56.02%
gson	24457	99.75%	0.21%	1168	2654	0.25%	47.28%	0.00%	0.62%	52.10%
slf4j	56574	99.06%	0.80%	3016	7105	0.90%	39.57%	0.00%	1.15%	59.28%

Sources

Version	Parse Nodes			Character Nodes Count
Version	Count	Ambiguous	Irreusable	Character Nodes Count
Average (0..1)	571226	0 (0.00%)	86083 (15.07%)	396935

0	571555	0 (0.00%)	86079 (15.06%)	397077
1	570897	0 (0.00%)	86087 (15.08%)	396792
2	570913	0 (0.00%)	86063 (15.07%)	396796

Version	Parse Nodes			Shift		Breakdown
Version	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average (1..2)	583579	431867 (75.60%)	126731 (22.19%)	28920	60136	138525 (24.25%)	60214 (43.47%)	0 (0.00%)	706 (0.51%)	77605 (56.02%)
-> 0	1050282			0	397078
0 -> 1	583485	431545 (75.50%)	126406 (22.12%)	28782	60269	138442 (24.22%)	60050 (43.38%)	0 (0.00%)	1135 (0.82%)	77257 (55.80%)
1 -> 2	583673	432188 (75.70%)	127055 (22.26%)	29057	60002	138607 (24.28%)	60377 (43.56%)	0 (0.00%)	277 (0.20%)	77953 (56.24%)

Version	Parse Nodes			Character Nodes Count
Version	Count	Ambiguous	Irreusable	Character Nodes Count
Average (0..1)	2305879	0 (0.00%)	535339 (23.22%)	1267956

0	2305749	0 (0.00%)	535313 (23.22%)	1267874
1	2306009	0 (0.00%)	535365 (23.22%)	1268038
2	2306176	0 (0.00%)	535403 (23.22%)	1268122

Version	Parse Nodes			Shift		Breakdown
Version	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average (1..2)	24457	2300156 (99.75%)	4793 (0.21%)	1168	2654	5725 (0.25%)	2707 (47.28%)	0 (0.00%)	36 (0.62%)	2983 (52.10%)
-> 0	6379840			0	1268079
0 -> 1	25740	2299825 (99.74%)	4939 (0.21%)	1131	2780	5926 (0.26%)	2806 (47.35%)	0 (0.00%)	37 (0.62%)	3083 (52.02%)
1 -> 2	23173	2300487 (99.76%)	4647 (0.20%)	1205	2528	5524 (0.24%)	2608 (47.21%)	0 (0.00%)	34 (0.62%)	2882 (52.17%)

Version	Parse Nodes			Character Nodes Count
Version	Count	Ambiguous	Irreusable	Character Nodes Count
Average (0..1)	1454623	0 (0.00%)	268672 (18.47%)	882583

0	1453298	0 (0.00%)	268522 (18.48%)	881618
1	1455947	0 (0.00%)	268822 (18.46%)	883547
2	1455688	0 (0.00%)	268754 (18.46%)	883490

Version	Parse Nodes			Shift		Breakdown
Version	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average (1..2)	56574	1441013 (99.06%)	11582 (0.80%)	3016	7105	13078 (0.90%)	5174 (39.57%)	0 (0.00%)	151 (1.15%)	7753 (59.28%)
-> 0	3421848			0	881857
0 -> 1	58007	1440064 (99.09%)	11403 (0.78%)	2961	7891	12850 (0.88%)	5129 (39.91%)	0 (0.00%)	91 (0.71%)	7630 (59.38%)
1 -> 2	55141	1441961 (99.04%)	11761 (0.81%)	3070	6318	13306 (0.91%)	5219 (39.22%)	0 (0.00%)	211 (1.59%)	7876 (59.19%)

Source	Parse Nodes			Character Nodes Count
Source	Count	Ambiguous	Irreusable	Character Nodes Count
Average	246893	0.06%	18.78%	99773
YellowGrass	391904	0.07%	17.78%	159394
elib-utils	101881	0.05%	19.78%	40151

Source	Parse Nodes			Shift		Breakdown
Source	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average	10030	98.20%	1.42%	464	1474	1.68%	62.45%	0.00%	8.59%	28.96%
YellowGrass	14011	98.68%	1.13%	237	1803	1.23%	89.19%	0.00%	4.24%	6.57%
elib-utils	6048	97.72%	1.71%	691	1144	2.13%	35.71%	0.00%	12.93%	51.36%

Version	Parse Nodes			Character Nodes Count
Version	Count	Ambiguous	Irreusable	Character Nodes Count
Average (0..1)	391904	272 (0.07%)	69686 (17.78%)	159394

0	392319	272 (0.07%)	69674 (17.76%)	159532
1	391488	272 (0.07%)	69698 (17.80%)	159255
2	391392	272 (0.07%)	69698 (17.81%)	159227

Version	Parse Nodes			Shift		Breakdown
Version	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average (1..2)	14011	386726 (98.68%)	4437 (1.13%)	237	1803	4815 (1.23%)	4354 (89.19%)	0 (0.00%)	217 (4.24%)	244 (6.57%)
-> 0	684883			0	159584
0 -> 1	19735	384806 (98.08%)	6385 (1.63%)	189	2555	6953 (1.77%)	6396 (91.99%)	0 (0.00%)	335 (4.82%)	222 (3.19%)
1 -> 2	8286	388645 (99.27%)	2488 (0.64%)	284	1051	2676 (0.68%)	2312 (86.40%)	0 (0.00%)	98 (3.66%)	266 (9.94%)

Version	Parse Nodes			Character Nodes Count
Version	Count	Ambiguous	Irreusable	Character Nodes Count
Average (0..1)	101881	48 (0.05%)	20154 (19.78%)	40151

0	101002	48 (0.05%)	20046 (19.85%)	39821
1	102759	48 (0.05%)	20262 (19.72%)	40480
2	103029	48 (0.05%)	20322 (19.72%)	40589

Version	Parse Nodes			Shift		Breakdown
Version	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average (1..2)	6048	99566 (97.72%)	1738 (1.71%)	691	1144	2162 (2.13%)	723 (35.71%)	0 (0.00%)	306 (12.93%)	1134 (51.36%)
-> 0	181055			0	39838
0 -> 1	6684	98052 (97.08%)	2060 (2.04%)	742	1423	2671 (2.64%)	694 (25.98%)	0 (0.00%)	484 (18.12%)	1493 (55.90%)
1 -> 2	5412	101079 (98.37%)	1416 (1.38%)	639	864	1653 (1.61%)	751 (45.43%)	0 (0.00%)	128 (7.74%)	774 (46.82%)

Source	Parse Nodes			Character Nodes Count
Source	Count	Ambiguous	Irreusable	Character Nodes Count
Average	95945	1.01%	41.87%	50051
NaBL	194260	0.88%	39.69%	98548
DynSem	21531	1.22%	40.38%	10138
FlowSpec	27218	1.06%	47.66%	13760
WebDSL	162860	1.14%	41.38%	86161
Java	73854	0.76%	40.24%	41650

Source	Parse Nodes			Shift		Breakdown
Source	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average	18919	90.30%	8.68%	760	2613	9.70%	62.97%	0.00%	3.06%	33.96%
NaBL	25743	96.78%	2.94%	1051	3176	3.22%	62.56%	0.00%	1.31%	36.14%
DynSem	20336	72.38%	24.59%	997	2418	27.61%	61.48%	0.00%	0.85%	37.67%
FlowSpec	11629	89.93%	8.88%	341	1530	10.05%	72.89%	0.00%	3.09%	24.02%
WebDSL	34667	93.22%	6.22%	1272	5611	6.77%	61.12%	0.00%	0.50%	38.38%
Java	2221	99.17%	0.76%	141	330	0.83%	56.81%	0.00%	9.58%	33.61%

Sources

Version	Parse Nodes			Character Nodes Count
Version	Count	Ambiguous	Irreusable	Character Nodes Count
Average (0..1)	194260	1707 (0.88%)	77098 (39.69%)	98548

0	194255	1707 (0.88%)	77096 (39.69%)	98540
1	194265	1707 (0.88%)	77099 (39.69%)	98556
2	194617	1717 (0.88%)	77231 (39.68%)	98731

Version	Parse Nodes			Shift		Breakdown
Version	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average (1..2)	25743	188000 (96.78%)	5702 (2.94%)	1051	3176	6263 (3.22%)	4145 (62.56%)	0 (0.00%)	37 (1.31%)	2081 (36.14%)
-> 0	521447			0	98667
0 -> 1	45911	183197 (94.31%)	10084 (5.19%)	1826	5448	11060 (5.69%)	7443 (67.30%)	0 (0.00%)	40 (0.36%)	3577 (32.34%)
1 -> 2	5575	192802 (99.25%)	1320 (0.68%)	275	904	1465 (0.75%)	847 (57.82%)	0 (0.00%)	33 (2.25%)	585 (39.93%)

Version	Parse Nodes			Character Nodes Count
Version	Count	Ambiguous	Irreusable	Character Nodes Count
Average (0..1)	21531	263 (1.22%)	8694 (40.38%)	10138

0	21312	259 (1.22%)	8602 (40.36%)	10027
1	21750	267 (1.23%)	8785 (40.39%)	10248
2	21750	267 (1.23%)	8785 (40.39%)	10248

Version	Parse Nodes			Shift		Breakdown
Version	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average (1..2)	20336	15584 (72.38%)	5296 (24.59%)	997	2418	5946 (27.61%)	3656 (61.48%)	0 (0.00%)	50 (0.85%)	2240 (37.67%)
-> 0	56142			0	10031
0 -> 1	20555	15479 (72.63%)	5177 (24.29%)	984	2482	5837 (27.39%)	3581 (61.35%)	0 (0.00%)	71 (1.22%)	2185 (37.43%)
1 -> 2	20117	15689 (72.13%)	5414 (24.89%)	1010	2353	6054 (27.83%)	3730 (61.61%)	0 (0.00%)	29 (0.48%)	2295 (37.91%)

Version	Parse Nodes			Character Nodes Count
Version	Count	Ambiguous	Irreusable	Character Nodes Count
Average (0..1)	27218	289 (1.06%)	12973 (47.66%)	13760

0	26820	283 (1.06%)	12790 (47.69%)	13540
1	27616	295 (1.07%)	13156 (47.64%)	13980
2	28023	295 (1.05%)	13267 (47.34%)	14154

Version	Parse Nodes			Shift		Breakdown
Version	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average (1..2)	11629	24457 (89.93%)	2435 (8.88%)	341	1530	2756 (10.05%)	1911 (72.89%)	0 (0.00%)	58 (3.09%)	788 (24.02%)
-> 0	77718			0	13560
0 -> 1	7491	25536 (95.21%)	1169 (4.36%)	112	1105	1296 (4.83%)	1032 (79.63%)	0 (0.00%)	64 (4.94%)	200 (15.43%)
1 -> 2	15767	23377 (84.65%)	3701 (13.40%)	570	1954	4216 (15.27%)	2789 (66.15%)	0 (0.00%)	52 (1.23%)	1375 (32.61%)

Version	Parse Nodes			Character Nodes Count
Version	Count	Ambiguous	Irreusable	Character Nodes Count
Average (0..1)	162860	1864 (1.14%)	67390 (41.38%)	86161

0	162878	1864 (1.14%)	67403 (41.38%)	86167
1	162841	1864 (1.14%)	67376 (41.38%)	86154
2	163063	1868 (1.15%)	67436 (41.36%)	86285

Version	Parse Nodes			Shift		Breakdown
Version	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average (1..2)	34667	151824 (93.22%)	10125 (6.22%)	1272	5611	11023 (6.77%)	6686 (61.12%)	0 (0.00%)	35 (0.50%)	4303 (38.38%)
-> 0	424536			0	86193
0 -> 1	60581	143507 (88.11%)	17801 (10.93%)	2183	9734	19343 (11.88%)	11703 (60.50%)	0 (0.00%)	49 (0.25%)	7591 (39.24%)
1 -> 2	8752	160140 (98.34%)	2448 (1.50%)	361	1488	2703 (1.66%)	1669 (61.75%)	0 (0.00%)	20 (0.74%)	1014 (37.51%)

Version	Parse Nodes			Character Nodes Count
Version	Count	Ambiguous	Irreusable	Character Nodes Count
Average (0..1)	73854	559 (0.76%)	29718 (40.24%)	41650

0	73857	559 (0.76%)	29718 (40.24%)	41651
1	73851	559 (0.76%)	29718 (40.24%)	41649
2	73852	559 (0.76%)	29718 (40.24%)	41649

Version	Parse Nodes			Shift		Breakdown
Version	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average (1..2)	2221	73240 (99.17%)	560 (0.76%)	141	330	613 (0.83%)	409 (56.81%)	0 (0.00%)	40 (9.58%)	164 (33.61%)
-> 0	197675			0	41712
0 -> 1	3486	72951 (98.77%)	813 (1.10%)	152	481	902 (1.22%)	702 (77.83%)	0 (0.00%)	28 (3.10%)	172 (19.07%)
1 -> 2	956	73529 (99.56%)	307 (0.42%)	129	178	324 (0.44%)	116 (35.80%)	0 (0.00%)	52 (16.05%)	156 (48.15%)