2021-04-23 09:23

Contents of config.yml

#shrinkBatchSources: 30
batchSamples: 3
warmupIterations: 3
benchmarkIterations: 3
jsglr2variants:
  - standard
  - elkhound
  - incremental
languages:
  - id: java
    name: Java
    extension: java
    parseTable:
      repo: https://github.com/metaborg/java-front.git
      subDir: lang.java
    sources:
      incremental:
        - id: apache-commons-lang-stringutils
          name: StringUtils
          repo: https://github.com/apache/commons-lang.git
          files:
            - src/main/java/org/apache/commons/lang3/StringUtils.java
          versions: 3 # 16
        - id: gson
          repo: https://github.com/google/gson.git
          versions: 3 # 16
        - id: slf4j
          repo: https://github.com/qos-ch/slf4j.git
          versions: 3 # 16
  - id: webdsl
    name: WebDSL
    extension: app
    parseTable:
      file: ../parsetables/WebDSL.tbl
      subDir: webdslstatix
    sources:
      incremental:
        - id: webdsl-yellowgrass-incremental
          name: YellowGrass
          repo: https://github.com/webdsl/yellowgrass
          fetchOptions:
            - '--depth=200'
          versions: 3 # 16
        - id: webdsl-elib-utils
          name: elib-utils
          repo: https://github.com/webdsl/elib-utils
          versions: 3 # 16
  - id: sdf3
    name: SDF3
    extension: sdf3
    parseTable:
      repo: https://github.com/metaborg/sdf.git
      subDir: org.metaborg.meta.lang.template
    sources:
      incremental:
        - id: nabl
          name: NaBL
          repo: https://github.com/metaborg/nabl
          versions: 3 # 16
        - id: dynsem
          name: DynSem
          repo: https://github.com/metaborg/dynsem
          versions: 3 # 16
        - id: flowspec
          name: FlowSpec
          repo: https://github.com/metaborg/flowspec
          versions: 3 # 16
        - id: webdsl
          name: WebDSL
          repo: https://github.com/webdsl/webdsl-statix.git
          versions: 3 # 16
        - id: java
          name: Java
          repo: https://github.com/metaborg/java-front.git
          versions: 3 # 16

Iterations: 3/3

Spoofax version: master
JSGLR version: develop/jsglr2
SDF version: develop/jsglr2

Language	Parse Nodes			Character Nodes Count
Language	Count	Ambiguous	Irreusable	Character Nodes Count
Average	595581	0.36%	33.17%	332986
Java	1444012	0.00%	27.54%	849201
WebDSL	246893	0.06%	24.99%	99773
SDF3	95837	1.01%	46.98%	49984

Language	Parse Nodes			Shift		Breakdown
Language	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average	7855	99.07%	0.71%	602	1044	0.86%	71.56%	0.00%	17.12%	11.32%
Java	10272	99.54%	0.36%	1332	1242	0.41%	70.91%	0.00%	15.29%	13.80%
WebDSL	8472	98.87%	0.78%	255	1196	1.00%	68.44%	0.00%	23.16%	8.40%
SDF3	4822	98.81%	1.00%	219	693	1.17%	75.34%	0.00%	12.91%	11.75%

Per Language

Source	Parse Nodes			Character Nodes Count
Source	Count	Ambiguous	Irreusable	Character Nodes Count
Average	1444012	0.00%	27.54%	849201
StringUtils	571535	0.00%	21.55%	397063
gson	2305879	0.00%	33.46%	1267956
slf4j	1454623	0.00%	27.62%	882583

Source	Parse Nodes			Shift		Breakdown
Source	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average	10272	99.54%	0.36%	1332	1242	0.41%	70.91%	0.00%	15.29%	13.80%
StringUtils	23351	98.70%	1.03%	3102	2078	1.16%	63.92%	0.00%	10.75%	25.34%
gson	1600	99.99%	0.01%	325	220	0.01%	76.67%	0.00%	13.43%	9.90%
slf4j	5865	99.92%	0.04%	569	1429	0.05%	72.13%	0.00%	21.70%	6.17%

Sources

Version	Parse Nodes			Character Nodes Count
Version	Count	Ambiguous	Irreusable	Character Nodes Count
Average (0..1)	571535	0 (0.00%)	123170 (21.55%)	397063

0	571514	0 (0.00%)	123168 (21.55%)	397048
1	571555	0 (0.00%)	123172 (21.55%)	397077
2	570897	0 (0.00%)	123206 (21.58%)	396792

Version	Parse Nodes			Shift		Breakdown
Version	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average (1..2)	23351	564127 (98.70%)	5888 (1.03%)	3102	2078	6650 (1.16%)	4918 (63.92%)	0 (0.00%)	714 (10.75%)	1019 (25.34%)
-> 0	1050237			0	397049
0 -> 1	5228	568857 (99.54%)	2437 (0.43%)	979	1327	2709 (0.47%)	1273 (46.99%)	0 (0.00%)	292 (10.78%)	1144 (42.23%)
1 -> 2	41474	559396 (97.87%)	9338 (1.63%)	5225	2828	10591 (1.85%)	8562 (80.84%)	0 (0.00%)	1135 (10.72%)	894 (8.44%)

Version	Parse Nodes			Character Nodes Count
Version	Count	Ambiguous	Irreusable	Character Nodes Count
Average (0..1)	2305879	0 (0.00%)	771515 (33.46%)	1267956

0	2305749	0 (0.00%)	771476 (33.46%)	1267874
1	2306009	0 (0.00%)	771553 (33.46%)	1268038
2	2306176	0 (0.00%)	771609 (33.46%)	1268122

Version	Parse Nodes			Shift		Breakdown
Version	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average (1..2)	1600	2305591 (99.99%)	235 (0.01%)	325	220	290 (0.01%)	221 (76.67%)	0 (0.00%)	36 (13.43%)	34 (9.90%)
-> 0	6379840			0	1268079
0 -> 1	1250	2305542 (99.99%)	174 (0.01%)	336	214	209 (0.01%)	165 (78.95%)	0 (0.00%)	37 (17.70%)	7 (3.35%)
1 -> 2	1950	2305640 (99.98%)	295 (0.01%)	313	226	371 (0.02%)	276 (74.39%)	0 (0.00%)	34 (9.16%)	61 (16.44%)

Version	Parse Nodes			Character Nodes Count
Version	Count	Ambiguous	Irreusable	Character Nodes Count
Average (0..1)	1454623	0 (0.00%)	401737 (27.62%)	882583

0	1453298	0 (0.00%)	401497 (27.63%)	881618
1	1455947	0 (0.00%)	401976 (27.61%)	883547
2	1455688	0 (0.00%)	401844 (27.61%)	883490

Version	Parse Nodes			Shift		Breakdown
Version	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average (1..2)	5865	1453413 (99.92%)	539 (0.04%)	569	1429	678 (0.05%)	486 (72.13%)	0 (0.00%)	151 (21.70%)	41 (6.17%)
-> 0	3421848			0	881857
0 -> 1	8103	1452291 (99.93%)	519 (0.04%)	555	2326	623 (0.04%)	484 (77.69%)	0 (0.00%)	91 (14.61%)	48 (7.70%)
1 -> 2	3626	1454534 (99.90%)	559 (0.04%)	583	532	733 (0.05%)	488 (66.58%)	0 (0.00%)	211 (28.79%)	34 (4.64%)

Source	Parse Nodes			Character Nodes Count
Source	Count	Ambiguous	Irreusable	Character Nodes Count
Average	246893	0.06%	24.99%	99773
YellowGrass	391904	0.07%	25.10%	159394
elib-utils	101881	0.05%	24.88%	40151

Source	Parse Nodes			Shift		Breakdown
Source	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average	8472	98.87%	0.78%	255	1196	1.00%	68.44%	0.00%	23.16%	8.40%
YellowGrass	13633	98.73%	1.08%	208	1716	1.18%	92.83%	0.00%	4.49%	2.68%
elib-utils	3311	99.02%	0.48%	301	676	0.83%	44.06%	0.00%	41.83%	14.12%

Version	Parse Nodes			Character Nodes Count
Version	Count	Ambiguous	Irreusable	Character Nodes Count
Average (0..1)	391904	272 (0.07%)	98376 (25.10%)	159394

0	392319	272 (0.07%)	98365 (25.07%)	159532
1	391488	272 (0.07%)	98386 (25.13%)	159255
2	391392	272 (0.07%)	98387 (25.14%)	159227

Version	Parse Nodes			Shift		Breakdown
Version	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average (1..2)	13633	386930 (98.73%)	4240 (1.08%)	208	1716	4611 (1.18%)	4322 (92.83%)	0 (0.00%)	217 (4.49%)	72 (2.68%)
-> 0	684883			0	159584
0 -> 1	19471	384958 (98.12%)	6244 (1.59%)	167	2463	6801 (1.73%)	6444 (94.75%)	0 (0.00%)	335 (4.93%)	22 (0.32%)
1 -> 2	7794	388901 (99.34%)	2235 (0.57%)	248	969	2420 (0.62%)	2200 (90.91%)	0 (0.00%)	98 (4.05%)	122 (5.04%)

Version	Parse Nodes			Character Nodes Count
Version	Count	Ambiguous	Irreusable	Character Nodes Count
Average (0..1)	101881	48 (0.05%)	25351 (24.88%)	40151

0	101002	48 (0.05%)	25179 (24.93%)	39821
1	102759	48 (0.05%)	25523 (24.84%)	40480
2	103029	48 (0.05%)	25611 (24.86%)	40589

Version	Parse Nodes			Shift		Breakdown
Version	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average (1..2)	3311	100884 (99.02%)	481 (0.48%)	301	676	844 (0.83%)	400 (44.06%)	0 (0.00%)	306 (41.83%)	138 (14.12%)
-> 0	181055			0	39838
0 -> 1	5449	99293 (98.31%)	819 (0.81%)	501	1157	1430 (1.42%)	698 (48.81%)	0 (0.00%)	484 (33.85%)	248 (17.34%)
1 -> 2	1172	102475 (99.72%)	143 (0.14%)	101	195	257 (0.25%)	101 (39.30%)	0 (0.00%)	128 (49.81%)	28 (10.89%)

Source	Parse Nodes			Character Nodes Count
Source	Count	Ambiguous	Irreusable	Character Nodes Count
Average	95837	1.01%	46.98%	49984
NaBL	194260	0.88%	45.68%	98548
DynSem	21531	1.22%	45.15%	10138
FlowSpec	27218	1.06%	52.78%	13760
WebDSL	162321	1.13%	45.02%	85822
Java	73854	0.76%	46.28%	41650

Source	Parse Nodes			Shift		Breakdown
Source	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average	4822	98.81%	1.00%	219	693	1.17%	75.34%	0.00%	12.91%	11.75%
NaBL	9254	99.23%	0.70%	421	976	0.77%	87.54%	0.00%	7.35%	5.11%
DynSem	2639	97.69%	1.94%	128	347	2.31%	83.90%	0.00%	9.70%	6.40%
FlowSpec	2683	99.04%	0.77%	82	442	0.94%	54.25%	0.00%	23.32%	22.43%
WebDSL	8578	98.48%	1.25%	343	1559	1.46%	83.72%	0.00%	9.55%	6.73%
Java	958	99.64%	0.34%	122	141	0.36%	67.32%	0.00%	14.64%	18.05%

Sources

Version	Parse Nodes			Character Nodes Count
Version	Count	Ambiguous	Irreusable	Character Nodes Count
Average (0..1)	194260	1707 (0.88%)	88736 (45.68%)	98548

0	194255	1707 (0.88%)	88733 (45.68%)	98540
1	194265	1707 (0.88%)	88738 (45.68%)	98556
2	194617	1717 (0.88%)	88870 (45.66%)	98731

Version	Parse Nodes			Shift		Breakdown
Version	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average (1..2)	9254	192765 (99.23%)	1357 (0.70%)	421	976	1498 (0.77%)	1406 (87.54%)	0 (0.00%)	37 (7.35%)	55 (5.11%)
-> 0	521447			0	98667
0 -> 1	16481	191511 (98.59%)	2515 (1.29%)	652	1639	2746 (1.41%)	2613 (95.16%)	0 (0.00%)	40 (1.46%)	93 (3.39%)
1 -> 2	2026	194018 (99.87%)	199 (0.10%)	189	313	249 (0.13%)	199 (79.92%)	0 (0.00%)	33 (13.25%)	17 (6.83%)

Version	Parse Nodes			Character Nodes Count
Version	Count	Ambiguous	Irreusable	Character Nodes Count
Average (0..1)	21531	263 (1.22%)	9721 (45.15%)	10138

0	21312	259 (1.22%)	9621 (45.14%)	10027
1	21750	267 (1.23%)	9820 (45.15%)	10248
2	21750	267 (1.23%)	9820 (45.15%)	10248

Version	Parse Nodes			Shift		Breakdown
Version	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average (1..2)	2639	21034 (97.69%)	418 (1.94%)	128	347	496 (2.31%)	415 (83.90%)	0 (0.00%)	50 (9.70%)	31 (6.40%)
-> 0	56142			0	10031
0 -> 1	3345	20757 (97.40%)	467 (2.19%)	174	449	559 (2.62%)	459 (82.11%)	0 (0.00%)	71 (12.70%)	29 (5.19%)
1 -> 2	1933	21310 (97.98%)	369 (1.70%)	81	244	433 (1.99%)	371 (85.68%)	0 (0.00%)	29 (6.70%)	33 (7.62%)

Version	Parse Nodes			Character Nodes Count
Version	Count	Ambiguous	Irreusable	Character Nodes Count
Average (0..1)	27218	289 (1.06%)	14365 (52.78%)	13760

0	26820	283 (1.06%)	14137 (52.71%)	13540
1	27616	295 (1.07%)	14593 (52.84%)	13980
2	28023	295 (1.05%)	14731 (52.57%)	14154

Version	Parse Nodes			Shift		Breakdown
Version	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average (1..2)	2683	26956 (99.04%)	211 (0.77%)	82	442	257 (0.94%)	145 (54.25%)	0 (0.00%)	58 (23.32%)	54 (22.43%)
-> 0	77718			0	13560
0 -> 1	3362	26610 (99.22%)	182 (0.68%)	85	542	222 (0.83%)	85 (38.29%)	0 (0.00%)	64 (28.83%)	73 (32.88%)
1 -> 2	2003	27301 (98.86%)	239 (0.87%)	78	342	292 (1.06%)	205 (70.21%)	0 (0.00%)	52 (17.81%)	35 (11.99%)

Version	Parse Nodes			Character Nodes Count
Version	Count	Ambiguous	Irreusable	Character Nodes Count
Average (0..1)	162321	1841 (1.13%)	73070 (45.02%)	85822

0	162369	1841 (1.13%)	73088 (45.01%)	85844
1	162273	1840 (1.13%)	73052 (45.02%)	85799
2	162457	1856 (1.14%)	73056 (44.97%)	85931

Version	Parse Nodes			Shift		Breakdown
Version	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average (1..2)	8578	159854 (98.48%)	2034 (1.25%)	343	1559	2368 (1.46%)	1919 (83.72%)	0 (0.00%)	271 (9.55%)	178 (6.73%)
-> 0	423695			0	85870
0 -> 1	6067	160677 (98.96%)	1523 (0.94%)	229	1064	1603 (0.99%)	1474 (91.95%)	0 (0.00%)	60 (3.74%)	69 (4.30%)
1 -> 2	11089	159031 (98.00%)	2544 (1.57%)	457	2054	3132 (1.93%)	2364 (75.48%)	0 (0.00%)	481 (15.36%)	287 (9.16%)

Version	Parse Nodes			Character Nodes Count
Version	Count	Ambiguous	Irreusable	Character Nodes Count
Average (0..1)	73854	559 (0.76%)	34177 (46.28%)	41650

0	73857	559 (0.76%)	34178 (46.28%)	41651
1	73851	559 (0.76%)	34176 (46.28%)	41649
2	73852	559 (0.76%)	34178 (46.28%)	41649

Version	Parse Nodes			Shift		Breakdown
Version	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average (1..2)	958	73586 (99.64%)	251 (0.34%)	122	141	267 (0.36%)	177 (67.32%)	0 (0.00%)	40 (14.64%)	51 (18.05%)
-> 0	197675			0	41712
0 -> 1	982	73627 (99.69%)	211 (0.29%)	113	121	226 (0.31%)	170 (75.22%)	0 (0.00%)	28 (12.39%)	28 (12.39%)
1 -> 2	933	73545 (99.59%)	291 (0.39%)	130	160	308 (0.42%)	183 (59.42%)	0 (0.00%)	52 (16.88%)	73 (23.70%)