Determine identifiers through SchemaFrame in bundle and alterschema - #996
Merged
Conversation
Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>
![cubic-dev-ai[bot]](https://avatars.githubusercontent.com/in/1082092?s=60&v=4){kind=small}
There was a problem hiding this comment.
8 issues found and verified against the latest diff
Prompt for AI agents (unresolved issues)
Check if these issues are valid — if so, understand the root cause of each and fix them. If appropriate, use sub-agents to investigate and fix each issue separately.
<file name="test/foundation/foundation_identify_draft7_test.cc">
<violation number="1" location="test/foundation/foundation_identify_draft7_test.cc:82">
P3: `base_dialect_shortcut` was changed to call `IDENTIFY_OF(document, sourcemeta::blaze::schema_resolver)`, which no longer tests the base-dialect-shortcut behavior its name describes. With the `$schema: draft-07` document it now duplicates the `valid_id` test exactly. Keep coverage of the known-base-dialect path (e.g. pass a `default_dialect` to `IDENTIFY_OF` for a schema without a `$schema` keyword) or rename the test, otherwise this path loses its test.</violation>
</file>
<file name="src/bundle/bundle.cc">
<violation number="1" location="src/bundle/bundle.cc:45">
P2: When `dependencies` receives custom nonempty `paths`, callbacks lose the outer schema URI and report an empty origin even if the document has `$id` or `default_id`. Preserve the outer document identifier by framing it separately without `paths` (or otherwise retain the previous fallback) before invoking callbacks.</violation>
</file>
<file name="src/alterschema/linter/valid_default.h">
<violation number="1" location="src/alterschema/linter/valid_default.h:79">
P2: When a nested resource uses a different dialect and the document has no top-level `$schema`, this analyzes the whole `root` using the nested location's dialect. That can miss or invent the root identifier, changing relative-reference resolution during default validation; analyze with the root location's dialect instead.</violation>
</file>
<file name="test/foundation/foundation_identify_draft1_test.cc">
<violation number="1" location="test/foundation/foundation_identify_draft1_test.cc:82">
P2: After this change the `base_dialect_shortcut` test no longer exercises the base-dialect-shortcut code path and is now byte-for-byte identical to `valid_id`: both build the same `{"id": "https://example.com/my-schema", "$schema": "http://json-schema.org/draft-01/schema#"}` document, call `IDENTIFY_OF(document, schema_resolver)`, and assert the same result. It previously called `identify(document, SchemaBaseDialect::JSON_Schema_Draft_1_Hyper)` to cover the overload that skips `$schema` resolution; that coverage is now gone, and the test name is misleading. Either keep a real shortcut test (passing a `SchemaBaseDialect`) or remove `base_dialect_shortcut` as a redundant duplicate of `valid_id`.</violation>
</file>
<file name="test/foundation/foundation_identify_draft3_test.cc">
<violation number="1" location="test/foundation/foundation_identify_draft3_test.cc:82">
P3: The `base_dialect_shortcut` test no longer tests the base-dialect shortcut. It previously called identify with SchemaBaseDialect::JSON_Schema_Draft_3 and no resolver; it now calls IDENTIFY_OF with schema_resolver, and the document's own $schema keyword drives the dialect resolution. Since the schema always declares its $schema, the shortcut code path (caller-supplied SchemaBaseDialect with no resolver) is no longer covered. Either rename the test to reflect that it exercises default dialect detection through the frame, or keep a test that passes a SchemaBaseDialect to preserve coverage of that path.</violation>
</file>
<file name="test/foundation/foundation_identify_2019_09_test.cc">
<violation number="1" location="test/foundation/foundation_identify_2019_09_test.cc:82">
P3: Converting the three base-dialect tests to `IDENTIFY_OF(document, schema_resolver)` (no default dialect) makes each one an exact duplicate of its counterpart: `base_dialect_shortcut` now calls the same args as `valid_id`, and `id_empty_fragment_only_base_dialect` / `id_empty_string_base_dialect` duplicate `id_empty_fragment_only` / `id_empty_string`. The `identify` `SchemaBaseDialect` shortcut path and default-dialect-based identification are no longer tested at all, while the misleading `_base_dialect`/`_shortcut` names imply coverage that no longer exists. Since these documents carry an explicit `$schema`, dropping the default dialect is behaviorally equivalent, so the right fix is to delete the redundant duplicate tests (or keep only one) rather than keep silent duplicates that give false coverage signal.</violation>
</file>
<file name="test/bundle/bundle_draft7_test.cc">
<violation number="1" location="test/bundle/bundle_draft7_test.cc:709">
P3: The resource id for 'trailing-hash' no longer has a trailing '#', so this test now exercises a plain id with a fragment ref, not an id with a trailing hash. The test name ref_with_fragment_to_id_with_trailing_hash describes behavior this change removed. Rename it (e.g. ref_with_fragment_to_id) to keep the name in sync with what the test actually covers.</violation>
</file>
<file name="test/foundation/foundation_identify_2020_12_test.cc">
<violation number="1" location="test/foundation/foundation_identify_2020_12_test.cc:82">
P3: TEST(base_dialect_shortcut), TEST(id_empty_fragment_only_base_dialect) and TEST(id_empty_string_base_dialect) no longer exercise a distinct path: after removing the identify(SchemaBaseDialect) overload, each now runs the same document and IDENTIFY_OF(document, schema_resolver) as its non-base-dialect counterpart (valid_id, id_empty_fragment_only, id_empty_string). The names still claim to test a base-dialect shortcut that no longer exists, so the coverage is redundant and misleading. Remove these three tests or convert them to test something the others do not.</violation>
</file>
Reply with feedback, questions, or to request a fix.
Re-trigger cubic
| paths); | ||
| const auto origin{sourcemeta::blaze::identify(schema, resolver, | ||
| default_dialect, default_id)}; | ||
| const auto &origin{frame.root()}; |
There was a problem hiding this comment.
P2: When dependencies receives custom nonempty paths, callbacks lose the outer schema URI and report an empty origin even if the document has $id or default_id. Preserve the outer document identifier by framing it separately without paths (or otherwise retain the previous fallback) before invoking callbacks.
Prompt for AI agents
Check if this issue is valid — if so, understand the root cause and fix it. At src/bundle/bundle.cc, line 45:
<comment>When `dependencies` receives custom nonempty `paths`, callbacks lose the outer schema URI and report an empty origin even if the document has `$id` or `default_id`. Preserve the outer document identifier by framing it separately without `paths` (or otherwise retain the previous fallback) before invoking callbacks.</comment>
<file context>
@@ -42,8 +42,7 @@ auto dependencies_internal(
paths);
- const auto origin{sourcemeta::blaze::identify(schema, resolver,
- default_dialect, default_id)};
+ const auto &origin{frame.root()};
std::vector<
</file context>
| // comes back empty exactly when the schema declares none of its own | ||
| sourcemeta::blaze::SchemaFrame declared_frame{ | ||
| sourcemeta::blaze::SchemaFrame::Mode::Root}; | ||
| declared_frame.analyse(root, walker, resolver, location.dialect); |
There was a problem hiding this comment.
P2: When a nested resource uses a different dialect and the document has no top-level $schema, this analyzes the whole root using the nested location's dialect. That can miss or invent the root identifier, changing relative-reference resolution during default validation; analyze with the root location's dialect instead.
Prompt for AI agents
Check if this issue is valid — if so, understand the root cause and fix it. At src/alterschema/linter/valid_default.h, line 79:
<comment>When a nested resource uses a different dialect and the document has no top-level `$schema`, this analyzes the whole `root` using the nested location's dialect. That can miss or invent the root identifier, changing relative-reference resolution during default validation; analyze with the root location's dialect instead.</comment>
<file context>
@@ -72,17 +72,19 @@ class ValidDefault final : public SchemaTransformRule {
+ // comes back empty exactly when the schema declares none of its own
+ sourcemeta::blaze::SchemaFrame declared_frame{
+ sourcemeta::blaze::SchemaFrame::Mode::Root};
+ declared_frame.analyse(root, walker, resolver, location.dialect);
std::string_view default_id{location.base};
- if (!sourcemeta::blaze::identify(root, root_base_dialect).empty() ||
</file context>
Suggested change
| declared_frame.analyse(root, walker, resolver, location.dialect); | |
| const auto &root_location{frame.root_location().value().get()}; | |
| declared_frame.analyse(root, walker, resolver, root_location.dialect); |
| })JSON"); | ||
| const auto id{sourcemeta::blaze::identify( | ||
| document, sourcemeta::blaze::schema_resolver)}; | ||
| const auto id{IDENTIFY_OF(document, sourcemeta::blaze::schema_resolver)}; |
There was a problem hiding this comment.
P2: After this change the base_dialect_shortcut test no longer exercises the base-dialect-shortcut code path and is now byte-for-byte identical to valid_id: both build the same {"id": "https://example.com/my-schema", "$schema": "http://json-schema.org/draft-01/schema#"} document, call IDENTIFY_OF(document, schema_resolver), and assert the same result. It previously called identify(document, SchemaBaseDialect::JSON_Schema_Draft_1_Hyper) to cover the overload that skips $schema resolution; that coverage is now gone, and the test name is misleading. Either keep a real shortcut test (passing a SchemaBaseDialect) or remove base_dialect_shortcut as a redundant duplicate of valid_id.
Prompt for AI agents
Check if this issue is valid — if so, understand the root cause and fix it. At test/foundation/foundation_identify_draft1_test.cc, line 82:
<comment>After this change the `base_dialect_shortcut` test no longer exercises the base-dialect-shortcut code path and is now byte-for-byte identical to `valid_id`: both build the same `{"id": "https://example.com/my-schema", "$schema": "http://json-schema.org/draft-01/schema#"}` document, call `IDENTIFY_OF(document, schema_resolver)`, and assert the same result. It previously called `identify(document, SchemaBaseDialect::JSON_Schema_Draft_1_Hyper)` to cover the overload that skips `$schema` resolution; that coverage is now gone, and the test name is misleading. Either keep a real shortcut test (passing a `SchemaBaseDialect`) or remove `base_dialect_shortcut` as a redundant duplicate of `valid_id`.</comment>
<file context>
@@ -68,8 +79,7 @@ TEST(valid_id) {
})JSON");
- const auto id{sourcemeta::blaze::identify(
- document, sourcemeta::blaze::schema_resolver)};
+ const auto id{IDENTIFY_OF(document, sourcemeta::blaze::schema_resolver)};
EXPECT_EQ(id, "https://example.com/my-schema");
}
</file context>
| })JSON"); | ||
| const auto id{sourcemeta::blaze::identify( | ||
| document, sourcemeta::blaze::schema_resolver)}; | ||
| const auto id{IDENTIFY_OF(document, sourcemeta::blaze::schema_resolver)}; |
There was a problem hiding this comment.
P3: base_dialect_shortcut was changed to call IDENTIFY_OF(document, sourcemeta::blaze::schema_resolver), which no longer tests the base-dialect-shortcut behavior its name describes. With the $schema: draft-07 document it now duplicates the valid_id test exactly. Keep coverage of the known-base-dialect path (e.g. pass a default_dialect to IDENTIFY_OF for a schema without a $schema keyword) or rename the test, otherwise this path loses its test.
Prompt for AI agents
Check if this issue is valid — if so, understand the root cause and fix it. At test/foundation/foundation_identify_draft7_test.cc, line 82:
<comment>`base_dialect_shortcut` was changed to call `IDENTIFY_OF(document, sourcemeta::blaze::schema_resolver)`, which no longer tests the base-dialect-shortcut behavior its name describes. With the `$schema: draft-07` document it now duplicates the `valid_id` test exactly. Keep coverage of the known-base-dialect path (e.g. pass a `default_dialect` to `IDENTIFY_OF` for a schema without a `$schema` keyword) or rename the test, otherwise this path loses its test.</comment>
<file context>
@@ -68,8 +79,7 @@ TEST(valid_id) {
})JSON");
- const auto id{sourcemeta::blaze::identify(
- document, sourcemeta::blaze::schema_resolver)};
+ const auto id{IDENTIFY_OF(document, sourcemeta::blaze::schema_resolver)};
EXPECT_EQ(id, "https://example.com/my-schema");
}
</file context>
| })JSON"); | ||
| const auto id{sourcemeta::blaze::identify( | ||
| document, sourcemeta::blaze::schema_resolver)}; | ||
| const auto id{IDENTIFY_OF(document, sourcemeta::blaze::schema_resolver)}; |
There was a problem hiding this comment.
P3: The base_dialect_shortcut test no longer tests the base-dialect shortcut. It previously called identify with SchemaBaseDialect::JSON_Schema_Draft_3 and no resolver; it now calls IDENTIFY_OF with schema_resolver, and the document's own $schema keyword drives the dialect resolution. Since the schema always declares its $schema, the shortcut code path (caller-supplied SchemaBaseDialect with no resolver) is no longer covered. Either rename the test to reflect that it exercises default dialect detection through the frame, or keep a test that passes a SchemaBaseDialect to preserve coverage of that path.
Prompt for AI agents
Check if this issue is valid — if so, understand the root cause and fix it. At test/foundation/foundation_identify_draft3_test.cc, line 82:
<comment>The `base_dialect_shortcut` test no longer tests the base-dialect shortcut. It previously called identify with SchemaBaseDialect::JSON_Schema_Draft_3 and no resolver; it now calls IDENTIFY_OF with schema_resolver, and the document's own $schema keyword drives the dialect resolution. Since the schema always declares its $schema, the shortcut code path (caller-supplied SchemaBaseDialect with no resolver) is no longer covered. Either rename the test to reflect that it exercises default dialect detection through the frame, or keep a test that passes a SchemaBaseDialect to preserve coverage of that path.</comment>
<file context>
@@ -68,8 +79,7 @@ TEST(valid_id) {
})JSON");
- const auto id{sourcemeta::blaze::identify(
- document, sourcemeta::blaze::schema_resolver)};
+ const auto id{IDENTIFY_OF(document, sourcemeta::blaze::schema_resolver)};
EXPECT_EQ(id, "https://example.com/my-schema");
}
</file context>
| })JSON"); | ||
| const auto id{sourcemeta::blaze::identify( | ||
| document, sourcemeta::blaze::schema_resolver)}; | ||
| const auto id{IDENTIFY_OF(document, sourcemeta::blaze::schema_resolver)}; |
There was a problem hiding this comment.
P3: Converting the three base-dialect tests to IDENTIFY_OF(document, schema_resolver) (no default dialect) makes each one an exact duplicate of its counterpart: base_dialect_shortcut now calls the same args as valid_id, and id_empty_fragment_only_base_dialect / id_empty_string_base_dialect duplicate id_empty_fragment_only / id_empty_string. The identify SchemaBaseDialect shortcut path and default-dialect-based identification are no longer tested at all, while the misleading _base_dialect/_shortcut names imply coverage that no longer exists. Since these documents carry an explicit $schema, dropping the default dialect is behaviorally equivalent, so the right fix is to delete the redundant duplicate tests (or keep only one) rather than keep silent duplicates that give false coverage signal.
Prompt for AI agents
Check if this issue is valid — if so, understand the root cause and fix it. At test/foundation/foundation_identify_2019_09_test.cc, line 82:
<comment>Converting the three base-dialect tests to `IDENTIFY_OF(document, schema_resolver)` (no default dialect) makes each one an exact duplicate of its counterpart: `base_dialect_shortcut` now calls the same args as `valid_id`, and `id_empty_fragment_only_base_dialect` / `id_empty_string_base_dialect` duplicate `id_empty_fragment_only` / `id_empty_string`. The `identify` `SchemaBaseDialect` shortcut path and default-dialect-based identification are no longer tested at all, while the misleading `_base_dialect`/`_shortcut` names imply coverage that no longer exists. Since these documents carry an explicit `$schema`, dropping the default dialect is behaviorally equivalent, so the right fix is to delete the redundant duplicate tests (or keep only one) rather than keep silent duplicates that give false coverage signal.</comment>
<file context>
@@ -68,8 +79,7 @@ TEST(valid_id) {
})JSON");
- const auto id{sourcemeta::blaze::identify(
- document, sourcemeta::blaze::schema_resolver)};
+ const auto id{IDENTIFY_OF(document, sourcemeta::blaze::schema_resolver)};
EXPECT_EQ(id, "https://example.com/my-schema");
}
</file context>
| }, | ||
| "definitions": { | ||
| "https://www.sourcemeta.com/trailing-hash#": { | ||
| "https://www.sourcemeta.com/trailing-hash": { |
There was a problem hiding this comment.
P3: The resource id for 'trailing-hash' no longer has a trailing '#', so this test now exercises a plain id with a fragment ref, not an id with a trailing hash. The test name ref_with_fragment_to_id_with_trailing_hash describes behavior this change removed. Rename it (e.g. ref_with_fragment_to_id) to keep the name in sync with what the test actually covers.
Prompt for AI agents
Check if this issue is valid — if so, understand the root cause and fix it. At test/bundle/bundle_draft7_test.cc, line 709:
<comment>The resource id for 'trailing-hash' no longer has a trailing '#', so this test now exercises a plain id with a fragment ref, not an id with a trailing hash. The test name ref_with_fragment_to_id_with_trailing_hash describes behavior this change removed. Rename it (e.g. ref_with_fragment_to_id) to keep the name in sync with what the test actually covers.</comment>
<file context>
@@ -698,9 +706,9 @@ TEST(ref_with_fragment_to_id_with_trailing_hash) {
},
"definitions": {
- "https://www.sourcemeta.com/trailing-hash#": {
+ "https://www.sourcemeta.com/trailing-hash": {
"$schema": "http://json-schema.org/draft-07/schema#",
- "$id": "https://www.sourcemeta.com/trailing-hash#",
</file context>
| })JSON"); | ||
| const auto id{sourcemeta::blaze::identify( | ||
| document, sourcemeta::blaze::schema_resolver)}; | ||
| const auto id{IDENTIFY_OF(document, sourcemeta::blaze::schema_resolver)}; |
There was a problem hiding this comment.
P3: TEST(base_dialect_shortcut), TEST(id_empty_fragment_only_base_dialect) and TEST(id_empty_string_base_dialect) no longer exercise a distinct path: after removing the identify(SchemaBaseDialect) overload, each now runs the same document and IDENTIFY_OF(document, schema_resolver) as its non-base-dialect counterpart (valid_id, id_empty_fragment_only, id_empty_string). The names still claim to test a base-dialect shortcut that no longer exists, so the coverage is redundant and misleading. Remove these three tests or convert them to test something the others do not.
Prompt for AI agents
Check if this issue is valid — if so, understand the root cause and fix it. At test/foundation/foundation_identify_2020_12_test.cc, line 82:
<comment>TEST(base_dialect_shortcut), TEST(id_empty_fragment_only_base_dialect) and TEST(id_empty_string_base_dialect) no longer exercise a distinct path: after removing the identify(SchemaBaseDialect) overload, each now runs the same document and IDENTIFY_OF(document, schema_resolver) as its non-base-dialect counterpart (valid_id, id_empty_fragment_only, id_empty_string). The names still claim to test a base-dialect shortcut that no longer exists, so the coverage is redundant and misleading. Remove these three tests or convert them to test something the others do not.</comment>
<file context>
@@ -68,8 +79,7 @@ TEST(valid_id) {
})JSON");
- const auto id{sourcemeta::blaze::identify(
- document, sourcemeta::blaze::schema_resolver)};
+ const auto id{IDENTIFY_OF(document, sourcemeta::blaze::schema_resolver)};
EXPECT_EQ(id, "https://example.com/my-schema");
}
</file context>
![github-actions[bot]](https://avatars.githubusercontent.com/in/15368?s=60&v=4){kind=small}
There was a problem hiding this comment.
Benchmark (macos/llvm)
Details
| Benchmark suite | Current: e33838c | Previous: 48fbf45 | Ratio |
|---|---|---|---|
Schema_Tracker_ISO_Language |
3730154.9043060653 ns/iter |
4318399.165679602 ns/iter |
0.86 |
Schema_Tracker_ISO_Language_To_JSON |
15465634.615382511 ns/iter |
17120537.234046772 ns/iter |
0.90 |
Schema_Frame_WoT_References |
4858713.149659008 ns/iter |
6871477.272726555 ns/iter |
0.71 |
Schema_Frame_OMC_References |
22718070.31250006 ns/iter |
27812137.807691567 ns/iter |
0.82 |
Schema_Frame_OMC_Locations |
20573719.35294374 ns/iter |
29828750.00000402 ns/iter |
0.69 |
Schema_Frame_ISO_Language_Locations |
72904233.30000523 ns/iter |
93032535.71426596 ns/iter |
0.78 |
Schema_Frame_ISO_Language_Root |
175.30867800183483 ns/iter |
232.15143367505337 ns/iter |
0.76 |
Schema_Frame_KrakenD_References |
45873507.812501654 ns/iter |
56099830.076933496 ns/iter |
0.82 |
Schema_Frame_KrakenD_Reachable |
523091833.00008047 ns/iter |
845062332.9999871 ns/iter |
0.62 |
Schema_Frame_ISO_Language_Locations_To_JSON |
56436954.91666752 ns/iter |
75157135.37500802 ns/iter |
0.75 |
Schema_Frame_Many_Resources_References |
335476728.9999927 ns/iter |
507202959.0000966 ns/iter |
0.66 |
Schema_Bundle_Meta_2020_12 |
1285271.3145527807 ns/iter |
1653760.9767410262 ns/iter |
0.78 |
Schema_Format_ISO_Language_To_JSON |
77847981.55557838 ns/iter |
97901659.83330704 ns/iter |
0.80 |
E2E_Compiler_adaptivecard |
60869451.41667381 ns/iter |
79485578.777773 ns/iter |
0.77 |
E2E_Compiler_ansible_meta |
25437657.407404978 ns/iter |
33411884.04347715 ns/iter |
0.76 |
E2E_Compiler_aws_cdk |
267291.55072965135 ns/iter |
358987.83542537305 ns/iter |
0.74 |
E2E_Compiler_babelrc |
2426181.7867035894 ns/iter |
2858831.3891051975 ns/iter |
0.85 |
E2E_Compiler_clang_format |
16267193.583336355 ns/iter |
21921626.354843546 ns/iter |
0.74 |
E2E_Compiler_cmake_presets |
21572098.214286532 ns/iter |
31921687.499995887 ns/iter |
0.68 |
E2E_Compiler_code_climate |
2254768.2906974843 ns/iter |
2811974.373016602 ns/iter |
0.80 |
E2E_Compiler_cql2 |
9724341.071426222 ns/iter |
14482126.615383515 ns/iter |
0.67 |
E2E_Compiler_cspell |
20856510.41666855 ns/iter |
24246902.777770594 ns/iter |
0.86 |
E2E_Compiler_cypress |
3397080.5401791283 ns/iter |
4428888.971591246 ns/iter |
0.77 |
E2E_Compiler_deno |
6500024.060344379 ns/iter |
8322922.144735027 ns/iter |
0.78 |
E2E_Compiler_dependabot |
3756000.6127451365 ns/iter |
4282620.111110999 ns/iter |
0.88 |
E2E_Compiler_draft_04 |
1837188.5214722229 ns/iter |
2872674.21602825 ns/iter |
0.64 |
E2E_Compiler_fabric_mod |
3734658.1632646676 ns/iter |
4794302.752293125 ns/iter |
0.78 |
E2E_Compiler_geojson |
21668705.882354837 ns/iter |
28164411.84615297 ns/iter |
0.77 |
E2E_Compiler_gitpod_configuration |
3782303.847953449 ns/iter |
5255327.290076834 ns/iter |
0.72 |
E2E_Compiler_helm_chart_lock |
480449.35826483957 ns/iter |
671864.9776916744 ns/iter |
0.72 |
E2E_Compiler_importmap |
203702.66507554337 ns/iter |
243918.62045529575 ns/iter |
0.84 |
E2E_Compiler_jasmine |
878188.9475753332 ns/iter |
1240744.6397941927 ns/iter |
0.71 |
E2E_Compiler_jshintrc |
2815916.6666668113 ns/iter |
3701673.214285555 ns/iter |
0.76 |
E2E_Compiler_jsconfig |
16660230.166670382 ns/iter |
24794153.285711218 ns/iter |
0.67 |
E2E_Compiler_krakend |
116786187.49999714 ns/iter |
167596708.33334896 ns/iter |
0.70 |
E2E_Compiler_lazygit |
30809098.31999634 ns/iter |
39896225.52941963 ns/iter |
0.77 |
E2E_Compiler_lerna |
1030310.4572784244 ns/iter |
1605425.386892334 ns/iter |
0.64 |
E2E_Compiler_nest_cli |
5385878.496182706 ns/iter |
9054212.125001661 ns/iter |
0.59 |
E2E_Compiler_omc |
139829341.59998876 ns/iter |
233788916.66667792 ns/iter |
0.60 |
E2E_Compiler_omnisharp |
5124369.716417168 ns/iter |
7652995.639535558 ns/iter |
0.67 |
E2E_Compiler_openapi |
18848648.64864908 ns/iter |
32270221.043478634 ns/iter |
0.58 |
E2E_Compiler_pre_commit_hooks |
3673254.3612564467 ns/iter |
5076517.250000023 ns/iter |
0.72 |
E2E_Compiler_pulumi |
2826960.734614658 ns/iter |
4018057.3483140822 ns/iter |
0.70 |
E2E_Compiler_semantic_release |
1078141.483516564 ns/iter |
1611788.1868132707 ns/iter |
0.67 |
E2E_Compiler_stale |
1270577.699851126 ns/iter |
1531720.6346865084 ns/iter |
0.83 |
E2E_Compiler_stylecop |
4465749.730262527 ns/iter |
7162013.464646104 ns/iter |
0.62 |
E2E_Compiler_tmuxinator |
1209874.489473693 ns/iter |
2036715.054590635 ns/iter |
0.59 |
E2E_Compiler_ui5 |
42326578.124999516 ns/iter |
65057738.636369325 ns/iter |
0.65 |
E2E_Compiler_ui5_manifest |
262700402.9999777 ns/iter |
417158603.99995106 ns/iter |
0.63 |
E2E_Compiler_unreal_engine_uproject |
3055961.9565219292 ns/iter |
5122684.579998804 ns/iter |
0.60 |
E2E_Compiler_users_array |
485246.04365903756 ns/iter |
818034.7607023885 ns/iter |
0.59 |
E2E_Compiler_vercel |
8836699.475000387 ns/iter |
13750733.695652027 ns/iter |
0.64 |
E2E_Compiler_yamllint |
201008.78684807246 ns/iter |
324713.0404395068 ns/iter |
0.62 |
E2E_Evaluator_adaptivecard |
22175.956457423355 ns/iter |
29972.960577384492 ns/iter |
0.74 |
E2E_Evaluator_ansible_meta |
187628.51119997018 ns/iter |
278691.3556016857 ns/iter |
0.67 |
E2E_Evaluator_aws_cdk |
42725.710904220105 ns/iter |
68943.87539580045 ns/iter |
0.62 |
E2E_Evaluator_babelrc |
91446.67276739089 ns/iter |
143140.28950545914 ns/iter |
0.64 |
E2E_Evaluator_cerebrum_criminal_case |
893688.9221557524 ns/iter |
1434637.9543479523 ns/iter |
0.62 |
E2E_Evaluator_clang_format |
96637.2171145736 ns/iter |
140269.95063557217 ns/iter |
0.69 |
E2E_Evaluator_cmake_presets |
3924685.356756723 ns/iter |
5858406.047170045 ns/iter |
0.67 |
E2E_Evaluator_code_climate |
205708.09403974432 ns/iter |
252911.78717294405 ns/iter |
0.81 |
E2E_Evaluator_cql2 |
179765.86864310052 ns/iter |
245955.94410381268 ns/iter |
0.73 |
E2E_Evaluator_cspell |
526673.0840000946 ns/iter |
794626.977924925 ns/iter |
0.66 |
E2E_Evaluator_cypress |
174412.6272418817 ns/iter |
223640.22051774646 ns/iter |
0.78 |
E2E_Evaluator_deno |
388367.3529804608 ns/iter |
424506.6390108849 ns/iter |
0.91 |
E2E_Evaluator_dependabot |
298822.20061326027 ns/iter |
554046.0584127267 ns/iter |
0.54 |
E2E_Evaluator_draft_04 |
6474634.25396865 ns/iter |
7660825.207317319 ns/iter |
0.85 |
E2E_Evaluator_fabric_mod |
531671.3523238102 ns/iter |
804932.86965808 ns/iter |
0.66 |
E2E_Evaluator_geojson |
11111947.430768292 ns/iter |
12692415.697671982 ns/iter |
0.88 |
E2E_Evaluator_gitpod_configuration |
308649.4439477669 ns/iter |
307285.78172829095 ns/iter |
1.00 |
E2E_Evaluator_helm_chart_lock |
446817.24301669834 ns/iter |
446294.7305605812 ns/iter |
1.00 |
E2E_Evaluator_importmap |
66750.70890991628 ns/iter |
62958.989447645865 ns/iter |
1.06 |
E2E_Evaluator_jasmine |
113283.2065859198 ns/iter |
155766.2196201578 ns/iter |
0.73 |
E2E_Evaluator_jshintrc |
1588307.856305256 ns/iter |
1392916.1186811992 ns/iter |
1.14 |
E2E_Evaluator_jsconfig |
388054.5043242868 ns/iter |
475944.58520659385 ns/iter |
0.82 |
E2E_Evaluator_krakend |
169970.2517820112 ns/iter |
222029.20850718295 ns/iter |
0.77 |
E2E_Evaluator_lazygit |
128521.21837239907 ns/iter |
163494.91793722345 ns/iter |
0.79 |
E2E_Evaluator_lerna |
172000.29651447822 ns/iter |
207226.16603114465 ns/iter |
0.83 |
E2E_Evaluator_nest_cli |
198815.10099779145 ns/iter |
245331.54401460238 ns/iter |
0.81 |
E2E_Evaluator_omc |
24024.49370737262 ns/iter |
24481.387066517414 ns/iter |
0.98 |
E2E_Evaluator_omnisharp |
653784.3339999655 ns/iter |
727412.0103687795 ns/iter |
0.90 |
E2E_Evaluator_openapi |
10169886.154929847 ns/iter |
11683571.049180038 ns/iter |
0.87 |
E2E_Evaluator_pre_commit_hooks |
614426.9999999779 ns/iter |
628560.5692850583 ns/iter |
0.98 |
E2E_Evaluator_pulumi |
782092.4740089528 ns/iter |
848440.1458333416 ns/iter |
0.92 |
E2E_Evaluator_semantic_release |
98187.86812638372 ns/iter |
117319.91758745481 ns/iter |
0.84 |
E2E_Evaluator_stale |
173922.0074247835 ns/iter |
180137.98890829887 ns/iter |
0.97 |
E2E_Evaluator_stylecop |
247516.56426429286 ns/iter |
314403.6775450358 ns/iter |
0.79 |
E2E_Evaluator_tmuxinator |
83938.91250709195 ns/iter |
104502.72607306509 ns/iter |
0.80 |
E2E_Evaluator_ui5 |
554982.6250000934 ns/iter |
746272.3459675838 ns/iter |
0.74 |
E2E_Evaluator_ui5_manifest |
2245203.685810787 ns/iter |
3186107.551724051 ns/iter |
0.70 |
E2E_Evaluator_unreal_engine_uproject |
418992.99199085427 ns/iter |
536826.317786446 ns/iter |
0.78 |
E2E_Evaluator_users_array |
490580.79688603256 ns/iter |
666626.38954012 ns/iter |
0.74 |
E2E_Evaluator_vercel |
281167.2017398259 ns/iter |
414961.795415475 ns/iter |
0.68 |
E2E_Evaluator_yamllint |
9154.971255652255 ns/iter |
12155.915521445035 ns/iter |
0.75 |
JSONLD_Catalog_Simple |
22947042.857140332 ns/iter |
30836184.999998294 ns/iter |
0.74 |
JSONLD_Catalog_Override_Agreeing |
21131407.4166656 ns/iter |
25201481.045459416 ns/iter |
0.84 |
JSONLD_Catalog_Override_Shadowing |
34985871.04761663 ns/iter |
33742480.14286725 ns/iter |
1.04 |
Micro_Draft4_Meta_1_No_Callback |
184.45749437085502 ns/iter |
170.65798310808574 ns/iter |
1.08 |
Micro_Draft4_Required_Properties |
790.7946340554 ns/iter |
817.025881050275 ns/iter |
0.97 |
Micro_Draft4_Many_Optional_Properties_Minimal_Match |
18.34847641389814 ns/iter |
20.342654459026303 ns/iter |
0.90 |
Micro_Draft4_Few_Optional_Properties_Minimal_Match |
10.15194414746425 ns/iter |
10.67668352131391 ns/iter |
0.95 |
Micro_Draft4_Items_Schema |
267.1573694366067 ns/iter |
291.46678495653714 ns/iter |
0.92 |
Micro_Draft4_Nested_Object |
1.0593007841969717 ns/iter |
1.159550707837871 ns/iter |
0.91 |
Micro_Draft4_Properties_Triad_Optional |
256.96170798354666 ns/iter |
241.7249155742746 ns/iter |
1.06 |
Micro_Draft4_Properties_Triad_Closed |
193.37010850519442 ns/iter |
200.57991373098338 ns/iter |
0.96 |
Micro_Draft4_Properties_Triad_Required |
253.13989598907798 ns/iter |
270.03920346860974 ns/iter |
0.94 |
Micro_Draft4_Properties_Closed |
54.9128898754794 ns/iter |
68.51367952753846 ns/iter |
0.80 |
Micro_Draft4_Non_Recursive_Ref |
13.529604863090976 ns/iter |
14.43272107805178 ns/iter |
0.94 |
Micro_Draft4_Pattern_Properties_True |
150.5113597913696 ns/iter |
164.75392354046906 ns/iter |
0.91 |
Micro_Draft4_Ref_To_Single_Property |
10.353273522720768 ns/iter |
10.630857179962932 ns/iter |
0.97 |
Micro_Draft4_Additional_Properties_Type |
34.49133814632569 ns/iter |
33.07272316508673 ns/iter |
1.04 |
Micro_Draft4_Nested_Oneof |
44.28829295671709 ns/iter |
47.7498606357541 ns/iter |
0.93 |
Micro_Draft4_Short_Enum |
6.47813309207692 ns/iter |
8.016760640415963 ns/iter |
0.81 |
Micro_Draft4_Long_Enum |
11.6647846748691 ns/iter |
13.95515154992627 ns/iter |
0.84 |
Micro_Draft4_Long_Enum_Short_Strings |
7.445169478420449 ns/iter |
9.897335221042662 ns/iter |
0.75 |
Micro_Draft4_Type_Object |
2.8357464249422 ns/iter |
3.7013434246426935 ns/iter |
0.77 |
Micro_Draft4_Ref_Single_100 |
1634472.9953703808 ns/iter |
2036071.0851650264 ns/iter |
0.80 |
Micro_Draft4_Compile_Ref_Many_Nested |
1101166.333865766 ns/iter |
1556681.8584069295 ns/iter |
0.71 |
Micro_Draft4_Compile_Wrap |
1877117.1497582002 ns/iter |
2731227.221453542 ns/iter |
0.69 |
Micro_Draft6_Property_Names |
117.9139429278245 ns/iter |
129.6461455308335 ns/iter |
0.91 |
Micro_Draft6_Compile_FHIR |
12797495332.999916 ns/iter |
26847314832.999928 ns/iter |
0.48 |
Micro_Draft7_If_Then_Else |
18.480105211480303 ns/iter |
18.701483610557002 ns/iter |
0.99 |
Micro_2019_09_Unevaluated_Properties |
31.759312857385247 ns/iter |
31.33741486317083 ns/iter |
1.01 |
Micro_2019_09_Compile_Wrap |
276003180.66667265 ns/iter |
301068978.9999788 ns/iter |
0.92 |
Micro_2020_12_Dynamic_Ref |
666.2985851221588 ns/iter |
671.9802085911667 ns/iter |
0.99 |
Micro_2020_12_Dynamic_Ref_Single |
2.750685126136627 ns/iter |
2.802306001708868 ns/iter |
0.98 |
Micro_2020_12_Simple_Output_Mask |
880.2429378237565 ns/iter |
889.3222315165037 ns/iter |
0.99 |
Micro_2020_12_Simple_Output_Annotations |
63405.78229796573 ns/iter |
62643.372300392184 ns/iter |
1.01 |
Micro_2020_12_Simple_Output_Annotation_Dropping |
1417405.1610880117 ns/iter |
1725236.9153677647 ns/iter |
0.82 |
Micro_2020_12_Compile_NonCircular_Shared_Refs |
715265.7216496213 ns/iter |
938889.629388826 ns/iter |
0.76 |
Micro_2020_12_Exhaustive_Deep_Numeric |
5547.44266753101 ns/iter |
7506.131335510994 ns/iter |
0.74 |
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput |
38580.74817517827 ns/iter |
45252.15691026066 ns/iter |
0.85 |
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput |
15018.566145657649 ns/iter |
19112.577702142356 ns/iter |
0.79 |
Micro_2020_12_Exhaustive_Deep_Numeric_Fail |
94.63783905427768 ns/iter |
111.7931909390341 ns/iter |
0.85 |
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput |
2689.2813096758796 ns/iter |
3237.328055714318 ns/iter |
0.83 |
TestSuite_Parse_WoT |
21196249.999995586 ns/iter |
32453069.44444969 ns/iter |
0.65 |
Alterschema_Check_Readibility_ISO_Language_Set_3 |
218323333.33334947 ns/iter |
266188583.00003013 ns/iter |
0.82 |
Alterschema_Check_Readibility_OMC |
67322840.90908664 ns/iter |
92938783.39999537 ns/iter |
0.72 |
Alterschema_Check_Readibility_KrakenD |
768856958.0000149 ns/iter |
1384260374.99994 ns/iter |
0.56 |
Alterschema_Apply_Readibility_KrakenD |
86067875334.00006 ns/iter |
108594125291.00018 ns/iter |
0.79 |
Alterschema_Check_Invalid_External_Refs |
189507902.99997303 ns/iter |
247242846.9999765 ns/iter |
0.77 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
JavaScript (macos/llvm)
Details
| Benchmark suite | Current: e33838c | Previous: 48fbf45 | Ratio |
|---|---|---|---|
E2E_Evaluator_adaptivecard |
140188 ns |
133855 ns |
1.05 |
E2E_Evaluator_ansible-meta |
488338 ns |
493427 ns |
0.99 |
E2E_Evaluator_aws-cdk |
148191 ns |
150627 ns |
0.98 |
E2E_Evaluator_babelrc |
354190 ns |
355170 ns |
1.00 |
E2E_Evaluator_cerebrum-criminal-case |
2254207 ns |
2328595 ns |
0.97 |
E2E_Evaluator_clang-format |
246969 ns |
245643 ns |
1.01 |
E2E_Evaluator_cmake-presets |
18703985 ns |
17252899 ns |
1.08 |
E2E_Evaluator_code-climate |
544505 ns |
523520 ns |
1.04 |
E2E_Evaluator_cql2 |
1471350 ns |
1416926 ns |
1.04 |
E2E_Evaluator_cspell |
1705904 ns |
1609917 ns |
1.06 |
E2E_Evaluator_cypress |
800097 ns |
784936 ns |
1.02 |
E2E_Evaluator_deno |
1081067 ns |
1125589 ns |
0.96 |
E2E_Evaluator_dependabot |
1132748 ns |
1164486 ns |
0.97 |
E2E_Evaluator_draft-04 |
17614165 ns |
20653704 ns |
0.85 |
E2E_Evaluator_fabric-mod |
1694796 ns |
2171663 ns |
0.78 |
E2E_Evaluator_geojson |
20239778 ns |
19561427 ns |
1.03 |
E2E_Evaluator_gitpod-configuration |
575943 ns |
585656 ns |
0.98 |
E2E_Evaluator_helm-chart-lock |
959660 ns |
936736 ns |
1.02 |
E2E_Evaluator_importmap |
243000 ns |
237890 ns |
1.02 |
E2E_Evaluator_jasmine |
258460 ns |
244727 ns |
1.06 |
E2E_Evaluator_jsconfig |
1074715 ns |
1011960 ns |
1.06 |
E2E_Evaluator_jshintrc |
2278670 ns |
2533554 ns |
0.90 |
E2E_Evaluator_krakend |
488043 ns |
555920 ns |
0.88 |
E2E_Evaluator_lazygit |
341610 ns |
462197 ns |
0.74 |
E2E_Evaluator_lerna |
381930 ns |
363846 ns |
1.05 |
E2E_Evaluator_nest-cli |
479326 ns |
473095 ns |
1.01 |
E2E_Evaluator_omc |
112738 ns |
117518 ns |
0.96 |
E2E_Evaluator_omnisharp |
1324784 ns |
1167891 ns |
1.13 |
E2E_Evaluator_openapi |
32677534 ns |
31394141 ns |
1.04 |
E2E_Evaluator_pre-commit-hooks |
1499137 ns |
1496579 ns |
1.00 |
E2E_Evaluator_pulumi |
1666983 ns |
1875025 ns |
0.89 |
E2E_Evaluator_semantic-release |
201382 ns |
216641 ns |
0.93 |
E2E_Evaluator_stale |
322478 ns |
317903 ns |
1.01 |
E2E_Evaluator_stylecop |
817143 ns |
806106 ns |
1.01 |
E2E_Evaluator_tmuxinator |
213310 ns |
186540 ns |
1.14 |
E2E_Evaluator_ui5 |
1783073 ns |
1757518 ns |
1.01 |
E2E_Evaluator_ui5-manifest |
9779403 ns |
10346289 ns |
0.95 |
E2E_Evaluator_unreal-engine-uproject |
1318349 ns |
1301433 ns |
1.01 |
E2E_Evaluator_users-array |
2468406 ns |
2977083 ns |
0.83 |
E2E_Evaluator_vercel |
832072 ns |
908759 ns |
0.92 |
E2E_Evaluator_yamllint |
26843 ns |
30165 ns |
0.89 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Benchmark (linux/llvm)
Details
| Benchmark suite | Current: e33838c | Previous: a6753b2 | Ratio |
|---|---|---|---|
Schema_Tracker_ISO_Language |
4415846.930817439 ns/iter |
4129605.0000003404 ns/iter |
1.07 |
Schema_Tracker_ISO_Language_To_JSON |
17647754.124999437 ns/iter |
18125535.897437517 ns/iter |
0.97 |
Schema_Frame_WoT_References |
4020151.2011491815 ns/iter |
3785738.0106954793 ns/iter |
1.06 |
Schema_Frame_OMC_References |
18571758.947368715 ns/iter |
17841908.84615246 ns/iter |
1.04 |
Schema_Frame_OMC_Locations |
17539953.925000872 ns/iter |
16747218.585367857 ns/iter |
1.05 |
Schema_Frame_ISO_Language_Locations |
82869295.99999838 ns/iter |
82822715.2500034 ns/iter |
1.00 |
Schema_Frame_ISO_Language_Root |
357.613385369715 ns/iter |
376.42825543401653 ns/iter |
0.95 |
Schema_Frame_KrakenD_References |
35024713.6500002 ns/iter |
34318145.54999732 ns/iter |
1.02 |
Schema_Frame_KrakenD_Reachable |
437652451.50007105 ns/iter |
475273979.5000025 ns/iter |
0.92 |
Schema_Frame_ISO_Language_Locations_To_JSON |
107123898.33332735 ns/iter |
103597405.42857513 ns/iter |
1.03 |
Schema_Frame_Many_Resources_References |
318981539.4999869 ns/iter |
310199791.9999917 ns/iter |
1.03 |
Schema_Bundle_Meta_2020_12 |
1133917.185935408 ns/iter |
1086750.970356535 ns/iter |
1.04 |
Schema_Format_ISO_Language_To_JSON |
93213799.85713716 ns/iter |
89651874.00004026 ns/iter |
1.04 |
E2E_Compiler_adaptivecard |
52249369.23076921 ns/iter |
51546156.84615202 ns/iter |
1.01 |
E2E_Compiler_ansible_meta |
23823985.310345646 ns/iter |
21838103.625000827 ns/iter |
1.09 |
E2E_Compiler_aws_cdk |
254828.35119482566 ns/iter |
232000.38898105294 ns/iter |
1.10 |
E2E_Compiler_babelrc |
1916558.2657534874 ns/iter |
1774381.5291140303 ns/iter |
1.08 |
E2E_Compiler_clang_format |
14667288.04255465 ns/iter |
13650016.520000463 ns/iter |
1.07 |
E2E_Compiler_cmake_presets |
23092969.799999233 ns/iter |
21941773.935483776 ns/iter |
1.05 |
E2E_Compiler_code_climate |
1907359.6840657557 ns/iter |
1790856.0769231557 ns/iter |
1.07 |
E2E_Compiler_cql2 |
10931007.156250061 ns/iter |
10640456.469697269 ns/iter |
1.03 |
E2E_Compiler_cspell |
20005031.6571443 ns/iter |
19125792.027027175 ns/iter |
1.05 |
E2E_Compiler_cypress |
3313533.297169318 ns/iter |
3104962.8000002685 ns/iter |
1.07 |
E2E_Compiler_deno |
6331540.372726026 ns/iter |
5868483.90000038 ns/iter |
1.08 |
E2E_Compiler_dependabot |
3090308.761062035 ns/iter |
2841791.947154308 ns/iter |
1.09 |
E2E_Compiler_draft_04 |
2022037.5480223834 ns/iter |
1899278.1810809262 ns/iter |
1.06 |
E2E_Compiler_fabric_mod |
3554462.792553363 ns/iter |
3359125.7681158036 ns/iter |
1.06 |
E2E_Compiler_geojson |
18539401.63157643 ns/iter |
17511042.39999961 ns/iter |
1.06 |
E2E_Compiler_gitpod_configuration |
3872459.6408845684 ns/iter |
3617746.5129537545 ns/iter |
1.07 |
E2E_Compiler_helm_chart_lock |
498807.7414528896 ns/iter |
450496.2924951771 ns/iter |
1.11 |
E2E_Compiler_importmap |
197325.15116941987 ns/iter |
180182.05998970094 ns/iter |
1.10 |
E2E_Compiler_jasmine |
949822.3084238673 ns/iter |
883648.8494897687 ns/iter |
1.07 |
E2E_Compiler_jshintrc |
3271748.0700939293 ns/iter |
3036810.334782311 ns/iter |
1.08 |
E2E_Compiler_jsconfig |
18883958.243239593 ns/iter |
17280450.926827278 ns/iter |
1.09 |
E2E_Compiler_krakend |
125212203.83333306 ns/iter |
119741140.00001161 ns/iter |
1.05 |
E2E_Compiler_lazygit |
28479177.333328683 ns/iter |
26542080.65384777 ns/iter |
1.07 |
E2E_Compiler_lerna |
1149231.2805870643 ns/iter |
1030239.0723780228 ns/iter |
1.12 |
E2E_Compiler_nest_cli |
5928061.65811966 ns/iter |
5480504.338582637 ns/iter |
1.08 |
E2E_Compiler_omc |
142229061.7999806 ns/iter |
136182231.80001223 ns/iter |
1.04 |
E2E_Compiler_omnisharp |
5415632.643411116 ns/iter |
4951282.560283444 ns/iter |
1.09 |
E2E_Compiler_openapi |
20104827.705883026 ns/iter |
19206534.638890896 ns/iter |
1.05 |
E2E_Compiler_pre_commit_hooks |
3946510.225988806 ns/iter |
3651310.1570685483 ns/iter |
1.08 |
E2E_Compiler_pulumi |
3069705.4803488445 ns/iter |
2898084.2355376207 ns/iter |
1.06 |
E2E_Compiler_semantic_release |
1090864.6203123596 ns/iter |
1031737.1246291331 ns/iter |
1.06 |
E2E_Compiler_stale |
1119363.8006433416 ns/iter |
1019593.1436863404 ns/iter |
1.10 |
E2E_Compiler_stylecop |
4931501.461539159 ns/iter |
4422245.151899224 ns/iter |
1.12 |
E2E_Compiler_tmuxinator |
1346088.535645406 ns/iter |
1245980.3932981754 ns/iter |
1.08 |
E2E_Compiler_ui5 |
43479063.312503286 ns/iter |
42198336.52940211 ns/iter |
1.03 |
E2E_Compiler_ui5_manifest |
273068331.9999798 ns/iter |
269814879.333353 ns/iter |
1.01 |
E2E_Compiler_unreal_engine_uproject |
3528922.265306336 ns/iter |
3326551.1666665287 ns/iter |
1.06 |
E2E_Compiler_users_array |
568746.4208331979 ns/iter |
519490.6785448363 ns/iter |
1.09 |
E2E_Compiler_vercel |
10798918.15384494 ns/iter |
10245646.897059862 ns/iter |
1.05 |
E2E_Compiler_yamllint |
231071.19569538144 ns/iter |
208630.85655134247 ns/iter |
1.11 |
E2E_Evaluator_adaptivecard |
26445.571890152052 ns/iter |
20853.135569595473 ns/iter |
1.27 |
E2E_Evaluator_ansible_meta |
229065.702232463 ns/iter |
194511.85789617297 ns/iter |
1.18 |
E2E_Evaluator_aws_cdk |
46103.648060483894 ns/iter |
43632.45811912129 ns/iter |
1.06 |
E2E_Evaluator_babelrc |
102048.11672374577 ns/iter |
99847.74528437207 ns/iter |
1.02 |
E2E_Evaluator_cerebrum_criminal_case |
1181311.0199667586 ns/iter |
1016668.3213772916 ns/iter |
1.16 |
E2E_Evaluator_clang_format |
113137.47546011503 ns/iter |
103058.33357997838 ns/iter |
1.10 |
E2E_Evaluator_cmake_presets |
4440976.910828001 ns/iter |
4745018.217391404 ns/iter |
0.94 |
E2E_Evaluator_code_climate |
165462.25519850384 ns/iter |
164465.5166391295 ns/iter |
1.01 |
E2E_Evaluator_cql2 |
201733.23022222405 ns/iter |
176207.74522131355 ns/iter |
1.14 |
E2E_Evaluator_cspell |
644200.8698059629 ns/iter |
589970.2046035453 ns/iter |
1.09 |
E2E_Evaluator_cypress |
176221.49135984256 ns/iter |
166167.86738095037 ns/iter |
1.06 |
E2E_Evaluator_deno |
276798.8882306662 ns/iter |
320259.739468889 ns/iter |
0.86 |
E2E_Evaluator_dependabot |
352064.70898932056 ns/iter |
306552.6550660296 ns/iter |
1.15 |
E2E_Evaluator_draft_04 |
8077477.728395226 ns/iter |
8064257.187498924 ns/iter |
1.00 |
E2E_Evaluator_fabric_mod |
697760.3512689892 ns/iter |
637791.6530427525 ns/iter |
1.09 |
E2E_Evaluator_geojson |
12480847.875000985 ns/iter |
13293476.730771441 ns/iter |
0.94 |
E2E_Evaluator_gitpod_configuration |
233438.56241741098 ns/iter |
204430.92901329903 ns/iter |
1.14 |
E2E_Evaluator_helm_chart_lock |
265634.18373615155 ns/iter |
442871.65003153414 ns/iter |
0.60 |
E2E_Evaluator_importmap |
53362.72910426283 ns/iter |
36292.43206803719 ns/iter |
1.47 |
E2E_Evaluator_jasmine |
101522.257602078 ns/iter |
94240.6524439753 ns/iter |
1.08 |
E2E_Evaluator_jshintrc |
1192282.4752982582 ns/iter |
1181917.7237939797 ns/iter |
1.01 |
E2E_Evaluator_jsconfig |
420931.6865222952 ns/iter |
368367.76088100206 ns/iter |
1.14 |
E2E_Evaluator_krakend |
191630.61924457506 ns/iter |
159002.7233165188 ns/iter |
1.21 |
E2E_Evaluator_lazygit |
135023.8930314168 ns/iter |
118650.79766401844 ns/iter |
1.14 |
E2E_Evaluator_lerna |
119576.83404986975 ns/iter |
139112.2687651638 ns/iter |
0.86 |
E2E_Evaluator_nest_cli |
190964.92351505384 ns/iter |
166974.98453117348 ns/iter |
1.14 |
E2E_Evaluator_omc |
22602.784928541572 ns/iter |
18113.559205440044 ns/iter |
1.25 |
E2E_Evaluator_omnisharp |
592268.6196945213 ns/iter |
531073.8655015827 ns/iter |
1.12 |
E2E_Evaluator_openapi |
13465092.509807386 ns/iter |
13020364.740740392 ns/iter |
1.03 |
E2E_Evaluator_pre_commit_hooks |
512640.3851850396 ns/iter |
486794.7004102775 ns/iter |
1.05 |
E2E_Evaluator_pulumi |
691247.4292778156 ns/iter |
730304.3924051011 ns/iter |
0.95 |
E2E_Evaluator_semantic_release |
85229.91610200756 ns/iter |
80146.81502562432 ns/iter |
1.06 |
E2E_Evaluator_stale |
156230.67639901384 ns/iter |
132704.98370285245 ns/iter |
1.18 |
E2E_Evaluator_stylecop |
277367.47370503127 ns/iter |
240098.979979272 ns/iter |
1.16 |
E2E_Evaluator_tmuxinator |
86019.78514227217 ns/iter |
86380.51526672795 ns/iter |
1.00 |
E2E_Evaluator_ui5 |
508269.6937407341 ns/iter |
441817.165933374 ns/iter |
1.15 |
E2E_Evaluator_ui5_manifest |
2542576.6181822172 ns/iter |
2548072.5487365886 ns/iter |
1.00 |
E2E_Evaluator_unreal_engine_uproject |
450527.4589217009 ns/iter |
423713.13430134894 ns/iter |
1.06 |
E2E_Evaluator_users_array |
652953.8398876355 ns/iter |
574578.8241576607 ns/iter |
1.14 |
E2E_Evaluator_vercel |
286212.82088320487 ns/iter |
317024.75758944306 ns/iter |
0.90 |
E2E_Evaluator_yamllint |
8704.960826646375 ns/iter |
6934.107631216661 ns/iter |
1.26 |
JSONLD_Catalog_Simple |
19505402.527777784 ns/iter |
18682131.83783573 ns/iter |
1.04 |
JSONLD_Catalog_Override_Agreeing |
20658128.38235187 ns/iter |
18615510.108112495 ns/iter |
1.11 |
JSONLD_Catalog_Override_Shadowing |
32007451.99999553 ns/iter |
31336736.6521739 ns/iter |
1.02 |
Micro_Draft4_Meta_1_No_Callback |
205.27341408561622 ns/iter |
179.83790454020985 ns/iter |
1.14 |
Micro_Draft4_Required_Properties |
977.5629567318273 ns/iter |
797.9770835060673 ns/iter |
1.23 |
Micro_Draft4_Many_Optional_Properties_Minimal_Match |
26.438465338723795 ns/iter |
22.651347087829276 ns/iter |
1.17 |
Micro_Draft4_Few_Optional_Properties_Minimal_Match |
11.751566648791622 ns/iter |
9.575398239604011 ns/iter |
1.23 |
Micro_Draft4_Items_Schema |
286.016977650114 ns/iter |
329.5373532578448 ns/iter |
0.87 |
Micro_Draft4_Nested_Object |
1.4073797153044316 ns/iter |
1.3435901523256542 ns/iter |
1.05 |
Micro_Draft4_Properties_Triad_Optional |
329.6624820330384 ns/iter |
290.75862206132854 ns/iter |
1.13 |
Micro_Draft4_Properties_Triad_Closed |
273.32302047011154 ns/iter |
237.70814753427672 ns/iter |
1.15 |
Micro_Draft4_Properties_Triad_Required |
348.67551757565474 ns/iter |
301.76156419483715 ns/iter |
1.16 |
Micro_Draft4_Properties_Closed |
64.63911422393413 ns/iter |
52.71137853997106 ns/iter |
1.23 |
Micro_Draft4_Non_Recursive_Ref |
16.275046802359277 ns/iter |
13.774803545874612 ns/iter |
1.18 |
Micro_Draft4_Pattern_Properties_True |
147.16845771239176 ns/iter |
141.30503125568436 ns/iter |
1.04 |
Micro_Draft4_Ref_To_Single_Property |
11.729300742146545 ns/iter |
9.65999005440489 ns/iter |
1.21 |
Micro_Draft4_Additional_Properties_Type |
37.99628226737036 ns/iter |
37.280652979942694 ns/iter |
1.02 |
Micro_Draft4_Nested_Oneof |
57.45074997443024 ns/iter |
50.49194509999779 ns/iter |
1.14 |
Micro_Draft4_Short_Enum |
10.93696954377905 ns/iter |
9.696164630466294 ns/iter |
1.13 |
Micro_Draft4_Long_Enum |
12.956194052012009 ns/iter |
12.47033936716281 ns/iter |
1.04 |
Micro_Draft4_Long_Enum_Short_Strings |
10.915121813667614 ns/iter |
9.68506153849288 ns/iter |
1.13 |
Micro_Draft4_Type_Object |
3.527082666806388 ns/iter |
3.3281004472603093 ns/iter |
1.06 |
Micro_Draft4_Ref_Single_100 |
1807186.9432990695 ns/iter |
1692269.5193236857 ns/iter |
1.07 |
Micro_Draft4_Compile_Ref_Many_Nested |
1278454.8589741883 ns/iter |
1174804.6956525159 ns/iter |
1.09 |
Micro_Draft4_Compile_Wrap |
1815458.2374667476 ns/iter |
1665159.6762589903 ns/iter |
1.09 |
Micro_Draft6_Property_Names |
124.10070420227652 ns/iter |
122.83989137966213 ns/iter |
1.01 |
Micro_Draft6_Compile_FHIR |
14123583986.999847 ns/iter |
15425860955.99995 ns/iter |
0.92 |
Micro_Draft7_If_Then_Else |
23.603628705396478 ns/iter |
21.622753160628633 ns/iter |
1.09 |
Micro_2019_09_Unevaluated_Properties |
26.580282608423282 ns/iter |
29.74289476853404 ns/iter |
0.89 |
Micro_2019_09_Compile_Wrap |
275896683.5000365 ns/iter |
260872816.66665757 ns/iter |
1.06 |
Micro_2020_12_Dynamic_Ref |
727.1426304062843 ns/iter |
668.4952160299459 ns/iter |
1.09 |
Micro_2020_12_Dynamic_Ref_Single |
3.5262568291637044 ns/iter |
3.2244497360195474 ns/iter |
1.09 |
Micro_2020_12_Simple_Output_Mask |
1049.6727525978806 ns/iter |
888.1523786567665 ns/iter |
1.18 |
Micro_2020_12_Simple_Output_Annotations |
46066.798169451606 ns/iter |
47154.078663789485 ns/iter |
0.98 |
Micro_2020_12_Simple_Output_Annotation_Dropping |
1287425.5137114292 ns/iter |
1239404.3214917507 ns/iter |
1.04 |
Micro_2020_12_Compile_NonCircular_Shared_Refs |
732392.6045547744 ns/iter |
671652.2468779377 ns/iter |
1.09 |
Micro_2020_12_Exhaustive_Deep_Numeric |
8664.26406004714 ns/iter |
7280.085628261067 ns/iter |
1.19 |
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput |
37369.35172746868 ns/iter |
33820.749563353085 ns/iter |
1.10 |
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput |
20013.915458248423 ns/iter |
16413.01175287789 ns/iter |
1.22 |
Micro_2020_12_Exhaustive_Deep_Numeric_Fail |
155.95702480557296 ns/iter |
118.05158126842025 ns/iter |
1.32 |
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput |
2326.6773012112717 ns/iter |
2192.2574579134307 ns/iter |
1.06 |
TestSuite_Parse_WoT |
20559462.705879174 ns/iter |
19469517.65714532 ns/iter |
1.06 |
Alterschema_Check_Readibility_ISO_Language_Set_3 |
321932158.49997616 ns/iter |
305658376.4999914 ns/iter |
1.05 |
Alterschema_Check_Readibility_OMC |
86538704.75001213 ns/iter |
84923310.8750127 ns/iter |
1.02 |
Alterschema_Check_Readibility_KrakenD |
1139642817.0000944 ns/iter |
1198566477.9999752 ns/iter |
0.95 |
Alterschema_Apply_Readibility_KrakenD |
125055210838.00021 ns/iter |
127244783174.99983 ns/iter |
0.98 |
Alterschema_Check_Invalid_External_Refs |
236139093.3333496 ns/iter |
194866279.49999046 ns/iter |
1.21 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
JavaScript (linux/llvm)
Details
| Benchmark suite | Current: e33838c | Previous: a6753b2 | Ratio |
|---|---|---|---|
E2E_Evaluator_adaptivecard |
120874 ns |
105572 ns |
1.14 |
E2E_Evaluator_ansible-meta |
535622 ns |
528637 ns |
1.01 |
E2E_Evaluator_aws-cdk |
132239 ns |
133663 ns |
0.99 |
E2E_Evaluator_babelrc |
364203 ns |
473439 ns |
0.77 |
E2E_Evaluator_cerebrum-criminal-case |
2696944 ns |
2352687 ns |
1.15 |
E2E_Evaluator_clang-format |
270308 ns |
318310 ns |
0.85 |
E2E_Evaluator_cmake-presets |
17764095 ns |
18091568 ns |
0.98 |
E2E_Evaluator_code-climate |
515837 ns |
516192 ns |
1.00 |
E2E_Evaluator_cql2 |
1245795 ns |
1099001 ns |
1.13 |
E2E_Evaluator_cspell |
1663673 ns |
1710226 ns |
0.97 |
E2E_Evaluator_cypress |
858799 ns |
990018 ns |
0.87 |
E2E_Evaluator_deno |
1094730 ns |
1061819 ns |
1.03 |
E2E_Evaluator_dependabot |
1090091 ns |
1061146 ns |
1.03 |
E2E_Evaluator_draft-04 |
19674121 ns |
18929969 ns |
1.04 |
E2E_Evaluator_fabric-mod |
2456343 ns |
2318378 ns |
1.06 |
E2E_Evaluator_geojson |
23583095 ns |
27406563 ns |
0.86 |
E2E_Evaluator_gitpod-configuration |
734623 ns |
770607 ns |
0.95 |
E2E_Evaluator_helm-chart-lock |
1136087 ns |
1039991 ns |
1.09 |
E2E_Evaluator_importmap |
266188 ns |
325618 ns |
0.82 |
E2E_Evaluator_jasmine |
290154 ns |
311079 ns |
0.93 |
E2E_Evaluator_jsconfig |
1451465 ns |
1718290 ns |
0.84 |
E2E_Evaluator_jshintrc |
2929940 ns |
3121190 ns |
0.94 |
E2E_Evaluator_krakend |
657414 ns |
566217 ns |
1.16 |
E2E_Evaluator_lazygit |
470468 ns |
468934 ns |
1.00 |
E2E_Evaluator_lerna |
469347 ns |
477838 ns |
0.98 |
E2E_Evaluator_nest-cli |
630681 ns |
709159 ns |
0.89 |
E2E_Evaluator_omc |
115157 ns |
106293 ns |
1.08 |
E2E_Evaluator_omnisharp |
1497029 ns |
1537477 ns |
0.97 |
E2E_Evaluator_openapi |
44331462 ns |
39793463 ns |
1.11 |
E2E_Evaluator_pre-commit-hooks |
2208387 ns |
2013751 ns |
1.10 |
E2E_Evaluator_pulumi |
2102432 ns |
2041126 ns |
1.03 |
E2E_Evaluator_semantic-release |
236397 ns |
282653 ns |
0.84 |
E2E_Evaluator_stale |
385560 ns |
417943 ns |
0.92 |
E2E_Evaluator_stylecop |
1199312 ns |
1221950 ns |
0.98 |
E2E_Evaluator_tmuxinator |
220706 ns |
296917 ns |
0.74 |
E2E_Evaluator_ui5 |
2200736 ns |
1945600 ns |
1.13 |
E2E_Evaluator_ui5-manifest |
9823377 ns |
10045107 ns |
0.98 |
E2E_Evaluator_unreal-engine-uproject |
1606948 ns |
1693268 ns |
0.95 |
E2E_Evaluator_users-array |
2835758 ns |
2660534 ns |
1.07 |
E2E_Evaluator_vercel |
1017407 ns |
1035901 ns |
0.98 |
E2E_Evaluator_yamllint |
24215 ns |
25814 ns |
0.94 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Benchmark (linux/gcc)
Details
| Benchmark suite | Current: e33838c | Previous: a6753b2 | Ratio |
|---|---|---|---|
Alterschema_Check_Readibility_ISO_Language_Set_3 |
327750564.4999792 ns/iter |
347005935.9999595 ns/iter |
0.94 |
Alterschema_Check_Readibility_OMC |
82360650.12499693 ns/iter |
87800137.75000839 ns/iter |
0.94 |
Alterschema_Check_Readibility_KrakenD |
1041481303.9999444 ns/iter |
1092766172.9999726 ns/iter |
0.95 |
Alterschema_Apply_Readibility_KrakenD |
118191993681.99997 ns/iter |
123430909562.9999 ns/iter |
0.96 |
Alterschema_Check_Invalid_External_Refs |
279234308.5000084 ns/iter |
288601992.5000483 ns/iter |
0.97 |
TestSuite_Parse_WoT |
22151561.531252638 ns/iter |
23749418.766669806 ns/iter |
0.93 |
Micro_2020_12_Dynamic_Ref |
825.944078415716 ns/iter |
850.2501266518434 ns/iter |
0.97 |
Micro_2020_12_Dynamic_Ref_Single |
4.360927607951279 ns/iter |
4.361465325925376 ns/iter |
1.00 |
Micro_2020_12_Simple_Output_Mask |
1137.2387372256403 ns/iter |
1138.379106099146 ns/iter |
1.00 |
Micro_2020_12_Simple_Output_Annotations |
61887.94594120463 ns/iter |
60321.474307610595 ns/iter |
1.03 |
Micro_2020_12_Simple_Output_Annotation_Dropping |
1636207.632558115 ns/iter |
1630190.8181817443 ns/iter |
1.00 |
Micro_2020_12_Compile_NonCircular_Shared_Refs |
869496.0248446834 ns/iter |
880203.9020102898 ns/iter |
0.99 |
Micro_2020_12_Exhaustive_Deep_Numeric |
9047.917694746044 ns/iter |
9216.208727462425 ns/iter |
0.98 |
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput |
44104.94625015666 ns/iter |
44975.02546267015 ns/iter |
0.98 |
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput |
21967.30675097791 ns/iter |
22104.99813403311 ns/iter |
0.99 |
Micro_2020_12_Exhaustive_Deep_Numeric_Fail |
167.75642487299314 ns/iter |
159.9896368771137 ns/iter |
1.05 |
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput |
3042.488508137705 ns/iter |
3008.357154597058 ns/iter |
1.01 |
Micro_2019_09_Unevaluated_Properties |
31.815579658132524 ns/iter |
30.95474525624372 ns/iter |
1.03 |
Micro_2019_09_Compile_Wrap |
283546146.0000488 ns/iter |
306273339.4999668 ns/iter |
0.93 |
Micro_Draft7_If_Then_Else |
23.994181491521346 ns/iter |
24.936886532618214 ns/iter |
0.96 |
Micro_Draft6_Property_Names |
150.1558557422559 ns/iter |
149.83675934899395 ns/iter |
1.00 |
Micro_Draft6_Compile_FHIR |
12465894985.999966 ns/iter |
14443149700.00005 ns/iter |
0.86 |
Micro_Draft4_Meta_1_No_Callback |
179.13702144302212 ns/iter |
182.27759819748843 ns/iter |
0.98 |
Micro_Draft4_Required_Properties |
859.226901830103 ns/iter |
870.6582149762515 ns/iter |
0.99 |
Micro_Draft4_Many_Optional_Properties_Minimal_Match |
21.51140091248282 ns/iter |
22.157749390226034 ns/iter |
0.97 |
Micro_Draft4_Few_Optional_Properties_Minimal_Match |
15.590226362763644 ns/iter |
15.583519156961403 ns/iter |
1.00 |
Micro_Draft4_Items_Schema |
351.6207833935942 ns/iter |
332.29785024728164 ns/iter |
1.06 |
Micro_Draft4_Nested_Object |
1.5575382890436382 ns/iter |
1.5567217691916992 ns/iter |
1.00 |
Micro_Draft4_Properties_Triad_Optional |
434.3026214849137 ns/iter |
364.27661811570243 ns/iter |
1.19 |
Micro_Draft4_Properties_Triad_Closed |
308.6716259293542 ns/iter |
299.99042458010894 ns/iter |
1.03 |
Micro_Draft4_Properties_Triad_Required |
424.2423358584188 ns/iter |
432.6629549131927 ns/iter |
0.98 |
Micro_Draft4_Properties_Closed |
66.39994722962483 ns/iter |
66.40097382934529 ns/iter |
1.00 |
Micro_Draft4_Non_Recursive_Ref |
9.036024684882547 ns/iter |
9.0352316054871 ns/iter |
1.00 |
Micro_Draft4_Pattern_Properties_True |
202.2771408003575 ns/iter |
207.25055076422208 ns/iter |
0.98 |
Micro_Draft4_Ref_To_Single_Property |
15.90716134491445 ns/iter |
15.915029518410714 ns/iter |
1.00 |
Micro_Draft4_Additional_Properties_Type |
14.022775130452777 ns/iter |
14.005550650112013 ns/iter |
1.00 |
Micro_Draft4_Nested_Oneof |
63.74952583058645 ns/iter |
63.15923503600394 ns/iter |
1.01 |
Micro_Draft4_Short_Enum |
14.677215353982573 ns/iter |
14.70236817261866 ns/iter |
1.00 |
Micro_Draft4_Long_Enum |
13.716591879139976 ns/iter |
12.471321217247086 ns/iter |
1.10 |
Micro_Draft4_Long_Enum_Short_Strings |
14.652646152348954 ns/iter |
14.651239364067225 ns/iter |
1.00 |
Micro_Draft4_Type_Object |
4.359118801542097 ns/iter |
4.35871454346316 ns/iter |
1.00 |
Micro_Draft4_Ref_Single_100 |
1945820.3036212132 ns/iter |
1988260.4745761694 ns/iter |
0.98 |
Micro_Draft4_Compile_Ref_Many_Nested |
1387368.0177513864 ns/iter |
1382752.225742596 ns/iter |
1.00 |
Micro_Draft4_Compile_Wrap |
2077067.0474779797 ns/iter |
2086657.1845237743 ns/iter |
1.00 |
JSONLD_Catalog_Simple |
23286570.199995063 ns/iter |
24748811.148145724 ns/iter |
0.94 |
JSONLD_Catalog_Override_Agreeing |
23333744.800000507 ns/iter |
26124784.879993968 ns/iter |
0.89 |
JSONLD_Catalog_Override_Shadowing |
33218981.761906654 ns/iter |
38668901.17647284 ns/iter |
0.86 |
E2E_Compiler_adaptivecard |
56744370.4166711 ns/iter |
60493128.63636012 ns/iter |
0.94 |
E2E_Compiler_ansible_meta |
25924535.1111093 ns/iter |
27165990.999999568 ns/iter |
0.95 |
E2E_Compiler_aws_cdk |
315911.8957302801 ns/iter |
315474.5590621857 ns/iter |
1.00 |
E2E_Compiler_babelrc |
2149798.3661538456 ns/iter |
2170985.000000313 ns/iter |
0.99 |
E2E_Compiler_clang_format |
15605054.86666241 ns/iter |
16048491.295454038 ns/iter |
0.97 |
E2E_Compiler_cmake_presets |
23584317.633337073 ns/iter |
24254627.74074192 ns/iter |
0.97 |
E2E_Compiler_code_climate |
2127691.893292649 ns/iter |
2153873.221537791 ns/iter |
0.99 |
E2E_Compiler_cql2 |
11773574.288134238 ns/iter |
12406594.035711903 ns/iter |
0.95 |
E2E_Compiler_cspell |
20150445.771430116 ns/iter |
21570257.058823805 ns/iter |
0.93 |
E2E_Compiler_cypress |
3404256.4975607092 ns/iter |
3437642.092682459 ns/iter |
0.99 |
E2E_Compiler_deno |
7061598.020201394 ns/iter |
7098417.295918233 ns/iter |
0.99 |
E2E_Compiler_dependabot |
3329660.0900482764 ns/iter |
3385452.705314479 ns/iter |
0.98 |
E2E_Compiler_draft_04 |
2285647.3921568845 ns/iter |
2303645.8052803646 ns/iter |
0.99 |
E2E_Compiler_fabric_mod |
3912898.9611109924 ns/iter |
3947445.016853196 ns/iter |
0.99 |
E2E_Compiler_geojson |
19829426.828573562 ns/iter |
20706052.212117907 ns/iter |
0.96 |
E2E_Compiler_gitpod_configuration |
4251216.266667061 ns/iter |
4320047.656441312 ns/iter |
0.98 |
E2E_Compiler_helm_chart_lock |
566443.1014611478 ns/iter |
574628.9508197076 ns/iter |
0.99 |
E2E_Compiler_importmap |
240348.27955877583 ns/iter |
241933.6936937093 ns/iter |
0.99 |
E2E_Compiler_jasmine |
1101863.6666665655 ns/iter |
1109510.671428671 ns/iter |
0.99 |
E2E_Compiler_jshintrc |
3633337.6735757706 ns/iter |
3685950.1361262104 ns/iter |
0.99 |
E2E_Compiler_jsconfig |
19580539.38889432 ns/iter |
20586471.70588301 ns/iter |
0.95 |
E2E_Compiler_krakend |
126644747.39999604 ns/iter |
137458492.3999919 ns/iter |
0.92 |
E2E_Compiler_lazygit |
29542316.87500434 ns/iter |
32167292.77273151 ns/iter |
0.92 |
E2E_Compiler_lerna |
1321915.5310735982 ns/iter |
1328712.5028680395 ns/iter |
0.99 |
E2E_Compiler_nest_cli |
6360083.4454539595 ns/iter |
6488488.093458659 ns/iter |
0.98 |
E2E_Compiler_omc |
156497414.74999246 ns/iter |
174799810.74995977 ns/iter |
0.90 |
E2E_Compiler_omnisharp |
5805669.669419984 ns/iter |
5941192.669491996 ns/iter |
0.98 |
E2E_Compiler_openapi |
22746422.35484099 ns/iter |
24856345.535714094 ns/iter |
0.92 |
E2E_Compiler_pre_commit_hooks |
4313615.012346485 ns/iter |
4482585.384615062 ns/iter |
0.96 |
E2E_Compiler_pulumi |
3399112.9660190707 ns/iter |
3439531.177339188 ns/iter |
0.99 |
E2E_Compiler_semantic_release |
1254588.5637340317 ns/iter |
1287726.67889897 ns/iter |
0.97 |
E2E_Compiler_stale |
1259477.8255397745 ns/iter |
1282233.5174952322 ns/iter |
0.98 |
E2E_Compiler_stylecop |
5320337.378787882 ns/iter |
5400729.669230923 ns/iter |
0.99 |
E2E_Compiler_tmuxinator |
1559059.5367480589 ns/iter |
1585516.8136361253 ns/iter |
0.98 |
E2E_Compiler_ui5 |
42731509.00000644 ns/iter |
47881904.35713854 ns/iter |
0.89 |
E2E_Compiler_ui5_manifest |
291305413.5000266 ns/iter |
322566641.000094 ns/iter |
0.90 |
E2E_Compiler_unreal_engine_uproject |
3815775.190217793 ns/iter |
3911388.313186902 ns/iter |
0.98 |
E2E_Compiler_users_array |
681959.5267250873 ns/iter |
699912.6613547119 ns/iter |
0.97 |
E2E_Compiler_vercel |
10978529.852462118 ns/iter |
11733927.803278243 ns/iter |
0.94 |
E2E_Compiler_yamllint |
282582.2033966888 ns/iter |
289250.0540765589 ns/iter |
0.98 |
E2E_Evaluator_adaptivecard |
26074.115771619116 ns/iter |
26206.33033021962 ns/iter |
0.99 |
E2E_Evaluator_ansible_meta |
286061.11274514743 ns/iter |
289455.7323885228 ns/iter |
0.99 |
E2E_Evaluator_aws_cdk |
58917.539056583686 ns/iter |
59321.48881923884 ns/iter |
0.99 |
E2E_Evaluator_babelrc |
116088.18928629677 ns/iter |
115814.18291876212 ns/iter |
1.00 |
E2E_Evaluator_cerebrum_criminal_case |
1151832.261083758 ns/iter |
1174414.5953177293 ns/iter |
0.98 |
E2E_Evaluator_clang_format |
106480.99417265962 ns/iter |
106075.65452071308 ns/iter |
1.00 |
E2E_Evaluator_cmake_presets |
4801915.935713298 ns/iter |
6685492.321099829 ns/iter |
0.72 |
E2E_Evaluator_code_climate |
230738.0427406511 ns/iter |
234296.26220124096 ns/iter |
0.98 |
E2E_Evaluator_cql2 |
230258.29124959456 ns/iter |
226015.02981721333 ns/iter |
1.02 |
E2E_Evaluator_cspell |
627485.010733448 ns/iter |
628841.378870625 ns/iter |
1.00 |
E2E_Evaluator_cypress |
188409.9719827381 ns/iter |
190890.49022270218 ns/iter |
0.99 |
E2E_Evaluator_deno |
365844.1491596313 ns/iter |
364729.1995764764 ns/iter |
1.00 |
E2E_Evaluator_dependabot |
402155.8456684339 ns/iter |
411656.16792561597 ns/iter |
0.98 |
E2E_Evaluator_draft_04 |
8770759.103895983 ns/iter |
10471343.148648541 ns/iter |
0.84 |
E2E_Evaluator_fabric_mod |
798855.6472601474 ns/iter |
809987.7058822889 ns/iter |
0.99 |
E2E_Evaluator_geojson |
13498782.403845467 ns/iter |
13569795.549020614 ns/iter |
0.99 |
E2E_Evaluator_gitpod_configuration |
277566.7442322657 ns/iter |
284041.11855455546 ns/iter |
0.98 |
E2E_Evaluator_helm_chart_lock |
363720.0000000122 ns/iter |
376690.28844110813 ns/iter |
0.97 |
E2E_Evaluator_importmap |
50264.692601385526 ns/iter |
51177.45576980153 ns/iter |
0.98 |
E2E_Evaluator_jasmine |
124759.78318424737 ns/iter |
128250.1927233305 ns/iter |
0.97 |
E2E_Evaluator_jshintrc |
1093011.3859373592 ns/iter |
1091547.71048516 ns/iter |
1.00 |
E2E_Evaluator_jsconfig |
444280.3463576481 ns/iter |
448105.4448693332 ns/iter |
0.99 |
E2E_Evaluator_krakend |
226022.75095910174 ns/iter |
219311.20432161845 ns/iter |
1.03 |
E2E_Evaluator_lazygit |
152857.2611548961 ns/iter |
151655.81132076215 ns/iter |
1.01 |
E2E_Evaluator_lerna |
172401.06950946472 ns/iter |
172235.13772309636 ns/iter |
1.00 |
E2E_Evaluator_nest_cli |
214205.46495832893 ns/iter |
217614.6918532621 ns/iter |
0.98 |
E2E_Evaluator_omc |
24495.263858941787 ns/iter |
24634.263497263833 ns/iter |
0.99 |
E2E_Evaluator_omnisharp |
607800.0384285216 ns/iter |
585385.3856540364 ns/iter |
1.04 |
E2E_Evaluator_openapi |
15206855.34782605 ns/iter |
17345434.682926968 ns/iter |
0.88 |
E2E_Evaluator_pre_commit_hooks |
555153.910883211 ns/iter |
572822.5209002929 ns/iter |
0.97 |
E2E_Evaluator_pulumi |
769456.1877731233 ns/iter |
770898.7656078913 ns/iter |
1.00 |
E2E_Evaluator_semantic_release |
108977.64915280283 ns/iter |
108427.89109660519 ns/iter |
1.01 |
E2E_Evaluator_stale |
176209.5710710747 ns/iter |
176465.34516372706 ns/iter |
1.00 |
E2E_Evaluator_stylecop |
324545.08257303486 ns/iter |
321594.4477406793 ns/iter |
1.01 |
E2E_Evaluator_tmuxinator |
110370.05486558891 ns/iter |
106416.17410505039 ns/iter |
1.04 |
E2E_Evaluator_ui5 |
620256.0158033055 ns/iter |
630645.3645545917 ns/iter |
0.98 |
E2E_Evaluator_ui5_manifest |
3063022.9344983906 ns/iter |
4210281.438271983 ns/iter |
0.73 |
E2E_Evaluator_unreal_engine_uproject |
516386.69581197965 ns/iter |
508435.48403495847 ns/iter |
1.02 |
E2E_Evaluator_users_array |
668981.2638215531 ns/iter |
715455.9555555802 ns/iter |
0.94 |
E2E_Evaluator_vercel |
348141.8466135501 ns/iter |
353607.5615813671 ns/iter |
0.98 |
E2E_Evaluator_yamllint |
13434.429228778738 ns/iter |
13058.52420873884 ns/iter |
1.03 |
Schema_Format_ISO_Language_To_JSON |
104641951.33333002 ns/iter |
112787231.49996495 ns/iter |
0.93 |
Schema_Bundle_Meta_2020_12 |
1481900.1898759292 ns/iter |
1533790.292578825 ns/iter |
0.97 |
Schema_Frame_WoT_References |
4625114.572368267 ns/iter |
4862306.815602232 ns/iter |
0.95 |
Schema_Frame_OMC_References |
20903424.757575933 ns/iter |
25609856.892864563 ns/iter |
0.82 |
Schema_Frame_OMC_Locations |
19290753.9444415 ns/iter |
22893574.40000307 ns/iter |
0.84 |
Schema_Frame_ISO_Language_Locations |
97164195.14286046 ns/iter |
103290192.16665833 ns/iter |
0.94 |
Schema_Frame_ISO_Language_Root |
459.137160330863 ns/iter |
476.6618103260421 ns/iter |
0.96 |
Schema_Frame_KrakenD_References |
36049966.199993834 ns/iter |
42050139.06249633 ns/iter |
0.86 |
Schema_Frame_KrakenD_Reachable |
441662660.50001466 ns/iter |
517360589.9999529 ns/iter |
0.85 |
Schema_Frame_ISO_Language_Locations_To_JSON |
117148090.79999213 ns/iter |
119707941.80001576 ns/iter |
0.98 |
Schema_Frame_Many_Resources_References |
347679489.5000239 ns/iter |
366990213.5000029 ns/iter |
0.95 |
Schema_Tracker_ISO_Language |
4900723.669012978 ns/iter |
5331658.123077432 ns/iter |
0.92 |
Schema_Tracker_ISO_Language_To_JSON |
19303921.756760687 ns/iter |
20346617.42424181 ns/iter |
0.95 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
JavaScript (linux/gcc)
Details
| Benchmark suite | Current: e33838c | Previous: a6753b2 | Ratio |
|---|---|---|---|
E2E_Evaluator_adaptivecard |
120909 ns |
122044 ns |
0.99 |
E2E_Evaluator_ansible-meta |
516023 ns |
528931 ns |
0.98 |
E2E_Evaluator_aws-cdk |
147959 ns |
148259 ns |
1.00 |
E2E_Evaluator_babelrc |
343249 ns |
363064 ns |
0.95 |
E2E_Evaluator_cerebrum-criminal-case |
2523774 ns |
2572489 ns |
0.98 |
E2E_Evaluator_clang-format |
252445 ns |
261349 ns |
0.97 |
E2E_Evaluator_cmake-presets |
19695635 ns |
19774174 ns |
1.00 |
E2E_Evaluator_code-climate |
522572 ns |
527107 ns |
0.99 |
E2E_Evaluator_cql2 |
1297708 ns |
1263845 ns |
1.03 |
E2E_Evaluator_cspell |
1468239 ns |
1575329 ns |
0.93 |
E2E_Evaluator_cypress |
772816 ns |
798100 ns |
0.97 |
E2E_Evaluator_deno |
1066411 ns |
1086219 ns |
0.98 |
E2E_Evaluator_dependabot |
1105831 ns |
1143417 ns |
0.97 |
E2E_Evaluator_draft-04 |
21204412 ns |
24529933 ns |
0.86 |
E2E_Evaluator_fabric-mod |
2344849 ns |
2484810 ns |
0.94 |
E2E_Evaluator_geojson |
22713446 ns |
25523149 ns |
0.89 |
E2E_Evaluator_gitpod-configuration |
707032 ns |
750660 ns |
0.94 |
E2E_Evaluator_helm-chart-lock |
975223 ns |
1006865 ns |
0.97 |
E2E_Evaluator_importmap |
262662 ns |
269492 ns |
0.97 |
E2E_Evaluator_jasmine |
299986 ns |
306421 ns |
0.98 |
E2E_Evaluator_jsconfig |
1229997 ns |
1300410 ns |
0.95 |
E2E_Evaluator_jshintrc |
2709368 ns |
2916925 ns |
0.93 |
E2E_Evaluator_krakend |
660720 ns |
674449 ns |
0.98 |
E2E_Evaluator_lazygit |
493560 ns |
530302 ns |
0.93 |
E2E_Evaluator_lerna |
466273 ns |
480865 ns |
0.97 |
E2E_Evaluator_nest-cli |
594067 ns |
617301 ns |
0.96 |
E2E_Evaluator_omc |
116736 ns |
116510 ns |
1.00 |
E2E_Evaluator_omnisharp |
1437727 ns |
1459875 ns |
0.98 |
E2E_Evaluator_openapi |
45019432 ns |
48097130 ns |
0.94 |
E2E_Evaluator_pre-commit-hooks |
1947689 ns |
2140308 ns |
0.91 |
E2E_Evaluator_pulumi |
1900044 ns |
2053005 ns |
0.93 |
E2E_Evaluator_semantic-release |
256558 ns |
273805 ns |
0.94 |
E2E_Evaluator_stale |
411038 ns |
421511 ns |
0.98 |
E2E_Evaluator_stylecop |
1204659 ns |
1247585 ns |
0.97 |
E2E_Evaluator_tmuxinator |
228455 ns |
244392 ns |
0.93 |
E2E_Evaluator_ui5 |
2251942 ns |
2273264 ns |
0.99 |
E2E_Evaluator_ui5-manifest |
10433346 ns |
14259041 ns |
0.73 |
E2E_Evaluator_unreal-engine-uproject |
1507868 ns |
1567841 ns |
0.96 |
E2E_Evaluator_users-array |
3121549 ns |
3231073 ns |
0.97 |
E2E_Evaluator_vercel |
981119 ns |
992285 ns |
0.99 |
E2E_Evaluator_yamllint |
25705 ns |
26070 ns |
0.99 |
This comment was automatically generated by workflow using github-action-benchmark.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Signed-off-by: Juan Cruz Viotti jv@jviotti.com