Skip to content

Upgrade JSON Schema Test Suite to aa77c9d343a2da809d4c8734f473c4d5b5d80f14#829

Merged
jviotti merged 1 commit into
mainfrom
test-suite-draft3
May 26, 2026
Merged

Upgrade JSON Schema Test Suite to aa77c9d343a2da809d4c8734f473c4d5b5d80f14#829
jviotti merged 1 commit into
mainfrom
test-suite-draft3

Conversation

@jviotti
Copy link
Copy Markdown
Member

@jviotti jviotti commented May 26, 2026

Signed-off-by: Juan Cruz Viotti jv@jviotti.com

…d80f14`

Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>
Copy link
Copy Markdown

@cubic-dev-ai cubic-dev-ai Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No issues found across 3 files

Re-trigger cubic

@augmentcode
Copy link
Copy Markdown

augmentcode Bot commented May 26, 2026

🤖 Augment PR Summary

Summary: Updates the vendored JSON Schema Test Suite to commit aa77c9d3….
Changes: Bumps the dependency pin and drops a now-obsolete local patch while carrying forward the updated Draft 3 ref.json test content.

🤖 Was this summary useful? React with 👍 or 👎

Copy link
Copy Markdown

@augmentcode augmentcode Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Review completed. 1 suggestion posted.

Fix All in Augment

Comment augment review to trigger a new review at any time.

Comment thread vendor/jsonschema-test-suite/tests/draft3/ref.json
Copy link
Copy Markdown

@github-actions github-actions Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark (macos/llvm)

Details
Benchmark suite Current: dfca757 Previous: 12cec8e Ratio
Schema_Iterator_ISO_Language 2011902.148484351 ns/iter 2059506.1214687305 ns/iter 0.98
Schema_Tracker_ISO_Language 4156164.473684914 ns/iter 3904623.8516482017 ns/iter 1.06
Schema_Tracker_ISO_Language_To_JSON 12693860.124995483 ns/iter 12343127.155173171 ns/iter 1.03
Schema_Frame_WoT_References 4327574.012423153 ns/iter 4287402.439024945 ns/iter 1.01
Schema_Frame_OMC_References 20543868.882347908 ns/iter 20978612.393939715 ns/iter 0.98
Schema_Frame_OMC_Locations 19228659.891895577 ns/iter 23370030.083330877 ns/iter 0.82
Schema_Frame_ISO_Language_Locations 65485270.8999897 ns/iter 66079087.49999751 ns/iter 0.99
Schema_Frame_KrakenD_References 44358723.93750628 ns/iter 38178497.666668445 ns/iter 1.16
Schema_Frame_KrakenD_Reachable 308450625.50019974 ns/iter 312245562.4999247 ns/iter 0.99
Schema_Frame_ISO_Language_Locations_To_JSON 88079708.33330122 ns/iter 75916680.55555248 ns/iter 1.16
Schema_Frame_Many_Resources_References 254596166.66663957 ns/iter 248194263.66665688 ns/iter 1.03
Schema_Bundle_Meta_2020_12 1185467.84011835 ns/iter 1175974.4848493612 ns/iter 1.01
Schema_Format_ISO_Language_To_JSON 66661920.79997017 ns/iter 67298879.30001724 ns/iter 0.99
E2E_Compiler_adaptivecard 49882431.57140459 ns/iter 50699937.499993145 ns/iter 0.98
E2E_Compiler_ansible_meta 22130286.290326517 ns/iter 21924830.718749177 ns/iter 1.01
E2E_Compiler_aws_cdk 251520.42604207667 ns/iter 251093.18828154687 ns/iter 1.00
E2E_Compiler_babelrc 1925937.3861106925 ns/iter 2113886.726776159 ns/iter 0.91
E2E_Compiler_clang_format 14020592.134618081 ns/iter 15676995.162792524 ns/iter 0.89
E2E_Compiler_cmake_presets 22942982.548395395 ns/iter 22510856.193548534 ns/iter 1.02
E2E_Compiler_code_climate 1973540.9605640545 ns/iter 1972495.0704226678 ns/iter 1.00
E2E_Compiler_cql2 10426724.7424256 ns/iter 11363904.850746458 ns/iter 0.92
E2E_Compiler_cspell 18448663.461535595 ns/iter 18758434.675674293 ns/iter 0.98
E2E_Compiler_cypress 3283000.954338168 ns/iter 3191019.5852533476 ns/iter 1.03
E2E_Compiler_deno 5974111.470083863 ns/iter 5920133.822033384 ns/iter 1.01
E2E_Compiler_dependabot 3266936.046511123 ns/iter 3241898.5370370555 ns/iter 1.01
E2E_Compiler_draft_04 1793173.6982091654 ns/iter 1784728.5805627299 ns/iter 1.00
E2E_Compiler_fabric_mod 3316259.211537989 ns/iter 3362374.6121493964 ns/iter 0.99
E2E_Compiler_geojson 19217042.805558372 ns/iter 19805564.285713572 ns/iter 0.97
E2E_Compiler_gitpod_configuration 3658634.816755603 ns/iter 3764521.0681818947 ns/iter 0.97
E2E_Compiler_helm_chart_lock 467610.2040819041 ns/iter 463737.869420406 ns/iter 1.01
E2E_Compiler_importmap 185131.1280969916 ns/iter 183580.12727272024 ns/iter 1.01
E2E_Compiler_jasmine 974384.5367846835 ns/iter 953272.4018816113 ns/iter 1.02
E2E_Compiler_jshintrc 2874855.1350205 ns/iter 2878372.1000002557 ns/iter 1.00
E2E_Compiler_jsconfig 16617660.714278568 ns/iter 16849128.860464357 ns/iter 0.99
E2E_Compiler_krakend 110649333.33333707 ns/iter 131278805.49999797 ns/iter 0.84
E2E_Compiler_lazygit 27897943.320003834 ns/iter 29342574.26086926 ns/iter 0.95
E2E_Compiler_lerna 1205938.7182134711 ns/iter 1212032.495667293 ns/iter 0.99
E2E_Compiler_nest_cli 5582723.873015903 ns/iter 5929392.561983684 ns/iter 0.94
E2E_Compiler_omc 139318991.79997343 ns/iter 152575208.24999914 ns/iter 0.91
E2E_Compiler_omnisharp 5277066.7938956935 ns/iter 5518335.526315704 ns/iter 0.96
E2E_Compiler_openapi 19850719.888886992 ns/iter 19316523.13888637 ns/iter 1.03
E2E_Compiler_pre_commit_hooks 3725152.4064173126 ns/iter 3850552.3031915342 ns/iter 0.97
E2E_Compiler_pulumi 2910472.1618248853 ns/iter 2922172.224999997 ns/iter 1.00
E2E_Compiler_semantic_release 1144030.1009459042 ns/iter 1128808.0834724582 ns/iter 1.01
E2E_Compiler_stale 1111674.737007781 ns/iter 1089723.861801117 ns/iter 1.02
E2E_Compiler_stylecop 4880800.062497631 ns/iter 4889493.055555268 ns/iter 1.00
E2E_Compiler_tmuxinator 1363778.9452056198 ns/iter 1351816.3461537387 ns/iter 1.01
E2E_Compiler_ui5 44527502.56248805 ns/iter 45459755.250000454 ns/iter 0.98
E2E_Compiler_ui5_manifest 257584527.99997637 ns/iter 260845486.0000317 ns/iter 0.99
E2E_Compiler_unreal_engine_uproject 3707576.203209208 ns/iter 3523424.528301554 ns/iter 1.05
E2E_Compiler_users_array 699458.6630430837 ns/iter 814097.7394711281 ns/iter 0.86
E2E_Compiler_vercel 10901280.924241345 ns/iter 13045349.451612853 ns/iter 0.84
E2E_Compiler_yamllint 224216.44993580054 ns/iter 272631.9562437022 ns/iter 0.82
E2E_Evaluator_adaptivecard 17365.05448209868 ns/iter 18822.86520628459 ns/iter 0.92
E2E_Evaluator_ansible_meta 146032.57005434175 ns/iter 158611.13799741914 ns/iter 0.92
E2E_Evaluator_aws_cdk 30939.269185101206 ns/iter 32888.06245243751 ns/iter 0.94
E2E_Evaluator_babelrc 71035.28635259089 ns/iter 73770.7857842664 ns/iter 0.96
E2E_Evaluator_cerebrum_criminal_case 570105.2419354827 ns/iter 668381.7670068067 ns/iter 0.85
E2E_Evaluator_clang_format 85941.61174712238 ns/iter 95026.35217855984 ns/iter 0.90
E2E_Evaluator_cmake_presets 2967594.224770404 ns/iter 4064031.380753515 ns/iter 0.73
E2E_Evaluator_code_climate 111965.6752411806 ns/iter 112708.68991121209 ns/iter 0.99
E2E_Evaluator_cql2 130396.88335242766 ns/iter 131211.464938457 ns/iter 0.99
E2E_Evaluator_cspell 342789.3987248908 ns/iter 349670.8825271904 ns/iter 0.98
E2E_Evaluator_cypress 123497.82788482663 ns/iter 129304.71840197397 ns/iter 0.96
E2E_Evaluator_deno 197569.2046213005 ns/iter 195075.4367816155 ns/iter 1.01
E2E_Evaluator_dependabot 210152.68555912827 ns/iter 208725.96297401673 ns/iter 1.01
E2E_Evaluator_draft_04 4475139.692308753 ns/iter 5202373.642856701 ns/iter 0.86
E2E_Evaluator_fabric_mod 422194.2608173033 ns/iter 421517.3798165473 ns/iter 1.00
E2E_Evaluator_geojson 8484803.204819728 ns/iter 8957409.638553025 ns/iter 0.95
E2E_Evaluator_gitpod_configuration 145835.81277218115 ns/iter 154550.946681677 ns/iter 0.94
E2E_Evaluator_helm_chart_lock 183699.2212965477 ns/iter 181696.64927216645 ns/iter 1.01
E2E_Evaluator_importmap 27600.867310248865 ns/iter 27907.19988223416 ns/iter 0.99
E2E_Evaluator_jasmine 73163.9952137461 ns/iter 75349.31371103716 ns/iter 0.97
E2E_Evaluator_jshintrc 852540.0238949853 ns/iter 848182.2783132116 ns/iter 1.01
E2E_Evaluator_jsconfig 274064.8291634284 ns/iter 272940.2719469462 ns/iter 1.00
E2E_Evaluator_krakend 112383.0215862116 ns/iter 112666.13463713683 ns/iter 1.00
E2E_Evaluator_lazygit 92423.96907213413 ns/iter 90805.68998430464 ns/iter 1.02
E2E_Evaluator_lerna 100607.71564806775 ns/iter 100777.96635378299 ns/iter 1.00
E2E_Evaluator_nest_cli 112704.27439313264 ns/iter 112060.1464184233 ns/iter 1.01
E2E_Evaluator_omc 12152.71022815399 ns/iter 14117.81125241652 ns/iter 0.86
E2E_Evaluator_omnisharp 386820.28223560564 ns/iter 387445.5699224099 ns/iter 1.00
E2E_Evaluator_openapi 5002766.951725664 ns/iter 5211264.365517967 ns/iter 0.96
E2E_Evaluator_pre_commit_hooks 312688.5283362565 ns/iter 307864.6020317627 ns/iter 1.02
E2E_Evaluator_pulumi 450460.59974090685 ns/iter 470071.63174797577 ns/iter 0.96
E2E_Evaluator_semantic_release 61976.17939371723 ns/iter 64121.66047601101 ns/iter 0.97
E2E_Evaluator_stale 99987.84162507362 ns/iter 100244.13618440545 ns/iter 1.00
E2E_Evaluator_stylecop 170125.08085210976 ns/iter 183686.67028720482 ns/iter 0.93
E2E_Evaluator_tmuxinator 63044.74439057074 ns/iter 64937.60814048254 ns/iter 0.97
E2E_Evaluator_ui5 302532.60336647095 ns/iter 330062.73832223687 ns/iter 0.92
E2E_Evaluator_ui5_manifest 1340668.3571428258 ns/iter 1476605.275362762 ns/iter 0.91
E2E_Evaluator_unreal_engine_uproject 282148.45205485454 ns/iter 293302.81740895525 ns/iter 0.96
E2E_Evaluator_users_array 383331.57249849295 ns/iter 373374.5132696897 ns/iter 1.03
E2E_Evaluator_vercel 197051.25021355113 ns/iter 197848.9494064897 ns/iter 1.00
E2E_Evaluator_yamllint 5376.666263127504 ns/iter 5455.762408276307 ns/iter 0.99
Micro_Draft4_Meta_1_No_Callback 118.86674500481757 ns/iter 120.23517295561979 ns/iter 0.99
Micro_Draft4_Required_Properties 571.2033757870864 ns/iter 571.483224435442 ns/iter 1.00
Micro_Draft4_Many_Optional_Properties_Minimal_Match 14.414792940860961 ns/iter 14.511706234446885 ns/iter 0.99
Micro_Draft4_Few_Optional_Properties_Minimal_Match 6.550657280207351 ns/iter 6.484166587644107 ns/iter 1.01
Micro_Draft4_Items_Schema 234.53390852514838 ns/iter 239.08771262930833 ns/iter 0.98
Micro_Draft4_Nested_Object 0.6317900221670258 ns/iter 0.6276982784804722 ns/iter 1.01
Micro_Draft4_Properties_Triad_Optional 183.2289455561178 ns/iter 183.66248066759772 ns/iter 1.00
Micro_Draft4_Properties_Triad_Closed 151.6752093810065 ns/iter 151.4191420970452 ns/iter 1.00
Micro_Draft4_Properties_Triad_Required 192.6029237451443 ns/iter 201.3919431698569 ns/iter 0.96
Micro_Draft4_Properties_Closed 34.887360691391514 ns/iter 34.20966864296811 ns/iter 1.02
Micro_Draft4_Non_Recursive_Ref 9.132791461943286 ns/iter 9.17484462515769 ns/iter 1.00
Micro_Draft4_Pattern_Properties_True 135.05929059377027 ns/iter 139.208802323169 ns/iter 0.97
Micro_Draft4_Ref_To_Single_Property 6.535088505699681 ns/iter 6.477409281622836 ns/iter 1.01
Micro_Draft4_Additional_Properties_Type 18.518238938267828 ns/iter 18.530643547270724 ns/iter 1.00
Micro_Draft4_Nested_Oneof 37.008690868647484 ns/iter 37.050696272551605 ns/iter 1.00
Micro_Draft4_Short_Enum 4.747748048665054 ns/iter 4.5764127463694715 ns/iter 1.04
Micro_Draft4_Long_Enum 9.412567349065482 ns/iter 9.921755454409022 ns/iter 0.95
Micro_Draft4_Long_Enum_Short_Strings 5.714737574296662 ns/iter 5.948462504675406 ns/iter 0.96
Micro_Draft4_Type_Object 2.0192298522409664 ns/iter 2.2813253470932495 ns/iter 0.89
Micro_Draft4_Ref_Single_100 1529031.318083281 ns/iter 1567646.7830802791 ns/iter 0.98
Micro_Draft4_Compile_Ref_Many_Nested 1151112.4742763562 ns/iter 1111182.4324322662 ns/iter 1.04
Micro_Draft4_Compile_Wrap 1850374.5654449123 ns/iter 1810948.6701030282 ns/iter 1.02
Micro_Draft6_Property_Names 87.40580598282149 ns/iter 86.93746400673425 ns/iter 1.01
Micro_Draft6_Compile_FHIR 7167599584.0000725 ns/iter 6601273291.99986 ns/iter 1.09
Micro_Draft7_If_Then_Else 15.708006241004322 ns/iter 15.759459551044428 ns/iter 1.00
Micro_2019_09_Unevaluated_Properties 24.73721258016752 ns/iter 24.69028141590449 ns/iter 1.00
Micro_2019_09_Compile_Wrap 281680833.5001042 ns/iter 262595013.9999986 ns/iter 1.07
Micro_2020_12_Dynamic_Ref 171.276515568783 ns/iter 173.99380287080734 ns/iter 0.98
Micro_2020_12_Dynamic_Ref_Single 2.0203291703147115 ns/iter 2.0333498215004275 ns/iter 0.99
Micro_2020_12_Simple_Output_Mask 755.9285697985003 ns/iter 738.7934696876212 ns/iter 1.02
Micro_2020_12_Simple_Output_Annotations 81768.13416554988 ns/iter 78625.25113739583 ns/iter 1.04
Micro_2020_12_Compile_NonCircular_Shared_Refs 730050.7567847138 ns/iter 731152.7175574207 ns/iter 1.00
Micro_2020_12_Exhaustive_Deep_Numeric 4817.261242132636 ns/iter 4895.912079295684 ns/iter 0.98
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput 104812.18453002821 ns/iter 104386.60340451248 ns/iter 1.00
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput 13213.010445885337 ns/iter 12950.420985697436 ns/iter 1.02
Micro_2020_12_Exhaustive_Deep_Numeric_Fail 82.827219198846 ns/iter 82.92136223886445 ns/iter 1.00
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput 4591.543378822143 ns/iter 4524.460423752986 ns/iter 1.01
Alterschema_Check_Readibility_ISO_Language_Set_3 210989402.6666552 ns/iter 217759319.3333299 ns/iter 0.97
Alterschema_Check_Readibility_OMC 52018598.21428505 ns/iter 54691249.99999272 ns/iter 0.95
Alterschema_Check_Readibility_KrakenD 624504500.0000573 ns/iter 534274249.9999531 ns/iter 1.17
Alterschema_Apply_Readibility_KrakenD 57827078666.00003 ns/iter 57672097166.99995 ns/iter 1.00
Alterschema_Check_Invalid_External_Refs 166007770.9999541 ns/iter 158410020.7500114 ns/iter 1.05

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown

@github-actions github-actions Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

JavaScript (macos/llvm)

Details
Benchmark suite Current: dfca757 Previous: 12cec8e Ratio
E2E_Evaluator_adaptivecard 99558 ns 92046 ns 1.08
E2E_Evaluator_ansible-meta 337407 ns 338894 ns 1.00
E2E_Evaluator_aws-cdk 116754 ns 111282 ns 1.05
E2E_Evaluator_babelrc 251434 ns 245605 ns 1.02
E2E_Evaluator_cerebrum-criminal-case 1654013 ns 1557219 ns 1.06
E2E_Evaluator_clang-format 168807 ns 170025 ns 0.99
E2E_Evaluator_cmake-presets 11778060 ns 10904683 ns 1.08
E2E_Evaluator_code-climate 360436 ns 333064 ns 1.08
E2E_Evaluator_cql2 977745 ns 855146 ns 1.14
E2E_Evaluator_cspell 1100125 ns 924418 ns 1.19
E2E_Evaluator_cypress 496554 ns 507643 ns 0.98
E2E_Evaluator_deno 636620 ns 663810 ns 0.96
E2E_Evaluator_dependabot 718538 ns 715200 ns 1.00
E2E_Evaluator_draft-04 15430103 ns 15053466 ns 1.03
E2E_Evaluator_fabric-mod 1332396 ns 1323269 ns 1.01
E2E_Evaluator_geojson 13636730 ns 13688715 ns 1.00
E2E_Evaluator_gitpod-configuration 471901 ns 455274 ns 1.04
E2E_Evaluator_helm-chart-lock 819524 ns 795978 ns 1.03
E2E_Evaluator_importmap 204427 ns 201812 ns 1.01
E2E_Evaluator_jasmine 213089 ns 201880 ns 1.06
E2E_Evaluator_jsconfig 846878 ns 787704 ns 1.08
E2E_Evaluator_jshintrc 1864485 ns 1848020 ns 1.01
E2E_Evaluator_krakend 402473 ns 396192 ns 1.02
E2E_Evaluator_lazygit 271969 ns 258503 ns 1.05
E2E_Evaluator_lerna 340638 ns 300907 ns 1.13
E2E_Evaluator_nest-cli 514044 ns 401314 ns 1.28
E2E_Evaluator_omc 72106 ns 65640 ns 1.10
E2E_Evaluator_omnisharp 1235531 ns 906720 ns 1.36
E2E_Evaluator_openapi 19441310 ns 14261276 ns 1.36
E2E_Evaluator_pre-commit-hooks 1806597 ns 1240579 ns 1.46
E2E_Evaluator_pulumi 1765648 ns 1269341 ns 1.39
E2E_Evaluator_semantic-release 202023 ns 168161 ns 1.20
E2E_Evaluator_stale 297915 ns 266988 ns 1.12
E2E_Evaluator_stylecop 722153 ns 683995 ns 1.06
E2E_Evaluator_tmuxinator 171424 ns 150630 ns 1.14
E2E_Evaluator_ui5 1678519 ns 1447674 ns 1.16
E2E_Evaluator_ui5-manifest 9294436 ns 7201316 ns 1.29
E2E_Evaluator_unreal-engine-uproject 1186620 ns 1161580 ns 1.02
E2E_Evaluator_users-array 2215540 ns 1722498 ns 1.29
E2E_Evaluator_vercel 766721 ns 705466 ns 1.09
E2E_Evaluator_yamllint 24289 ns 22475 ns 1.08

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown

@github-actions github-actions Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark (linux/llvm)

Details
Benchmark suite Current: dfca757 Previous: 12cec8e Ratio
Schema_Iterator_ISO_Language 3000093.7217392754 ns/iter 3042784.709250935 ns/iter 0.99
Schema_Tracker_ISO_Language 7175982.242105611 ns/iter 7386013.191920009 ns/iter 0.97
Schema_Tracker_ISO_Language_To_JSON 17989826.102565624 ns/iter 18031564.461539466 ns/iter 1.00
Schema_Frame_WoT_References 5306883.1654138565 ns/iter 5334091.175572531 ns/iter 0.99
Schema_Frame_OMC_References 22470605.322580688 ns/iter 22833408.620687712 ns/iter 0.98
Schema_Frame_OMC_Locations 20908679.44117663 ns/iter 21131432.84848527 ns/iter 0.99
Schema_Frame_ISO_Language_Locations 106658612.9999981 ns/iter 101714793.00000404 ns/iter 1.05
Schema_Frame_KrakenD_References 42413819.058825694 ns/iter 41370494.24999617 ns/iter 1.03
Schema_Frame_KrakenD_Reachable 592271022.9999666 ns/iter 579445343.0000886 ns/iter 1.02
Schema_Frame_ISO_Language_Locations_To_JSON 113977478.99998195 ns/iter 111758515.50001425 ns/iter 1.02
Schema_Frame_Many_Resources_References 369066535.9999912 ns/iter 366193506.0000019 ns/iter 1.01
Schema_Bundle_Meta_2020_12 1680170.2613882918 ns/iter 1655582.2600459263 ns/iter 1.01
Schema_Format_ISO_Language_To_JSON 115696455.8333584 ns/iter 108345570.99999149 ns/iter 1.07
E2E_Compiler_adaptivecard 64450052.999998465 ns/iter 62936821.54545298 ns/iter 1.02
E2E_Compiler_ansible_meta 29527517.45833382 ns/iter 29375745.291664165 ns/iter 1.01
E2E_Compiler_aws_cdk 362023.99585492903 ns/iter 363528.27927460003 ns/iter 1.00
E2E_Compiler_babelrc 2574688.5091577843 ns/iter 2572091.9743589014 ns/iter 1.00
E2E_Compiler_clang_format 18531768.526315775 ns/iter 18436532.868418597 ns/iter 1.01
E2E_Compiler_cmake_presets 26624109.80769017 ns/iter 26969005.666665502 ns/iter 0.99
E2E_Compiler_code_climate 2606446.4312266996 ns/iter 2621901.153557967 ns/iter 0.99
E2E_Compiler_cql2 13100187.849056296 ns/iter 13128301.596155394 ns/iter 1.00
E2E_Compiler_cspell 23344748.866668396 ns/iter 23340619.785715587 ns/iter 1.00
E2E_Compiler_cypress 3962510.2329549384 ns/iter 3964115.977273056 ns/iter 1.00
E2E_Compiler_deno 7823013.213483596 ns/iter 7788253.8444454335 ns/iter 1.00
E2E_Compiler_dependabot 3990373.879999944 ns/iter 3961988.644067849 ns/iter 1.01
E2E_Compiler_draft_04 2705258.9186047753 ns/iter 2695191.318007677 ns/iter 1.00
E2E_Compiler_fabric_mod 4813952.075861724 ns/iter 4776684.836734498 ns/iter 1.01
E2E_Compiler_geojson 22985937.354838647 ns/iter 22457798.580643933 ns/iter 1.02
E2E_Compiler_gitpod_configuration 4971367.666666509 ns/iter 4930205.007042332 ns/iter 1.01
E2E_Compiler_helm_chart_lock 676592.5996132399 ns/iter 677156.0666022765 ns/iter 1.00
E2E_Compiler_importmap 274645.28509805555 ns/iter 272071.2399068587 ns/iter 1.01
E2E_Compiler_jasmine 1347378.1464354943 ns/iter 1344814.0345488552 ns/iter 1.00
E2E_Compiler_jshintrc 4321003.487654179 ns/iter 4318460.129629756 ns/iter 1.00
E2E_Compiler_jsconfig 22080740.625000317 ns/iter 22090267.19355088 ns/iter 1.00
E2E_Compiler_krakend 139298810.20001176 ns/iter 138838735.60000664 ns/iter 1.00
E2E_Compiler_lazygit 34412327.14285867 ns/iter 34100358.64999941 ns/iter 1.01
E2E_Compiler_lerna 1587654.133182792 ns/iter 1599493.397727191 ns/iter 0.99
E2E_Compiler_nest_cli 7517698.408601944 ns/iter 7532080.010752262 ns/iter 1.00
E2E_Compiler_omc 162108648.50000918 ns/iter 160700032.49998876 ns/iter 1.01
E2E_Compiler_omnisharp 6802925.514563461 ns/iter 6776272.844660428 ns/iter 1.00
E2E_Compiler_openapi 25609599.48148475 ns/iter 25416240.7407387 ns/iter 1.01
E2E_Compiler_pre_commit_hooks 5354007.374045826 ns/iter 5358621.069230525 ns/iter 1.00
E2E_Compiler_pulumi 4049532.312138986 ns/iter 4059334.1213875622 ns/iter 1.00
E2E_Compiler_semantic_release 1555887.0953434524 ns/iter 1566498.4608500842 ns/iter 0.99
E2E_Compiler_stale 1542794.0750550765 ns/iter 1561058.61625286 ns/iter 0.99
E2E_Compiler_stylecop 6188292.132742792 ns/iter 6184389.309734508 ns/iter 1.00
E2E_Compiler_tmuxinator 1910174.7983649338 ns/iter 1909699.2027399424 ns/iter 1.00
E2E_Compiler_ui5 48559527.85714278 ns/iter 48546117.50000361 ns/iter 1.00
E2E_Compiler_ui5_manifest 308697920.4999807 ns/iter 308034813.00000614 ns/iter 1.00
E2E_Compiler_unreal_engine_uproject 4609074.589403547 ns/iter 4638500.8344370825 ns/iter 0.99
E2E_Compiler_users_array 772295.0444444147 ns/iter 774017.3509933102 ns/iter 1.00
E2E_Compiler_vercel 12557156.464286631 ns/iter 12501620.78571496 ns/iter 1.00
E2E_Compiler_yamllint 335008.6464646321 ns/iter 331184.86078343634 ns/iter 1.01
E2E_Evaluator_adaptivecard 23679.68602958507 ns/iter 23726.247802807775 ns/iter 1.00
E2E_Evaluator_ansible_meta 205879.57854177576 ns/iter 203886.3888888911 ns/iter 1.01
E2E_Evaluator_aws_cdk 41711.418179637454 ns/iter 41678.936533819106 ns/iter 1.00
E2E_Evaluator_babelrc 84218.39611324164 ns/iter 83777.09163346406 ns/iter 1.01
E2E_Evaluator_cerebrum_criminal_case 1006377.832618162 ns/iter 999777.9220586768 ns/iter 1.01
E2E_Evaluator_clang_format 114522.48863450442 ns/iter 115536.70294118054 ns/iter 0.99
E2E_Evaluator_cmake_presets 4401312.029850529 ns/iter 4245621.415204411 ns/iter 1.04
E2E_Evaluator_code_climate 148877.84969981507 ns/iter 148833.28846978105 ns/iter 1.00
E2E_Evaluator_cql2 180159.01668377875 ns/iter 183389.7637974691 ns/iter 0.98
E2E_Evaluator_cspell 540137.2483973615 ns/iter 540370.7943706388 ns/iter 1.00
E2E_Evaluator_cypress 168390.13908532026 ns/iter 164661.9536550229 ns/iter 1.02
E2E_Evaluator_deno 242280.89701601234 ns/iter 243147.11909722871 ns/iter 1.00
E2E_Evaluator_dependabot 290988.2280265177 ns/iter 293147.3910870267 ns/iter 0.99
E2E_Evaluator_draft_04 8465928.749999529 ns/iter 7267932.221052911 ns/iter 1.16
E2E_Evaluator_fabric_mod 657061.3560399387 ns/iter 642756.1499068484 ns/iter 1.02
E2E_Evaluator_geojson 14933011.914894102 ns/iter 15208975.872339696 ns/iter 0.98
E2E_Evaluator_gitpod_configuration 193801.41762238028 ns/iter 195748.58645773443 ns/iter 0.99
E2E_Evaluator_helm_chart_lock 237500.89887640483 ns/iter 234868.64365860098 ns/iter 1.01
E2E_Evaluator_importmap 40723.11486099797 ns/iter 40559.20977360843 ns/iter 1.00
E2E_Evaluator_jasmine 91983.0740740697 ns/iter 92011.78121735221 ns/iter 1.00
E2E_Evaluator_jshintrc 1151623.5700164123 ns/iter 1156588.342062154 ns/iter 1.00
E2E_Evaluator_jsconfig 395524.7412031575 ns/iter 397096.92329704534 ns/iter 1.00
E2E_Evaluator_krakend 187545.52335234574 ns/iter 181118.80323590746 ns/iter 1.04
E2E_Evaluator_lazygit 119388.87417334432 ns/iter 121394.08643477746 ns/iter 0.98
E2E_Evaluator_lerna 104391.31720107836 ns/iter 105271.07259528464 ns/iter 0.99
E2E_Evaluator_nest_cli 164595.72013484823 ns/iter 165113.15451552896 ns/iter 1.00
E2E_Evaluator_omc 16950.93701919447 ns/iter 17295.910493528805 ns/iter 0.98
E2E_Evaluator_omnisharp 554004.5075576565 ns/iter 554445.0768000388 ns/iter 1.00
E2E_Evaluator_openapi 12690634.37930997 ns/iter 10885035.540982766 ns/iter 1.17
E2E_Evaluator_pre_commit_hooks 457699.8780327709 ns/iter 458038.9488189261 ns/iter 1.00
E2E_Evaluator_pulumi 640738.1093750452 ns/iter 654497.5213357732 ns/iter 0.98
E2E_Evaluator_semantic_release 76872.6226643188 ns/iter 82301.73232496709 ns/iter 0.93
E2E_Evaluator_stale 140317.80557769095 ns/iter 147401.98662884536 ns/iter 0.95
E2E_Evaluator_stylecop 252837.01405913747 ns/iter 252781.43361527406 ns/iter 1.00
E2E_Evaluator_tmuxinator 79568.17579633035 ns/iter 78984.06170598479 ns/iter 1.01
E2E_Evaluator_ui5 459678.55921051785 ns/iter 460769.2341935563 ns/iter 1.00
E2E_Evaluator_ui5_manifest 2282998.292604292 ns/iter 2247400.7491961545 ns/iter 1.02
E2E_Evaluator_unreal_engine_uproject 403362.5884058247 ns/iter 400703.823732699 ns/iter 1.01
E2E_Evaluator_users_array 536622.2234206698 ns/iter 537373.4148204743 ns/iter 1.00
E2E_Evaluator_vercel 238724.54322270452 ns/iter 242223.66277874907 ns/iter 0.99
E2E_Evaluator_yamllint 8150.8690934996 ns/iter 8057.990255925725 ns/iter 1.01
Micro_Draft4_Meta_1_No_Callback 191.7806959246755 ns/iter 197.2223146221418 ns/iter 0.97
Micro_Draft4_Required_Properties 856.8461901992381 ns/iter 858.0916881908963 ns/iter 1.00
Micro_Draft4_Many_Optional_Properties_Minimal_Match 23.77239141305527 ns/iter 24.08201244662844 ns/iter 0.99
Micro_Draft4_Few_Optional_Properties_Minimal_Match 10.802190065341154 ns/iter 10.634743647570472 ns/iter 1.02
Micro_Draft4_Items_Schema 249.31817301944773 ns/iter 252.97524554554758 ns/iter 0.99
Micro_Draft4_Nested_Object 1.4066430876942204 ns/iter 1.406400525084268 ns/iter 1.00
Micro_Draft4_Properties_Triad_Optional 317.6110506815123 ns/iter 325.08993061566383 ns/iter 0.98
Micro_Draft4_Properties_Triad_Closed 262.7730408840497 ns/iter 262.95023433265584 ns/iter 1.00
Micro_Draft4_Properties_Triad_Required 330.38826336475967 ns/iter 331.7040849437406 ns/iter 1.00
Micro_Draft4_Properties_Closed 59.880784545995425 ns/iter 59.963191861682276 ns/iter 1.00
Micro_Draft4_Non_Recursive_Ref 12.247969519560387 ns/iter 12.21298452546247 ns/iter 1.00
Micro_Draft4_Pattern_Properties_True 152.52546489000153 ns/iter 147.3827842954413 ns/iter 1.03
Micro_Draft4_Ref_To_Single_Property 10.62525231907916 ns/iter 10.62975381033057 ns/iter 1.00
Micro_Draft4_Additional_Properties_Type 23.173362029974307 ns/iter 22.917530527185214 ns/iter 1.01
Micro_Draft4_Nested_Oneof 52.11753044803354 ns/iter 52.21087157790577 ns/iter 1.00
Micro_Draft4_Short_Enum 14.060717857175437 ns/iter 14.05976048693307 ns/iter 1.00
Micro_Draft4_Long_Enum 13.029157483457183 ns/iter 13.37160707422313 ns/iter 0.97
Micro_Draft4_Long_Enum_Short_Strings 14.061738869699784 ns/iter 14.060168539000232 ns/iter 1.00
Micro_Draft4_Type_Object 3.169122885564635 ns/iter 3.168404858954441 ns/iter 1.00
Micro_Draft4_Ref_Single_100 2325917.493377401 ns/iter 2331946.182119429 ns/iter 1.00
Micro_Draft4_Compile_Ref_Many_Nested 1712173.8296296308 ns/iter 1715984.9535452062 ns/iter 1.00
Micro_Draft4_Compile_Wrap 2387920.46598621 ns/iter 2366731.087542165 ns/iter 1.01
Micro_Draft6_Property_Names 123.85444882029056 ns/iter 123.77933810054294 ns/iter 1.00
Micro_Draft6_Compile_FHIR 15965495207.000004 ns/iter 15833296098.999994 ns/iter 1.01
Micro_Draft7_If_Then_Else 28.11304857445218 ns/iter 23.409172165409398 ns/iter 1.20
Micro_2019_09_Unevaluated_Properties 25.053867006520687 ns/iter 25.04085386989724 ns/iter 1.00
Micro_2019_09_Compile_Wrap 315172672.4999548 ns/iter 343770957.99999326 ns/iter 0.92
Micro_2020_12_Dynamic_Ref 224.03191829847077 ns/iter 224.60467772269058 ns/iter 1.00
Micro_2020_12_Dynamic_Ref_Single 3.1675788090832264 ns/iter 3.167701619130601 ns/iter 1.00
Micro_2020_12_Simple_Output_Mask 1030.5068417377513 ns/iter 1026.9573649744934 ns/iter 1.00
Micro_2020_12_Simple_Output_Annotations 94059.40712365317 ns/iter 93350.52610654142 ns/iter 1.01
Micro_2020_12_Compile_NonCircular_Shared_Refs 1077771.912442277 ns/iter 1082118.6559139057 ns/iter 1.00
Micro_2020_12_Exhaustive_Deep_Numeric 8380.36293273595 ns/iter 8603.743126674653 ns/iter 0.97
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput 167587.86127863446 ns/iter 171565.63227062984 ns/iter 0.98
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput 22672.282255441743 ns/iter 23511.992872749106 ns/iter 0.96
Micro_2020_12_Exhaustive_Deep_Numeric_Fail 144.98289129496203 ns/iter 144.4392955317845 ns/iter 1.00
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput 4017.646145723618 ns/iter 4084.8994682281086 ns/iter 0.98
Alterschema_Check_Readibility_ISO_Language_Set_3 343022087.9999979 ns/iter 355628452.000019 ns/iter 0.96
Alterschema_Check_Readibility_OMC 90706926.62500335 ns/iter 92180090.62499277 ns/iter 0.98
Alterschema_Check_Readibility_KrakenD 1304457120.000052 ns/iter 1302086904.0000207 ns/iter 1.00
Alterschema_Apply_Readibility_KrakenD 130767708835.00012 ns/iter 129232087099.99994 ns/iter 1.01
Alterschema_Check_Invalid_External_Refs 279237755.9999295 ns/iter 278257654.66665566 ns/iter 1.00

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown

@github-actions github-actions Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

JavaScript (linux/llvm)

Details
Benchmark suite Current: dfca757 Previous: 12cec8e Ratio
E2E_Evaluator_adaptivecard 118134 ns 118500 ns 1.00
E2E_Evaluator_ansible-meta 535007 ns 548994 ns 0.97
E2E_Evaluator_aws-cdk 132903 ns 133923 ns 0.99
E2E_Evaluator_babelrc 335602 ns 309240 ns 1.09
E2E_Evaluator_cerebrum-criminal-case 2652559 ns 2644195 ns 1.00
E2E_Evaluator_clang-format 260047 ns 282949 ns 0.92
E2E_Evaluator_cmake-presets 18056615 ns 18228186 ns 0.99
E2E_Evaluator_code-climate 482192 ns 494211 ns 0.98
E2E_Evaluator_cql2 1247573 ns 1265726 ns 0.99
E2E_Evaluator_cspell 1695488 ns 1732011 ns 0.98
E2E_Evaluator_cypress 905246 ns 863423 ns 1.05
E2E_Evaluator_deno 1109937 ns 1105427 ns 1.00
E2E_Evaluator_dependabot 1183442 ns 1208179 ns 0.98
E2E_Evaluator_draft-04 25308129 ns 25728766 ns 0.98
E2E_Evaluator_fabric-mod 2528631 ns 2623030 ns 0.96
E2E_Evaluator_geojson 21123152 ns 24964366 ns 0.85
E2E_Evaluator_gitpod-configuration 729807 ns 741081 ns 0.98
E2E_Evaluator_helm-chart-lock 1003879 ns 1005599 ns 1.00
E2E_Evaluator_importmap 267788 ns 278027 ns 0.96
E2E_Evaluator_jasmine 281938 ns 290017 ns 0.97
E2E_Evaluator_jsconfig 1448848 ns 1530927 ns 0.95
E2E_Evaluator_jshintrc 3121611 ns 2983128 ns 1.05
E2E_Evaluator_krakend 642332 ns 634477 ns 1.01
E2E_Evaluator_lazygit 461737 ns 466571 ns 0.99
E2E_Evaluator_lerna 462328 ns 465290 ns 0.99
E2E_Evaluator_nest-cli 608886 ns 614104 ns 0.99
E2E_Evaluator_omc 92581 ns 94978 ns 0.97
E2E_Evaluator_omnisharp 1478548 ns 1489597 ns 0.99
E2E_Evaluator_openapi 26737359 ns 26719537 ns 1.00
E2E_Evaluator_pre-commit-hooks 2098784 ns 2097488 ns 1.00
E2E_Evaluator_pulumi 2056079 ns 2024996 ns 1.02
E2E_Evaluator_semantic-release 226591 ns 229458 ns 0.99
E2E_Evaluator_stale 383745 ns 382543 ns 1.00
E2E_Evaluator_stylecop 1244123 ns 1238307 ns 1.00
E2E_Evaluator_tmuxinator 215678 ns 219176 ns 0.98
E2E_Evaluator_ui5 2285867 ns 2373831 ns 0.96
E2E_Evaluator_ui5-manifest 10450577 ns 11411973 ns 0.92
E2E_Evaluator_unreal-engine-uproject 1583262 ns 1590122 ns 1.00
E2E_Evaluator_users-array 2483384 ns 2549541 ns 0.97
E2E_Evaluator_vercel 1013575 ns 1070363 ns 0.95
E2E_Evaluator_yamllint 28732 ns 24109 ns 1.19

This comment was automatically generated by workflow using github-action-benchmark.

@jviotti jviotti merged commit ef4910b into main May 26, 2026
14 checks passed
@jviotti jviotti deleted the test-suite-draft3 branch May 26, 2026 22:09
Copy link
Copy Markdown

@github-actions github-actions Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark (linux/gcc)

Details
Benchmark suite Current: dfca757 Previous: 12cec8e Ratio
Alterschema_Check_Readibility_ISO_Language_Set_3 359375815.0000212 ns/iter 365583764.50000197 ns/iter 0.98
Alterschema_Check_Readibility_OMC 95409807.14288187 ns/iter 95089513.42857991 ns/iter 1.00
Alterschema_Check_Readibility_KrakenD 1334164635.9999685 ns/iter 1274132955.999903 ns/iter 1.05
Alterschema_Apply_Readibility_KrakenD 122734167479 ns/iter 120607168319.00005 ns/iter 1.02
Alterschema_Check_Invalid_External_Refs 327754679.9999982 ns/iter 319587130.5000537 ns/iter 1.03
Micro_2020_12_Dynamic_Ref 259.89189918978957 ns/iter 256.7252814560956 ns/iter 1.01
Micro_2020_12_Dynamic_Ref_Single 4.668744779215169 ns/iter 4.677861923335042 ns/iter 1.00
Micro_2020_12_Simple_Output_Mask 1181.4635060287317 ns/iter 1167.7895719926246 ns/iter 1.01
Micro_2020_12_Simple_Output_Annotations 118122.39519759736 ns/iter 117999.17466956451 ns/iter 1.00
Micro_2020_12_Compile_NonCircular_Shared_Refs 1260280.2486485376 ns/iter 1282591.0165441416 ns/iter 0.98
Micro_2020_12_Exhaustive_Deep_Numeric 8962.755475650707 ns/iter 11480.933072958502 ns/iter 0.78
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput 168393.54483925807 ns/iter 170841.84484017774 ns/iter 0.99
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput 25714.648362595286 ns/iter 26954.446598950497 ns/iter 0.95
Micro_2020_12_Exhaustive_Deep_Numeric_Fail 158.97893319223118 ns/iter 158.65971031895762 ns/iter 1.00
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput 4810.601895212409 ns/iter 4962.635115349638 ns/iter 0.97
Micro_2019_09_Unevaluated_Properties 29.015192022729106 ns/iter 29.04553137110609 ns/iter 1.00
Micro_2019_09_Compile_Wrap 314558081.9999623 ns/iter 309150828.00004256 ns/iter 1.02
Micro_Draft7_If_Then_Else 24.30555164875302 ns/iter 24.28809340871456 ns/iter 1.00
Micro_Draft6_Property_Names 164.5454961963024 ns/iter 164.4517960079636 ns/iter 1.00
Micro_Draft6_Compile_FHIR 12957108050.000216 ns/iter 12805246798.0001 ns/iter 1.01
Micro_Draft4_Meta_1_No_Callback 174.7267035762185 ns/iter 172.87719362318649 ns/iter 1.01
Micro_Draft4_Required_Properties 818.2952830277574 ns/iter 816.4079407797585 ns/iter 1.00
Micro_Draft4_Many_Optional_Properties_Minimal_Match 21.062241258092122 ns/iter 20.919121944511268 ns/iter 1.01
Micro_Draft4_Few_Optional_Properties_Minimal_Match 13.102623825826099 ns/iter 13.09922459731689 ns/iter 1.00
Micro_Draft4_Items_Schema 322.6317813180938 ns/iter 323.5929259132871 ns/iter 1.00
Micro_Draft4_Nested_Object 1.8687884697637196 ns/iter 1.8685247821873432 ns/iter 1.00
Micro_Draft4_Properties_Triad_Optional 396.64162302413797 ns/iter 433.93687776339164 ns/iter 0.91
Micro_Draft4_Properties_Triad_Closed 303.7987113548532 ns/iter 358.8902016427971 ns/iter 0.85
Micro_Draft4_Properties_Triad_Required 413.45249418139235 ns/iter 415.98864392545966 ns/iter 0.99
Micro_Draft4_Properties_Closed 62.69019105112871 ns/iter 62.793397819794414 ns/iter 1.00
Micro_Draft4_Non_Recursive_Ref 9.343319652845958 ns/iter 9.344962920616604 ns/iter 1.00
Micro_Draft4_Pattern_Properties_True 193.87883262384196 ns/iter 193.9614609143426 ns/iter 1.00
Micro_Draft4_Ref_To_Single_Property 13.718194632315178 ns/iter 13.750351914962845 ns/iter 1.00
Micro_Draft4_Additional_Properties_Type 14.326786793087447 ns/iter 14.334124418139602 ns/iter 1.00
Micro_Draft4_Nested_Oneof 63.23226154103245 ns/iter 63.0074067204187 ns/iter 1.00
Micro_Draft4_Short_Enum 14.679704945139736 ns/iter 14.712689043186746 ns/iter 1.00
Micro_Draft4_Long_Enum 14.65988957936602 ns/iter 14.652834679088492 ns/iter 1.00
Micro_Draft4_Long_Enum_Short_Strings 14.6620460312529 ns/iter 14.711616713550924 ns/iter 1.00
Micro_Draft4_Type_Object 4.357287482074481 ns/iter 4.359639641214794 ns/iter 1.00
Micro_Draft4_Ref_Single_100 2600578.9407412927 ns/iter 2620134.1455224687 ns/iter 0.99
Micro_Draft4_Compile_Ref_Many_Nested 1871463.8579087877 ns/iter 1885443.048257334 ns/iter 0.99
Micro_Draft4_Compile_Wrap 2650413.8901519566 ns/iter 2688570.2557250666 ns/iter 0.99
E2E_Compiler_adaptivecard 67538034.80000898 ns/iter 67402857.29999869 ns/iter 1.00
E2E_Compiler_ansible_meta 32055453.09090625 ns/iter 32569930.14285096 ns/iter 0.98
E2E_Compiler_aws_cdk 446283.3322704671 ns/iter 449959.6621620921 ns/iter 0.99
E2E_Compiler_babelrc 2880876.6954736165 ns/iter 2943434.096234044 ns/iter 0.98
E2E_Compiler_clang_format 20263396.742861263 ns/iter 20645719.20588525 ns/iter 0.98
E2E_Compiler_cmake_presets 27830076.959999133 ns/iter 27943727.120000407 ns/iter 1.00
E2E_Compiler_code_climate 2910796.6763481405 ns/iter 2963593.7796616275 ns/iter 0.98
E2E_Compiler_cql2 14282923.833330112 ns/iter 14377204.20408461 ns/iter 0.99
E2E_Compiler_cspell 24367734.551725365 ns/iter 24582440.965520527 ns/iter 0.99
E2E_Compiler_cypress 4309355.323171741 ns/iter 4298788.546011732 ns/iter 1.00
E2E_Compiler_deno 8806118.16455712 ns/iter 8905688.88607786 ns/iter 0.99
E2E_Compiler_dependabot 4376818.645569016 ns/iter 4450828.471338291 ns/iter 0.98
E2E_Compiler_draft_04 3072223.2358076368 ns/iter 3115908.8577775643 ns/iter 0.99
E2E_Compiler_fabric_mod 5343641.622046805 ns/iter 5415387.223075204 ns/iter 0.99
E2E_Compiler_geojson 24641474.714290522 ns/iter 24979293.214284685 ns/iter 0.99
E2E_Compiler_gitpod_configuration 5496500.889763396 ns/iter 5602025.136000521 ns/iter 0.98
E2E_Compiler_helm_chart_lock 792850.4182855249 ns/iter 805613.0758621753 ns/iter 0.98
E2E_Compiler_importmap 331671.8076009309 ns/iter 337191.5422671433 ns/iter 0.98
E2E_Compiler_jasmine 1542881.7694015165 ns/iter 1565775.0134226931 ns/iter 0.99
E2E_Compiler_jshintrc 4870439.13888859 ns/iter 4971571.5714277 ns/iter 0.98
E2E_Compiler_jsconfig 23711284.56666156 ns/iter 23833713.482754946 ns/iter 0.99
E2E_Compiler_krakend 146765863.9999627 ns/iter 145623553.99998525 ns/iter 1.01
E2E_Compiler_lazygit 36383249.684209466 ns/iter 36998222.94737188 ns/iter 0.98
E2E_Compiler_lerna 1850988.5423281717 ns/iter 1862514.8155080294 ns/iter 0.99
E2E_Compiler_nest_cli 8268518.809524311 ns/iter 8408076.833334344 ns/iter 0.98
E2E_Compiler_omc 172395539.75002763 ns/iter 171699176.4999989 ns/iter 1.00
E2E_Compiler_omnisharp 7588412.468083895 ns/iter 7642426.902172563 ns/iter 0.99
E2E_Compiler_openapi 28494342.35999979 ns/iter 28631783.999998108 ns/iter 1.00
E2E_Compiler_pre_commit_hooks 5874265.441667603 ns/iter 6028096.094016494 ns/iter 0.97
E2E_Compiler_pulumi 4538594.4580644835 ns/iter 4618715.1842113845 ns/iter 0.98
E2E_Compiler_semantic_release 1784207.1755730503 ns/iter 1810231.1576222638 ns/iter 0.99
E2E_Compiler_stale 1753851.2019951157 ns/iter 1779613.208651639 ns/iter 0.99
E2E_Compiler_stylecop 6927275.1274491595 ns/iter 6957704.999999805 ns/iter 1.00
E2E_Compiler_tmuxinator 2218873.0504727825 ns/iter 2236307.770000015 ns/iter 0.99
E2E_Compiler_ui5 50274905.28571629 ns/iter 49881656.42857569 ns/iter 1.01
E2E_Compiler_ui5_manifest 328560764.50002545 ns/iter 322762785.9999984 ns/iter 1.02
E2E_Compiler_unreal_engine_uproject 5099320.474451868 ns/iter 5194228.7761207875 ns/iter 0.98
E2E_Compiler_users_array 917627.6961690742 ns/iter 920441.3096179838 ns/iter 1.00
E2E_Compiler_vercel 13444376.076922009 ns/iter 13493122.176473038 ns/iter 1.00
E2E_Compiler_yamllint 405793.36610761646 ns/iter 405962.52295180125 ns/iter 1.00
E2E_Evaluator_adaptivecard 23907.340100474907 ns/iter 23713.23993693494 ns/iter 1.01
E2E_Evaluator_ansible_meta 263207.94053442305 ns/iter 265256.22040351847 ns/iter 0.99
E2E_Evaluator_aws_cdk 56146.54847062171 ns/iter 55903.09935153648 ns/iter 1.00
E2E_Evaluator_babelrc 106522.03473573158 ns/iter 107096.10524731582 ns/iter 0.99
E2E_Evaluator_cerebrum_criminal_case 1088209.3599373458 ns/iter 1110891.6970172243 ns/iter 0.98
E2E_Evaluator_clang_format 115406.98769684079 ns/iter 115083.89975307434 ns/iter 1.00
E2E_Evaluator_cmake_presets 4591203.929031772 ns/iter 4576982.59740246 ns/iter 1.00
E2E_Evaluator_code_climate 198666.95794784845 ns/iter 195814.97041423063 ns/iter 1.01
E2E_Evaluator_cql2 225899.34075507204 ns/iter 224118.78113935606 ns/iter 1.01
E2E_Evaluator_cspell 546539.0438526887 ns/iter 550075.6891357176 ns/iter 0.99
E2E_Evaluator_cypress 180087.6609121555 ns/iter 180153.22578986394 ns/iter 1.00
E2E_Evaluator_deno 351509.65144597186 ns/iter 355115.929113927 ns/iter 0.99
E2E_Evaluator_dependabot 390681.007688075 ns/iter 387281.6686947494 ns/iter 1.01
E2E_Evaluator_draft_04 7018579.787233861 ns/iter 6793081.699028848 ns/iter 1.03
E2E_Evaluator_fabric_mod 812764.9176334916 ns/iter 814906.8748538708 ns/iter 1.00
E2E_Evaluator_geojson 16253920.159091318 ns/iter 15524092.521742284 ns/iter 1.05
E2E_Evaluator_gitpod_configuration 271094.79234337376 ns/iter 280537.19794949214 ns/iter 0.97
E2E_Evaluator_helm_chart_lock 310833.15915114817 ns/iter 314562.08523991995 ns/iter 0.99
E2E_Evaluator_importmap 54235.16983601147 ns/iter 54625.28913574369 ns/iter 0.99
E2E_Evaluator_jasmine 125941.78652699986 ns/iter 127010.22230322794 ns/iter 0.99
E2E_Evaluator_jshintrc 1110329.1396823677 ns/iter 1115523.2503963753 ns/iter 1.00
E2E_Evaluator_jsconfig 410160.1804819649 ns/iter 409437.34404771973 ns/iter 1.00
E2E_Evaluator_krakend 216851.10216719293 ns/iter 238012.6422573087 ns/iter 0.91
E2E_Evaluator_lazygit 149895.4343112612 ns/iter 149502.92074591693 ns/iter 1.00
E2E_Evaluator_lerna 173429.68697161257 ns/iter 172974.35494369626 ns/iter 1.00
E2E_Evaluator_nest_cli 203624.63873747742 ns/iter 204365.58364526727 ns/iter 1.00
E2E_Evaluator_omc 18914.842532077466 ns/iter 19049.868020586004 ns/iter 0.99
E2E_Evaluator_omnisharp 569351.2412102671 ns/iter 564205.3240131573 ns/iter 1.01
E2E_Evaluator_openapi 9595345.630138071 ns/iter 9441099.875001809 ns/iter 1.02
E2E_Evaluator_pre_commit_hooks 533758.7553353343 ns/iter 533075.0237366566 ns/iter 1.00
E2E_Evaluator_pulumi 771952.8015267818 ns/iter 776302.2858720209 ns/iter 0.99
E2E_Evaluator_semantic_release 105874.20639757444 ns/iter 108137.66064651655 ns/iter 0.98
E2E_Evaluator_stale 175010.81515524816 ns/iter 176298.01303911192 ns/iter 0.99
E2E_Evaluator_stylecop 308006.70083951036 ns/iter 310041.2164810136 ns/iter 0.99
E2E_Evaluator_tmuxinator 102208.91764018533 ns/iter 102195.73002753957 ns/iter 1.00
E2E_Evaluator_ui5 560152.5923566441 ns/iter 576769.2048582992 ns/iter 0.97
E2E_Evaluator_ui5_manifest 2826519.87148561 ns/iter 2829950.9265308394 ns/iter 1.00
E2E_Evaluator_unreal_engine_uproject 497332.30250898504 ns/iter 493937.70525570214 ns/iter 1.01
E2E_Evaluator_users_array 604092.2044106115 ns/iter 611597.4827286784 ns/iter 0.99
E2E_Evaluator_vercel 330211.54954520677 ns/iter 333599.67809517565 ns/iter 0.99
E2E_Evaluator_yamllint 10789.941389313251 ns/iter 10997.620134145287 ns/iter 0.98
Schema_Format_ISO_Language_To_JSON 111397516.33330281 ns/iter 111928764.16657782 ns/iter 1.00
Schema_Bundle_Meta_2020_12 1999075.9600074983 ns/iter 2015650.7385024072 ns/iter 0.99
Schema_Frame_WoT_References 5920315.60169505 ns/iter 6042759.818965664 ns/iter 0.98
Schema_Frame_OMC_References 24117586.172412205 ns/iter 24359294.13792925 ns/iter 0.99
Schema_Frame_OMC_Locations 22225092.58064982 ns/iter 22523693.741937503 ns/iter 0.99
Schema_Frame_ISO_Language_Locations 104270965.71428202 ns/iter 104851509.57142 ns/iter 0.99
Schema_Frame_KrakenD_References 43072575.99999931 ns/iter 41538590.64705797 ns/iter 1.04
Schema_Frame_KrakenD_Reachable 529983130.0001188 ns/iter 533624918.9999762 ns/iter 0.99
Schema_Frame_ISO_Language_Locations_To_JSON 147620118.39998195 ns/iter 151176999.59996572 ns/iter 0.98
Schema_Frame_Many_Resources_References 410748087.9999912 ns/iter 408009253.00004566 ns/iter 1.01
Schema_Iterator_ISO_Language 3913959.016574043 ns/iter 3998437.418078158 ns/iter 0.98
Schema_Tracker_ISO_Language 5171236.992592404 ns/iter 5158082.794117584 ns/iter 1.00
Schema_Tracker_ISO_Language_To_JSON 24340307.24137709 ns/iter 24106187.34482592 ns/iter 1.01

This comment was automatically generated by workflow using github-action-benchmark.

Copy link
Copy Markdown

@github-actions github-actions Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

JavaScript (linux/gcc)

Details
Benchmark suite Current: dfca757 Previous: 12cec8e Ratio
E2E_Evaluator_adaptivecard 119475 ns 118667 ns 1.01
E2E_Evaluator_ansible-meta 522242 ns 522305 ns 1.00
E2E_Evaluator_aws-cdk 138765 ns 140846 ns 0.99
E2E_Evaluator_babelrc 320298 ns 328555 ns 0.97
E2E_Evaluator_cerebrum-criminal-case 2579177 ns 2501940 ns 1.03
E2E_Evaluator_clang-format 254506 ns 261432 ns 0.97
E2E_Evaluator_cmake-presets 16781787 ns 17325171 ns 0.97
E2E_Evaluator_code-climate 501924 ns 496463 ns 1.01
E2E_Evaluator_cql2 1232476 ns 1227986 ns 1.00
E2E_Evaluator_cspell 1467726 ns 1482058 ns 0.99
E2E_Evaluator_cypress 767060 ns 783062 ns 0.98
E2E_Evaluator_deno 1121145 ns 1065264 ns 1.05
E2E_Evaluator_dependabot 1208021 ns 1232225 ns 0.98
E2E_Evaluator_draft-04 20747798 ns 20386118 ns 1.02
E2E_Evaluator_fabric-mod 2335389 ns 2303612 ns 1.01
E2E_Evaluator_geojson 20540761 ns 20137711 ns 1.02
E2E_Evaluator_gitpod-configuration 708038 ns 721658 ns 0.98
E2E_Evaluator_helm-chart-lock 1046363 ns 990023 ns 1.06
E2E_Evaluator_importmap 263900 ns 266347 ns 0.99
E2E_Evaluator_jasmine 285810 ns 288598 ns 0.99
E2E_Evaluator_jsconfig 1202257 ns 1223360 ns 0.98
E2E_Evaluator_jshintrc 2731415 ns 2731891 ns 1.00
E2E_Evaluator_krakend 683242 ns 647271 ns 1.06
E2E_Evaluator_lazygit 505126 ns 514847 ns 0.98
E2E_Evaluator_lerna 470388 ns 473217 ns 0.99
E2E_Evaluator_nest-cli 587593 ns 586522 ns 1.00
E2E_Evaluator_omc 93645 ns 91011 ns 1.03
E2E_Evaluator_omnisharp 1388295 ns 1411954 ns 0.98
E2E_Evaluator_openapi 22798183 ns 22297563 ns 1.02
E2E_Evaluator_pre-commit-hooks 1943965 ns 1950731 ns 1.00
E2E_Evaluator_pulumi 1861160 ns 1837288 ns 1.01
E2E_Evaluator_semantic-release 249852 ns 252528 ns 0.99
E2E_Evaluator_stale 395052 ns 391227 ns 1.01
E2E_Evaluator_stylecop 1239914 ns 1210987 ns 1.02
E2E_Evaluator_tmuxinator 223039 ns 222513 ns 1.00
E2E_Evaluator_ui5 2333529 ns 2307173 ns 1.01
E2E_Evaluator_ui5-manifest 10410588 ns 10246302 ns 1.02
E2E_Evaluator_unreal-engine-uproject 1511093 ns 1504974 ns 1.00
E2E_Evaluator_users-array 2813517 ns 2512995 ns 1.12
E2E_Evaluator_vercel 966440 ns 989020 ns 0.98
E2E_Evaluator_yamllint 25578 ns 25696 ns 1.00

This comment was automatically generated by workflow using github-action-benchmark.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant