Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add options to compiler #374

Draft
wants to merge 2 commits into
base: main
Choose a base branch
from
Draft

Add options to compiler #374

wants to merge 2 commits into from

Conversation

michaelmior
Copy link
Collaborator

No description provided.

Copy link

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark (macos/llvm)

Benchmark suite Current: cf83dd2 Previous: 948ff42 Ratio
Compiler_Draft6_AdaptiveCard 48865358374.99997 ns/iter 68687515583.000046 ns/iter 0.71
Compiler_2019_09_OMC_JSON_V2 8836208666.000004 ns/iter 8528971500.000011 ns/iter 1.04
Evaluator_Draft4_Meta_1_No_Callback 186.11419124923657 ns/iter 169.72671719074128 ns/iter 1.10
Evaluator_Draft4_Required_Properties 416.46456124630606 ns/iter 398.85139337212945 ns/iter 1.04
Evaluator_Draft4_Many_Optional_Properties_Minimal_Match 20.435233010994537 ns/iter 20.51143861046239 ns/iter 1.00
Evaluator_Draft4_Few_Optional_Properties_Minimal_Match 7.8526059848932235 ns/iter 9.754479308351259 ns/iter 0.81
Evaluator_Draft4_Items_Schema 283.0003877761105 ns/iter 290.958509477248 ns/iter 0.97
Evaluator_Draft4_Nested_Object 3.476405362432533 ns/iter 3.968864993033598 ns/iter 0.88
Evaluator_Draft4_Properties_Triad_Optional 818.4914807796631 ns/iter 875.1472013270312 ns/iter 0.94
Evaluator_Draft4_Properties_Triad_Closed 665.2833887885349 ns/iter 758.1153561037494 ns/iter 0.88
Evaluator_Draft4_Properties_Triad_Required 800.1163679701264 ns/iter 833.6451984327313 ns/iter 0.96
Evaluator_Draft4_Properties_Closed 48.51153133025986 ns/iter 55.927379199999905 ns/iter 0.87
Evaluator_Draft4_Non_Recursive_Ref 10.60158935146018 ns/iter 13.085731213957361 ns/iter 0.81
Evaluator_Draft4_Pattern_Properties_True 182.16001611379718 ns/iter 200.68650287337857 ns/iter 0.91
Evaluator_Draft4_Ref_To_Single_Property 7.936141243664921 ns/iter 8.417060277864975 ns/iter 0.94
Evaluator_Draft4_Additional_Properties_Type 17.14298131276084 ns/iter 22.170639848878377 ns/iter 0.77
Evaluator_Draft4_Nested_Oneof 52.298411471123956 ns/iter 56.529484446949944 ns/iter 0.93
Evaluator_Draft4_Short_Enum 8.810356768063665 ns/iter 8.75859896604509 ns/iter 1.01
Evaluator_Draft4_Long_Enum 29.603837468393955 ns/iter 29.47636304523582 ns/iter 1.00
Evaluator_Draft4_Long_Enum_Short_Strings 9.935873302021127 ns/iter 9.424160060216112 ns/iter 1.05
Evaluator_Draft4_Type_Object 5.810491919223843 ns/iter 5.706730231793229 ns/iter 1.02
Evaluator_Draft6_Property_Names 93.47439409267609 ns/iter 87.48063427586591 ns/iter 1.07
Evaluator_Draft7_If_Then_Else 25.71899724426745 ns/iter 24.124260760333353 ns/iter 1.07
Evaluator_Draft7_Vercel_1 36529.975278121165 ns/iter 31001.408750495273 ns/iter 1.18
Evaluator_Draft7_Helm_Chart_Lock_1 110.7189467666542 ns/iter 100.813398222645 ns/iter 1.10
Evaluator_Draft7_Helm_Chart_Lock_2 106.7411998792749 ns/iter 94.80699379120254 ns/iter 1.13
Evaluator_Draft7_Jasmine_1 109.34832432325476 ns/iter 102.79844408169117 ns/iter 1.06
Evaluator_Draft7_Dependabot_1 697.355114891019 ns/iter 755.3488162935638 ns/iter 0.92
Evaluator_2019_09_Unevaluated_Properties 39.085875369207415 ns/iter 36.48072370268871 ns/iter 1.07
Evaluator_2019_09_OMC_JSON_V2_1 983.1133331493554 ns/iter 1092.606902354513 ns/iter 0.90
Evaluator_2020_12_Dynamic_Ref 432.2405129328628 ns/iter 389.8425455808763 ns/iter 1.11
Evaluator_2020_12_Dynamic_Ref_Single 5.867379089818038 ns/iter 5.683845428665494 ns/iter 1.03
Evaluator_2020_12_CQL_1 2130.629984991102 ns/iter 2035.9767382685468 ns/iter 1.05
Evaluator_2020_12_OpenAPI 169452.7720147424 ns/iter 163976.83418651525 ns/iter 1.03

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark (macos/gcc)

Benchmark suite Current: cf83dd2 Previous: 948ff42 Ratio
Compiler_Draft6_AdaptiveCard 61656486272.81189 ns/iter 66122399091.72058 ns/iter 0.93
Compiler_2019_09_OMC_JSON_V2 9430306911.468506 ns/iter 9416313171.386719 ns/iter 1.00
Evaluator_Draft4_Meta_1_No_Callback 191.24795846735574 ns/iter 179.0340070301557 ns/iter 1.07
Evaluator_Draft4_Required_Properties 357.39237308118726 ns/iter 344.7638374317063 ns/iter 1.04
Evaluator_Draft4_Many_Optional_Properties_Minimal_Match 20.931571017663217 ns/iter 19.190374248157752 ns/iter 1.09
Evaluator_Draft4_Few_Optional_Properties_Minimal_Match 7.386787309887951 ns/iter 7.2702240138345875 ns/iter 1.02
Evaluator_Draft4_Items_Schema 450.4029721368102 ns/iter 455.4414268031641 ns/iter 0.99
Evaluator_Draft4_Nested_Object 2.1108764254531414 ns/iter 2.134963338809859 ns/iter 0.99
Evaluator_Draft4_Properties_Triad_Optional 819.6582590046427 ns/iter 865.6593168388846 ns/iter 0.95
Evaluator_Draft4_Properties_Triad_Closed 660.2961924294228 ns/iter 702.7710659449518 ns/iter 0.94
Evaluator_Draft4_Properties_Triad_Required 824.6207786365762 ns/iter 856.5415463299862 ns/iter 0.96
Evaluator_Draft4_Properties_Closed 67.10016003143376 ns/iter 70.87603836993475 ns/iter 0.95
Evaluator_Draft4_Non_Recursive_Ref 13.98374815320376 ns/iter 13.559024297252597 ns/iter 1.03
Evaluator_Draft4_Pattern_Properties_True 192.05735364718825 ns/iter 200.37707917551452 ns/iter 0.96
Evaluator_Draft4_Ref_To_Single_Property 7.1787714198708334 ns/iter 7.426877794109733 ns/iter 0.97
Evaluator_Draft4_Additional_Properties_Type 24.295898855252062 ns/iter 25.9833847640857 ns/iter 0.94
Evaluator_Draft4_Nested_Oneof 56.51908533135109 ns/iter 62.40785232352358 ns/iter 0.91
Evaluator_Draft4_Short_Enum 9.012688222587819 ns/iter 8.395230292503834 ns/iter 1.07
Evaluator_Draft4_Long_Enum 9.383540293438031 ns/iter 9.321592823113116 ns/iter 1.01
Evaluator_Draft4_Long_Enum_Short_Strings 8.341783668220858 ns/iter 8.999559781026068 ns/iter 0.93
Evaluator_Draft4_Type_Object 4.582059327346685 ns/iter 5.353753369571162 ns/iter 0.86
Evaluator_Draft6_Property_Names 103.78828945110924 ns/iter 114.66352924942656 ns/iter 0.91
Evaluator_Draft7_If_Then_Else 24.86092386844441 ns/iter 29.995074614982155 ns/iter 0.83
Evaluator_Draft7_Vercel_1 39775.48332085841 ns/iter 42715.14873207156 ns/iter 0.93
Evaluator_Draft7_Helm_Chart_Lock_1 165.29501904879842 ns/iter 179.9912254344356 ns/iter 0.92
Evaluator_Draft7_Helm_Chart_Lock_2 158.15464678475402 ns/iter 175.34144665097384 ns/iter 0.90
Evaluator_Draft7_Jasmine_1 124.41721347946455 ns/iter 133.06838680008266 ns/iter 0.93
Evaluator_Draft7_Dependabot_1 867.0132959515206 ns/iter 917.1057017982159 ns/iter 0.95
Evaluator_2019_09_Unevaluated_Properties 37.77188145485199 ns/iter 35.53271021993407 ns/iter 1.06
Evaluator_2019_09_OMC_JSON_V2_1 1155.4319440013896 ns/iter 1093.2433737637066 ns/iter 1.06
Evaluator_2020_12_Dynamic_Ref 492.48818620335607 ns/iter 465.00417112685284 ns/iter 1.06
Evaluator_2020_12_Dynamic_Ref_Single 5.041598454894206 ns/iter 4.820824961476824 ns/iter 1.05
Evaluator_2020_12_CQL_1 2664.668940372824 ns/iter 2560.7715192139476 ns/iter 1.04
Evaluator_2020_12_OpenAPI 172158.7284884288 ns/iter 173179.49894008652 ns/iter 0.99

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark (windows/msvc)

Benchmark suite Current: cf83dd2 Previous: 948ff42 Ratio
Compiler_Draft6_AdaptiveCard 170105263899.99997 ns/iter 161770240300.00006 ns/iter 1.05
Compiler_2019_09_OMC_JSON_V2 24190514300.000134 ns/iter 23853667800.00004 ns/iter 1.01
Evaluator_Draft4_Meta_1_No_Callback 367.83152088528874 ns/iter 369.96210133753726 ns/iter 0.99
Evaluator_Draft4_Required_Properties 764.292187500055 ns/iter 762.2712053570219 ns/iter 1.00
Evaluator_Draft4_Many_Optional_Properties_Minimal_Match 38.07200289157793 ns/iter 37.2045207642031 ns/iter 1.02
Evaluator_Draft4_Few_Optional_Properties_Minimal_Match 15.546628055595294 ns/iter 15.51812276785723 ns/iter 1.00
Evaluator_Draft4_Items_Schema 695.78984374985 ns/iter 704.8370535713389 ns/iter 0.99
Evaluator_Draft4_Nested_Object 5.892569000000094 ns/iter 5.897417857141818 ns/iter 1.00
Evaluator_Draft4_Properties_Triad_Optional 1625.1821428571338 ns/iter 1580.1118303571116 ns/iter 1.03
Evaluator_Draft4_Properties_Triad_Closed 1305.6276785712435 ns/iter 1289.5600046603834 ns/iter 1.01
Evaluator_Draft4_Properties_Triad_Required 1580.1265624999821 ns/iter 1575.3526785715621 ns/iter 1.00
Evaluator_Draft4_Properties_Closed 106.96160683207955 ns/iter 89.99354910714479 ns/iter 1.19
Evaluator_Draft4_Non_Recursive_Ref 31.839966122506706 ns/iter 32.15320982143055 ns/iter 0.99
Evaluator_Draft4_Pattern_Properties_True 228.50019771203387 ns/iter 228.47622450043858 ns/iter 1.00
Evaluator_Draft4_Ref_To_Single_Property 15.557350446430615 ns/iter 15.856716517857553 ns/iter 0.98
Evaluator_Draft4_Additional_Properties_Type 58.04756249998734 ns/iter 57.02608035714921 ns/iter 1.02
Evaluator_Draft4_Nested_Oneof 109.94431250001213 ns/iter 109.23020312500141 ns/iter 1.01
Evaluator_Draft4_Short_Enum 23.755680538442427 ns/iter 23.661743039487437 ns/iter 1.00
Evaluator_Draft4_Long_Enum 22.42734349969641 ns/iter 27.28693924522558 ns/iter 0.82
Evaluator_Draft4_Long_Enum_Short_Strings 28.306429460146 ns/iter 28.403774774167626 ns/iter 1.00
Evaluator_Draft4_Type_Object 13.341221428573494 ns/iter 13.541313555619258 ns/iter 0.99
Evaluator_Draft6_Property_Names 166.68272321425093 ns/iter 165.64225885997365 ns/iter 1.01
Evaluator_Draft7_If_Then_Else 55.012580357153446 ns/iter 53.3219910714219 ns/iter 1.03
Evaluator_Draft7_Vercel_1 71416.67857143018 ns/iter 71851.69642856489 ns/iter 0.99
Evaluator_Draft7_Helm_Chart_Lock_1 287.7968844733548 ns/iter 287.3415809222873 ns/iter 1.00
Evaluator_Draft7_Helm_Chart_Lock_2 262.9640943287555 ns/iter 264.0092908039715 ns/iter 1.00
Evaluator_Draft7_Jasmine_1 230.67726202335564 ns/iter 222.84465624998973 ns/iter 1.04
Evaluator_Draft7_Dependabot_1 1531.699330357128 ns/iter 1559.6377232139755 ns/iter 0.98
Evaluator_2019_09_Unevaluated_Properties 71.47553571430011 ns/iter 82.31427455357273 ns/iter 0.87
Evaluator_2019_09_OMC_JSON_V2_1 1920.5414469118025 ns/iter 1834.1054768799418 ns/iter 1.05
Evaluator_2020_12_Dynamic_Ref 826.7661830354863 ns/iter 844.8600446429667 ns/iter 0.98
Evaluator_2020_12_Dynamic_Ref_Single 13.339262500003153 ns/iter 13.549202618084447 ns/iter 0.98
Evaluator_2020_12_CQL_1 5007.464999998774 ns/iter 5086.841964285327 ns/iter 0.98
Evaluator_2020_12_OpenAPI 273173.6038569631 ns/iter 286299.7589393 ns/iter 0.95

This comment was automatically generated by workflow using github-action-benchmark.

@michaelmior michaelmior force-pushed the compile-options branch 2 times, most recently from cf0654e to 12555b9 Compare February 13, 2025 18:24
Copy link

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark (linux/llvm)

Benchmark suite Current: cf83dd2 Previous: 948ff42 Ratio
Compiler_Draft6_AdaptiveCard 68088188122.00002 ns/iter 70181558139 ns/iter 0.97
Compiler_2019_09_OMC_JSON_V2 10877352459.999998 ns/iter 11138521516.999958 ns/iter 0.98
Evaluator_Draft4_Meta_1_No_Callback 286.186207234951 ns/iter 281.14040644772996 ns/iter 1.02
Evaluator_Draft4_Required_Properties 631.0877571573822 ns/iter 637.0091221771631 ns/iter 0.99
Evaluator_Draft4_Many_Optional_Properties_Minimal_Match 32.55476395428322 ns/iter 33.2186778862558 ns/iter 0.98
Evaluator_Draft4_Few_Optional_Properties_Minimal_Match 13.3942555934411 ns/iter 13.731349942757772 ns/iter 0.98
Evaluator_Draft4_Items_Schema 653.4270547890515 ns/iter 601.3772615762289 ns/iter 1.09
Evaluator_Draft4_Nested_Object 4.661889549220544 ns/iter 5.297473956896181 ns/iter 0.88
Evaluator_Draft4_Properties_Triad_Optional 904.7973580398457 ns/iter 887.1673177241104 ns/iter 1.02
Evaluator_Draft4_Properties_Triad_Closed 723.7971327074355 ns/iter 713.7878019748217 ns/iter 1.01
Evaluator_Draft4_Properties_Triad_Required 894.5584732219543 ns/iter 889.2194886415485 ns/iter 1.01
Evaluator_Draft4_Properties_Closed 84.62420567603719 ns/iter 84.08842008239641 ns/iter 1.01
Evaluator_Draft4_Non_Recursive_Ref 28.965857635550137 ns/iter 32.37792947252274 ns/iter 0.89
Evaluator_Draft4_Pattern_Properties_True 259.42623712796546 ns/iter 235.13549778088895 ns/iter 1.10
Evaluator_Draft4_Ref_To_Single_Property 12.987588265374677 ns/iter 13.411372947017563 ns/iter 0.97
Evaluator_Draft4_Additional_Properties_Type 52.860505874920335 ns/iter 61.27961603326165 ns/iter 0.86
Evaluator_Draft4_Nested_Oneof 89.45231050673144 ns/iter 87.07251612037518 ns/iter 1.03
Evaluator_Draft4_Short_Enum 17.767899020258476 ns/iter 16.50783786203162 ns/iter 1.08
Evaluator_Draft4_Long_Enum 18.892429204234258 ns/iter 20.565145435470694 ns/iter 0.92
Evaluator_Draft4_Long_Enum_Short_Strings 19.065258051954782 ns/iter 16.526727689236928 ns/iter 1.15
Evaluator_Draft4_Type_Object 9.966038603068483 ns/iter 10.582110879094703 ns/iter 0.94
Evaluator_Draft6_Property_Names 143.57114864937338 ns/iter 135.48538461731502 ns/iter 1.06
Evaluator_Draft7_If_Then_Else 41.69531123576393 ns/iter 39.88803906165974 ns/iter 1.05
Evaluator_Draft7_Vercel_1 47288.41156233295 ns/iter 46288.47811447448 ns/iter 1.02
Evaluator_Draft7_Helm_Chart_Lock_1 286.1054004040354 ns/iter 281.46179588999286 ns/iter 1.02
Evaluator_Draft7_Helm_Chart_Lock_2 279.3485543241803 ns/iter 279.94249177250515 ns/iter 1.00
Evaluator_Draft7_Jasmine_1 181.335256438825 ns/iter 184.42010480591483 ns/iter 0.98
Evaluator_Draft7_Dependabot_1 1231.875325666867 ns/iter 1222.03226172467 ns/iter 1.01
Evaluator_2019_09_Unevaluated_Properties 54.211840347257635 ns/iter 54.325921385455835 ns/iter 1.00
Evaluator_2019_09_OMC_JSON_V2_1 1458.6741341433599 ns/iter 1417.2456792076925 ns/iter 1.03
Evaluator_2020_12_Dynamic_Ref 590.5427493841902 ns/iter 566.8699171107282 ns/iter 1.04
Evaluator_2020_12_Dynamic_Ref_Single 9.975617498950312 ns/iter 10.266036931503017 ns/iter 0.97
Evaluator_2020_12_CQL_1 3767.4511768677385 ns/iter 3723.4724145352698 ns/iter 1.01
Evaluator_2020_12_OpenAPI 191848.418617471 ns/iter 194824.32222222062 ns/iter 0.98

This comment was automatically generated by workflow using github-action-benchmark.

Copy link

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark (linux/gcc)

Benchmark suite Current: cf83dd2 Previous: 948ff42 Ratio
Evaluator_2020_12_Dynamic_Ref 638.3774802732102 ns/iter 635.9577243058183 ns/iter 1.00
Evaluator_2020_12_Dynamic_Ref_Single 9.151225560311953 ns/iter 9.343295283391022 ns/iter 0.98
Evaluator_2020_12_CQL_1 3805.5016657402416 ns/iter 3821.5626433768857 ns/iter 1.00
Evaluator_2020_12_OpenAPI 230242.13819263337 ns/iter 299480.82440285385 ns/iter 0.77
Evaluator_2019_09_Unevaluated_Properties 53.496395957022365 ns/iter 53.756518710617875 ns/iter 1.00
Evaluator_2019_09_OMC_JSON_V2_1 1375.802278849304 ns/iter 1468.2192248889442 ns/iter 0.94
Evaluator_Draft7_If_Then_Else 44.59500728128751 ns/iter 45.00796674142221 ns/iter 0.99
Evaluator_Draft7_Vercel_1 47361.78548057562 ns/iter 46247.23961385161 ns/iter 1.02
Evaluator_Draft7_Helm_Chart_Lock_1 124.68084467729295 ns/iter 128.90943455613973 ns/iter 0.97
Evaluator_Draft7_Helm_Chart_Lock_2 121.17839102009519 ns/iter 123.68435419840264 ns/iter 0.98
Evaluator_Draft7_Jasmine_1 159.19275363852253 ns/iter 163.58958322045885 ns/iter 0.97
Evaluator_Draft7_Dependabot_1 912.3775762917951 ns/iter 936.7290464740399 ns/iter 0.97
Evaluator_Draft6_Property_Names 164.5566743589685 ns/iter 164.73557366528155 ns/iter 1.00
Evaluator_Draft4_Meta_1_No_Callback 240.27461608908075 ns/iter 252.07732929063337 ns/iter 0.95
Evaluator_Draft4_Required_Properties 462.65447752957283 ns/iter 468.73268444265244 ns/iter 0.99
Evaluator_Draft4_Many_Optional_Properties_Minimal_Match 27.893746977938708 ns/iter 28.99678531535682 ns/iter 0.96
Evaluator_Draft4_Few_Optional_Properties_Minimal_Match 10.085743259094459 ns/iter 10.324006690627593 ns/iter 0.98
Evaluator_Draft4_Items_Schema 504.91682193096955 ns/iter 507.1539858709309 ns/iter 1.00
Evaluator_Draft4_Nested_Object 4.272458627771341 ns/iter 3.8784852917353807 ns/iter 1.10
Evaluator_Draft4_Properties_Triad_Optional 1040.221062243617 ns/iter 1057.1632652142694 ns/iter 0.98
Evaluator_Draft4_Properties_Triad_Closed 832.5992677432954 ns/iter 835.4239937830546 ns/iter 1.00
Evaluator_Draft4_Properties_Triad_Required 1034.6610659939288 ns/iter 1047.7677059420514 ns/iter 0.99
Evaluator_Draft4_Properties_Closed 74.70640953839089 ns/iter 73.26398762431346 ns/iter 1.02
Evaluator_Draft4_Non_Recursive_Ref 12.242975983145339 ns/iter 12.750778481284776 ns/iter 0.96
Evaluator_Draft4_Pattern_Properties_True 286.6541452332953 ns/iter 275.4881356627262 ns/iter 1.04
Evaluator_Draft4_Ref_To_Single_Property 10.076917219285232 ns/iter 10.396153478224226 ns/iter 0.97
Evaluator_Draft4_Additional_Properties_Type 15.17303237648123 ns/iter 15.5671088707288 ns/iter 0.97
Evaluator_Draft4_Nested_Oneof 109.47301110449976 ns/iter 112.69235509758879 ns/iter 0.97
Evaluator_Draft4_Short_Enum 17.754898599801603 ns/iter 17.771240443466887 ns/iter 1.00
Evaluator_Draft4_Long_Enum 22.853050145125085 ns/iter 23.244065334356275 ns/iter 0.98
Evaluator_Draft4_Long_Enum_Short_Strings 17.763961779317263 ns/iter 17.747170623133446 ns/iter 1.00
Evaluator_Draft4_Type_Object 9.149452780358349 ns/iter 9.44521004207763 ns/iter 0.97
Compiler_2019_09_OMC_JSON_V2 10842095611.99998 ns/iter 10775551389.000044 ns/iter 1.01
Compiler_Draft6_AdaptiveCard 71586696832.00003 ns/iter 69954461205.99991 ns/iter 1.02

This comment was automatically generated by workflow using github-action-benchmark.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant