Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Wait for cardano-node sync #1224

Merged
merged 2 commits into from
Dec 27, 2023
Merged

Wait for cardano-node sync #1224

merged 2 commits into from
Dec 27, 2023

Conversation

v0d1ch
Copy link
Contributor

@v0d1ch v0d1ch commented Dec 27, 2023

Smoke tests were failing because we would query the protocol-parameters while the node is not yet in sync and that would throw era missmatch because of the latest changes to hydra-node. We solve this by waiting for the cardano-node to be in sync immediately since this workflow is used only when running smoke-tests. We should investigate if this error we get makes sense for the potential users trying to run their hydra-node using the cardano-node that is not fully synced.


  • CHANGELOG updated or not needed
  • Documentation updated or not needed
  • Haddocks updated or not needed
  • No new TODOs introduced or explained herafter

@v0d1ch v0d1ch self-assigned this Dec 27, 2023
@v0d1ch v0d1ch requested a review from ffakenz December 27, 2023 17:12
Copy link

github-actions bot commented Dec 27, 2023

Transactions Costs

Sizes and execution budgets for Hydra protocol transactions. Note that unlisted parameters are currently using arbitrary values and results are not fully deterministic and comparable to previous runs.

Metadata
Generated at 2023-12-27 17:30:59.067254167 UTC
Max. memory units 14000000
Max. CPU units 10000000000
Max. tx size (kB) 16384

Script summary

Name Hash Size (Bytes)
νInitial 985245919fcc6c0c5cd116023cd2c947c43e80dcbb5075fe12433fbb 4072
νCommit 7cb20fa71eb4c563ca283566ebe0aa65859d96c3f8cba35c52c181fd 2043
νHead 7a36661f5c15e9f1783aeaab890812c59b7286cbbc6de762d3110772 8816
μHead 8b111ac12274e46314769295a1c5dcab1d260096fc469fd698065463* 3851
  • The minting policy hash is only usable for comparison. As the script is parameterized, the actual script is unique per Head.

Cost of Init Transaction

Parties Tx size % max Mem % max CPU Min fee ₳
1 4372 10.29 3.97 0.45
2 4573 12.57 4.83 0.49
3 4774 14.73 5.65 0.52
5 5180 19.12 7.31 0.59
10 6182 30.30 11.55 0.75
41 12418 99.11 37.63 1.77

Cost of Commit Transaction

This is using ada-only outputs for better comparability.

UTxO Tx size % max Mem % max CPU Min fee ₳
1 534 11.37 4.44 0.30
2 724 15.04 6.07 0.35
3 912 18.85 7.75 0.40
5 1288 26.90 11.27 0.51
10 2224 49.55 20.97 0.80
19 3905 99.43 41.75 1.43

Cost of CollectCom Transaction

Parties UTxO (bytes) Tx size % max Mem % max CPU Min fee ₳
1 57 480 21.78 8.51 0.41
2 113 590 34.16 13.45 0.55
3 171 700 48.36 19.17 0.71
4 225 810 59.29 23.81 0.84
5 284 920 76.12 30.71 1.03
6 339 1031 92.54 37.56 1.21

Cost of Close Transaction

Parties Tx size % max Mem % max CPU Min fee ₳
1 546 16.68 7.67 0.36
2 727 18.54 9.35 0.40
3 908 20.17 10.92 0.43
5 1282 23.80 14.21 0.50
10 2155 31.75 21.77 0.66
50 9014 98.89 83.93 1.95

Cost of Contest Transaction

Parties Tx size % max Mem % max CPU Min fee ₳
1 567 20.22 8.95 0.40
2 746 22.17 10.64 0.44
3 976 24.15 12.39 0.48
5 1261 27.79 15.46 0.54
10 2124 37.13 23.65 0.71
42 7465 95.95 74.87 1.79

Cost of Abort Transaction

Some variation because of random mixture of still initial and already committed outputs.

Parties Tx size % max Mem % max CPU Min fee ₳
1 4313 18.98 8.16 0.55
2 4500 31.91 13.91 0.71
3 4647 47.85 20.98 0.89
4 4836 66.03 29.07 1.11
5 5015 87.62 38.65 1.36

Cost of FanOut Transaction

Involves spending head output and burning head tokens. Uses ada-only UTxO for better comparability.

Parties UTxO UTxO (bytes) Tx size % max Mem % max CPU Min fee ₳
5 0 0 4205 7.92 3.32 0.42
5 1 57 4239 9.28 4.13 0.44
5 5 285 4375 14.40 7.27 0.51
5 10 570 4545 20.34 10.99 0.59
5 20 1140 4885 32.51 18.57 0.76
5 30 1707 5224 44.82 26.20 0.93
5 40 2274 5562 57.25 33.88 1.10
5 50 2847 5905 69.77 41.61 1.27
5 74 4212 6718 99.34 59.96 1.68

End-To-End Benchmark Results

This page is intended to collect the latest end-to-end benchmarks results produced by Hydra's Continuous Integration system from the latest master code.

Please take those results with a grain of salt as they are currently produced from very limited cloud VMs and not controlled hardware. Instead of focusing on the absolute results, the emphasis should be on relative results, eg. how the timings for a scenario evolve as the code changes.

Generated at 2023-12-27 17:34:47.935094417 UTC

Baseline Scenario

Number of nodes 3
Number of txs 9000
Avg. Confirmation Time (ms) 23.927665084
P99 117.88872217000001ms
P95 33.35513144999997ms
P50 20.772000499999997ms
Number of Invalid txs 0

Baseline Scenario

Number of nodes 1
Number of txs 3000
Avg. Confirmation Time (ms) 4.167230722
P99 7.3075181199999815ms
P95 5.162787049999994ms
P50 3.99859ms
Number of Invalid txs 0

Smoke tests were failing because we would query the protocol-parameters
while the node is not yet in sync and that would throw era missmatch
because of the latest changes to hydra-node. We solve this by waiting
for the cardano-node to be in sync immediately since this workflow is
used only when running smoke-tests. We should investigate if this error
we get makes sense for the potential users trying to run their
hydra-node using the cardano-node that is not fully synced.
Copy link

Test Results

388 tests  ±0   383 ✅ ±0   22m 20s ⏱️ +36s
132 suites ±0     5 💤 ±0 
  5 files   ±0     0 ❌ ±0 

Results for commit e6fcb0e. ± Comparison against base commit f15b322.

@v0d1ch v0d1ch merged commit 14451ea into master Dec 27, 2023
@v0d1ch v0d1ch deleted the fix-smoke-tests branch December 27, 2023 17:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants