Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Snappy revamp #3564

Merged
merged 10 commits into from
Apr 15, 2022
Merged

Snappy revamp #3564

merged 10 commits into from
Apr 15, 2022

Conversation

arnetheduck
Copy link
Member

This PR makes the necessary adjustments to deal with the revamped snappy
API.

In practical terms for nimbus-eth2, there are performance increases to
gossip processing, database reading and writing as well as era file
processing. Exporting .era files for example, a snappy-heavy
operation, almost halves in total processing time:

Pre:

     Average,       StdDev,          Min,          Max,      Samples,         Test
      39.088,        8.735,       23.619,       53.301,           50, tState
     237.079,       46.692,      165.620,      355.481,           49, tBlocks

Post:

All time are ms
     Average,       StdDev,          Min,          Max,      Samples,         Test
      25.350,        5.303,       15.351,       41.856,           50, tState
     141.238,       24.164,       99.990,      199.329,           49, tBlocks

@github-actions
Copy link

github-actions bot commented Apr 1, 2022

Unit Test Results

     12 files  ±0     834 suites  ±0   56m 44s ⏱️ +57s
1 686 tests ±0  1 638 ✔️ ±0    48 💤 ±0  0 ±0 
9 825 runs  ±0  9 713 ✔️ ±0  112 💤 ±0  0 ±0 

Results for commit 4cdbddf. ± Comparison against base commit bacc1ff.

♻️ This comment has been updated with latest results.

@arnetheduck arnetheduck force-pushed the snappy-revamp branch 2 times, most recently from 5d3e587 to 79bfe1b Compare April 12, 2022 11:10
This PR makes the necessary adjustments to deal with the revamped snappy
API.

In practical terms for nimbus-eth2, there are performance increases to
gossip processing, database reading and writing as well as era file
processing. Exporting `.era` files for example, a snappy-heavy
operation, almost halves in total processing time:

Pre:

```
     Average,       StdDev,          Min,          Max,      Samples,         Test
      39.088,        8.735,       23.619,       53.301,           50, tState
     237.079,       46.692,      165.620,      355.481,           49, tBlocks
```

Post:

```
All time are ms
     Average,       StdDev,          Min,          Max,      Samples,         Test
      25.350,        5.303,       15.351,       41.856,           50, tState
     141.238,       24.164,       99.990,      199.329,           49, tBlocks
```
@arnetheduck
Copy link
Member Author

jenkins fail unrelated

@arnetheduck arnetheduck merged commit d0dbc4a into unstable Apr 15, 2022
@arnetheduck arnetheduck deleted the snappy-revamp branch April 15, 2022 07:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant