Blocksim Benchmark by cody-littley · Pull Request #3247 · sei-protocol/sei-chain

cody-littley · 2026-04-14T20:33:21Z

Created a benchmarking framework for the block DB. This benchmark currently exercises the write pathway. The read pathway benchmarking will come in a future PR.

github-actions · 2026-04-14T20:34:26Z

The latest Buf updates on your PR. Results from workflow Buf / buf (pull_request).

Build	Format	Lint	Breaking	Updated (UTC)
`✅ passed`	`✅ passed`	`✅ passed`	`✅ passed`	Apr 22, 2026, 4:40 PM

codecov · 2026-04-14T20:37:03Z

Codecov Report

❌ Patch coverage is 11.07872% with 915 lines in your changes missing coverage. Please review.
✅ Project coverage is 58.31%. Comparing base (cf0fb2d) to head (a7e48e1).
⚠️ Report is 1 commits behind head on main.

Files with missing lines	Patch %	Lines
sei-db/ledger_db/block/blocksim/blocksim.go	0.00%	230 Missing ⚠️
sei-db/common/metrics/system_metrics.go	0.00%	162 Missing ⚠️
...ei-db/ledger_db/block/blocksim/blocksim_metrics.go	0.00%	120 Missing ⚠️
sei-db/common/utils/format.go	0.00%	101 Missing ⚠️
sei-db/ledger_db/block/blocksim/blocksim_config.go	0.00%	78 Missing ⚠️
...i-db/ledger_db/block/blocksim/cmd/blocksim/main.go	0.00%	63 Missing ⚠️
sei-db/ledger_db/block/blocksim/block_generator.go	0.00%	44 Missing ⚠️
sei-db/common/metrics/setup.go	0.00%	37 Missing ⚠️
sei-db/common/utils/config.go	0.00%	25 Missing ⚠️
...ger_db/block/blocksim/cmd/configure-logger/main.go	0.00%	25 Missing ⚠️
... and 5 more

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #3247      +/-   ##
==========================================
- Coverage   58.55%   58.31%   -0.24%     
==========================================
  Files        2072     2085      +13     
  Lines      207968   208904     +936     
==========================================
+ Hits       121773   121823      +50     
- Misses      77420    78302     +882     
- Partials     8775     8779       +4

Flag	Coverage Δ
sei-chain-pr	`23.48% <11.07%> (?)`
sei-db	`69.36% <ø> (ø)`

Flags with carried forward coverage won't be shown. Click here to find out more.

Files with missing lines	Coverage Δ
sei-db/common/keys/evm.go	`76.78% <66.66%> (ø)`
...ei-db/ledger_db/block/mem_block_db/mem_block_db.go	`97.91% <97.91%> (ø)`
sei-db/common/rand/canned_random.go	`54.66% <40.00%> (ø)`
sei-db/common/utils/hash64.go	`82.35% <82.35%> (ø)`
sei-db/common/utils/path.go	`65.51% <0.00%> (-34.49%)`	⬇️
sei-db/common/utils/config.go	`0.00% <0.00%> (ø)`
...ger_db/block/blocksim/cmd/configure-logger/main.go	`0.00% <0.00%> (ø)`
sei-db/common/metrics/setup.go	`0.00% <0.00%> (ø)`
sei-db/ledger_db/block/blocksim/block_generator.go	`0.00% <0.00%> (ø)`
...i-db/ledger_db/block/blocksim/cmd/blocksim/main.go	`0.00% <0.00%> (ø)`
... and 5 more

... and 34 files with indirect coverage changes

🚀 New features to boost your workflow:

❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

yzang2019 · 2026-04-17T20:54:42Z

@@ -0,0 +1,78 @@
+package blockdb


Recommend move blockDB code to ledger_db/block

yzang2019 · 2026-04-17T21:10:56Z

+	// Periodic prune.
+	if blk.Height > b.config.UnprunedBlocks {
+		b.metrics.SetMainThreadPhase("prune")
+		lowestToKeep := blk.Height - b.config.UnprunedBlocks
+		if err := b.db.Prune(b.ctx, lowestToKeep); err != nil {


The comment says periodic prune, but we are pruning for every block here

Oops, fixed. Is now periodic. This was a bug.

blindchaser · 2026-04-22T01:38:45Z

-
 // ResolveAndCreateDir expands ~ to the home directory, resolves the path to
 // an absolute path, and creates the directory if it doesn't exist.
 func ResolveAndCreateDir(dataDir string) (string, error) {


is this dup func?

Good catch. Yes, this was duplicated when I moved around code in feature branches. Deleted the duplicate.

blindchaser · 2026-04-22T01:40:09Z

+			b.totalBlocksWritten = 0
+			b.totalTransactionsWritten = 0
+			b.startTimestamp = time.Now()
+			fmt.Printf("Benchmark resumed.\n")


also reset b.totalBytesWritten = 0 here?

Oops, forgot that field. Fixed.

blindchaser · 2026-04-22T01:41:12Z

+}
+
+// openBlockDB creates a BlockDB for the given backend name.
+func openBlockDB(backend string, dataDir string, unprunedBlocks uint64) (block.BlockDB, error) {


seems dataDir and unprunedBlocks params are not used

unprunedBlocks does not belong here (removed). But the dataDir is going to be needed for DB implementations that write their data to disk. In my experimental branch, I've got two such implementations (pebble and littDB), but I didn't include those in this PR to reduce scope.

blindchaser · 2026-04-22T01:41:32Z

+	// The number of blocks to keep in the database after pruning.
+	UnprunedBlocks uint64
+
+	// Iniitate pruning every this many blocks.


typo: Initiate

blindchaser · 2026-04-22T01:44:09Z

+	"github.com/sei-protocol/sei-chain/sei-db/common/utils"
 )

+const AddressLen = 20 // EVM address length


should we put this in sei-db/common/keys as it's not random number

Good suggestion, change made

Ported blocksim to branch

6d24137

cody-littley self-assigned this Apr 14, 2026

cody-littley added the non-app-hash-breaking label Apr 15, 2026

Cody Littley added 2 commits April 15, 2026 12:56

remove pebble DB, merge in later PR

4b33af1

resolve TODO

acfe800

cody-littley requested review from blindchaser and yzang2019 April 15, 2026 17:59

cody-littley marked this pull request as ready for review April 15, 2026 18:00

yzang2019 reviewed Apr 17, 2026

View reviewed changes

Cody Littley added 3 commits April 21, 2026 13:48

Merge branch 'main' into cjl/blocksim-stand-alone

8f09a62

moved code to new location

16f7de4

fix periodic pruning

936457f

yzang2019 approved these changes Apr 22, 2026

View reviewed changes

blindchaser reviewed Apr 22, 2026

View reviewed changes

blindchaser approved these changes Apr 22, 2026

View reviewed changes

Cody Littley added 2 commits April 22, 2026 11:35

made suggested changes

ea3fcd4

Merge branch 'main' into cjl/blocksim-stand-alone

a7e48e1

cody-littley enabled auto-merge April 22, 2026 16:39

cody-littley added this pull request to the merge queue Apr 22, 2026

Merged via the queue into main with commit 0ddccd5 Apr 22, 2026
39 checks passed

cody-littley deleted the cjl/blocksim-stand-alone branch April 22, 2026 17:06

Conversation

cody-littley commented Apr 14, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions Bot commented Apr 14, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

codecov Bot commented Apr 14, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Codecov Report

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

cody-littley Apr 22, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

cody-littley commented Apr 14, 2026 •

edited

Loading

github-actions Bot commented Apr 14, 2026 •

edited

Loading

codecov Bot commented Apr 14, 2026 •

edited

Loading

cody-littley Apr 22, 2026 •

edited

Loading