sea-orm integration + rust-lightning persitence layer

[dcorral]

Summary

Replaces file-based persistence with SQLite database using sea-orm ORM.

Changes

New database tables:

• mnemonic - encrypted mnemonic storage
• kv_store - LDK persistence (channel manager, payments, swaps, network graph, scorer)
• config - configuration key/value pairs (indexer_url, proxy_url, etc.)
• revoked_token - revoked auth token IDs
• channel_peer - channel peer pubkey/address mapping

Migrated to database:

• Mnemonic (was encrypted file)
• All LDK KVStore data (channel manager, inbound/outbound payments, swaps, scorer)
• Config parameters (synced to files for rust-lightning compatibility)
• Revoked tokens (was flat file)
• Channel peer data (was flat file)
• PSBTs (temporary storage during channel funding)
• Output spender transactions

Architecture:

• Single shared DatabaseConnection via Arc
• SeaOrmKvStore implements rust-lightning's KVStoreSync trait
• Migrations run automatically on startup
• Config stored in DB as source of truth, synced to files for rust-lightning compatibility

rust-lightning submodule (961313c → b061470):

• RGB data persistence moved from filesystem to KVStoreSync trait across 8 files
• rgb_utils/mod.rs: replaced file I/O (read_rgb_transfer_info, write_rgb_transfer_info, parse_rgb_payment_info, get_rgb_channel_info_path) with KVStore namespace-based read/write operations using RGB_PRIMARY_NS + secondary namespaces (channel_info, payment_info_inbound, payment_info_outbound, transfer_info, etc.)
• ChannelContext, ChannelManager, OutboundPayments, KeysManager: added rgb_kv_store: Arc<dyn KVStoreSync + Send + Sync> field, threaded through constructors and deserialization
• color_commitment, color_htlc, color_closing: now take &dyn KVStoreSync instead of reading files directly
• is_channel_rgb, get_rgb_channel_info, rename_rgb_files, filter_first_hops, is_payment_rgb: switched from path-based lookups to KVStore reads
• Removed filesystem fallback — KVStore is now the sole persistence backend for RGB data

IMPORTANT!
This PR depends on RGB-Tools/rust-lightning#17 and .submodule must be updated to point to the right RGB-Tools fork before merging

[zoedberg]

@dcorral could you please rebase this PR?

[dcorral]

@zoedberg done!

[zoedberg]

Thanks! In addition to the requested changes please

• commit the src/database/entities/prelude.rs file that gets generated by sea-orm-cli
• add the migration cargo lock file to the .gitignore file and remove the file
• do not make changes to src/database/entities/mod.rs since its autogenerated by sea-orm-cli
• I know you took inspiration from rgb-lib when creating aliases like ChannelPeerActMod, but I saw this is not the best/recommended approach so please drop the aliases (see rgb-multisig-hub to see what is the best way to use the DB utility objects)
• as requested in the rust-lightning PR, please keep only essential comments

P.S this is not a final review, will do another one after these requests have been addressed

[Arshia-r-m]

Hi every one, what's the status of this PR?
I think this can help us a lot since on the nodes we maintain we face a lot of file corruptions which I believe can be enhanced with this!

[zoedberg]

I agree the changes in this PR are important and would like to understand if this has been paused intentionally. From what I see, the feedback I provided before hasn't been addressed yet, and there are also some merge conflicts. @dcorral please let us know

[dcorral]

Yes I needed to postpone the work on this PR, anyway I believe I'll have some time starting next week to address the requested changes and push this work forward.

[zoedberg]

It seems we are almost done, please rebase this on the updated master tip. If it's ok for you in the next iteration if I find something that needs to be addressed I will do it on top of your commit

[codecov]

Codecov Report

❌ Patch coverage is 90.78947% with 112 lines in your changes missing coverage. Please review.
✅ Project coverage is 88.24%. Comparing base (463b244) to head (a85e97b).

Files with missing lines	Patch %	Lines
src/kv_store.rs	92.79%	40 Missing ⚠️
src/ldk.rs	88.44%	38 Missing ⚠️
src/routes.rs	92.05%	12 Missing ⚠️
src/auth.rs	58.33%	5 Missing ⚠️
src/utils.rs	94.20%	4 Missing ⚠️
src/error.rs	0.00%	3 Missing ⚠️
src/backup.rs	92.85%	2 Missing ⚠️
src/database/entities/channel_peer.rs	85.71%	2 Missing ⚠️
src/database/entities/config.rs	90.47%	2 Missing ⚠️
src/database/entities/kv_store.rs	86.66%	2 Missing ⚠️
... and 1 more

Additional details and impacted files

@@            Coverage Diff             @@
##           master      #95      +/-   ##
==========================================
+ Coverage   87.78%   88.24%   +0.46%     
==========================================
  Files          13       18       +5     
  Lines        7613     8227     +614     
==========================================
+ Hits         6683     7260     +577     
- Misses        930      967      +37     

Flag	Coverage Δ
rust	88.24% <90.78%> (+0.46%)	⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.