feat: basic swarm (#4)

* feat: basic swarm

* Make swarm and database constructable from outside of P2P type (#9)

This is needed for P2P users to specify `memory` or `tcp` transport
and whether the database should be temporarly, for tests and
production accordingly.

Co-authored-by: Velnbur <[email protected]>

* Move db and protobuf related code to separate crates (#8)

Move `crates/p2p/src/db` to `crates/db`, `crates/p2p/src/wire` to
`crates/wire` and then `crates/wire/proto/` out of `wire` to top level
`proto`. Also some minor refactor stuff and fixes to make CI happy
were applied.

* chore: fix ci (#11)

* chore: moved nextest config to .config/

* chore: add github token to arduino/setup-protoc

* Move `tokio`, `tokio-util` and `tracing-subscriber` to workspace deps (#10)

* feat: Add new methods for tests, make `init` public and add test (#12)

`init` was renamed to `establish_connections` and made public, so the crate user can control stages of P2P readiness.

Added test with sequential handling of multiple scopes with multiple operators.

* Add doc comments to some of the methods and remove redundant code (#13)

* feat: add request-response (#14)

* feat: added basic request-response

* feat: added pub key storage in db entry and signature validation

* fix: review issues resolved

* fix: refactor pubkey serde + remove all_messages_empty

* Add async threadpooled wrapper for `sled::Db` (#16)

* refactor: operator id not via peer id (#15)

* refactor: operator id now independent of peer id

* fix: post-review improvements

* chore: taplo fmt

* fix: resolve end-to-end tests

* chore: cargo fmt --all

* chore: taplo fmt

* chore: remove unused deps in cargo.toml files

* draft: added whitelist of signers

* fix: resolve issues

* refactor: move validation into p2p

* fix: resolve some review comments

* fix: resolve db test private field

* refactor: migrated from snafu to thiserror (#17)

* refactor: migrated from snafu to thiserror

* refactor: post-review improvements

* refactor: post-review improvements

* fix(db): agnostic InvalidData error

* fix

* Remove `TimeoutManager` and add command for requesting messages for `P2PHandle` (#18)

* Remove timeout manager

To simplify current code for Testnet I, as state handling of peers is
not in the scope for now.

* Add implementation of direct `RequestMessage` command for handles

By removing timeouts handling in the previous commit, we didn't left
an option for P2P users to request something through
`request-response` behaviour. That's why this commit adds handling of
`Command::RequestMessage`.

Added persistent mapping of operator pubkey to peer id, that
distributed messages from this operators, so P2P can request that
message directly by retrieving peer ID from this mapping.

* Make threadpool for DB with one core for tests instead of all

* refactor: request command use fallback neighbours request (#20)

* refactor: added request from neighbours in request command

* wip: added request-response test

* fix: resolved test

* refactor: upd tests

* trying to fix compiler bug

* fix visibility in tests

* refactor: renamed OperatorLever

* refactor: moved handling of request-response message to separate function

* refactor: Use `SessionId` instead of `Scope` for nonces and signatures exchange messages (#19)

* Introduce `SessionId` and `Scope` types

* Replace hash with scope, refactor names

* Add `CleanStorage` command for P2P (#21)

`CleanStorageCommand` - deletes all entries from storage by session
IDs, scopes and operators' pubkeys.

For that `delete_raw` method for `Repository` was added, which deletes
entries at once by array of keys.

Implementation creates cartesian products from sets of operators'
pubkeys and session IDs, operators' pubkeys and scopes, then
deletes all some entries at once, but sequantially for each type
of entry (nonces, signatures or deposit setups).

---------

Co-authored-by: Velnbur <[email protected]>
Co-authored-by: Kyrylo Baibula <[email protected]>

Author: NikitaMasych

nextest.toml .config/nextest.toml

@@ -23,6 +23,8 @@ jobs:
           toolchain: nightly-2024-07-27
       - name: Install Protoc
         uses: arduino/setup-protoc@v3
+        with:
+          repo-token: ${{ secrets.GITHUB_TOKEN }}
       - uses: Swatinem/rust-cache@v2
         with:
           cache-on-failure: true

.github/workflows/docs.yml

@@ -21,6 +21,8 @@ jobs:
       - uses: dtolnay/rust-toolchain@clippy
       - name: Install Protoc
         uses: arduino/setup-protoc@v3
+        with:
+          repo-token: ${{ secrets.GITHUB_TOKEN }}
       - uses: Swatinem/rust-cache@v2
         with:
           cache-on-failure: true
@@ -45,6 +47,8 @@ jobs:
           toolchain: nightly-2024-07-27
       - name: Install Protoc
         uses: arduino/setup-protoc@v3
+        with:
+          repo-token: ${{ secrets.GITHUB_TOKEN }}
       - uses: taiki-e/install-action@cargo-hack
       - uses: Swatinem/rust-cache@v2
         with:

.github/workflows/lint.yml

@@ -34,6 +34,8 @@ jobs:
           toolchain: nightly-2024-07-27
       - name: Install Protoc
         uses: arduino/setup-protoc@v3
+        with:
+          repo-token: ${{ secrets.GITHUB_TOKEN }}
       - name: Install latest nextest release
         uses: taiki-e/install-action@v2
         with:
@@ -81,6 +83,8 @@ jobs:
 
       - name: Install Protoc
         uses: arduino/setup-protoc@v3
+        with:
+          repo-token: ${{ secrets.GITHUB_TOKEN }}
 
       - uses: Swatinem/rust-cache@v2
         with: