Skip to content

Commit

Permalink
Add remote store protobuf/gRPC definitions (#7674)
Browse files Browse the repository at this point in the history
In this PR we aim to define initial version of the V0 storage node APIs
in the form of grpc protobuf definition. We also want to:
* settle on code generation
* type conversions (between rerun internal types and grpc types

(currently) Example usage:

```rust

use re_storage_types::v0::{
    storage_node_client::StorageNodeClient, RegisterRecordingsRequest
};

...

  let mut client = StorageNodeClient::connect("http://127.0.0.1:51234")
        .await
        .unwrap();

    let resp = client
        .register_recordings(RegisterRecordingsRequest {
            description: "test".to_string(),
            obj_storage:  ObjectStore {
              url: "dna.rd",
              bucket_name: "my_s3_bucket",
            },
            typ: re_storage_types::v0::RecordingType::Rrd.into(),
        })
        .await
        .unwrap()
        .into_inner();
```

---------

Co-authored-by: Clement Rey <cr.rey.clement@gmail.com>
  • Loading branch information
zehiko and teh-cmc authored Oct 19, 2024
1 parent d6e8ca4 commit 454b7ca
Show file tree
Hide file tree
Showing 20 changed files with 2,095 additions and 73 deletions.
30 changes: 16 additions & 14 deletions ARCHITECTURE.md
Original file line number Diff line number Diff line change
Expand Up @@ -159,14 +159,15 @@ Update instructions:

### Application-level store

| Crate | Description |
|----------------------|--------------------------------------------------------------------------|
| re_entity_db | In-memory storage of Rerun entities |
| re_query | Querying data in the re_chunk_store |
| re_dataframe | The Rerun public data APIs. |
| re_types | The built-in Rerun data types, component types, and archetypes. |
| re_types_blueprint | The core traits and types that power Rerun's Blueprint sub-system. |
| re_log_encoding | Helpers for encoding and transporting Rerun log messages |
| Crate | Description |
|-----------------------|--------------------------------------------------------------------------|
| re_entity_db | In-memory storage of Rerun entities |
| re_query | Querying data in the re_chunk_store |
| re_dataframe | The Rerun public data APIs. |
| re_remote_store_types | Rerun remote store gRPC API types |
| re_types | The built-in Rerun data types, component types, and archetypes. |
| re_types_blueprint | The core traits and types that power Rerun's Blueprint sub-system. |
| re_log_encoding | Helpers for encoding and transporting Rerun log messages |


### Low-level store
Expand All @@ -193,12 +194,13 @@ Update instructions:

### Build support

| Crate | Description |
|----------------------------|------------------------------------------------------------------|
| re_build_info | Information about the build. Use together with re_build_tools |
| re_build_tools | build.rs helpers for generating build info |
| re_types_builder | Generates code for Rerun's SDKs from flatbuffers definitions. |
| re_dev_tools | Various tools for Rerun development. Each tool has a subcommand. |
| Crate | Description |
|-------------------------------|------------------------------------------------------------------|
| re_build_info | Information about the build. Use together with re_build_tools |
| re_build_tools | build.rs helpers for generating build info |
| re_remote_store_types_builder | Generates code for Rerun remote store gRPC API |
| re_types_builder | Generates code for Rerun's SDKs from flatbuffers definitions. |
| re_dev_tools | Various tools for Rerun development. Each tool has a subcommand. |


### Utilities
Expand Down
1 change: 1 addition & 0 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -6,6 +6,7 @@

## [0.19.0](https://github.com/rerun-io/rerun/compare/0.18.2...0.19.0) - Dataframes & Video support


<!-- TODO(emilk): insert a screenshot and/or code sample here -->

📖 Release blogpost: Coming soon! <!-- TODO(niko): link to it! -->
Expand Down
Loading

0 comments on commit 454b7ca

Please sign in to comment.