Add `tape.toml` for configs by aarjn · Pull Request #26 · spool-labs/tape

aarjn · 2025-08-07T08:08:11Z

PR for #16

I have pushed code of simple implementation of using tape.toml . In the following code change of only rpc_url is used from tape.toml config file. Couple of changes I made

add toml crate for handling toml file
removed default cluster option of l from cli args
priority is given to cli commands. if cluster is mention in cli command, rpc_url from tape.toml wont be used. if not it will be used.
if config is loaded from tape.toml it is passed through cli context
tape.toml is created at home dir

I tested the above change in archive command

~/tape.toml

[solana]
rpc_url = "https://api.devnet.solana.com"
ws_url = "wss://api.devnet.solana.com/"
commitment = "confirmed"

cargo run -p tapedrive-cli --manifest-path ~/Documents/solana/tape/cli/Cargo.toml archive
cargo run -p tapedrive-cli --manifest-path ~/Documents/solana/tape/cli/Cargo.toml archive -ul

Nagaprasadvr · 2025-08-07T10:56:56Z

Cool ,
can u disable rust formatting, this repo is not using rust formatting and the pr will add unnecessary changes

Nagaprasadvr · 2025-08-07T10:58:09Z

Also i feel we dont wanna use cli args because the reason for adding toml is to make things easier to configure wdyt @zfedoran

aarjn · 2025-08-07T12:20:20Z

add rustfmt.toml to disable auto formatting. dropped the commits with auto formatted code. redone the changes to last two commits.

zfedoran · 2025-08-07T18:09:32Z

Welcome @4rjunc, I hope this is one of many PRs, I'd love to see more in the future.

I'm curious, why are we removing the local cluster option?

aarjn · 2025-08-07T20:25:05Z

I'm curious, why are we removing the local cluster option

I removed the default local cluster option because tape.toml is generated on first run with a default rpc_url (devnet). The CLI checks for an rpc_url in the options first if defaults exist, it won't use the config value.

zfedoran · 2025-08-07T23:38:53Z

Ah understood, I thought the l option was being removed entirely, not just the default.

aarjn · 2025-08-09T03:08:40Z

Also i feel we dont wanna use cli args because the reason for adding toml is to make things easier to configure wdyt @zfedoran

Quoting this again in case you missed replying @zfedoran

Nagaprasadvr

few things to update , can u also add a unit test to test the toml parsing works properly

Nagaprasadvr · 2025-08-22T03:16:30Z

+    }
+
+    /// validate values in tape.toml
+    fn validate(&self) -> anyhow::Result<()> {


we also need to check urls are right here, just check for valid url using grep or something

zfedoran · 2025-08-22T18:53:00Z

So there is a non-zero chance that we may point tapedrive at all three clusters at the same time, but only one would be considered primary (where tokens are earned). Does this remove the need for the config file?

I guess not, but it might be worth thinking about what this file would look like with more than one source.

@Nagaprasadvr what are your thoughts?

Nagaprasadvr · 2025-08-23T01:10:16Z

So there is a non-zero chance that we may point tapedrive at all three clusters at the same time, but only one would be considered primary (where tokens are earned). Does this remove the need for the config file?

I guess not, but it might be worth thinking about what this file would look like with more than one source.

@Nagaprasadvr what are your thoughts?

For that we can just change the cluster url when we spawn the node in the config file , ig along with this we can have a field primary_cluster to mark which cluster is primary to use

Nagaprasadvr · 2025-08-23T09:19:39Z

So there is a non-zero chance that we may point tapedrive at all three clusters at the same time, but only one would be considered primary (where tokens are earned). Does this remove the need for the config file?

I guess not, but it might be worth thinking about what this file would look like with more than one source.

@Nagaprasadvr what are your thoughts?

U mean simultaneously running tape node on multiple clusters ?

@zfedoran

zfedoran · 2025-08-24T02:10:33Z

So there is a non-zero chance that we may point tapedrive at all three clusters at the same time, but only one would be considered primary (where tokens are earned). Does this remove the need for the config file?
I guess not, but it might be worth thinking about what this file would look like with more than one source.
@Nagaprasadvr what are your thoughts?

U mean simultaneously running tape node on multiple clusters ?

@zfedoran

Yeah, exactly this. The premise is that users can write wherever it is cheapest. Assuming they are okay with lower recovery guarantees.

Nagaprasadvr · 2025-08-24T11:38:42Z

So there is a non-zero chance that we may point tapedrive at all three clusters at the same time, but only one would be considered primary (where tokens are earned). Does this remove the need for the config file?
I guess not, but it might be worth thinking about what this file would look like with more than one source.
@Nagaprasadvr what are your thoughts?

U mean simultaneously running tape node on multiple clusters ?
@zfedoran

Yeah, exactly this. The premise is that users can write wherever it is cheapest. Assuming they are okay with lower recovery guarantees.

What is the difference will be in this case between a primary cluster ,(possibly mainnet ) and other clusters like devnet and testnet

aarjn · 2025-08-26T04:43:20Z

@Nagaprasadvr I have pushed code addressing your comments. lmk if this needs to be changed. If this looks good to go, I will start working on code to pass values from tape.toml.

Nagaprasadvr

looking good

zfedoran · 2025-08-27T00:31:21Z

Lots of good stuff in here.

@4rjunc if you'd like, I'd love to give you access to the dev channel in discord

aarjn · 2025-08-27T04:31:00Z

thank you!

@zfedoran i haven't joined the discord yet. i will join now. my username: 4rjunc

Nagaprasadvr

Few things to fix

Nagaprasadvr · 2025-09-02T00:51:35Z

-

-    let context = Context::try_build(&cli)?;
+    let config = match TapeConfig::load_with_path(&cli.config_path) {


Let's just do this

let config = TapeConfig::load(&cli.config)?;

Move this inside context so we can get everything from context

zfedoran · 2025-09-02T16:46:35Z

This is looking really awesome @4rjunc. One more thing I'd love to see in here is the miner name. The current approach uses the word "default", which is fine, but we might as well put it in the config.

@Nagaprasadvr what are your thoughts?

(related issue: #36)

Nagaprasadvr · 2025-09-02T17:05:05Z

This is looking really awesome @4rjunc. One more thing I'd love to see in here is the miner name. The current approach uses the word "default", which is fine, but we might as well put it in the config.

@Nagaprasadvr what are your thoughts?

(related issue: #36)

Yeah definitely ig i missed it but it's a good addition

aarjn · 2025-09-02T18:25:21Z

This is looking really awesome @4rjunc. One more thing I'd love to see in here is the miner name. The current approach uses the word "default", which is fine, but we might as well put it in the config.

@Nagaprasadvr what are your thoughts?

(related issue: #36)

thank you!

you mean to use a custom name instead of "default" in this line right ?

Nagaprasadvr · 2025-09-03T00:40:09Z

This is looking really awesome @4rjunc. One more thing I'd love to see in here is the miner name. The current approach uses the word "default", which is fine, but we might as well put it in the config.
@Nagaprasadvr what are your thoughts?
(related issue: #36)

thank you!

you mean to use a custom name instead of "default" in this line right ?

Let's add miner_name to miner config and hardcode it to "default"

Nagaprasadvr · 2025-09-03T00:42:17Z

Hey @4rjunc ig we have changes from previous commits did u rebase this ?

zfedoran · 2025-09-03T00:45:05Z

This is looking really awesome @4rjunc. One more thing I'd love to see in here is the miner name. The current approach uses the word "default", which is fine, but we might as well put it in the config.
@Nagaprasadvr what are your thoughts?
(related issue: #36)

thank you!

you mean to use a custom name instead of "default" in this line right ?

Yes, exactly this

Nagaprasadvr

Few nits

> transaction > performance > identity > solana > storage > network > logging feat: add validate + default values for toml.config feat: log_level is enum fix: resolving comments > change the `max_memory_mb` 2gb -> 16 gb > add few comments on what to change fix: remove the `NetworkConfig` feat: add enum for commitment level > add a impl for `CommitmentLevel` fix: fix the keypair loading up from ~ path feat: removed the helper function for tilde, add function used in anchor feat: add abstract StorageConfig feat: add URL validation fix: rename performance -> mining_config > add max_poa_thread > add max_pow_thread feat: better error handling for config::load() - ConfigFileNotFound - InvalidUrl(String) - KeypairNotFound(String) - HomeDirectoryNotFound - FileReadError(std::io::Error) - ParseError(toml::de::Error) - DefaultConfigCreationFailed(String) feat: add `--config` option feat: add error handling for config load > create new config is not found in default path, `--config` is not used > if config file not found in given path -> error will be shown feat: add `--config` option feat: add error handling for config load > create new config is not found in default path, `--config` is not used > if config file not found in given path -> error will be shown

> rm keypair_path > update keypair_path() helper function

A

> open_read_only_store_conn

Nagaprasadvr · 2025-11-30T12:14:16Z

looks good

zfedoran · 2026-05-20T01:01:13Z

closing, there are about 100k lines of diffs at this point in the proof of stake version, will review this once it is time for this

aarjn · 2026-05-20T01:21:10Z

Okay, will open a new PR for this when tapedrive v2 is open

aarjn force-pushed the toml branch from 16add07 to 89b00cf Compare August 7, 2025 12:17

Nagaprasadvr suggested changes Aug 22, 2025

View reviewed changes

Nagaprasadvr suggested changes Aug 26, 2025

View reviewed changes

aarjn force-pushed the toml branch 2 times, most recently from 6b1229a to 496b5dc Compare September 1, 2025 18:20

Nagaprasadvr suggested changes Sep 2, 2025

View reviewed changes

aarjn force-pushed the toml branch from 49fc7be to c561878 Compare September 3, 2025 09:03

Nagaprasadvr suggested changes Sep 4, 2025

View reviewed changes

Comment thread cli/src/config.rs

Comment thread cli/src/cli.rs Outdated

Nagaprasadvr suggested changes Sep 10, 2025

View reviewed changes

Comment thread tape.example.toml Outdated

Comment thread cli/src/cli.rs Outdated

Comment thread cli/src/config.rs Outdated

Comment thread cli/src/config.rs Outdated

aarjn force-pushed the toml branch from 6db09f8 to 50bfabf Compare September 11, 2025 05:58

aarjn added 14 commits October 11, 2025 12:38

Squash

55a8780

fix: removed duplicate lines

b2213e8

fix: better names to structs and vars

c55525d

feat: move config load-up -> Context:try_build

519ff95

fix: add miner_name

4c4ebcc

feat: reduce match block of config loadup

fa7708f

imp: change the args in get_keypair_path fn

9ad1077

imp: move the keypair_path -> Solana, remove Identity

6f4813b

imp: logs default config creation path

0415068

feat: add config field to Context

6755c57

> rm keypair_path > update keypair_path() helper function

feat: add config for mine

b875f87

A

feat: add config for web

73d51d6

feat: add config for archive

25b548c

aarjn force-pushed the toml branch from c2686f0 to 8b7e34b Compare October 11, 2025 07:09

feat: add config to snapshot

cc62dc3

> open_read_only_store_conn

aarjn force-pushed the toml branch from 8b7e34b to cc62dc3 Compare October 28, 2025 04:08

aarjn added 3 commits October 28, 2025 11:30

feat: add max_transaction_retries

89fcf0f

feat: add miner_name

16d0977

cleanup: delete unused code

d92a722

zfedoran force-pushed the main branch from 13672d5 to 7e37cf9 Compare May 15, 2026 23:47

zfedoran closed this May 20, 2026



		let context = Context::try_build(&cli)?;
		let config = match TapeConfig::load_with_path(&cli.config_path) {

Conversation

aarjn commented Aug 7, 2025

Uh oh!

Nagaprasadvr commented Aug 7, 2025

Uh oh!

Nagaprasadvr commented Aug 7, 2025

Uh oh!

aarjn commented Aug 7, 2025

Uh oh!

zfedoran commented Aug 7, 2025

Uh oh!

aarjn commented Aug 7, 2025

Uh oh!

zfedoran commented Aug 7, 2025

Uh oh!

aarjn commented Aug 9, 2025

Uh oh!

Nagaprasadvr left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Nagaprasadvr Aug 22, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

zfedoran commented Aug 22, 2025

Uh oh!

Nagaprasadvr commented Aug 23, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Nagaprasadvr commented Aug 23, 2025

Uh oh!

zfedoran commented Aug 24, 2025

Uh oh!

Nagaprasadvr commented Aug 24, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

aarjn commented Aug 26, 2025

Uh oh!

Nagaprasadvr left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

zfedoran commented Aug 27, 2025

Uh oh!

aarjn commented Aug 27, 2025

Uh oh!

Nagaprasadvr left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Nagaprasadvr Sep 2, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

zfedoran commented Sep 2, 2025

Uh oh!

Nagaprasadvr commented Sep 2, 2025

Uh oh!

aarjn commented Sep 2, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Nagaprasadvr Aug 22, 2025 •

edited

Loading

Nagaprasadvr commented Aug 23, 2025 •

edited

Loading

Nagaprasadvr commented Aug 24, 2025 •

edited

Loading

Nagaprasadvr Sep 2, 2025 •

edited

Loading

aarjn commented Sep 2, 2025 •

edited

Loading

Nagaprasadvr commented Sep 3, 2025 •

edited

Loading