Add Rate Limiting or Queueing or Retry for API Calls

[tanchekwei]

When applying formulas to a large number of cells in Excel, I frequently encounter the following error:

HTTP request failed: No connection could be made because the target machine actively refused it. (127.0.0.1:11434)

Would it be possible to implement a rate limit or a queueing mechanism for API calls to prevent this issue?

Also, it’d be awesome to have a retry option so that if an HTTP request fails, it automatically tries again after some time.

[kaspermarstal]

Hey, yes this is possible, it is already implemented for the Anthropic provider. Will add it to Ollama as well. Good point!

[kaspermarstal]

Just merged #114 which adds queue and retry to Ollama. Would you be willing to build the main branch locally and test if this works for you? You can use the Build with Visual Studio guide in the readme.

[tanchekwei]

I've built the main branch and run the tests—applied the formula to 500 cells, and everything worked perfectly without any errors. Thanks!

[kaspermarstal]

Your welcome, thanks for confirming it works!