Enhancement: Add Custom Headers to Endpoints

[darkBuddha]

What features would you like to see added?

Hi, it seems that there was an update: https://x.com/alexalbert__/status/1812921642143900036

More details

Adding a custom header is not possible currently AFAIK

Which components are impacted by your request?

No response

Pictures

Code of Conduct

• I agree to follow this project's Code of Conduct

[danny-avila]

renamed this issue to Enhancement: Add Custom Headers to Endpoints

[darkBuddha]

Any ETA on this? I use only 3.5 Sonnet since it came out, really missing the context window. Don't want to look for LibreChat alternative

[danny-avila]

Handling the concern that opened this issue here: #3407

Adding custom headers is possible for azure/custom endpoints but not the other endpoints so will keep this open until then.

[darkBuddha]

Thank you so much 🎉

[darkBuddha]

https://x.com/alexalbert__/status/1825920737326281184

FYI

[danny-avila]

https://x.com/alexalbert__/status/1825920737326281184

FYI

For your information, I'm already using that header as the default behavior for Anthropic, as well as prompt caching. The ability to customize headers for non-custom/non-openai endpoints remains.

[darkBuddha]

They said the header is not needed any more :D Thought you can clean up the code ...

[danny-avila]

They said the header is not needed any more :D Thought you can clean up the code ...

it's still needed, it's just an abstraction for it