auth support for ollama cloud models without proxy

[ShubhamTiwary914]

ref: https://github.com/thushan/olla/blob/main/docs/content/integrations/backend/ollama.md#remote-ollama-configuration

Currently, olla does support Auth, so it doesn't add a Authorization: Bearer <token> to attach to make calls to ollama cloud models.
Workaround I use is olla --> ollama --> cloud models (so ollama doing the auth login).

Any plans to add support for this yet?

[thushan]

Agree, i think with Ollama's foray into cloud, we really should. Thanks, I'll start figuring out how we support this. Will come back to this thread with some questions / clarifications soon.

[lbatalha]

+1 To this, all my local backends (llama.cpp, llama-proxy etc..) have Bearer token auth enabled so not being able to pass that header makes them unusable unless I disable it.

I think even just the ability to manually set the Authorization header (or any other header) for the endpoints would be an easy win, thats super flexible.

[thushan]

Coming in v0.0.27, hopefully before end of the month... is what we were thinking, but this will be quite a bit of work to implement. We may have to review and set this up for a v0.0.30 release.