Azure AI Foundry Model support

[jpbotha11]

Hi all,

Has anyone gotten OpenNotebook to work with a LLM hosted in either Azure Foundry or Azure OpenAI? I have been battling with various env variables, setting different API endpoints and version numbers. Each time I receive a "500" connection timeout.

cURL the endpoint then I get a successfull response.

Anyone got a working .env config I can reference?

Thanks

[lfnovo]

This is the config you need to use Azure Open AI LLM or Embedding:

AZURE_OPENAI_API_KEY_LLM=apikeyhere
AZURE_OPENAI_ENDPOINT_LLM=azure-endpoint-here
OPENAI_API_VERSION="2024-12-01-preview" 
AZURE_OPENAI_DEPLOYMENT_NAME_LLM="gpt-4o-mini"
AZURE_OPENAI_API_KEY_EMBEDDING=apikeyhere
AZURE_OPENAI_ENDPOINT_EMBEDDING=azure-endpoint-here