Ollama as a supported Model provider for version 26.1

1

Hello Community,

Is there a plan to include Ollama as a Model Provider? I would like to keep the data within the on-premise network. Thanks.

2

Hi Arun,

Currently no plans. Our general approach is to comply with the OpenAI API spec and will test with major LLM providers

Thanks

Bali

3

OpenAI API compatibility should be good enough. Thanks for letting me know @balaji.ramaswamy ,