Support: Model for Ollama only CPU #3500
Replies: 1 comment
-
|
I've converted this into a discussion, given its more a general ask.
For the event summarization I had the best results with the gemma3 or llama3.2 models so far. Not as good as with AI studio gemini flash 2.0 though.
No, this is not supported. The |
Beta Was this translation helpful? Give feedback.
Uh oh!
There was an error while loading. Please reload this page.
-
Good evening everyone,
which models would you recommend to run on Ollama locally using only the CPU?
Can I use a single model, or would it be better to use something more specific for each individual module (nl2q, llm_summarize, llm_synthesize)?
For the log_analyzer module, can I use Ollama? I usually get the error: An unexpected error occurred during Log
Analyzer execution: 'Ollama' object has no attribute 'SUPPORTS_STREAMING'."
Beta Was this translation helpful? Give feedback.
All reactions