Check out: https://github.com/SakuraLLM/SakuraLLM Recommended model to download: https://hf-mirror.com/SakuraLLM/Sakura-7B-Qwen2.5-v1.0-GGUF/blob/main/sakura-7b-qwen2.5-v1.0-iq4xs.gguf