Skip to content

Commit d60617a

Browse files
authored
docs(README): promote llama.cpp/GGUF (CPU/edge) runtime to a first-class section (#304)
1 parent 07a2110 commit d60617a

1 file changed

Lines changed: 10 additions & 1 deletion

File tree

README.md

Lines changed: 10 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -265,7 +265,16 @@ print([rich_transcription_postprocess(i) for i in res])
265265
Note: Libtorch model is exported to the original model directory.
266266
</details>
267267

268-
> **CPU / edge (no GPU, no Python):** run SenseVoice as a single self-contained binary via **llama.cpp / GGUF** (official, validated CTC ids identical to PyTorch). See [runtime/llama.cpp/](runtime/llama.cpp/).
268+
### Run on CPU / edge — llama.cpp / GGUF (no GPU, no Python)
269+
270+
Run SenseVoice as a **single self-contained binary** — this is to SenseVoice what [whisper.cpp](https://github.com/ggml-org/whisper.cpp) is to Whisper, but with far stronger Chinese & Cantonese accuracy. Built-in FSMN-VAD, no Python at runtime.
271+
272+
```bash
273+
bash download-funasr-model.sh sensevoice ./gguf
274+
llama-funasr-sensevoice -m ./gguf/SenseVoiceSmall-f16.gguf --vad ./gguf/fsmn-vad.gguf -a audio.wav
275+
```
276+
277+
**Prebuilt binaries:** [Releases](../../releases) · **Download & quickstart:** [funasr.com/llama-cpp](https://www.funasr.com/llama-cpp.html) · **GGUF:** [Hugging Face](https://huggingface.co/FunAudioLLM/SenseVoiceSmall-GGUF) · **Docs & benchmarks:** [runtime/llama.cpp/](./runtime/llama.cpp/)
269278

270279
## Service
271280

0 commit comments

Comments
 (0)