Skip to content

Commit ca54f88

Browse files
juntaoclaude
andcommitted
Add OpenAI-compatible ASR API server
Add asr-server binary with axum-based HTTP server exposing: - POST /v1/audio/transcriptions (multipart: file, language, response_format) - GET /v1/models - GET /health Supports json, text, and verbose_json response formats. CLI args: --model-dir, --host, --port, --language, -v. Uses spawn_blocking with Arc<Mutex<AsrInference>> for thread-safe inference dispatch. Also adds duration_seconds to TranscribeResult and includes asr-server in release CI packaging. Signed-off-by: Michael Yuan <michael@secondstate.io> Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
1 parent eb1c426 commit ca54f88

5 files changed

Lines changed: 947 additions & 1 deletion

File tree

.github/workflows/release.yml

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -155,6 +155,7 @@ jobs:
155155
run: |
156156
mkdir ${{ matrix.asset-name }}
157157
cp target/release/asr ${{ matrix.asset-name }}/asr
158+
cp target/release/asr-server ${{ matrix.asset-name }}/asr-server
158159
cp -r tokenizers ${{ matrix.asset-name }}/tokenizers
159160
if [ "${{ matrix.backend }}" = "mlx" ]; then
160161
cp target/release/build/qwen3_asr-*/out/lib/mlx.metallib ${{ matrix.asset-name }}/

0 commit comments

Comments
 (0)