Search results

Feature request. Implement distributed cluster inference.

feature requestNew feature or requestNew feature or request

Status: Open.

#3422 In mlc-ai/mlc-llm;

· sperglord8008s opened on Feb 11, 2026

[Question] MLC concurrent request handling behavior

questionQuestion about the usageQuestion about the usage

Status: Open.

#3407 In mlc-ai/mlc-llm;

· jimmyparadm opened on Jan 2, 2026

[Bug] Compiling Qwen3-Embedding model fails

bugConfirmed bugsConfirmed bugs

Status: Open.

#3404 In mlc-ai/mlc-llm;

· SuperMasterBlasterLaser opened on Dec 31, 2025

[Bug] 'tvm/ffi/any.h' file not found

bugConfirmed bugsConfirmed bugs

Status: Open.

#3399 In mlc-ai/mlc-llm;

· vmanvs opened on Dec 19, 2025

phi-3.5-vision strange output

questionQuestion about the usageQuestion about the usage

Status: Open.

#3395 In mlc-ai/mlc-llm;

· Lingrongye opened on Dec 10, 2025

[Bug] phi3V (phi3.5v) inference is broken

bugConfirmed bugsConfirmed bugs

Status: Open.

#3394 In mlc-ai/mlc-llm;

· cmpute opened on Dec 9, 2025

[Model Request]

new-models

Status: Open.

#3390 In mlc-ai/mlc-llm;

· wighawag opened on Dec 6, 2025

[Question] Custom Architecture

questionQuestion about the usageQuestion about the usage

Status: Open.

#3386 In mlc-ai/mlc-llm;

· hg0428 opened on Nov 26, 2025

Windows CPU+Vulkan build error IMPORTANT

bugConfirmed bugsConfirmed bugs

Status: Open.

#3384 In mlc-ai/mlc-llm;

· dhadialhda opened on Nov 26, 2025

[Bug] Failed to load Llama

bugConfirmed bugsConfirmed bugs

Status: Open.

#3381 In mlc-ai/mlc-llm;

· mariagcomesanaia-spa opened on Nov 17, 2025

[Bug] Totally broken in Python3.13. Under the rocm 6.2 build

bugConfirmed bugsConfirmed bugs

Status: Open.

#3380 In mlc-ai/mlc-llm;

· delphiRo opened on Nov 17, 2025

[Bug] Error compiling WASM under Windows11: tvm.error.InternalError

bugConfirmed bugsConfirmed bugs

Status: Open.

#3378 In mlc-ai/mlc-llm;

· willo83417 opened on Nov 12, 2025