llmfit detecting Ryzen 9800X3D CPU as a 2nd 7900XTX

[pffxivtools]

There's a few issues here:

• force-runtime does nothing, runtime is always vLLM
• llmfit detecting 2GPUs with 48GB VRAM total, I only have a single 7900XTX

system.txt
rocminfo.txt
llmfit.txt

[nikhil00shinde]

@pffxivtools Yeah, same thing happened, detecting other GPU only having single GPU.

[AlexsJones]

Fixed in v0.8.2 - rocm-smi was counting the iGPU as a second discrete GPU, and force-runtime now properly overrides the default for prequantized models.

[rvaidya]

The multiple gpu issue is still reproducible in 0.8.4

llmfit recommend -n 1

Details

{
  "models": [
    {
      "best_quant": "Q4_K_M",
      "category": "General",
      "context_length": 262144,
      "estimated_tps": 44.4,
      "fit_level": "Good",
      "gguf_sources": [],
      "is_moe": true,
      "memory_available_gb": 47.97,
      "memory_required_gb": 33.0,
      "moe_offloaded_gb": null,
      "name": "txn545/Qwen3.5-122B-A10B-NVFP4",
      "notes": [
        "GPU: model loaded into VRAM",
        "MoE: all 256 experts loaded in VRAM (optimal)",
        "Baseline estimated speed: 44.4 tok/s"
      ],
      "parameter_count": "64.4B",
      "params_b": 64.35,
      "provider": "txn545",
      "release_date": "2026-02-24",
      "run_mode": "GPU",
      "runtime": "llama.cpp",
      "runtime_label": "llama.cpp",
      "score": 96.4,
      "score_components": {
        "context": 100.0,
        "fit": 100.0,
        "quality": 92.0,
        "speed": 100.0
      },
      "total_memory_gb": 33.0,
      "use_case": "General purpose text generation",
      "utilization_pct": 68.8
    }
  ],
  "system": {
    "available_ram_gb": 152.34,
    "backend": "ROCm",
    "cpu_cores": 16,
    "cpu_name": "AMD Ryzen 7 9800X3D 8-Core Processor",
    "gpu_count": 2,
    "gpu_name": "Card Series",
    "gpu_vram_gb": 23.98,
    "gpus": [
      {
        "backend": "ROCm",
        "count": 2,
        "name": "Card Series",
        "unified_memory": false,
        "vram_gb": 23.98
      },
      {
        "backend": "Vulkan",
        "count": 1,
        "name": "AMD Radeon RX 7900 XTX (RADV NAVI31)",
        "unified_memory": false,
        "vram_gb": null
      },
      {
        "backend": "Vulkan",
        "count": 1,
        "name": "AMD Ryzen 7 9800X3D 8-Core Processor (RADV RAPHAEL_MENDOCINO)",
        "unified_memory": false,
        "vram_gb": null
      }
    ],
    "has_gpu": true,
    "total_ram_gb": 186.28,
    "unified_memory": false
  }
}