Skip to content

Request to add support for NPU and Hybrid models #301

@GautamMKGarg

Description

@GautamMKGarg

Hello

I have AMD Ryzen AI 7 350 processor in my laptop, which has inbuilt NPU. That's why it support Hybrid and NPU models also. Using the tools like Lemonade server and FastFlowLM I can run NPU and Hybrid LLM on my machine.
I like the concept of llmfit very much, but I found that currently llmfit does not have support for lemonade, FastFlowLM, NPU and Hybrid. Could you please add it in future updates.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions