Skip to content

No NPU Models availableΒ #510

@darylgraves-stantec

Description

@darylgraves-stantec

Foundry Version: 0.8.119
Intel NPU Driver: 32.0.100.4512

When running foundry model list I can only see GPU and CPU models. I've tried upgrading NPU driver just in case.

If I find a model on the website and paste in the command (e.g foundry model run qwen2.5-coder-7b-instruct-openvino-npu:2) I get this:

Exception: ❌ Model <qwen2.5-coder-7b-instruct-openvino-npu:2> was not found in the catalog or local cache.
πŸ” Did you mean: `foundry model run qwen2.5-coder-7b-instruct-generic-gpu:4`?
πŸ‘‰ Try `foundry model list` to see available models.
πŸ‘‰ Or check for typos in the model name.

Have the NPU models been removed? Thanks!

Metadata

Metadata

Assignees

No one assigned

    Labels

    CLIIssue relates to the CLI

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions