Skip to content

Upstage Solar Pro Preview model is not supported #2960

@brankoradovanovic-mcom

Description

@brankoradovanovic-mcom

When trying to use Solar Pro Preview (Maziyar Panahi's Q5_K_M GGUF), I'm largely getting incoherent responses:
image

Whether this is a problem with the GGUF or the inference logic is off, I can't tell. Anyone with a similar experience?

Your Environment

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions