Skip to content

[Error] Mistral-7B-Instruct-v0.2 Model is creating garbage responses to prompts #114

@kalyan-nakka

Description

@kalyan-nakka

I'm trying to build the MLC Chat Android app using the prebuilt models provided in this repository as per the instructions provided in https://llm.mlc.ai/docs/prebuilt_models.html#overview. All LLMs are working fine and are providing responses as expected but only Mistral-7B-Instruct-v0.2 model is generating garbage responses to the prompts as shown below.

This is happening for all kinds of prompts sending to the model.

Please help me with this error.

Screenshot_2024-04-18-16-09-21-52_39ee8d39e9d9fa2b63462cd99e6b41fe

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions