Skip to content

Default evaluator broken #1505

@wpietri

Description

@wpietri
RuntimeError: Not all annotators are ready to go. Status: {'llama_guard_2': ReadyResponse(is_ready=False, response=None, error=APIException('Unexpected API failure (400): {\n  "id": "obJrHNv-4msxKE-9dd514c1ad8ee826",\n  "error": {\n    "message": "Unable to access non-serverless model meta-llama/LlamaGuard-2-8b. Please visit https://api.together.ai/models/meta-llama/LlamaGuard-2-8b to create and start a new dedicated endpoint for the model.",\n    "type": "invalid_request_error",\n    "param": null,\n    "code": "model_not_available"\n  }\n}'))}                                                                                                         

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions