Skip to content

Conversation

@superdosh
Copy link
Contributor

@superdosh superdosh commented Jul 30, 2025

You'll now be able to do something like:

EXAONE_CONFIG = PromptEngineeredAnnotatorConfig(
    name=new_annotator_dynamic,
    description="exaone",
    llm_type="together",
    llm_path="lgai/exaone-3-5-32b-instruct",
    labeler_system_prompt=LABELER_SYS_PROMPT_V1,
    labeler_user_prompt=LABELER_USER_PROMPT_V1,
    taxonomy=V1_0_2024_09_09_TAXONOMY,
    role_to_measure=ASSISTANT_ROLE,
)

ANNOTATORS.register(
    PromptEngineeredAnnotator,
    EXAONE_CONFIG.name,
    EXAONE_CONFIG,
    InjectSecret(TogetherApiKey),
)

And even though the lgai SUT is dynamic, the annotator will work.

cc @bollacker

@github-actions
Copy link

github-actions bot commented Jul 30, 2025

MLCommons CLA bot All contributors have signed the MLCommons CLA ✍️ ✅

@superdosh superdosh force-pushed the dynamic-annotator-support branch 3 times, most recently from fdf881f to 2635140 Compare July 30, 2025 21:02
@superdosh superdosh force-pushed the dynamic-annotator-support branch from 2635140 to f924c1c Compare July 30, 2025 21:08
@superdosh superdosh requested a review from bkorycki July 30, 2025 21:17
@superdosh superdosh marked this pull request as ready for review July 30, 2025 21:17
@superdosh superdosh requested a review from a team as a code owner July 30, 2025 21:17
Copy link
Contributor

@bkorycki bkorycki left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm!

@superdosh superdosh merged commit 7f6127e into main Jul 30, 2025
3 checks passed
@superdosh superdosh deleted the dynamic-annotator-support branch July 30, 2025 21:29
@github-actions github-actions bot locked and limited conversation to collaborators Jul 30, 2025
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants