Skip to content

Update local_cost.py#59

Merged
amanpreet692 merged 1 commit intomainfrom
amanpreet692-openscholar-patch
Aug 15, 2025
Merged

Update local_cost.py#59
amanpreet692 merged 1 commit intomainfrom
amanpreet692-openscholar-patch

Conversation

@amanpreet692
Copy link
Copy Markdown
Contributor

@amanpreet692 amanpreet692 commented Aug 14, 2025

Custom cost to be added for open scholar solver for the finetuned model: https://huggingface.co/akariasai/os_8b

"together_ai/meta-llama/Meta-Llama-3.1-8B-Instruct-Turbo": {
        "input_cost_per_token": 1.8e-07,
        "output_cost_per_token": 1.8e-07,
        "litellm_provider": "together_ai",
        "supports_function_calling": true,
        "supports_parallel_function_calling": true,
        "supports_response_schema": true,
        "mode": "chat",
        "supports_tool_choice": true
    }

-- sourced from littlm here: https://raw.githubusercontent.com/BerriAI/litellm/refs/heads/main/litellm/model_prices_and_context_window_backup.json

Copy link
Copy Markdown
Contributor

@mdarcy220 mdarcy220 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm and I think @regan-huff is still OOO for another week; idk if @dirkraft or anyone else understands the full mechanism for this right now, but it seems harmless to merge and can update if it turns out an additional change is needed

@amanpreet692 amanpreet692 merged commit e1eb4c3 into main Aug 15, 2025
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants