Skip to content

Conversation

@thatsKevinJain
Copy link
Contributor

@thatsKevinJain thatsKevinJain commented Apr 11, 2025

Summary

Contains models updates for:

  • llama-3.3-70b-instruct-fp8-fast
  • mistral-small-3.1-24b-instruct

closes #21718

Documentation checklist

@github-actions
Copy link
Contributor

github-actions bot commented Apr 11, 2025

@thatsKevinJain thatsKevinJain force-pushed the kevin/llama-3-3-70b-schema-update branch from b7aebaa to b170047 Compare April 11, 2025 22:03
@thatsKevinJain thatsKevinJain changed the title Add support for batching, function calling and loras for llama-3.3-70b Add support for batching and function calling for llama-3.3-70b Apr 11, 2025
@miguelleon88

This comment was marked as off-topic.

@kodster28
Copy link
Collaborator

dupe of #21772

@kodster28 kodster28 closed this Apr 17, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Incorrect list of supported batch AI models

5 participants