MLX in Production? #870
justinh-rahb
started this conversation in
Show and tell
MLX in Production?
#870
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Yes.. you read that right. It can be done:
Screen.Recording.2024-06-30.at.10.21.59.AM.mp4
It even supports tool-use/function-calling:
Screen.Recording.2024-07-04.at.5.33.00.PM.mp4
All made possible by this "Pipeline" connector I've made, in combination with the Open WebUI project.
https://github.com/open-webui/pipelines/blob/main/examples/pipelines/providers/mlx_manifold_pipeline.py
Beta Was this translation helpful? Give feedback.
All reactions