More Provider Support

[salihfurkaan]

It would be great to use open weight llms from HuggingFace, Ollama and LM Studio.

[johnnygreco]

👋 @salihfurkaan! Thank you for starting a discussion on this important topic!

I'm happy to share that Data Designer works with all of those model providers! Supporting open models has always been a top-priority for us 🙌

You just need to create your own model provider – as long as the model is hosted on an OpenAI-compatible endpoint, you can use it with Data Designer.

In outline, that would look something like:

from data_designer.essentials import DataDesigner, DataDesignerConfigBuilder, ModelProvider, ModelConfig

provider = ModelProvider(
    name="open_weight_provider",
    endpoint="https://your.endpoint/v1",
)

model_configs = [
    ModelConfig(
        alias="model_alias",
        model="full/model/name",
        provider="open_weight_provider",
    )
]

data_designer = DataDesigner(model_providers=[provider])

config_builder = DataDesignerConfigBuilder(model_configs=model_configs)

...

Let's us know if you have any questions!