feat(inference): Add Latitude as inference provider#1927
feat(inference): Add Latitude as inference provider#1927gsalberto wants to merge 1 commit intohuggingface:mainfrom
Conversation
Latitude provides fast, affordable LLM inference on dedicated GPU infrastructure. Supported tasks: - conversational (chat completions) - text-generation (completions) Features: - OpenAI-compatible API - Tool calling / function calling - Structured output (JSON mode) - Vision / multimodal inputs - Streaming with TTFT tracking Provider details: - Organization: https://huggingface.co/latitude-sh - API Base: https://api.lsh.ai - Pricing: https://api.lsh.ai/pricing
|
Hi @hanouticelina @Wauplin - Just wanted to check if you have bandwidth to review this PR. |
|
Hi @Wauplin @hanouticelina @SBrandeis - friendly bump on this PR. It's been 2 weeks and we'd love to get Latitude added as an inference provider. We have production infrastructure ready with multiple models (Llama 3.1, Qwen 2.5/3, DeepSeek R1, Gemma 2) running on dedicated GPUs. Our API supports streaming, tool calling, vision, and structured output. Happy to make any changes needed. Let us know if there's anything blocking the review. Thanks! |
|
Hey there! However, we're currently in a consolidation phase focusing on growing usage of Inference Providers via new features and integrations rather than expanding to new partners. This means we've temporarily paused onboarding new providers while we work on these improvements. We're not able to provide a specific timeline for when we'll resume new provider onboarding, but we'd love to revisit this integration in the future. Thanks again for your contribution and understanding! |
Summary
This PR adds support for Latitude.sh as an inference provider.
About Latitude:
AI Inference Platform Features:
https://api.lsh.aiChanges
packages/inference/src/providers/latitude.tswithLatitudeConversationalTaskandLatitudeTextGenerationTasklatitude-shtoINFERENCE_PROVIDERSintypes.tslatitude-shtoPROVIDERS_HUB_ORGSmappinglatitude-shtoHARDCODED_MODEL_INFERENCE_MAPPINGinconsts.tsPROVIDERSingetProviderHelper.tsRelated PRs