Skip to content

Integrate Camb vertex#303

Open
Saransh-Shankar wants to merge 7 commits intofixie-ai:mainfrom
Saransh-Shankar:camb-vertex
Open

Integrate Camb vertex#303
Saransh-Shankar wants to merge 7 commits intofixie-ai:mainfrom
Saransh-Shankar:camb-vertex

Conversation

@Saransh-Shankar
Copy link

Add Google Vertex CAMB (MARS7) TTS Service

  • Integrates CAMB.AI's MARS7 text-to-speech model deployed on Google Cloud Vertex AI with Ultravox, providing high-quality speech synthesis with voice cloning capabilities.

Key Features

  • High-quality TTS: Uses MARS7 model for natural-sounding speech synthesis
  • Voice cloning: Support for reference audio to clone voices
  • Multilingual support: Multiple languages including en-us, es-es, de-de, fr-fr, ja-jp, ko-kr, zh-cn
  • Async implementation: Uses async predict endpoint to prevent blocking the event loop

Signed-off-by: Saransh-Shankar <saransh.shankar@camb.ai>
Signed-off-by: Saransh-Shankar <saransh.shankar@camb.ai>
Signed-off-by: Saransh-Shankar <saransh.shankar@camb.ai>
Signed-off-by: Saransh-Shankar <saransh.shankar@camb.ai>
Signed-off-by: Saransh-Shankar <saransh.shankar@camb.ai>
Signed-off-by: Saransh-Shankar <saransh.shankar@camb.ai>
@zqhuang211
Copy link
Contributor

@Saransh-Shankar thanks for submitting the PR. Can you take a look at the failed test?

Signed-off-by: Saransh-Shankar <saransh.shankar@camb.ai>
@Saransh-Shankar
Copy link
Author

@Saransh-Shankar thanks for submitting the PR. Can you take a look at the failed test?

Can you approve the workflow please?

@Saransh-Shankar
Copy link
Author

Hi Team,
Could one of the maintainers kindly review this PR? It enhances the organization’s TTS capabilities and introduces an additional tool for users to choose from.
Thank you!

@zqhuang211
Copy link
Contributor

@Saransh-Shankar sorry for the late response. The test is still failing. See here https://github.com/fixie-ai/ultravox/actions/runs/16160094945/job/46896709272?pr=303

I tried to check out your branch, remove the poetry.lock file, and regenerate it by running just install, but I am getting other dependency related errors.

Please try to run just test from your end to ensure everything passes.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants