Help needed:: Guidance on Deploying to Modern BentoCloud

[oluwakayodemike]

Help needed: Guidance on Deploying to Modern BentoCloud

Hi everyone,

I've been working with the repo from bentoml CLIP-API-service project and it runs perfectly on my local machine. I'm really impressed with how easy it is to get started, at least locally.

I ran into a challenge when trying to deploy it to the modern BentoCloud platform, and I wanted to share my experience to see if anyone in the community has found a solution or can offer some advice.

Context & Environment

• Installation: I followed the standard procedure: cloned the repo and used pdm install to set up the environment from the pdm.lock file.
• Local BentoML Version: This correctly installed bentoml==1.1.6 an old version used at the time the repo was created.
• Deployment Target: BentoCloud.

Deployment

1. I successfully built the Bento locally using the project's command: pdm run clip-api-service build --model-name=ViT-L-14:openai.
2. I successfully pushed the Bento to my BentoCloud account.
3. I then tried to deploy this Bento from the BentoCloud UI.

Version Mismatch

The deployment consistently fails when the server tries to start. The logs show a clear error pointing to an incompatibility between the old BentoML version and the modern cloud environment:

Error: No such command 'start-http-server'
Error: No such command 'start-runner-server'

you can view a more complete log here:
clip-api-service-7scg--all--20250727T215855.log
clip-api-service-wwtb--service--20250727T211731.log

i would appreciate if anyone can help me on this, thanks.

[frostming]

Since that repo hasn't got updated for over 2 years, the bentoml version is a bit old but is not pinned in the build config.

I have to fix that by pinning the bentoml version. But anyway, I recommend https://github.com/bentoml/BentoCLIP for latest usage.

[oluwakayodemike]

yes, i already clone this new one to test if it won't have same issue deploying, but some packages were unable to be installed from the requirements [e.g the version of pillow on the requirements] because i was running python 3.13.5 locally, so i had to install python 3.11.9 and used it in a venv and they all installed successfully.

i'm going to test if its working fine tonight tho, thank you!