This repo contains the code needed to run Falcon 7B using Truss and containerize it using Docker. It also contains a yaml file for deploying this model using a GPU-enabled kubernetes cluster.
htrivedi99/falcon-7b-truss
Folders and files
| Name | Name | Last commit date | ||
|---|---|---|---|---|