Skip to content

Commit 22ec140

Browse files
authored
Merge pull request docker#406 from docker/nim-doc-alyer
Temporarily removing NIM docs
2 parents f1ce938 + e5aef7f commit 22ec140

File tree

1 file changed

+3
-39
lines changed

1 file changed

+3
-39
lines changed

README.md

Lines changed: 3 additions & 39 deletions
Original file line numberDiff line numberDiff line change
@@ -41,6 +41,9 @@ docker version
4141

4242
# Check Docker Model Runner version
4343
docker model version
44+
45+
# Run a model to test the full setup
46+
docker model run ai/gemma3 "Hello"
4447
```
4548

4649
If `docker model` is not available, see the troubleshooting section below.
@@ -350,45 +353,6 @@ The response will contain the model's reply:
350353
}
351354
```
352355

353-
## NVIDIA NIM Support
354-
355-
Docker Model Runner supports running NVIDIA NIM (NVIDIA Inference Microservices) containers directly. This provides a simplified workflow for deploying NVIDIA's optimized inference containers.
356-
357-
### Prerequisites
358-
359-
- Docker with NVIDIA GPU support (nvidia-docker2 or Docker with NVIDIA Container Runtime)
360-
- NGC API Key (optional, but required for some NIM models)
361-
- Docker login to nvcr.io registry
362-
363-
### Quick Start
364-
365-
1. **Login to NVIDIA Container Registry:**
366-
367-
```bash
368-
docker login nvcr.io
369-
Username: $oauthtoken
370-
Password: <PASTE_API_KEY_HERE>
371-
```
372-
373-
2. **Set NGC API Key (if required by the model):**
374-
375-
```bash
376-
export NGC_API_KEY=<PASTE_API_KEY_HERE>
377-
```
378-
379-
3. **Run a NIM model:**
380-
381-
```bash
382-
docker model run nvcr.io/nim/google/gemma-3-1b-it:latest
383-
```
384-
385-
That's it! The Docker Model Runner will:
386-
- Automatically detect that this is a NIM image
387-
- Pull the NIM container image
388-
- Configure it with proper GPU support, shared memory (16GB), and NGC credentials
389-
- Start the container and wait for it to be ready
390-
- Provide an interactive chat interface
391-
392356
### Features
393357

394358
- **Automatic GPU Detection**: Automatically configures NVIDIA GPU support if available

0 commit comments

Comments
 (0)