Skip to content
This repository was archived by the owner on Aug 7, 2025. It is now read-only.

Commit 87f63e6

Browse files
authored
Add comment on using smaller models in Bedrock when resources are restricted (#1642)
1 parent ddf7331 commit 87f63e6

File tree

1 file changed

+4
-1
lines changed
  • content/en/user-guide/aws/bedrock

1 file changed

+4
-1
lines changed

content/en/user-guide/aws/bedrock/index.md

Lines changed: 4 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -142,14 +142,17 @@ $ DEFAULT_BEDROCK_MODEL=mistral localstack start
142142

143143
## Troubleshooting
144144

145-
Users of Docker Desktop on macOS might run into the issue of Bedrock becoming unresponsive after some usage.
145+
Users of Docker Desktop on macOS or Windows might run into the issue of Bedrock becoming unresponsive after some usage.
146146
A common reason for that is insufficient storage or memory space in the Docker Desktop VM.
147147
To resolve this issue you can increase those amounts directly in Docker Desktop or clean up unused artifacts with the Docker CLI like this
148148

149149
{{< command >}}
150150
$ docker system prune
151151
{{< / command >}}
152152

153+
You could also try to use a model with lower requirements.
154+
To achieve that you can search for models in the [Ollama Models library](https://ollama.com/search) with a low parameter count or smaller size.
155+
153156
## Limitations
154157

155158
* At this point, we have only tested text-based models in LocalStack.

0 commit comments

Comments
 (0)