Skip to content

Commit 3fba4f0

Browse files
authored
Merge branch 'main' into env-file-fix
2 parents b892d70 + 90c9c9c commit 3fba4f0

File tree

4 files changed

+56
-43
lines changed

4 files changed

+56
-43
lines changed

FAQ.md

Lines changed: 22 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -2,6 +2,18 @@
22

33
# bolt.diy
44

5+
## Recommended Models for bolt.diy
6+
7+
For the best experience with bolt.diy, we recommend using the following models:
8+
9+
- **Claude 3.5 Sonnet (old)**: Best overall coder, providing excellent results across all use cases
10+
- **Gemini 2.0 Flash**: Exceptional speed while maintaining good performance
11+
- **GPT-4o**: Strong alternative to Claude 3.5 Sonnet with comparable capabilities
12+
- **DeepSeekCoder V2 236b**: Best open source model (available through OpenRouter, DeepSeek API, or self-hosted)
13+
- **Qwen 2.5 Coder 32b**: Best model for self-hosting with reasonable hardware requirements
14+
15+
**Note**: Models with less than 7b parameters typically lack the capability to properly interact with bolt!
16+
517
## FAQ
618

719
### How do I get the best results with bolt.diy?
@@ -34,14 +46,18 @@ We have seen this error a couple times and for some reason just restarting the D
3446

3547
We promise you that we are constantly testing new PRs coming into bolt.diy and the preview is core functionality, so the application is not broken! When you get a blank preview or don’t get a preview, this is generally because the LLM hallucinated bad code or incorrect commands. We are working on making this more transparent so it is obvious. Sometimes the error will appear in developer console too so check that as well.
3648

37-
### How to add a LLM:
49+
### Everything works but the results are bad
3850

39-
To make new LLMs available to use in this version of bolt.new, head on over to `app/utils/constants.ts` and find the constant MODEL_LIST. Each element in this array is an object that has the model ID for the name (get this from the provider's API documentation), a label for the frontend model dropdown, and the provider.
51+
This goes to the point above about how local LLMs are getting very powerful but you still are going to see better (sometimes much better) results with the largest LLMs like GPT-4o, Claude 3.5 Sonnet, and DeepSeek Coder V2 236b. If you are using smaller LLMs like Qwen-2.5-Coder, consider it more experimental and educational at this point. It can build smaller applications really well, which is super impressive for a local LLM, but for larger scale applications you want to use the larger LLMs still!
4052

41-
By default, Anthropic, OpenAI, Groq, and Ollama are implemented as providers, but the YouTube video for this repo covers how to extend this to work with more providers if you wish!
53+
### Received structured exception #0xc0000005: access violation
4254

43-
When you add a new model to the MODEL_LIST array, it will immediately be available to use when you run the app locally or reload it. For Ollama models, make sure you have the model installed already before trying to use it here!
55+
If you are getting this, you are probably on Windows. The fix is generally to update the [Visual C++ Redistributable](https://learn.microsoft.com/en-us/cpp/windows/latest-supported-vc-redist?view=msvc-170)
4456

45-
### Everything works but the results are bad
57+
### How to add an LLM:
4658

47-
This goes to the point above about how local LLMs are getting very powerful but you still are going to see better (sometimes much better) results with the largest LLMs like GPT-4o, Claude 3.5 Sonnet, and DeepSeek Coder V2 236b. If you are using smaller LLMs like Qwen-2.5-Coder, consider it more experimental and educational at this point. It can build smaller applications really well, which is super impressive for a local LLM, but for larger scale applications you want to use the larger LLMs still!
59+
To make new LLMs available to use in this version of bolt.new, head on over to `app/utils/constants.ts` and find the constant MODEL_LIST. Each element in this array is an object that has the model ID for the name (get this from the provider's API documentation), a label for the frontend model dropdown, and the provider.
60+
61+
By default, many providers are already implemented, but the YouTube video for this repo covers how to extend this to work with more providers if you wish!
62+
63+
When you add a new model to the MODEL_LIST array, it will immediately be available to use when you run the app locally or reload it.

README.md

Lines changed: 13 additions & 36 deletions
Original file line numberDiff line numberDiff line change
@@ -4,7 +4,9 @@
44

55
Welcome to bolt.diy, the official open source version of Bolt.new (previously known as oTToDev and bolt.new ANY LLM), which allows you to choose the LLM that you use for each prompt! Currently, you can use OpenAI, Anthropic, Ollama, OpenRouter, Gemini, LMStudio, Mistral, xAI, HuggingFace, DeepSeek, or Groq models - and it is easily extended to use any other model supported by the Vercel AI SDK! See the instructions below for running this locally and extending it to include more models.
66

7-
Check the [bolt.diy Docs](https://stackblitz-labs.github.io/bolt.diy/) for more information. This documentation is still being updated after the transfer.
7+
Check the [bolt.diy Docs](https://stackblitz-labs.github.io/bolt.diy/) for more information.
8+
9+
We have also launched an experimental agent called the "bolt.diy Expert" that can answer common questions about bolt.diy. Find it here on the [oTTomator Live Agent Studio](https://studio.ottomator.ai/).
810

911
bolt.diy was originally started by [Cole Medin](https://www.youtube.com/@ColeMedin) but has quickly grown into a massive community effort to build the BEST open source AI coding assistant!
1012

@@ -95,34 +97,6 @@ Clone the repository using Git:
9597
git clone -b stable https://github.com/stackblitz-labs/bolt.diy
9698
```
9799

98-
### (Optional) Configure Environment Variables
99-
100-
Most environment variables can be configured directly through the settings menu of the application. However, if you need to manually configure them:
101-
102-
1. Rename `.env.example` to `.env.local`.
103-
2. Add your LLM API keys. For example:
104-
105-
```env
106-
GROQ_API_KEY=YOUR_GROQ_API_KEY
107-
OPENAI_API_KEY=YOUR_OPENAI_API_KEY
108-
ANTHROPIC_API_KEY=YOUR_ANTHROPIC_API_KEY
109-
```
110-
111-
**Note**: Ollama does not require an API key as it runs locally.
112-
113-
3. Optionally, set additional configurations:
114-
115-
```env
116-
# Debugging
117-
VITE_LOG_LEVEL=debug
118-
119-
# Ollama settings (example: 8K context, localhost port 11434)
120-
OLLAMA_API_BASE_URL=http://localhost:11434
121-
DEFAULT_NUM_CTX=8192
122-
```
123-
124-
**Important**: Do not commit your `.env.local` file to version control. This file is already included in `.gitignore`.
125-
126100
---
127101

128102
## Run the Application
@@ -155,27 +129,30 @@ DEFAULT_NUM_CTX=8192
155129
156130
Use the provided NPM scripts:
157131
```bash
158-
npm run dockerbuild # Development build
159-
npm run dockerbuild:prod # Production build
132+
npm run dockerbuild
160133
```
161134
162135
Alternatively, use Docker commands directly:
163136
```bash
164-
docker build . --target bolt-ai-development # Development build
165-
docker build . --target bolt-ai-production # Production build
137+
docker build . --target bolt-ai-development
166138
```
167139
168140
2. **Run the Container**:
169141
Use Docker Compose profiles to manage environments:
170142
```bash
171-
docker-compose --profile development up # Development
172-
docker-compose --profile production up # Production
143+
docker-compose --profile development up
173144
```
174145
175146
- With the development profile, changes to your code will automatically reflect in the running container (hot reloading).
176147
177148
---
178149
150+
### Entering API Keys
151+
152+
All of your API Keys can be configured directly in the application. Just selecte the provider you want from the dropdown and click the pencile icon to enter your API key.
153+
154+
---
155+
179156
### Update Your Local Version to the Latest
180157
181158
To keep your local version of bolt.diy up to date with the latest changes, follow these steps for your operating system:
@@ -236,4 +213,4 @@ Explore upcoming features and priorities on our [Roadmap](https://roadmap.sh/r/o
236213

237214
## FAQ
238215

239-
For answers to common questions, visit our [FAQ Page](FAQ.md).
216+
For answers to common questions, issues, and to see a list of recommended models, visit our [FAQ Page](FAQ.md).

app/commit.json

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1 +1 @@
1-
{ "commit": "d37c3736d5e73b0305f19d1bbc7c47a6dfbf7656" }
1+
{ "commit": "6458211bed379396e797e6da2944f6627a428c40", "version": "0.0.3" }

docs/docs/FAQ.md

Lines changed: 20 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,19 @@
11
# Frequently Asked Questions (FAQ)
22

3+
## What are the best models for bolt.diy?
4+
5+
For the best experience with bolt.diy, we recommend using the following models:
6+
7+
- **Claude 3.5 Sonnet (old)**: Best overall coder, providing excellent results across all use cases
8+
- **Gemini 2.0 Flash**: Exceptional speed while maintaining good performance
9+
- **GPT-4o**: Strong alternative to Claude 3.5 Sonnet with comparable capabilities
10+
- **DeepSeekCoder V2 236b**: Best open source model (available through OpenRouter, DeepSeek API, or self-hosted)
11+
- **Qwen 2.5 Coder 32b**: Best model for self-hosting with reasonable hardware requirements
12+
13+
**Note**: Models with less than 7b parameters typically lack the capability to properly interact with bolt!
14+
15+
---
16+
317
## How do I get the best results with bolt.diy?
418

519
- **Be specific about your stack**:
@@ -72,6 +86,12 @@ Local LLMs like Qwen-2.5-Coder are powerful for small applications but still exp
7286

7387
---
7488

89+
### **"Received structured exception #0xc0000005: access violation"**
90+
91+
If you are getting this, you are probably on Windows. The fix is generally to update the [Visual C++ Redistributable](https://learn.microsoft.com/en-us/cpp/windows/latest-supported-vc-redist?view=msvc-170)
92+
93+
---
94+
7595
### **"Miniflare or Wrangler errors in Windows"**
7696
You will need to make sure you have the latest version of Visual Studio C++ installed (14.40.33816), more information here https://github.com/stackblitz-labs/bolt.diy/issues/19.
7797

0 commit comments

Comments
 (0)