Skip to content

Commit e49bb9f

Browse files
authored
Agent support added (#79)
- Llama Agent UI in Explorer view - OpenRouter API model selection (assumes your OpenRauter key is in setting Api_key_tools) - MCP Support - 9 internal tools available for use - custom_tool - returns the content of a file or a web page - custom_eval_tool - write your own tool in Typescript/javascript - Attach the selection to the context - Configure maximum loops for Llama Agent
1 parent 019f8a5 commit e49bb9f

35 files changed

+9193
-479
lines changed

.vscodeignore

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,5 @@
11
.vscode/**
2+
.idea/**
23
.vscode-test/**
34
src/**
45
.gitignore
@@ -9,3 +10,6 @@ vsc-extension-quickstart.md
910
**/*.map
1011
**/*.ts
1112
**/.vscode-test.*
13+
ui/node_modules/**
14+
ui/src/**
15+
**/test

README.md

Lines changed: 23 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -20,6 +20,7 @@ Local LLM-assisted text completion extension for VS Code
2020
- Ring context with chunks from open and edited files and yanked text
2121
- [Supports very large contexts even on low-end hardware via smart context reuse](https://github.com/ggerganov/llama.cpp/pull/9787)
2222
- Display performance stats
23+
- **NEW**: React-based UI Llama AI with tools
2324

2425
## Installation
2526

@@ -103,6 +104,28 @@ You can use any other FIM-compatible model that your system can handle. By defau
103104

104105
The plugin requires FIM-compatible models: [HF collection](https://huggingface.co/collections/ggml-org/llamavim-6720fece33898ac10544ecf9)
105106

107+
## Llama Agent Webview
108+
109+
The extension includes Llama Agent:
110+
111+
### Features
112+
- Llama Agent UI in Explorer view
113+
- OpenRouter API model selection (assumes your OpenRauter key is in setting Api_key_tools)
114+
- MCP Support
115+
- 9 internal tools available for use
116+
- custom_tool - returns the content of a file or a web page
117+
- custom_eval_tool - write your own tool in Typescript/javascript
118+
- Attach the selection to the context
119+
- Configure maximum loops for Llama Agent
120+
121+
### Usage
122+
1. Open Llama Agent with Ctrl+Shift+A or from llama-vscode menu Show Llama Agent
123+
2. If you have OpenRouter API key in setting Api_key_tools - select a model from OpenRouter by clicking button Select Model. Alternatively - set the model directly with settings Endpoint_tools, Api_key_tools, Ai_model, Ai_api_version (should be v1 in almost all cases)
124+
3. Write a query (Use Enter for new line) and attach files if needed
125+
4. Click Ask button
126+
127+
More details(https://github.com/ggml-org/llama.vscode/wiki)
128+
106129
## Examples
107130

108131
Speculative FIMs running locally on a M2 Studio:

0 commit comments

Comments
 (0)