Skip to content

Commit afdb748

Browse files
authored
Update README.md
1 parent a0a23d9 commit afdb748

File tree

1 file changed

+14
-14
lines changed

1 file changed

+14
-14
lines changed

README.md

Lines changed: 14 additions & 14 deletions
Original file line numberDiff line numberDiff line change
@@ -5,13 +5,13 @@
55
/> </a>
66

77
&nbsp;&nbsp;|&nbsp;&nbsp;
8-
[🎯 Benchmarks](#supported-benchmarks) &nbsp;&nbsp;|&nbsp;&nbsp;
9-
[🛠️ Setup](#setup-agentlab) &nbsp;&nbsp;|&nbsp;&nbsp;
10-
[🤖 Assistant](#ui-assistant) &nbsp;&nbsp;|&nbsp;&nbsp;
11-
[🚀 Launch Experiments](#launch-experiments) &nbsp;&nbsp;|&nbsp;&nbsp;
12-
[🔍 Analyse Results](#analyse-results) &nbsp;&nbsp;|&nbsp;&nbsp;
13-
[🤖 Make Your Own Agent](#implement-a-new-agent) &nbsp;&nbsp;|&nbsp;&nbsp;
14-
[↻ Reproducibility](#reproducibility) &nbsp;&nbsp;|&nbsp;&nbsp;
8+
[🎯 Benchmarks](#-supported-benchmarks) &nbsp;&nbsp;|&nbsp;&nbsp;
9+
[🛠️ Setup](#-setup-agentlab) &nbsp;&nbsp;|&nbsp;&nbsp;
10+
[🤖 Assistant](#-ui-assistant) &nbsp;&nbsp;|&nbsp;&nbsp;
11+
[🚀 Launch Experiments](#-launch-experiments) &nbsp;&nbsp;|&nbsp;&nbsp;
12+
[🔍 Analyse Results](#-analyse-results) &nbsp;&nbsp;|&nbsp;&nbsp;
13+
[🤖 Make Your Own Agent](#-implement-a-new-agent) &nbsp;&nbsp;|&nbsp;&nbsp;
14+
[↻ Reproducibility](#-reproducibility) &nbsp;&nbsp;|&nbsp;&nbsp;
1515

1616
[![PyPI - License](https://img.shields.io/pypi/l/agentlab?style=flat-square)]([https://opensource.org/licenses/MIT](http://www.apache.org/licenses/LICENSE-2.0))
1717
[![PyPI - Downloads](https://img.shields.io/pypi/dm/agentlab?style=flat-square)](https://pypistats.org/packages/agentlab)
@@ -36,7 +36,7 @@ AgentLab Features:
3636
* Various [reproducibility features](#reproducibility-features)
3737
* Unified LeaderBoard (soon)
3838

39-
## Supported Benchmarks
39+
## 🎯 Supported Benchmarks
4040
| Benchmark | Setup <br> Link | # Task <br> Template| Seed <br> Diversity | Max <br> Step | Multi-tab | Hosted Method | BrowserGym <br> Leaderboard |
4141
|-----------|------------|---------|----------------|-----------|-----------|---------------|----------------------|
4242
| [WebArena](https://webarena.dev/) | [setup](https://github.com/ServiceNow/BrowserGym/blob/main/browsergym/webarena/README.md) | 812 | None | 30 | yes | self hosted (docker) | soon |
@@ -49,7 +49,7 @@ AgentLab Features:
4949
| [GAIA](https://huggingface.co/spaces/gaia-benchmark/leaderboard) (soon) | - | - | None | - | - | live web | soon |
5050
| [Mind2Web-live](https://huggingface.co/datasets/iMeanAI/Mind2Web-Live) (soon) | - | - | None | - | - | live web | soon |
5151
| [MiniWoB](https://miniwob.farama.org/index.html) | [setup](https://github.com/ServiceNow/BrowserGym/blob/main/browsergym/miniwob/README.md) | 125 | Medium | 10 | no | self hosted (static files) | soon |
52-
## Setup agentlab
52+
## 🛠️ Setup agentlab
5353

5454
```bash
5555
pip install agentlab
@@ -80,7 +80,7 @@ export AZURE_OPENAI_ENDPOINT=<your endpoint> # if using azure models
8080
```
8181
</details>
8282

83-
## UI-Assistant
83+
## 🤖 UI-Assistant
8484
Use an assistant to work for you (at your own cost and risk).
8585

8686
```bash
@@ -93,7 +93,7 @@ Try your own agent:
9393
agentlab-assistant --agent_config="module.path.to.your.AgentArgs"
9494
```
9595

96-
## Launch experiments
96+
## 🚀 Launch experiments
9797

9898
```python
9999
# Import your agent configuration extending bgym.AgentArgs class
@@ -160,7 +160,7 @@ each agent. AgentLab currently does not support evaluations across multiple inst
160160
either create a quick script to handle this or submit a PR to AgentLab. For a smoother parallel
161161
experience, consider using benchmarks like WorkArena instead.
162162

163-
## Analyse Results
163+
## 🔍 Analyse Results
164164

165165
### Loading Results
166166

@@ -201,7 +201,7 @@ In the following order, select:
201201
Once this is selected, you can see the trace of your agent on the given task. Click on the profiling
202202
image to select a step and observe the action taken by the agent.
203203

204-
## Implement a new Agent
204+
## 🤖 Implement a new Agent
205205

206206
Get inspiration from the `MostBasicAgent` in
207207
[agentlab/agents/most_basic_agent/most_basic_agent.py](src/agentlab/agents/most_basic_agent/most_basic_agent.py).
@@ -211,7 +211,7 @@ For a better integration with the tools, make sure to implement most functions i
211211
If you think your agent should be included directly in AgenLab, let use know and it can be added in
212212
agentlab/agents/ with the name of your agent.
213213

214-
## Reproducibility
214+
## Reproducibility
215215
Several factors can influence reproducibility of results in the context of evaluating agents on
216216
dynamic benchmarks.
217217

0 commit comments

Comments
 (0)