Skip to content

Commit 03f3c0d

Browse files
authored
add development bounty
1 parent d690f7f commit 03f3c0d

File tree

1 file changed

+6
-5
lines changed

1 file changed

+6
-5
lines changed

README.md

Lines changed: 6 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -7,7 +7,8 @@ medusa-llm"><b>Blog</b></a> | <a href="ROADMAP.md"><b>Roadmap</b></a> |
77

88
---
99
*News* 🔥
10-
- [2023/09] Medusa v0.1 is released! 🎉
10+
- [2023/09] Medusa won the [Chai Prize Grant](https://twitter.com/tianle_cai/status/1703891335147897341)🎉 The prize will be used as a development bounty for those who help us achieve milestones in our [roadmap](https://github.com/FasterDecoding/Medusa/issues/3)!
11+
- [2023/09] Medusa v0.1 is released!
1112

1213
---
1314
## Introduction
@@ -78,7 +79,7 @@ In this initial release, our primary focus is on optimizing Medusa for a batch s
7879
```bash
7980
pip install medusa-llm
8081
```
81-
### Method 2: From source
82+
### Method 2: From the source
8283
```bash
8384
git clone https://github.com/FasterDecoding/Medusa.git
8485
cd Medusa
@@ -95,7 +96,7 @@ pip install -e .
9596
### Inference
9697
We currently support single-GPU inference with a batch size of 1, which is the most common setup for local model hosting. We are actively working to extend Medusa's capabilities by integrating it into other inference frameworks; please don't hesitate to reach out if you are interested in contributing to this effort.
9798

98-
You can use the following command for launching a CLI interface:
99+
You can use the following command to launch a CLI interface:
99100
```bash
100101
CUDA_VISIBLE_DEVICES=0 python -m medusa.inference.cli --model [path of medusa model]
101102
```
@@ -111,7 +112,7 @@ We take a public version of the ShareGPT dataset, which is a subset of the Vicun
111112
```bash
112113
git clone https://huggingface.co/datasets/Aeala/ShareGPT_Vicuna_unfiltered
113114
```
114-
Remark: If you haven't installed `git-lfs`, please install it before clone:
115+
Remark: If you haven't installed `git-lfs`, please install it before cloning:
115116
```bash
116117
git lfs install
117118
```
@@ -158,7 +159,7 @@ python -m medusa.hf_utils --folder [path of the model folder] --repo [name of th
158159
```
159160

160161
## Codebase Guide
161-
`medusa/model/medusa_model.py` is the key file for Medusa. It contains the `MedusaModel` class, which is a wrapper of the original model and the new heads. This class also has implementation of a streaming generation method. If you want to dive into the details of Medusa, this is the place to start.
162+
`medusa/model/medusa_model.py` is the key file for Medusa. It contains the `MedusaModel` class, which is a wrapper of the original model and the new heads. This class also has an implementation of a streaming generation method. If you want to dive into the details of Medusa, this is the place to start.
162163

163164
We also provide some illustrative notebooks in `notebooks/` to help you understand the codebase.
164165

0 commit comments

Comments
 (0)