Skip to content

Commit 76d5eeb

Browse files
committed
adding the mlc config JSON file
1 parent 537ce91 commit 76d5eeb

File tree

1 file changed

+1
-18
lines changed
  • recipes/inference/mobile_inference/android_inference

1 file changed

+1
-18
lines changed

recipes/inference/mobile_inference/android_inference/README.md

Lines changed: 1 addition & 18 deletions
Original file line numberDiff line numberDiff line change
@@ -103,24 +103,7 @@ Connect your phone to your development machine. On OSX, you'll be prompted on th
103103

104104
## Building the Android Package with MLC
105105

106-
First edit the file under `android/MLCChat/mlc-package-config.json` and replace the contents with the following:
107-
108-
```json
109-
{
110-
"device": "android",
111-
"model_list": [
112-
{
113-
"model": "HF://mlc-ai/Llama-3-8B-Instruct-q4f16_1-MLC",
114-
"estimated_vram_bytes": 4348727787,
115-
"model_id": "Llama-3-8B-Instruct",
116-
"overrides": {
117-
"context_window_size": 768,
118-
"prefill_chunk_size": 256
119-
}
120-
}
121-
]
122-
}
123-
```
106+
First edit the file under `android/MLCChat/mlc-package-config.json` and with the [mlc-package-config.json](./mlc-package-config.json) in llama-recipes.
124107

125108
To understand what these JSON fields mean you can refer to this [documentation](https://llm.mlc.ai/docs/deploy/android.html#step-2-build-runtime-and-model-libraries).
126109

0 commit comments

Comments
 (0)