Skip to content

Last minute submission #101

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
wants to merge 1 commit into
base: main
Choose a base branch
from
Draft

Last minute submission #101

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion llm/android/LlamaDemo/app/build.gradle.kts
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -63,7 +63,7 @@ dependencies {
if (useLocalAar == true) {
implementation(files("libs/executorch.aar"))
} else {
implementation("org.pytorch:executorch-android:1.0.0")
implementation("org.pytorch:executorch-android-qnn:1.0.0")
}
implementation("com.google.android.material:material:1.12.0")
implementation("androidx.activity:activity:1.9.0")
Expand Down
2 changes: 2 additions & 0 deletions llm/android/LlamaDemo/app/src/main/java/com/example/executorchllamademo/ModelRunner.java
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -12,6 +12,8 @@
import android.os.HandlerThread;
import android.os.Looper;
import android.os.Message;
import android.util.Log;

import androidx.annotation.NonNull;
import org.json.JSONException;
import org.json.JSONObject;
Expand Down
16 changes: 15 additions & 1 deletion llm/android/LlamaDemo/app/src/main/java/com/example/executorchllamademo/PromptFormat.java
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -27,7 +27,21 @@ public static String getSystemPromptTemplate(ModelType modelType) {
case LLAVA_1_5:
return "USER: ";
case QWEN_3:
return "<|im_start|>system\n" + "You are a helpful assistant.\n" + "<|im_end|>\n";
return "<|im_start|>system\n" +
" You are a helpful assistant with access to tools. When you need to use a tool, format your response with JSON between <tool_call> and </tool_call> tokens.\n" +
" \n" +
" Use this exact format: <tool_call>{\"name\": \"function_name\", \"arguments\": {\"param\": \"value\"}}</tool_call>\n" +
" If a tool requires a argument you don't know the value of check if another tool can give you that information and call that tool first.\n" +
" Always respond directly and call the appropriate tool when needed.\n" +
" \n" +
" # Tools\n" +
" \n" +
" You may call one or more functions to assist with the user query.\n" +
" \n" +
" You are provided with function signatures within <tools></tools> XML tags:\n" +
" <tools>\n" +
" {\"description\":\"Get weather information for the location given in argument\",\"name\":\"get_weather\",\"parameters\":{\"properties\":{\"location\":{\"description\":\"The location to get weather for\",\"type\":\"string\"},\"unit\":{\"default\":\"celsius\",\"description\":\"Temperature unit (celsius or fahrenheit)\",\"type\":\"string\"}},\"required\":[\"location\"],\"type\":\"object\"}}" +
"\n<|im_end|>\n";
default:
return SYSTEM_PLACEHOLDER;
}
Expand Down