Skip to content

Commit 8dc9116

Browse files
committed
updated before third experiment
1 parent cb62e50 commit 8dc9116

File tree

1,002 files changed

+18330
-5847
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

1,002 files changed

+18330
-5847
lines changed

dataset/splitInference.py

Lines changed: 0 additions & 21 deletions
This file was deleted.

dataset/typst.json

Lines changed: 50 additions & 50 deletions
Large diffs are not rendered by default.

scripts/run_experiment.sh

Lines changed: 0 additions & 9 deletions
This file was deleted.

structeval/cli.py

Lines changed: 4 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -29,11 +29,14 @@ def inference(
2929
queries = [
3030
f"""{item['query']}
3131
\n\nIMPORTANT: Only output the required renderable or executable code. You must start the code with <code> and end the code with </code> (they are code block indicators, not HTML tags). No other text output (explanation, comments, etc.) are allowed.
32-
{"\n\n/no_think" if llm_model_name == "Qwen/Qwen3-4B-Base" else ""}
32+
{"\n\n/no_think" if llm_model_name == "Qwen/Qwen3-4B" else ""}
3333
"""
3434
for item in data
3535
]
3636

37+
if llm_model_name == "Qwen/Qwen3-4B":
38+
print("Qwen3-4B I'm here")
39+
3740
generations = run_inference(llm_model_name, llm_engine, queries, **kwargs)
3841

3942
output_data = []

structeval/debug_images/000100.png

24 KB

structeval/debug_images/000101.png

6.24 KB

structeval/debug_images/000102.png

5.54 KB

structeval/debug_images/000103.png

21.2 KB

structeval/debug_images/000104.png

6.24 KB

structeval/debug_images/000105.png

62.3 KB

0 commit comments

Comments
 (0)