Skip to content

Commit 57e469c

Browse files
Qualcomm AI Engine Direct - add seq_mse_candidates setting to SmolLM3 and fixed a bug in the graph drawer (#14571)
Qualcomm AI Engine Direct - add seq_mse_candidates setting to SmolLM3 and fixed a bug in the graph drawer ### Summary - add seq_mse_candidates setting to SmolLM3 - fixed a bug in the graph drawer ### Test plan DrawGraph Unit test ``` bash python -m backends.qualcomm.tests.test_qnn_delegate TestQNNFloatingPointUtils.test_qnn_backend_draw_graph -s ${SERIAL_NUM} -m ${SOC_MODEL} -b build-android -a . --executorch_root . python -m backends.qualcomm.tests.test_qnn_delegate TestQNNQuantizedUtils.test_qnn_backend_draw_graph -s ${SERIAL_NUM} -m ${SOC_MODEL} -b build-android -a . --executorch_root . ``` SmolLM3 script in `./examples/qualcomm/oss_scripts/llama/README.md` at SmolLM3 part Co-authored-by: DannyYuyang-quic <[email protected]>
1 parent e057805 commit 57e469c

File tree

2 files changed

+3
-2
lines changed

2 files changed

+3
-2
lines changed

backends/qualcomm/debugger/utils.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -183,11 +183,11 @@ def draw(self):
183183
cleanup=not self.dot_string,
184184
)
185185
source_file = os.path.join(temp_directory, f"{self.filename}.svg")
186-
destination_file = os.path.join(".", f"{self.filename}.svg")
186+
destination_file = os.path.join(self.directory, f"{self.filename}.svg")
187187
shutil.move(source_file, destination_file)
188188
if self.dot_string:
189189
dot_file = os.path.join(temp_directory, f"{self.filename}")
190-
dot_dest_file = os.path.join(".", f"{self.filename}.dot")
190+
dot_dest_file = os.path.join(self.directory, f"{self.filename}.dot")
191191
shutil.move(dot_file, dot_dest_file)
192192

193193

examples/qualcomm/oss_scripts/llama/__init__.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -501,6 +501,7 @@ class Smollm3_3B(LLMModelConfig):
501501
ptq = QuantDtype.use_16a4w_block
502502
group_size = 32
503503
masked_softmax = True
504+
seq_mse_candidates = 0
504505
r1 = False
505506
r2 = False
506507
r3 = False

0 commit comments

Comments
 (0)