Skip to content

Commit 89af1e0

Browse files
committed
workround for unexpected result in fp flow
1 parent 2043e22 commit 89af1e0

File tree

1 file changed

+5
-1
lines changed

1 file changed

+5
-1
lines changed

extension/llm/export/partitioner_lib.py

Lines changed: 5 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -191,5 +191,9 @@ def get_qnn_partitioner(
191191
),
192192
skip_node_id_set={},
193193
skip_node_op_set=skip_node_op_set,
194-
skip_mutable_buffer=False,
194+
# TODO: For fp flow, the behavior of mutable buffer is unexpected
195+
# It seems that delegated mutable buffer is not removed from the output.
196+
# When I trace back, I found the mutable buffer doesn't exist in original_program.state_dict.
197+
# So, it doesn't be added into output_specs_to_delete.
198+
skip_mutable_buffer=use_fp16,
195199
)

0 commit comments

Comments
 (0)