Skip to content

Commit a3aa838

Browse files
add comment [no ci]
1 parent 634c522 commit a3aa838

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

src/llama-context.cpp

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -324,6 +324,7 @@ llama_context::llama_context(
324324
ggml_backend_dev_t device_fa = ggml_backend_get_device(
325325
ggml_backend_sched_get_tensor_backend(sched.get(), n));
326326

327+
// TODO: instead of the tensor names, use a map to keep track of which (FA) tensors belong to which layer
327328
GGML_ASSERT(strncmp(n->name, LLAMA_TENSOR_NAME_FATTN "-", prefix_len) == 0);
328329
const int il = std::stoi(n->name + prefix_len);
329330
ggml_backend_dev_t device_kv = model.dev_layer(il);

0 commit comments

Comments
 (0)