Skip to content

Commit d5e8e1a

Browse files
committed
context : remove batch_manager
ggml-ci
1 parent 131743f commit d5e8e1a

File tree

4 files changed

+178
-227
lines changed

4 files changed

+178
-227
lines changed

src/llama-batch.h

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -42,9 +42,9 @@ struct llama_sbatch {
4242
bool logits_all; // TODO: remove once lctx.logits_all is removed too
4343

4444
// sorted indices into the batch
45-
std::vector<size_t> ids;
45+
std::vector<int64_t> ids;
4646
// batch indices of the output
47-
std::vector<size_t> out_ids;
47+
std::vector<int64_t> out_ids;
4848
std::vector<llama_sbatch_seq> seq;
4949

5050
const llama_batch * batch = nullptr;

0 commit comments

Comments
 (0)