Skip to content

Commit 6980437

Browse files
authored
Add support for position_ids and past_key_values in OrtBackend (#700)
1 parent f97308f commit 6980437

File tree

3 files changed

+305
-76
lines changed

3 files changed

+305
-76
lines changed

Cargo.lock

Lines changed: 103 additions & 15 deletions
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

backends/ort/Cargo.toml

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -10,7 +10,8 @@ anyhow = { workspace = true }
1010
nohash-hasher = { workspace = true }
1111
ndarray = "0.16.1"
1212
num_cpus = { workspace = true }
13-
ort = { version = "2.0.0-rc.8", default-features = false, features = ["download-binaries", "half", "onednn", "ndarray"] }
13+
ort = { version = "2.0.0-rc.10", default-features = false, features = ["std", "download-binaries", "half", "onednn", "ndarray"] }
14+
ort-sys = { version = "=2.0.0-rc.10", default-features = false } # https://github.com/pykeio/ort/issues/399
1415
text-embeddings-backend-core = { path = "../core" }
1516
tracing = { workspace = true }
1617
thiserror = { workspace = true }

0 commit comments

Comments
 (0)