Skip to content

Commit adc3fcb

Browse files
committed
fix(Vulkan): include integrated GPU memory
1 parent 02805ee commit adc3fcb

File tree

2 files changed

+5
-4
lines changed

2 files changed

+5
-4
lines changed

docs/guide/embedding.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -204,7 +204,7 @@ import DataBadge from "../../.vitepress/components/DataBadge/DataBadge.vue";
204204
</script>
205205
206206
#### Embedded databases {#databases-embedded}
207-
* **[LanceDB](https://lancedb.com/)** ([GitHub](https://github.com/lancedb/lancedb) | [npm](https://www.npmjs.com/package/@lancedb/lancedb) | [Quick start](https://lancedb.github.io/lancedb/basic/#__tabbed_1_2)) - Serverless vector database you can embed inside your application. No server required.
207+
* **[LanceDB](https://lancedb.com/)** ([GitHub](https://github.com/lancedb/lancedb) | [npm](https://www.npmjs.com/package/@lancedb/lancedb) | [Quick start](https://www.npmjs.com/package/@lancedb/lancedb#usage)) - Serverless vector database you can embed inside your application. No server required.
208208
<br/><DataBadge title="Written in" content="Rust"/><DataBadge title="License" content="Apache-2.0"/>
209209
210210
* **Vectra** ([GitHub](https://github.com/Stevenic/vectra) | [npm](https://www.npmjs.com/package/vectra)) - local vector database using local files

llama/addon/globals/getGpuInfo.cpp

Lines changed: 4 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -27,7 +27,8 @@ Napi::Value getGpuVramInfo(const Napi::CallbackInfo& info) {
2727

2828
for (size_t i = 0; i < ggml_backend_dev_count(); i++) {
2929
device = ggml_backend_dev_get(i);
30-
if (ggml_backend_dev_type(device) == GGML_BACKEND_DEVICE_TYPE_GPU) {
30+
auto deviceType = ggml_backend_dev_type(device);
31+
if (deviceType == GGML_BACKEND_DEVICE_TYPE_GPU || deviceType == GGML_BACKEND_DEVICE_TYPE_IGPU) {
3132
deviceTotal = 0;
3233
deviceFree = 0;
3334
ggml_backend_dev_memory(device, &deviceFree, &deviceTotal);
@@ -76,8 +77,8 @@ Napi::Value getGpuDeviceInfo(const Napi::CallbackInfo& info) {
7677

7778
for (size_t i = 0; i < ggml_backend_dev_count(); i++) {
7879
ggml_backend_dev_t device = ggml_backend_dev_get(i);
79-
if (ggml_backend_dev_type(device) == GGML_BACKEND_DEVICE_TYPE_GPU) {
80-
80+
auto deviceType = ggml_backend_dev_type(device);
81+
if (deviceType == GGML_BACKEND_DEVICE_TYPE_GPU || deviceType == GGML_BACKEND_DEVICE_TYPE_IGPU) {
8182
deviceNames.push_back(std::string(ggml_backend_dev_description(device)));
8283
}
8384
}

0 commit comments

Comments
 (0)