Skip to content

Portable build ooba 3.20 linux cuda contains 3 (three) identical files libggml-cuda* each having 1.1 Gb size #7344

@Kekuaka

Description

@Kekuaka

Describe the bug

Portable build ooba 3.20 linux cuda contains 3 (three) identical files libggml-cuda each having 1.1 Gb size.
I mean,
libggml-cuda.so
libggml-cuda.so.0
libggml-cuda.so.0.9.4
All these files have the same checksum and size.
General solution for such cases, to get one physical file and a number of symlinks for .0, .0.9.4 and so on, which are pointed to the physical file.

Is there an existing issue for this?

  • I have searched the existing issues

Reproduction

  1. Download textgen-portable-3.20-linux-cuda12.4.zip
  2. Unpack and navigate to portable_env/lib/python3.11/site-packages/llama_cpp_binaries/bin/
  3. Execute md5sum libggml-cuda.*
  4. Read that all three checksums are equal

Screenshot

No response

Logs

md5sum libggml-cuda.*
bab24cb57bb97254ba119e2f73da827d  libggml-cuda.so
bab24cb57bb97254ba119e2f73da827d  libggml-cuda.so.0
bab24cb57bb97254ba119e2f73da827d  libggml-cuda.so.0.9.4

System Info

Ubuntu 22.04, Nvidia

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions