Skip to content

Uprage to llama.cpp 74d73dc #10620

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
wants to merge 46 commits into from
Closed

Uprage to llama.cpp 74d73dc #10620

wants to merge 46 commits into from

Conversation

@TerryT9
Copy link

@TerryT9 TerryT9 commented Dec 2, 2024 •
edited
Loading

zhiyuan8 and others added 30 commits September 10, 2024 20:50
@zhiyuan8
support ggml
5f81588
@zhiyuan8
update README after renaming GGML
3a35526
@zhiyuan8
update vulkan target name
4a29bca
@zhiyuan8
support omni-audio
c7b912b
@zhiyuan8
enable qwen2-audio work E2E
f0d1c4f
@zhiyuan8
remove uneccesary build and rename shared lib
9e67ef7
@zhiyuan8
update to C++17 for compilation
4bdc70a
add omni-vlm examples (C++ & python)
d277c67
@zhiyuan8
Disable cxxabi.h dependency on Windows
995baef
@zhiyuan8
fix error on windows qwen2-audio/whisper.cpp:9935:38: error: '_O_BINA…
a4747b2 
…RY' was not declared in this scope
@zhiyuan8
Adding #include <io.h> & <fcntl.h>
6f1ed6e
@zhiyuan8
disable <cxxabi.h> for MSC_VER
1419681
@zhiyuan8
remove C++20 style
d42e037
@zhiyuan8
remove C++20 syntax
05853eb
@zhiyuan8
Merge pull request #6 from NexaAI/master-release-audio-lm
91b3caf 
Remove C++20 coding and suport Microsoft Visual Studio Compilation
@zhiyuan8
Merge pull request #8 from NexaAI/weili/master-release
983b462 
add omni-vlm examples (C++ & python)
add returned string (pure c const char* type) for omni-vlm inference api
22da7bc
@zhiyuan8
Merge pull request #10 from NexaAI/weili/master-release
5574bda 
add returned string (pure c const char* type) for omni-vlm inference api
add returned string (const char*) for qwen2 audio
b24a409
@zhiyuan8
Merge pull request #11 from NexaAI/weili/master-release
6a4cf0b 
add returned string (const char*) for qwen2 audio
add returned string type (const char*) for nexa-omni-audio
5edadff
@zhiyuan8
Merge pull request #12 from NexaAI/weili/master-release
20b9f02 
add returned string type (const char*) for nexa-omni-audio
add returned string type (const char*) for nexa-omni-audio
3dfac78
@zhiyuan8
Merge pull request #13 from NexaAI/weili/master-release
df5841b 
add omni-vlm-v2 implementations( C++ & python）
add submodule llava for android
86c2233
add one more model
400fc2a
add include llava.h
b17684e
remove redundant omni-vlm-v2/ folder, all omni-vlm examples will be a…
16c2247 
…dded to omni-vlm/ folder.
remove omni-vlm-v2/
3d9c63a
update README.md
eb6d546
zhiyuan8 and others added 11 commits November 9, 2024 10:03
@zhiyuan8
Merge pull request #17 from NexaAI/weili/master-release
21bc833 
fix OCR template error.
@zhiyuan8
Create CODEOWNERS
6f0e8c3
reset model in every inerence step to avoid nosense output.
7cf07df
@zhiyuan8
Merge pull request #18 from NexaAI/weili/master-release
362bdf3 
[omni-vlm example] reset model in every inerence step to avoid nosense output.
[omni-vlm] fixed the segmentation fault issue in nano-vlm-instruct(WIP,
55953d3 
current solution is still not perfect)
@zhiyuan8
Merge pull request #20 from NexaAI/weili/master-release
82dbdbd 
[omni-vlm] fixed the segmentation fault issue in nano-vlm-instruct(WIP)
@Davidqian123
fix vulkan build bug for external build
4e80184
@zhiyuan8
Merge pull request #22 from NexaAI/david/vulkan2
98297af 
fix vulkan build bug for external build
[memory leakage] fixed a leakage by projector free
fc25544
@zhiyuan8
Merge pull request #24 from NexaAI/weili/master-release
b9845b4 
[memory leakage] fixed a leakage by projector free
@TerryT9
ugrade to llama.cpp 74d73dc
809db95
@github-actions github-actions bot added documentation Improvements or additions to documentation build Compilation issues script Script related testing Everything test related android Issues specific to Android Nvidia GPU Issues specific to Nvidia GPUs nix Issues specific to consuming flake.nix, or generally concerned with ❄ Nix-based llama.cpp deployment Vulkan Issues specific to the Vulkan backend examples python python script changes devops improvements to build systems and github actions server ggml changes relating to the ggml tensor library for machine learning SYCL https://en.wikipedia.org/wiki/SYCL - GPU programming language Apple Metal https://en.wikipedia.org/wiki/Metal_(API) Kompute https://github.com/KomputeProject/kompute/ labels Dec 2, 2024
@TerryT9 TerryT9 closed this Dec 2, 2024
@TerryT9 TerryT9 deleted the teliu/dev branch December 2, 2024 06:28
@TerryT9 TerryT9 restored the teliu/dev branch December 2, 2024 06:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

android Issues specific to Android Apple Metal https://en.wikipedia.org/wiki/Metal_(API) build Compilation issues devops improvements to build systems and github actions documentation Improvements or additions to documentation examples ggml changes relating to the ggml tensor library for machine learning Kompute https://github.com/KomputeProject/kompute/ nix Issues specific to consuming flake.nix, or generally concerned with ❄ Nix-based llama.cpp deployment Nvidia GPU Issues specific to Nvidia GPUs python python script changes script Script related server SYCL https://en.wikipedia.org/wiki/SYCL - GPU programming language testing Everything test related Vulkan Issues specific to the Vulkan backend

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

4 participants

@TerryT9 @zhiyuan8 @zhycheng614 @Davidqian123