Skip to content

[swift] add module omnivlm #11171

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
wants to merge 80 commits into from
Closed

[swift] add module omnivlm #11171

wants to merge 80 commits into from

Conversation

@TerryT9
Copy link

@TerryT9 TerryT9 commented Jan 10, 2025

Make sure to read the contributing guidelines before submitting a PR

zhiyuan8 and others added 30 commits September 10, 2024 20:50
@zhiyuan8
support ggml
5f81588
@zhiyuan8
update README after renaming GGML
3a35526
@zhiyuan8
update vulkan target name
4a29bca
@zhiyuan8
support omni-audio
c7b912b
@zhiyuan8
enable qwen2-audio work E2E
f0d1c4f
@zhiyuan8
remove uneccesary build and rename shared lib
9e67ef7
@zhiyuan8
update to C++17 for compilation
4bdc70a
add omni-vlm examples (C++ & python)
d277c67
@zhiyuan8
Disable cxxabi.h dependency on Windows
995baef
@zhiyuan8
fix error on windows qwen2-audio/whisper.cpp:9935:38: error: '_O_BINA…
a4747b2 
…RY' was not declared in this scope
@zhiyuan8
Adding #include <io.h> & <fcntl.h>
6f1ed6e
@zhiyuan8
disable <cxxabi.h> for MSC_VER
1419681
@zhiyuan8
remove C++20 style
d42e037
@zhiyuan8
remove C++20 syntax
05853eb
@zhiyuan8
Merge pull request #6 from NexaAI/master-release-audio-lm
91b3caf 
Remove C++20 coding and suport Microsoft Visual Studio Compilation
@zhiyuan8
Merge pull request #7 from NexaAI/master
d6c0627 
Remove C++20 coding and suport Microsoft Visual Studio Compilation
@zhiyuan8
Merge pull request #8 from NexaAI/weili/master-release
983b462 
add omni-vlm examples (C++ & python)
@zhiyuan8
Merge pull request #9 from NexaAI/master
b535cd9 
Merge omni-vlm work by wei.li
@zhiyuan8
enable lib to be exported in nexa SDK
38c6fa3
add returned string (pure c const char* type) for omni-vlm inference api
22da7bc
@zhiyuan8
Merge pull request #10 from NexaAI/weili/master-release
5574bda 
add returned string (pure c const char* type) for omni-vlm inference api
add returned string (const char*) for qwen2 audio
b24a409
@zhiyuan8
Merge pull request #11 from NexaAI/weili/master-release
6a4cf0b 
add returned string (const char*) for qwen2 audio
add returned string type (const char*) for nexa-omni-audio
5edadff
@zhiyuan8
Merge pull request #12 from NexaAI/weili/master-release
20b9f02 
add returned string type (const char*) for nexa-omni-audio
add returned string type (const char*) for nexa-omni-audio
3dfac78
@zhiyuan8
Merge pull request #13 from NexaAI/weili/master-release
df5841b 
add omni-vlm-v2 implementations( C++ & python）
add submodule llava for android
86c2233
add one more model
400fc2a
add include llava.h
b17684e
@TerryT9 TerryT9 closed this Jan 10, 2025
@github-actions github-actions bot added documentation Improvements or additions to documentation build Compilation issues script Script related testing Everything test related android Issues specific to Android Nvidia GPU Issues specific to Nvidia GPUs nix Issues specific to consuming flake.nix, or generally concerned with ❄ Nix-based llama.cpp deployment Vulkan Issues specific to the Vulkan backend examples python python script changes devops improvements to build systems and github actions server ggml changes relating to the ggml tensor library for machine learning SYCL https://en.wikipedia.org/wiki/SYCL - GPU programming language Apple Metal https://en.wikipedia.org/wiki/Metal_(API) Kompute https://github.com/KomputeProject/kompute/ labels Jan 10, 2025
@TerryT9 TerryT9 deleted the t/omnivlm-ios branch January 15, 2025 02:09
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@JohannesGaessler JohannesGaessler Awaiting requested review from JohannesGaessler JohannesGaessler is a code owner

@ngxson ngxson Awaiting requested review from ngxson ngxson is a code owner

@ggerganov ggerganov Awaiting requested review from ggerganov ggerganov is a code owner

Assignees

No one assigned

Labels

android Issues specific to Android Apple Metal https://en.wikipedia.org/wiki/Metal_(API) build Compilation issues devops improvements to build systems and github actions documentation Improvements or additions to documentation examples ggml changes relating to the ggml tensor library for machine learning Kompute https://github.com/KomputeProject/kompute/ nix Issues specific to consuming flake.nix, or generally concerned with ❄ Nix-based llama.cpp deployment Nvidia GPU Issues specific to Nvidia GPUs python python script changes script Script related server SYCL https://en.wikipedia.org/wiki/SYCL - GPU programming language testing Everything test related Vulkan Issues specific to the Vulkan backend

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

5 participants

@TerryT9 @zhiyuan8 @zhycheng614 @Davidqian123 @liwiii