Skip to content

pr against the wrong repo ... #14284

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 129 commits into from
Closed

pr against the wrong repo ... #14284

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
129 commits
Select commit Hold shift + click to select a range
74eaeb8
src: reduce the logging
kpouget Apr 9, 2025
41846f3
Add helper scripts
kpouget Apr 9, 2025
ee79e12
build-system: integrate the Remoting Frontend backend build
kpouget Apr 9, 2025
1bedad3
ggml: ggml-remotingfrontend: stubs of a new backend
kpouget Apr 9, 2025
cd5410f
.github: remove
kpouget Apr 9, 2025
ece33a2
Merge pull request #2 from kpouget/remoting
kpouget Apr 9, 2025
b4b90ab
CMakeLists: add the ggml files and include Mesa files
kpouget Apr 10, 2025
53b42a8
ggml-*: move the ggml interfaces to a dedicated file
kpouget Apr 10, 2025
5049b2f
run.vulkan.sh: allow running with GDB
kpouget Apr 10, 2025
ffa659f
virtgpu: start integrating virt-gpu code
kpouget Apr 10, 2025
3ba78a5
virtgpu: allocate a shared page with the host
kpouget Apr 10, 2025
a87e398
run.remoting: cleanup the screen before running
kpouget Apr 11, 2025
3d7b19d
Reduce the verbose logging
kpouget Apr 11, 2025
4419c95
Trace the executionpath
kpouget May 2, 2025
a25b672
virtgpu: abort early
kpouget May 2, 2025
5febf22
virtgpu: add the virtgpu_submit to kick a command on the host
kpouget May 2, 2025
2ee2a4d
podman_compile.sh: add compile helper
kpouget May 2, 2025
847a2ad
virtgpu: move the logging functions to virtgpu-utils
kpouget May 5, 2025
3270cf9
virtgpu: use venus CS functions
kpouget May 5, 2025
d8d3c8e
Merge pull request #3 from kpouget/remoting
kpouget May 5, 2025
151c0ae
virtgpu: make more generic
kpouget May 6, 2025
52d8e42
ggml-remotingfrontend: fix and make more generic
kpouget May 6, 2025
d118515
prepare.backend.sh: helper script
kpouget May 6, 2025
a54229d
build.backend.sh: helper script
kpouget May 6, 2025
78d16d0
build: integrate the remoting-backend skeleton
kpouget May 6, 2025
e397396
Merge pull request #4 from kpouget/remoting
kpouget May 6, 2025
022ddce
remoting: start using shared header files
kpouget May 6, 2025
9bde80b
remotingbackend/CMakeLists: add header dependencies
kpouget May 6, 2025
b5ac398
ggml-remotingbackend: add skeleton of argument passing
kpouget May 6, 2025
0cdcdd2
remotingfrontend: improve the typing
kpouget May 6, 2025
f15fedf
podman_compile: delete the pod before compiling
kpouget May 6, 2025
0c264b1
virtgpu-utils: add WARNING
kpouget May 7, 2025
938ba6b
virtgpu: split the remote call into prepare/call/finish
kpouget May 7, 2025
0582bab
ggml-backend-reg: reindent
kpouget May 7, 2025
be5f5e0
move thks_bye() to virtgpu-utils
kpouget May 7, 2025
60bac85
virtgpu: remove forward call wip code
kpouget May 7, 2025
abd176f
ggml-remotingfrontend: build the apir framework
kpouget May 7, 2025
747728b
ggml-remotingbackend: build the apir framework
kpouget May 7, 2025
00be43f
Add support for device name and description
kpouget May 13, 2025
3dd26d1
ggml: src: ggml-metal/ggml-metal: make less verbose
kpouget May 13, 2025
11f65c5
ggml-remotingbackend: include the ggml backend initialization
kpouget May 13, 2025
f9a01ef
remoting: include device_get_type and device_get_memory
kpouget May 13, 2025
2461dc9
ggml: src: ggml-remotingbackend/backend: make less verbose
kpouget May 13, 2025
9ba6e06
shared: venus_cs: add more CS functions
kpouget May 13, 2025
9d52395
ggml: src: ggml-remotingfrontend/ggml-remoting: make the NOT_IMPLEMEN…
kpouget May 13, 2025
95ccc1a
ggml: src: ggml-remotingfrontend/virtgpu-forward: make less verbose
kpouget May 13, 2025
ad57811
remoting: correct the device_get_* name order
kpouget May 13, 2025
1d9d44d
remoting: add support for device_supports_op
kpouget May 13, 2025
4a68750
ggml/src/ggml-remotingbackend/shared/venus_cs.h: clearer message when…
kpouget May 13, 2025
0b77fde
ggml/src/ggml-remotingfrontend/virtgpu.cpp: make less verbose
kpouget May 13, 2025
8c81f0f
remoting: reindent and mark functions as NOT_IMPLEMENTED
kpouget May 13, 2025
319af57
Add buffer-type support
kpouget May 14, 2025
73ed507
Keep working
kpouget May 14, 2025
88e8ec3
Keep working on buffer types and buffers
kpouget May 15, 2025
43af3a0
implemnt alloc_buffer and get_base
kpouget May 15, 2025
25f8d24
buffer: clean ups
kpouget May 15, 2025
db107bb
Keep working on buffers
kpouget May 15, 2025
248f695
build.backend: build llama-run
kpouget May 16, 2025
2e70ad0
ggml: src: ggml-remotingbackend/shared/venus_cs: fix memory corruptio…
kpouget May 16, 2025
4d7d6dc
ggml: src: ggml-remotingfrontend/ggml-backend-device: handcode the caps
kpouget May 16, 2025
6f0578f
remoting: implement buffer_set_tensor
kpouget May 16, 2025
6f396cc
remoting: improve
kpouget May 16, 2025
d40a3da
remotingbackend: accept the virgl context argument
kpouget May 19, 2025
b815c1a
remotingfrontend: implement buffer_set_tensor with a guest shared page
kpouget May 19, 2025
b24fbe7
ggml: src: ggml-remotingbackend/backend-dispatched-buffer: implement …
kpouget May 19, 2025
3a20164
remotingfrontend: add more STOP_HERE calls
kpouget May 19, 2025
c560871
remotingfrontend: add IMPLEMENTED_ONCE
kpouget May 19, 2025
142924b
ggml: src: ggml-remotingfrontend/virtgpu-shm: reduce the verbosity
kpouget May 19, 2025
9913b7f
ggml: src: ggml-remotingfrontend/ggml-backend-reg: refactor to untigh…
kpouget May 19, 2025
ede8628
ggml: src: ggml-remotingfrontend/ggml-remoting: remove draft code
kpouget May 19, 2025
1927cf0
remotingfrontend: add host buffer memory allocation
kpouget May 19, 2025
d354166
remoting: add clear buffer and get_tensor
kpouget May 20, 2025
49bb020
remoting: add skeleton for graph_compute method
kpouget May 20, 2025
8edd5e6
remoting: continue the compute_graph skeleton
kpouget May 20, 2025
372e6d0
Continue the skeleton
kpouget May 20, 2025
1a82665
remoting: recursively encode/decode the tensors
kpouget May 20, 2025
6ce806b
keep working
kpouget May 20, 2025
6fc0c88
start using the ggml-rpc serialization methods
kpouget May 21, 2025
c927b34
remoting: implement the free_buffer function
kpouget May 21, 2025
f29aa56
remoting: highlight the hot path
kpouget May 21, 2025
17dd28c
Merge pull request #5 from kpouget/remoting
kpouget May 21, 2025
14f327a
remoting: fix the warnings and mute the debug logs when not in debug …
kpouget May 22, 2025
e80e480
scripts: make it easier to build and run in prod mode
kpouget May 22, 2025
31c0ce7
remotingfrontend: always prepare a shared memory for data
kpouget May 22, 2025
03935ee
remoting: release device buffers on exit
kpouget May 22, 2025
67d405d
remoting: refactor the buffer context
kpouget May 26, 2025
c5d44f9
remoting: exchange more data
kpouget May 26, 2025
83596a2
podman_compile: pass the PERF_MODE flag to the container
kpouget May 26, 2025
6b4bc18
examples: run: run: measure the generation throughput
kpouget May 27, 2025
9ab699d
examples: run: run: stop after 25 tokens
kpouget May 27, 2025
da8bdd4
remoting: add basic timing measurements
kpouget May 27, 2025
55ce372
remoting: cleanup the logs
kpouget May 27, 2025
5596265
ggml: src: ggml-remotingfrontend/ggml-backend-reg: call the initializ…
kpouget May 27, 2025
4f9a2d4
disable APIR_ALLOC_FROM_HOST_PTR
kpouget May 27, 2025
4fa0b0a
remoting: cache the buffer_get_base result
kpouget May 27, 2025
484d5a0
Merge pull request #6 from kpouget/remoting
kpouget May 27, 2025
609c743
examples: run: run: improve the timing measurement
kpouget May 28, 2025
6ea6a29
examples: run: run: remove the stop after 25 tokens
kpouget May 28, 2025
aac3ca8
remoting: improve the timing measurement
kpouget May 28, 2025
b4837da
remoting: allow compiling to Vulkan
kpouget May 28, 2025
ecb7a23
ggml: src: ggml-remotingfrontend/virtgpu: reduce the response time wa…
kpouget May 28, 2025
3f36244
remoting: experiement with buffer_from_ptr
kpouget Jun 2, 2025
b20672b
remoting: remove from_ptr code
kpouget Jun 2, 2025
f0127dc
remoting: try host_pointer
kpouget Jun 2, 2025
11e2eba
remoting: try from_host_ptr
kpouget Jun 2, 2025
efe68ca
remoting: make alloc_memory + alloc_from_host_ptr work :)
kpouget Jun 2, 2025
3769bb4
build.backend: export SDKROOT to please apple compiler ...
kpouget Jun 11, 2025
3a730d7
prepare.backend.sh: more flags
kpouget Jun 11, 2025
7ef077e
run.vulkan.sh: more flexible
kpouget Jun 11, 2025
6d98572
run.remoting.sh: more flexible
kpouget Jun 11, 2025
5032620
prepare.vulkan.sh: more details
kpouget Jun 11, 2025
eeba619
ggml: src: ggml-remotingfrontend/virtgpu: don't include virglrenderer…
kpouget Jun 11, 2025
66b34d6
ggml: src: ggml-remotingfrontend/virtgpu: don't use absolute paths in…
kpouget Jun 11, 2025
5b5ffec
remoting: rewrite to avoid hard-coded paths
kpouget Jun 11, 2025
94fb1a5
Merge pull request #7 from kpouget/remoting
kpouget Jun 11, 2025
38b1311
update the custom scripts
kpouget Jun 11, 2025
ade0886
Merge pull request #11 from kpouget/scripts
kpouget Jun 19, 2025
5c93fb3
ggml: src: ggml-remotingfrontend/virtgpu-shm: import the cpp atomic
kpouget Jun 17, 2025
af7caf0
Merge pull request #12 from kpouget/ramalama
kpouget Jun 19, 2025
65b92b9
remoting: reintroduce the support for support_op(tensor)
kpouget Jun 19, 2025
34e68b5
remotingbackend: add an optional call to support_op to avoid crashing…
kpouget Jun 19, 2025
4921388
Merge pull request #13 from kpouget/supports_op
kpouget Jun 19, 2025
1d4bbef
remotingfrontend: reduce and cleanup the logging
kpouget Jun 19, 2025
67d00e7
remotingfrontend: cache some values
kpouget Jun 19, 2025
b511bf8
Merge pull request #9 from kpouget/remoting
kpouget Jun 19, 2025
af1aa12
update to b5709
kpouget Jun 19, 2025
1f2c4be
Merge pull request #14 from kpouget/update
kpouget Jun 19, 2025
a6186a1
Update the custom scripts
kpouget Jun 19, 2025
61a6bdd
remotingbackend: set APIR_DEVICE_SUPPORTS_OP_ALWAYS_TRUE = 1
kpouget Jun 19, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
87 changes: 0 additions & 87 deletions .github/ISSUE_TEMPLATE/010-bug-compilation.yml
View file
Open in desktop

This file was deleted.

101 changes: 0 additions & 101 deletions .github/ISSUE_TEMPLATE/011-bug-results.yml
View file
Open in desktop

This file was deleted.

91 changes: 0 additions & 91 deletions .github/ISSUE_TEMPLATE/019-bug-misc.yml
View file
Open in desktop

This file was deleted.

51 changes: 0 additions & 51 deletions .github/ISSUE_TEMPLATE/020-enhancement.yml
View file
Open in desktop

This file was deleted.

52 changes: 0 additions & 52 deletions .github/ISSUE_TEMPLATE/030-research.yml
View file
Open in desktop

This file was deleted.

Loading