Skip to content

Add Comprehensive Concurrent and Multi-Threaded Testing (AT-102) #10

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 3 commits into
base: master
Choose a base branch
from
Open

Add Comprehensive Concurrent and Multi-Threaded Testing (AT-102) #10

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
063f8a5
Add comprehensive concurrent and multi-threaded testing for AT-102
devin-ai-integration[bot] Sep 29, 2025
00632a8
Fix editorconfig violations: Remove trailing whitespace
devin-ai-integration[bot] Sep 29, 2025
5479452
Fix trailing whitespace in CMakeLists.txt line 11
devin-ai-integration[bot] Sep 29, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
19 changes: 19 additions & 0 deletions tests/CMakeLists.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,5 +1,20 @@
llama_add_compile_flags()

# ThreadSanitizer configuration for race condition detection
option(LLAMA_SANITIZE_THREAD "Enable ThreadSanitizer for race condition detection" OFF)

if (LLAMA_SANITIZE_THREAD)
if (CMAKE_CXX_COMPILER_ID MATCHES "GNU|Clang")
add_compile_options(-fsanitize=thread -g -O1)
add_link_options(-fsanitize=thread)
message(STATUS "ThreadSanitizer enabled for concurrent testing")

set(ENV{TSAN_OPTIONS} "halt_on_error=1:second_deadlock_stack=1")
else()
message(WARNING "ThreadSanitizer is only supported with GCC or Clang")
endif()
endif()

function(llama_build source)
if (DEFINED LLAMA_TEST_NAME)
set(TEST_TARGET ${LLAMA_TEST_NAME})
Expand Down Expand Up @@ -187,6 +202,10 @@ llama_build_and_test(test-regex-partial.cpp)

llama_build_and_test(test-thread-safety.cpp ARGS -hf ggml-org/models -hff tinyllamas/stories15M-q4_0.gguf -ngl 99 -p "The meaning of life is" -n 128 -c 256 -ub 32 -np 4 -t 2)

llama_build_and_test(test-concurrent-stress.cpp ARGS -hf ggml-org/models -hff tinyllamas/stories15M-q4_0.gguf -ngl 99 -p "The meaning of life is" -n 32 -c 512 -np 4 -t 2 LABEL "stress")

llama_build_and_test(test-kv-cache-concurrent.cpp ARGS -hf ggml-org/models -hff tinyllamas/stories15M-q4_0.gguf -ngl 99 -p "The meaning of life is" -n 32 -c 1024 -np 4 -t 2 LABEL "stress")

# this fails on windows (github hosted runner) due to curl DLL not found (exit code 0xc0000135)
if (NOT WIN32)
llama_build_and_test(test-arg-parser.cpp)
Expand Down
Loading
Loading