Support for OSCOMP libctest testcases

[Azure-stars]

Description

Source code can been found at libctest. You can follow the README to compile the sdcard images with testcases.

Precompiled sdcard images can be found at 2025-sdcard.

Goal

• Musl-libc target when SMP=4 on four architectures
• Glibc target when SMP=4 on four architectures

Notes

Some testcases might fail under SMP=4. If you can confirm that the test case fails due to multi-core, please report it under this issue.

Current progress

Testcases should be run under SMP=4 feature.

	musl-static	musl-dynamic	glibc-static	glibc-dynamic
argv
basename
clocale_mbfuncs
clock_gettime
dirname
dlopen
env
fdopen
fnmatch
fscanf
fwscanf
iconv_open
inet_pton
mbc
memstream
pthread_cancel_points
pthread_cancel
pthread_cond
pthread_tsd
qsort
random
search_hsearch
search_insque
search_lsearch
search_tsearch
sem_init
setjmp
snprintf
socket
sscanf
sscanf_long
stat
strftime
string
string_memcpy
string_memmem
string_memset
string_strchr
string_strcspn
string_strstr
strptime
strtod
strtod_simple
strtof
strtol
strtold
swprintf
tgmath
time
tls_init
tls_local_exec
udiv
ungetc
utime
wcsstr
wcstol
daemon_failure
dn_expand_empty
dn_expand_ptr_0
fflush_exit
fgets_eof
fgetwc_buffering
fpclassify_invalid_ld80
ftello_unflushed_append
getpwnam_r_crash
getpwnam_r_errno
iconv_roundtrips
inet_ntop_v4mapped
inet_pton_empty_last_field
iswspace_null
lrand48_signextend
lseek_large
malloc_0
mbsrtowcs_overflow
memmem_oob_read
memmem_oob
mkdtemp_failure
mkstemp_failure
printf_1e9_oob
printf_fmt_g_round
printf_fmt_g_zeros
printf_fmt_n
pthread_robust_detach
pthread_cond_smasher
pthread_condattr_setclock
pthread_exit_cancel
pthread_once_deadlock
pthread_rwlock_ebusy
putenv_doublefree
regex_backref_0
regex_bracket_icase
regex_ere_backref
regex_escaped_high_byte
regex_negated_range
regexec_nosub
rewind_clear_error
rlimit_open_files
scanf_bytes_consumed
scanf_match_literal_eof
scanf_nullbyte_char
setvbuf_unget
sigprocmask_internal
sscanf_eof
statvfs
strverscmp
syscall_sign_extend
tls_get_new_dtv
uselocale_0
wcsncpy_read_overflow
wcsstr_false_negative

[wang-jiahua]

libctest is not running in CI? 🤔

[Azure-stars]

libctest is not running in CI? 🤔

Yep，you need to add testcases in https://github.com/oscomp/starry-next/blob/main/apps/oscomp/judge_libctest.py#L5

The format can refer to https://github.com/Azure-stars/oskernel-testsuits-cooperation/blob/master/judge/judge_libctest.py#L4

[wang-jiahua]

Yep，you need to add testcases in main/apps/oscomp/judge_libctest.py#L5

The format can refer to Azure-stars/oskernel-testsuits-cooperation@master/judge/judge_libctest.py#L4

It seems that /$LIBC/busybox sh /$LIBC/libctest_testcode.sh outputs nothing

[Azure-stars]

Yep，you need to add testcases in main/apps/oscomp/judge_libctest.py#L5
The format can refer to Azure-stars/oskernel-testsuits-cooperation@master/judge/judge_libctest.py#L4

It seems that /$LIBC/busybox sh /$LIBC/libctest_testcode.sh outputs nothing

you need to modify main/apps/oscomp/judge_libctest.py#L5

[AsakuraMizu]

It seems that /$LIBC/busybox sh /$LIBC/libctest_testcode.sh outputs nothing

busybox sh is not working properly currently. Running testcases through shell script needs #4 to be resolved first.

[chenyihu21]

The test case "argv" fails on aarch64. Is it right?
command: qemu-aarch64 -strace ./runtest.exe -w entry-static.exe argv ls

[wang-jiahua]

Problems encountered with riscv64 and glibc. It seems that the testcase failed even before calling start().

[BattiestStone4]

When completing syscalls about signal i met such a problem in loongarch64:

Starry failed to boot when SMP=4. Sometimes it can print a few lines of arceos logo and quit.

I don't think it's signal module's problem, since the problem still exists when code about signal module are removed. Also, the other 3 platforms works fine with signal module.

It's hard for me to locate where the problem is, because there is no debugging info, and I don't even know which commit introduces such a problem.

this is my commit link

[Azure-stars]

Problems encountered with riscv64 and glibc. It seems that the testcase failed even before calling start().

What are the specific test cases and execution instructions?

[Azure-stars]

When completing syscalls about signal i met such a problem in loongarch64:

Starry failed to boot when SMP=4. Sometimes it can print a few lines of arceos logo and quit.

I don't think it's signal module's problem, since the problem still exists when code about signal module are removed. Also, the other 3 platforms works fine with signal module.

It's hard for me to locate where the problem is, because there is no debugging info, and I don't even know which commit introduces such a problem.

this is my commit link

Will it happen still if you use code of arceos on the main branch?

[wang-jiahua]

Problems encountered with riscv64 and glibc. It seems that the testcase failed even before calling start().

What are the specific test cases and execution instructions?

libctest_testlist=("/$LIBC/runtest.exe -w /$LIBC/entry-static.exe fdopen"), run with make oscomp_test ARCH=riscv64 LIBC=glibc. In fact every testcase I tried failed like this.