Convert pipe tests deterministic part2 by ChinmayShringi · Pull Request #616 · Lind-Project/lind-wasm

ChinmayShringi · 2026-01-21T03:26:18Z

Purpose

This PR converts five non-deterministic fork tests (fork.c, fork_simple.c, forkandopen.c, forkfiles.c, and forknodup.c) to deterministic, assertion-based tests as part of addressing issue #603 (Deprecate non-deterministic tests).

Changes

Modified Files

tests/unit-tests/process_tests/non-deterministic/fork.c → tests/unit-tests/process_tests/deterministic/fork.c
tests/unit-tests/process_tests/non-deterministic/fork_simple.c → tests/unit-tests/process_tests/deterministic/fork_simple.c
tests/unit-tests/process_tests/non-deterministic/forkandopen.c → tests/unit-tests/process_tests/deterministic/forkandopen.c
tests/unit-tests/process_tests/non-deterministic/forkfiles.c → tests/unit-tests/process_tests/deterministic/forkfiles.c
tests/unit-tests/process_tests/non-deterministic/forknodup.c → tests/unit-tests/process_tests/deterministic/forknodup.c

Testing

Tests can be run individually:
./scripts/wasmtestreport.py --testfiles tests/unit-tests/process_tests/deterministic/fork.c
./scripts/wasmtestreport.py --testfiles tests/unit-tests/process_tests/deterministic/fork_simple.c
./scripts/wasmtestreport.py --testfiles tests/unit-tests/process_tests/deterministic/forkandopen.c
./scripts/wasmtestreport.py --testfiles tests/unit-tests/process_tests/deterministic/forkfiles.c
./scripts/wasmtestreport.py --testfiles tests/unit-tests/process_tests/deterministic/forknodup.c

…inistic assert-based tests - Replace non-deterministic printf statements with assert() calls - Remove printing of PIDs, FD numbers, return values, and message contents - Add required assertions for pipe(), fork(), write(), read(), memcmp(), close(), and waitpid() - Ensure tests fail via assert() on incorrect behavior - Use fixed messages with explicit length checks - Child processes read until full message length is received - Parent processes verify child exit status via waitpid() Addresses issue #603: Deprecate non-deterministic tests

github-actions · 2026-01-21T03:38:22Z

End-to-End Test Report

Test Preview

Test Report

Deterministic Tests

Summary

Metric	Count
Total Test Cases	87
Number of Successes	86
Number of Failures	1
Number of Compilation Failure Native	0
Number of Runtime Failure Native	0
Number of Segmentation Fault Native	0
Number of Timeout During Native	0
Number of Lind Wasm Compile Failure	0
Number of Lind Wasm Runtime Failure	0
Number of Lind Wasm Segmentation Failure	0
Number of Timeout During Lind Wasm run	1
Number of Unknown Failure	0
Number of C Compiler and Wasm Output mismatch	0
Number of Fail Test: Native Succeeded (Should Fail)	0
Number of Fail Test: Wasm Succeeded (Should Fail)	0
Number of Fail Test: Both Native and Wasm Succeeded (Should Fail)	0
Number of Fail Test: Native Compilation Failure (Should Succeed)	0
Number of Fail Test: Wasm Compilation Failure (Should Succeed)	0

Test Results by Category

Test Case	Status	Error Type	Output
File Tests
chartests.c	Success	None	Success
chdir_getcwd.c	Success	None	Success
chmod.c	Success	None	Success
close.c	Success	None	Success
doubleclose.c	Success	None	Success
dupwrite.c	Success	None	Success
fchmod.c	Success	None	Success
fcntl.c	Success	None	Success
fdatasync.c	Success	None	Success
filetest.c	Success	None	Success
filetest1000.c	Success	None	Success
fstat.c	Success	None	Success
fsync.c	Success	None	Success
ftruncate.c	Success	None	Success
getcwd.c	Success	None	Success
getrandom.c	Success	None	Success
ioctl.c	Success	None	Success
link.c	Success	None	Success
lseek.c	Success	None	Success
mkdir_rmdir.c	Success	None	Success
open.c	Success	None	Success
pread_pwrite.c	Success	None	Success
printf.c	Success	None	Success
readbytes.c	Success	None	Success
readlink.c	Success	None	Success
rename.c	Success	None	Success
stat.c	Success	None	Success
sync_file_range.c	Success	None	Success
truncate.c	Success	None	Success
unlink.c	Success	None	Success
unlinkat.c	Success	None	Success
write.c	Success	None	Success
writeloop.c	Success	None	Success
writepartial.c	Success	None	Success
writev.c	Success	None	Success
Memory Tests
brk.c	Success	None	Success
malloc.c	Success	None	Success
memcpy.c	Success	None	Success
memory_error_test.c	Success	None	Success
mmap.c	Success	None	Success
mmap_aligned.c	Success	None	Success
mmap_file.c	Success	None	Success
mprotect.c	Success	None	Success
mprotect_boundary.c	Success	None	Success
mprotect_end_region.c	Success	None	Success
mprotect_middle_region.c	Success	None	Success
mprotect_multiple_times.c	Success	None	Success
mprotect_same_value.c	Success	None	Success
mprotect_spanning_regions.c	Success	None	Success
sbrk.c	Success	None	Success
shmtest.c	Success	None	Success
Networking Tests
gethostname.c	Success	None	Success
makepipe.c	Success	None	Success
pipepong.c	Success	None	Success
poll.c	Success	None	Success
recvfrom-sendto.c	Success	None	Success
simple_epoll.c	Success	None	Success
socket.c	Success	None	Success
socket_cloexec.c	Success	None	Success
socketpair.c	Success	None	Success
tcp_connect_single.c	Success	None	Success
Process Tests
chain_thread.c	Success	None	Success
exit.c	Success	None	Success
forkexecv-arg.c	Success	None	Success
forkexecv.c	Success	None	Success
function-ptr.c	Success	None	Success
getppid.c	Success	None	Success
getuid.c	Success	None	Success
hello-arg.c	Success	None	Success
hello.c	Success	None	Success
longjmp.c	Success	None	Success
mutex.c	Success	None	Success
noforkfiles.c	Success	None	Success
sem_forks.c	Success	None	Success
setsid.c	Success	None	Success
thread-test.c	Success	None	Success
thread.c	Failure	Lind_wasm_Timeout	Timed Out (timeout: 10s)
wait.c	Success	None	Success
waitpid_anychild.c	Success	None	Success
waitpid_wnohang.c	Success	None	Success
Signal Tests
alarm.c	Success	None	Success
setitimer.c	Success	None	Success
sigalrm.c	Success	None	Success
sigchld.c	Success	None	Success
signal-fork.c	Success	None	Success
signal-simple.c	Success	None	Success
sigprocmask.c	Success	None	Success

Non Deterministic Tests

Summary

Metric	Count
Total Test Cases	37
Number of Successes	36
Number of Failures	1
Number of Compilation Failure Native	0
Number of Runtime Failure Native	0
Number of Segmentation Fault Native	0
Number of Timeout During Native	0
Number of Lind Wasm Compile Failure	0
Number of Lind Wasm Runtime Failure	0
Number of Lind Wasm Segmentation Failure	0
Number of Timeout During Lind Wasm run	1
Number of Unknown Failure	0
Number of C Compiler and Wasm Output mismatch	0
Number of Fail Test: Native Succeeded (Should Fail)	0
Number of Fail Test: Wasm Succeeded (Should Fail)	0
Number of Fail Test: Both Native and Wasm Succeeded (Should Fail)	0
Number of Fail Test: Native Compilation Failure (Should Succeed)	0
Number of Fail Test: Wasm Compilation Failure (Should Succeed)	0

Test Results by Category

Test Case	Status	Error Type	Output
File Tests
clock_gettime_highlevel.c	Success	None	Success
clock_gettime_simple.c	Success	None	Success
dup.c	Success	None	Success
fstatfs.c	Success	None	Success
read.c	Success	None	Success
statfs.c	Success	None	Success
Memory Tests
malloc_large.c	Success	None	Success
mmap_complicated.c	Success	None	Success
mmap_shared.c	Success	None	Success
segfault.c	Failure	Lind_wasm_Timeout	Timed Out (timeout: 10s)
shm.c	Success	None	Success
vtable.c	Success	None	Success
Networking Tests
dnstest.c	Success	None	Success
getifaddrs.c	Success	None	Success
pipe.c	Success	None	Success
pipe2.c	Success	None	Success
pipeinput.c	Success	None	Success
pipeinput2.c	Success	None	Success
pipeonestring.c	Success	None	Success
pipewrite.c	Success	None	Success
shutdown_fork.c	Success	None	Success
simple-select.c	Success	None	Success
Process Tests
fork2malloc.c	Success	None	Success
fork_simple.c	Success	None	Success
forkandopen.c	Success	None	Success
forkfiles.c	Success	None	Success
forkmalloc.c	Success	None	Success
forknodup.c	Success	None	Success
getpid.c	Success	None	Success
Signal Tests
signal.c	Success	None	Success
signal_SIGCHLD.c	Success	None	Success
signal_fork.c	Success	None	Success
signal_int_thread.c	Success	None	Success
signal_longjmp.c	Success	None	Success
signal_nodefer.c	Success	None	Success
signal_procmask.c	Success	None	Success
signal_sa_mask.c	Success	None	Success

Fail Tests

Summary

Metric	Count
Total Test Cases	1
Number of Successes	1
Number of Failures	0
Number of Compilation Failure Native	0
Number of Runtime Failure Native	0
Number of Segmentation Fault Native	0
Number of Timeout During Native	0
Number of Lind Wasm Compile Failure	0
Number of Lind Wasm Runtime Failure	0
Number of Lind Wasm Segmentation Failure	0
Number of Timeout During Lind Wasm run	0
Number of Unknown Failure	0
Number of C Compiler and Wasm Output mismatch	0
Number of Fail Test: Native Succeeded (Should Fail)	0
Number of Fail Test: Wasm Succeeded (Should Fail)	0
Number of Fail Test: Both Native and Wasm Succeeded (Should Fail)	0
Number of Fail Test: Native Compilation Failure (Should Succeed)	0
Number of Fail Test: Wasm Compilation Failure (Should Succeed)	0

Test Results by Category

Test Case	Status	Error Type	Output
Memory Tests
mmap-negative1.c	Success	None	Success

rennergade · 2026-01-21T03:42:24Z

These should be moved from the non-deterministic folder to the deterministic folder.

I missed that for the last PR so if you could move the other two files as well that would be great.

github-actions · 2026-01-21T03:58:03Z

End-to-End Test Report

Test Preview

Test Report

Deterministic Tests

Summary

Metric	Count
Total Test Cases	93
Number of Successes	92
Number of Failures	1
Number of Compilation Failure Native	0
Number of Runtime Failure Native	0
Number of Segmentation Fault Native	0
Number of Timeout During Native	0
Number of Lind Wasm Compile Failure	0
Number of Lind Wasm Runtime Failure	0
Number of Lind Wasm Segmentation Failure	1
Number of Timeout During Lind Wasm run	0
Number of Unknown Failure	0
Number of C Compiler and Wasm Output mismatch	0
Number of Fail Test: Native Succeeded (Should Fail)	0
Number of Fail Test: Wasm Succeeded (Should Fail)	0
Number of Fail Test: Both Native and Wasm Succeeded (Should Fail)	0
Number of Fail Test: Native Compilation Failure (Should Succeed)	0
Number of Fail Test: Wasm Compilation Failure (Should Succeed)	0

Test Results by Category

Test Case	Status	Error Type	Output
File Tests
chartests.c	Success	None	Success
chdir_getcwd.c	Success	None	Success
chmod.c	Success	None	Success
close.c	Success	None	Success
doubleclose.c	Success	None	Success
dupwrite.c	Success	None	Success
fchmod.c	Success	None	Success
fcntl.c	Success	None	Success
fdatasync.c	Success	None	Success
filetest.c	Success	None	Success
filetest1000.c	Success	None	Success
fstat.c	Success	None	Success
fsync.c	Success	None	Success
ftruncate.c	Success	None	Success
getcwd.c	Success	None	Success
getrandom.c	Success	None	Success
ioctl.c	Success	None	Success
link.c	Success	None	Success
lseek.c	Success	None	Success
mkdir_rmdir.c	Success	None	Success
open.c	Success	None	Success
pread_pwrite.c	Success	None	Success
printf.c	Success	None	Success
readbytes.c	Success	None	Success
readlink.c	Success	None	Success
rename.c	Success	None	Success
stat.c	Success	None	Success
sync_file_range.c	Success	None	Success
truncate.c	Success	None	Success
unlink.c	Success	None	Success
unlinkat.c	Success	None	Success
write.c	Success	None	Success
writeloop.c	Success	None	Success
writepartial.c	Success	None	Success
writev.c	Success	None	Success
Memory Tests
brk.c	Success	None	Success
malloc.c	Success	None	Success
memcpy.c	Success	None	Success
memory_error_test.c	Success	None	Success
mmap.c	Success	None	Success
mmap_aligned.c	Success	None	Success
mmap_file.c	Success	None	Success
mprotect.c	Success	None	Success
mprotect_boundary.c	Success	None	Success
mprotect_end_region.c	Success	None	Success
mprotect_middle_region.c	Success	None	Success
mprotect_multiple_times.c	Success	None	Success
mprotect_same_value.c	Success	None	Success
mprotect_spanning_regions.c	Success	None	Success
sbrk.c	Success	None	Success
shmtest.c	Success	None	Success
Networking Tests
gethostname.c	Success	None	Success
makepipe.c	Success	None	Success
pipe.c	Success	None	Success
pipe2.c	Success	None	Success
pipeinput.c	Success	None	Success
pipeinput2.c	Success	None	Success
pipeonestring.c	Failure	Lind_wasm_Segmentation_Fault	/tmp/wasmtest_artifacts_32ll2gpt/networking_tests/deterministic/pipeonestring.c:55: int main(void): Assertion `waited_pid == cpid' failed. Error: failed to run main module `/tmp/wasmtest_artifacts_32ll2gpt/networking_tests/deterministic/pipeonestring.cwasm` Caused by: 0: failed to invoke command default 1: error while executing at wasm backtrace: 0: 0x38827 - pipeonestring.wasm!abort 1: 0x2f4c - pipeonestring.wasm!__assert_fail_base 2: 0x3121 - pipeonestring.wasm!__assert_fail 3: 0x160b - pipeonestring.wasm!__original_main 4: 0xd9a - pipeonestring.wasm!_start 5: 0x9d926 - pipeonestring.wasm!_start.command_export note: using the `WASMTIME_BACKTRACE_DETAILS=1` environment variable may show more debugging information 2: wasm trap: wasm `unreachable` instruction executed
pipepong.c	Success	None	Success
pipewrite.c	Success	None	Success
poll.c	Success	None	Success
recvfrom-sendto.c	Success	None	Success
simple_epoll.c	Success	None	Success
socket.c	Success	None	Success
socket_cloexec.c	Success	None	Success
socketpair.c	Success	None	Success
tcp_connect_single.c	Success	None	Success
Process Tests
chain_thread.c	Success	None	Success
exit.c	Success	None	Success
forkexecv-arg.c	Success	None	Success
forkexecv.c	Success	None	Success
function-ptr.c	Success	None	Success
getppid.c	Success	None	Success
getuid.c	Success	None	Success
hello-arg.c	Success	None	Success
hello.c	Success	None	Success
longjmp.c	Success	None	Success
mutex.c	Success	None	Success
noforkfiles.c	Success	None	Success
sem_forks.c	Success	None	Success
setsid.c	Success	None	Success
thread-test.c	Success	None	Success
thread.c	Success	None	Success
wait.c	Success	None	Success
waitpid_anychild.c	Success	None	Success
waitpid_wnohang.c	Success	None	Success
Signal Tests
alarm.c	Success	None	Success
setitimer.c	Success	None	Success
sigalrm.c	Success	None	Success
sigchld.c	Success	None	Success
signal-fork.c	Success	None	Success
signal-simple.c	Success	None	Success
sigprocmask.c	Success	None	Success

Non Deterministic Tests

Summary

Metric	Count
Total Test Cases	31
Number of Successes	31
Number of Failures	0
Number of Compilation Failure Native	0
Number of Runtime Failure Native	0
Number of Segmentation Fault Native	0
Number of Timeout During Native	0
Number of Lind Wasm Compile Failure	0
Number of Lind Wasm Runtime Failure	0
Number of Lind Wasm Segmentation Failure	0
Number of Timeout During Lind Wasm run	0
Number of Unknown Failure	0
Number of C Compiler and Wasm Output mismatch	0
Number of Fail Test: Native Succeeded (Should Fail)	0
Number of Fail Test: Wasm Succeeded (Should Fail)	0
Number of Fail Test: Both Native and Wasm Succeeded (Should Fail)	0
Number of Fail Test: Native Compilation Failure (Should Succeed)	0
Number of Fail Test: Wasm Compilation Failure (Should Succeed)	0

Test Results by Category

Test Case	Status	Error Type	Output
File Tests
clock_gettime_highlevel.c	Success	None	Success
clock_gettime_simple.c	Success	None	Success
dup.c	Success	None	Success
fstatfs.c	Success	None	Success
read.c	Success	None	Success
statfs.c	Success	None	Success
Memory Tests
malloc_large.c	Success	None	Success
mmap_complicated.c	Success	None	Success
mmap_shared.c	Success	None	Success
segfault.c	Success	None	Success
shm.c	Success	None	Success
vtable.c	Success	None	Success
Networking Tests
dnstest.c	Success	None	Success
getifaddrs.c	Success	None	Success
shutdown_fork.c	Success	None	Success
simple-select.c	Success	None	Success
Process Tests
fork2malloc.c	Success	None	Success
fork_simple.c	Success	None	Success
forkandopen.c	Success	None	Success
forkfiles.c	Success	None	Success
forkmalloc.c	Success	None	Success
forknodup.c	Success	None	Success
getpid.c	Success	None	Success
Signal Tests
signal.c	Success	None	Success
signal_SIGCHLD.c	Success	None	Success
signal_fork.c	Success	None	Success
signal_int_thread.c	Success	None	Success
signal_longjmp.c	Success	None	Success
signal_nodefer.c	Success	None	Success
signal_procmask.c	Success	None	Success
signal_sa_mask.c	Success	None	Success

Fail Tests

Summary

Metric	Count
Total Test Cases	1
Number of Successes	1
Number of Failures	0
Number of Compilation Failure Native	0
Number of Runtime Failure Native	0
Number of Segmentation Fault Native	0
Number of Timeout During Native	0
Number of Lind Wasm Compile Failure	0
Number of Lind Wasm Runtime Failure	0
Number of Lind Wasm Segmentation Failure	0
Number of Timeout During Lind Wasm run	0
Number of Unknown Failure	0
Number of C Compiler and Wasm Output mismatch	0
Number of Fail Test: Native Succeeded (Should Fail)	0
Number of Fail Test: Wasm Succeeded (Should Fail)	0
Number of Fail Test: Both Native and Wasm Succeeded (Should Fail)	0
Number of Fail Test: Native Compilation Failure (Should Succeed)	0
Number of Fail Test: Wasm Compilation Failure (Should Succeed)	0

Test Results by Category

Test Case	Status	Error Type	Output
Memory Tests
mmap-negative1.c	Success	None	Success

github-actions · 2026-01-21T17:50:39Z

End-to-End Test Report

Test Preview

Test Report

Deterministic Tests

Summary

Metric	Count
Total Test Cases	93
Number of Successes	93
Number of Failures	0
Number of Compilation Failure Native	0
Number of Runtime Failure Native	0
Number of Segmentation Fault Native	0
Number of Timeout During Native	0
Number of Lind Wasm Compile Failure	0
Number of Lind Wasm Runtime Failure	0
Number of Lind Wasm Segmentation Failure	0
Number of Timeout During Lind Wasm run	0
Number of Unknown Failure	0
Number of C Compiler and Wasm Output mismatch	0
Number of Fail Test: Native Succeeded (Should Fail)	0
Number of Fail Test: Wasm Succeeded (Should Fail)	0
Number of Fail Test: Both Native and Wasm Succeeded (Should Fail)	0
Number of Fail Test: Native Compilation Failure (Should Succeed)	0
Number of Fail Test: Wasm Compilation Failure (Should Succeed)	0

Test Results by Category

Test Case	Status	Error Type	Output
File Tests
chartests.c	Success	None	Success
chdir_getcwd.c	Success	None	Success
chmod.c	Success	None	Success
close.c	Success	None	Success
doubleclose.c	Success	None	Success
dupwrite.c	Success	None	Success
fchmod.c	Success	None	Success
fcntl.c	Success	None	Success
fdatasync.c	Success	None	Success
filetest.c	Success	None	Success
filetest1000.c	Success	None	Success
fstat.c	Success	None	Success
fsync.c	Success	None	Success
ftruncate.c	Success	None	Success
getcwd.c	Success	None	Success
getrandom.c	Success	None	Success
ioctl.c	Success	None	Success
link.c	Success	None	Success
lseek.c	Success	None	Success
mkdir_rmdir.c	Success	None	Success
open.c	Success	None	Success
pread_pwrite.c	Success	None	Success
printf.c	Success	None	Success
readbytes.c	Success	None	Success
readlink.c	Success	None	Success
rename.c	Success	None	Success
stat.c	Success	None	Success
sync_file_range.c	Success	None	Success
truncate.c	Success	None	Success
unlink.c	Success	None	Success
unlinkat.c	Success	None	Success
write.c	Success	None	Success
writeloop.c	Success	None	Success
writepartial.c	Success	None	Success
writev.c	Success	None	Success
Memory Tests
brk.c	Success	None	Success
malloc.c	Success	None	Success
memcpy.c	Success	None	Success
memory_error_test.c	Success	None	Success
mmap.c	Success	None	Success
mmap_aligned.c	Success	None	Success
mmap_file.c	Success	None	Success
mprotect.c	Success	None	Success
mprotect_boundary.c	Success	None	Success
mprotect_end_region.c	Success	None	Success
mprotect_middle_region.c	Success	None	Success
mprotect_multiple_times.c	Success	None	Success
mprotect_same_value.c	Success	None	Success
mprotect_spanning_regions.c	Success	None	Success
sbrk.c	Success	None	Success
shmtest.c	Success	None	Success
Networking Tests
gethostname.c	Success	None	Success
makepipe.c	Success	None	Success
pipe.c	Success	None	Success
pipe2.c	Success	None	Success
pipeinput.c	Success	None	Success
pipeinput2.c	Success	None	Success
pipeonestring.c	Success	None	Success
pipepong.c	Success	None	Success
pipewrite.c	Success	None	Success
poll.c	Success	None	Success
recvfrom-sendto.c	Success	None	Success
simple_epoll.c	Success	None	Success
socket.c	Success	None	Success
socket_cloexec.c	Success	None	Success
socketpair.c	Success	None	Success
tcp_connect_single.c	Success	None	Success
Process Tests
chain_thread.c	Success	None	Success
exit.c	Success	None	Success
forkexecv-arg.c	Success	None	Success
forkexecv.c	Success	None	Success
function-ptr.c	Success	None	Success
getppid.c	Success	None	Success
getuid.c	Success	None	Success
hello-arg.c	Success	None	Success
hello.c	Success	None	Success
longjmp.c	Success	None	Success
mutex.c	Success	None	Success
noforkfiles.c	Success	None	Success
sem_forks.c	Success	None	Success
setsid.c	Success	None	Success
thread-test.c	Success	None	Success
thread.c	Success	None	Success
wait.c	Success	None	Success
waitpid_anychild.c	Success	None	Success
waitpid_wnohang.c	Success	None	Success
Signal Tests
alarm.c	Success	None	Success
setitimer.c	Success	None	Success
sigalrm.c	Success	None	Success
sigchld.c	Success	None	Success
signal-fork.c	Success	None	Success
signal-simple.c	Success	None	Success
sigprocmask.c	Success	None	Success

Non Deterministic Tests

Summary

Metric	Count
Total Test Cases	31
Number of Successes	28
Number of Failures	3
Number of Compilation Failure Native	0
Number of Runtime Failure Native	0
Number of Segmentation Fault Native	0
Number of Timeout During Native	0
Number of Lind Wasm Compile Failure	0
Number of Lind Wasm Runtime Failure	0
Number of Lind Wasm Segmentation Failure	0
Number of Timeout During Lind Wasm run	3
Number of Unknown Failure	0
Number of C Compiler and Wasm Output mismatch	0
Number of Fail Test: Native Succeeded (Should Fail)	0
Number of Fail Test: Wasm Succeeded (Should Fail)	0
Number of Fail Test: Both Native and Wasm Succeeded (Should Fail)	0
Number of Fail Test: Native Compilation Failure (Should Succeed)	0
Number of Fail Test: Wasm Compilation Failure (Should Succeed)	0

Test Results by Category

Test Case	Status	Error Type	Output
File Tests
clock_gettime_highlevel.c	Success	None	Success
clock_gettime_simple.c	Success	None	Success
dup.c	Success	None	Success
fstatfs.c	Success	None	Success
read.c	Success	None	Success
statfs.c	Success	None	Success
Memory Tests
malloc_large.c	Success	None	Success
mmap_complicated.c	Success	None	Success
mmap_shared.c	Success	None	Success
segfault.c	Failure	Lind_wasm_Timeout	Timed Out (timeout: 10s)
shm.c	Success	None	Success
vtable.c	Success	None	Success
Networking Tests
dnstest.c	Success	None	Success
getifaddrs.c	Success	None	Success
shutdown_fork.c	Success	None	Success
simple-select.c	Success	None	Success
Process Tests
fork2malloc.c	Success	None	Success
fork_simple.c	Success	None	Success
forkandopen.c	Failure	Lind_wasm_Timeout	Timed Out (timeout: 10s)
forkfiles.c	Success	None	Success
forkmalloc.c	Success	None	Success
forknodup.c	Success	None	Success
getpid.c	Success	None	Success
Signal Tests
signal.c	Failure	Lind_wasm_Timeout	Timed Out (timeout: 10s)
signal_SIGCHLD.c	Success	None	Success
signal_fork.c	Success	None	Success
signal_int_thread.c	Success	None	Success
signal_longjmp.c	Success	None	Success
signal_nodefer.c	Success	None	Success
signal_procmask.c	Success	None	Success
signal_sa_mask.c	Success	None	Success

Fail Tests

Summary

Metric	Count
Total Test Cases	1
Number of Successes	1
Number of Failures	0
Number of Compilation Failure Native	0
Number of Runtime Failure Native	0
Number of Segmentation Fault Native	0
Number of Timeout During Native	0
Number of Lind Wasm Compile Failure	0
Number of Lind Wasm Runtime Failure	0
Number of Lind Wasm Segmentation Failure	0
Number of Timeout During Lind Wasm run	0
Number of Unknown Failure	0
Number of C Compiler and Wasm Output mismatch	0
Number of Fail Test: Native Succeeded (Should Fail)	0
Number of Fail Test: Wasm Succeeded (Should Fail)	0
Number of Fail Test: Both Native and Wasm Succeeded (Should Fail)	0
Number of Fail Test: Native Compilation Failure (Should Succeed)	0
Number of Fail Test: Wasm Compilation Failure (Should Succeed)	0

Test Results by Category

Test Case	Status	Error Type	Output
Memory Tests
mmap-negative1.c	Success	None	Success

github-actions · 2026-01-21T17:53:53Z

End-to-End Test Report

Test Preview

Test Report

Deterministic Tests

Summary

Metric	Count
Total Test Cases	92
Number of Successes	89
Number of Failures	3
Number of Compilation Failure Native	0
Number of Runtime Failure Native	0
Number of Segmentation Fault Native	0
Number of Timeout During Native	0
Number of Lind Wasm Compile Failure	0
Number of Lind Wasm Runtime Failure	0
Number of Lind Wasm Segmentation Failure	2
Number of Timeout During Lind Wasm run	0
Number of Unknown Failure	0
Number of C Compiler and Wasm Output mismatch	1
Number of Fail Test: Native Succeeded (Should Fail)	0
Number of Fail Test: Wasm Succeeded (Should Fail)	0
Number of Fail Test: Both Native and Wasm Succeeded (Should Fail)	0
Number of Fail Test: Native Compilation Failure (Should Succeed)	0
Number of Fail Test: Wasm Compilation Failure (Should Succeed)	0

Test Results by Category

Test Case	Status	Error Type	Output
File Tests
chartests.c	Success	None	Success
chdir_getcwd.c	Success	None	Success
chmod.c	Success	None	Success
close.c	Success	None	Success
doubleclose.c	Success	None	Success
dupwrite.c	Success	None	Success
fchmod.c	Success	None	Success
fcntl.c	Success	None	Success
fdatasync.c	Success	None	Success
filetest.c	Success	None	Success
filetest1000.c	Success	None	Success
fstat.c	Success	None	Success
fsync.c	Success	None	Success
ftruncate.c	Success	None	Success
getcwd.c	Success	None	Success
getrandom.c	Success	None	Success
ioctl.c	Success	None	Success
link.c	Success	None	Success
lseek.c	Success	None	Success
mkdir_rmdir.c	Success	None	Success
open.c	Success	None	Success
pread_pwrite.c	Success	None	Success
printf.c	Success	None	Success
readbytes.c	Success	None	Success
readlink.c	Success	None	Success
rename.c	Success	None	Success
stat.c	Success	None	Success
sync_file_range.c	Success	None	Success
truncate.c	Success	None	Success
unlink.c	Success	None	Success
unlinkat.c	Success	None	Success
write.c	Success	None	Success
writeloop.c	Success	None	Success
writepartial.c	Success	None	Success
writev.c	Success	None	Success
Memory Tests
brk.c	Success	None	Success
malloc.c	Success	None	Success
memcpy.c	Success	None	Success
memory_error_test.c	Success	None	Success
mmap.c	Success	None	Success
mmap_aligned.c	Success	None	Success
mmap_file.c	Success	None	Success
mprotect.c	Success	None	Success
mprotect_boundary.c	Success	None	Success
mprotect_end_region.c	Success	None	Success
mprotect_middle_region.c	Success	None	Success
mprotect_multiple_times.c	Success	None	Success
mprotect_same_value.c	Success	None	Success
mprotect_spanning_regions.c	Success	None	Success
sbrk.c	Success	None	Success
shmtest.c	Success	None	Success
Networking Tests
gethostname.c	Success	None	Success
makepipe.c	Success	None	Success
pipe.c	Success	None	Success
pipe2.c	Success	None	Success
pipeinput.c	Failure	Lind_wasm_Segmentation_Fault	/tmp/wasmtest_artifacts_te_1wy7y/networking_tests/deterministic/pipeinput.c:55: int main(void): Assertion `waited_pid == cpid' failed. Error: failed to run main module `/tmp/wasmtest_artifacts_te_1wy7y/networking_tests/deterministic/pipeinput.cwasm` Caused by: 0: failed to invoke command default 1: error while executing at wasm backtrace: 0: 0x38827 - pipeinput.wasm!abort 1: 0x2f4c - pipeinput.wasm!__assert_fail_base 2: 0x3121 - pipeinput.wasm!__assert_fail 3: 0x160b - pipeinput.wasm!__original_main 4: 0xd9a - pipeinput.wasm!_start 5: 0x9d926 - pipeinput.wasm!_start.command_export note: using the `WASMTIME_BACKTRACE_DETAILS=1` environment variable may show more debugging information 2: wasm trap: wasm `unreachable` instruction executed
pipeinput2.c	Failure	Lind_wasm_Segmentation_Fault	/tmp/wasmtest_artifacts_te_1wy7y/networking_tests/deterministic/pipeinput2.c:57: int main(void): Assertion `waited_pid == cpid' failed. Error: failed to run main module `/tmp/wasmtest_artifacts_te_1wy7y/networking_tests/deterministic/pipeinput2.cwasm` Caused by: 0: failed to invoke command default 1: error while executing at wasm backtrace: 0: 0x3882a - pipeinput2.wasm!abort 1: 0x2f4f - pipeinput2.wasm!__assert_fail_base 2: 0x3124 - pipeinput2.wasm!__assert_fail 3: 0x160e - pipeinput2.wasm!__original_main 4: 0xd9a - pipeinput2.wasm!_start 5: 0x9d929 - pipeinput2.wasm!_start.command_export note: using the `WASMTIME_BACKTRACE_DETAILS=1` environment variable may show more debugging information 2: wasm trap: wasm `unreachable` instruction executed
pipepong.c	Success	None	Success
pipewrite.c	Success	None	Success
poll.c	Success	None	Success
recvfrom-sendto.c	Success	None	Success
simple_epoll.c	Success	None	Success
socket.c	Success	None	Success
socket_cloexec.c	Success	None	Success
socketpair.c	Success	None	Success
tcp_connect_single.c	Success	None	Success
Process Tests
chain_thread.c	Success	None	Success
exit.c	Success	None	Success
forkexecv-arg.c	Success	None	Success
forkexecv.c	Success	None	Success
function-ptr.c	Success	None	Success
getppid.c	Success	None	Success
getuid.c	Success	None	Success
hello-arg.c	Success	None	Success
hello.c	Success	None	Success
longjmp.c	Success	None	Success
mutex.c	Success	None	Success
noforkfiles.c	Success	None	Success
sem_forks.c	Success	None	Success
setsid.c	Success	None	Success
thread-test.c	Success	None	Success
thread.c	Success	None	Success
wait.c	Success	None	Success
waitpid_anychild.c	Failure	Output_mismatch	=== Expected Output === Test Passed: waitpid(-1) correctly waited for child === WASM Output === waitpid return -1, errono=4
waitpid_wnohang.c	Success	None	Success
Signal Tests
alarm.c	Success	None	Success
setitimer.c	Success	None	Success
sigalrm.c	Success	None	Success
sigchld.c	Success	None	Success
signal-fork.c	Success	None	Success
signal-simple.c	Success	None	Success
sigprocmask.c	Success	None	Success

Non Deterministic Tests

Summary

Metric	Count
Total Test Cases	31
Number of Successes	31
Number of Failures	0
Number of Compilation Failure Native	0
Number of Runtime Failure Native	0
Number of Segmentation Fault Native	0
Number of Timeout During Native	0
Number of Lind Wasm Compile Failure	0
Number of Lind Wasm Runtime Failure	0
Number of Lind Wasm Segmentation Failure	0
Number of Timeout During Lind Wasm run	0
Number of Unknown Failure	0
Number of C Compiler and Wasm Output mismatch	0
Number of Fail Test: Native Succeeded (Should Fail)	0
Number of Fail Test: Wasm Succeeded (Should Fail)	0
Number of Fail Test: Both Native and Wasm Succeeded (Should Fail)	0
Number of Fail Test: Native Compilation Failure (Should Succeed)	0
Number of Fail Test: Wasm Compilation Failure (Should Succeed)	0

Test Results by Category

Test Case	Status	Error Type	Output
File Tests
clock_gettime_highlevel.c	Success	None	Success
clock_gettime_simple.c	Success	None	Success
dup.c	Success	None	Success
fstatfs.c	Success	None	Success
read.c	Success	None	Success
statfs.c	Success	None	Success
Memory Tests
malloc_large.c	Success	None	Success
mmap_complicated.c	Success	None	Success
mmap_shared.c	Success	None	Success
segfault.c	Success	None	Success
shm.c	Success	None	Success
vtable.c	Success	None	Success
Networking Tests
dnstest.c	Success	None	Success
getifaddrs.c	Success	None	Success
shutdown_fork.c	Success	None	Success
simple-select.c	Success	None	Success
Process Tests
fork2malloc.c	Success	None	Success
fork_simple.c	Success	None	Success
forkandopen.c	Success	None	Success
forkfiles.c	Success	None	Success
forkmalloc.c	Success	None	Success
forknodup.c	Success	None	Success
getpid.c	Success	None	Success
Signal Tests
signal.c	Success	None	Success
signal_SIGCHLD.c	Success	None	Success
signal_fork.c	Success	None	Success
signal_int_thread.c	Success	None	Success
signal_longjmp.c	Success	None	Success
signal_nodefer.c	Success	None	Success
signal_procmask.c	Success	None	Success
signal_sa_mask.c	Success	None	Success

Fail Tests

Summary

Metric	Count
Total Test Cases	1
Number of Successes	1
Number of Failures	0
Number of Compilation Failure Native	0
Number of Runtime Failure Native	0
Number of Segmentation Fault Native	0
Number of Timeout During Native	0
Number of Lind Wasm Compile Failure	0
Number of Lind Wasm Runtime Failure	0
Number of Lind Wasm Segmentation Failure	0
Number of Timeout During Lind Wasm run	0
Number of Unknown Failure	0
Number of C Compiler and Wasm Output mismatch	0
Number of Fail Test: Native Succeeded (Should Fail)	0
Number of Fail Test: Wasm Succeeded (Should Fail)	0
Number of Fail Test: Both Native and Wasm Succeeded (Should Fail)	0
Number of Fail Test: Native Compilation Failure (Should Succeed)	0
Number of Fail Test: Wasm Compilation Failure (Should Succeed)	0

Test Results by Category

Test Case	Status	Error Type	Output
Memory Tests
mmap-negative1.c	Success	None	Success

github-actions · 2026-01-28T02:58:24Z

End-to-End Test Report

Test Preview

Test Report

Deterministic Tests

Summary

Metric	Count
Total Test Cases	106
Number of Successes	106
Number of Failures	0
Number of Compilation Failure Native	0
Number of Runtime Failure Native	0
Number of Segmentation Fault Native	0
Number of Timeout During Native	0
Number of Lind Wasm Compile Failure	0
Number of Lind Wasm Runtime Failure	0
Number of Lind Wasm Segmentation Failure	0
Number of Timeout During Lind Wasm run	0
Number of Unknown Failure	0
Number of C Compiler and Wasm Output mismatch	0
Number of Fail Test: Native Succeeded (Should Fail)	0
Number of Fail Test: Wasm Succeeded (Should Fail)	0
Number of Fail Test: Both Native and Wasm Succeeded (Should Fail)	0
Number of Fail Test: Native Compilation Failure (Should Succeed)	0
Number of Fail Test: Wasm Compilation Failure (Should Succeed)	0

Test Results by Category

Test Case	Status	Error Type	Output
File Tests
chartests.c	Success	None	Success
chdir_getcwd.c	Success	None	Success
chmod.c	Success	None	Success
clock_gettime_simple.c	Success	None	Success
close.c	Success	None	Success
doubleclose.c	Success	None	Success
dupwrite.c	Success	None	Success
fchmod.c	Success	None	Success
fcntl.c	Success	None	Success
fdatasync.c	Success	None	Success
filetest.c	Success	None	Success
filetest1000.c	Success	None	Success
fstat.c	Success	None	Success
fstatfs.c	Success	None	Success
fsync.c	Success	None	Success
ftruncate.c	Success	None	Success
getcwd.c	Success	None	Success
getrandom.c	Success	None	Success
ioctl.c	Success	None	Success
link.c	Success	None	Success
lseek.c	Success	None	Success
mkdir_rmdir.c	Success	None	Success
open.c	Success	None	Success
pread_pwrite.c	Success	None	Success
printf.c	Success	None	Success
readbytes.c	Success	None	Success
readlink.c	Success	None	Success
rename.c	Success	None	Success
stat.c	Success	None	Success
statfs.c	Success	None	Success
sync_file_range.c	Success	None	Success
truncate.c	Success	None	Success
unlink.c	Success	None	Success
unlinkat.c	Success	None	Success
write.c	Success	None	Success
writeloop.c	Success	None	Success
writepartial.c	Success	None	Success
writev.c	Success	None	Success
Memory Tests
brk.c	Success	None	Success
malloc.c	Success	None	Success
malloc_large.c	Success	None	Success
memcpy.c	Success	None	Success
memory_error_test.c	Success	None	Success
mmap.c	Success	None	Success
mmap_aligned.c	Success	None	Success
mmap_file.c	Success	None	Success
mmap_shared.c	Success	None	Success
mprotect.c	Success	None	Success
mprotect_boundary.c	Success	None	Success
mprotect_end_region.c	Success	None	Success
mprotect_middle_region.c	Success	None	Success
mprotect_multiple_times.c	Success	None	Success
mprotect_same_value.c	Success	None	Success
mprotect_spanning_regions.c	Success	None	Success
sbrk.c	Success	None	Success
shmtest.c	Success	None	Success
Networking Tests
gethostname.c	Success	None	Success
getsockopt.c	Success	None	Success
makepipe.c	Success	None	Success
pipe.c	Success	None	Success
pipe2.c	Success	None	Success
pipeinput.c	Success	None	Success
pipeinput2.c	Success	None	Success
pipeonestring.c	Success	None	Success
pipepong.c	Success	None	Success
pipewrite.c	Success	None	Success
poll.c	Success	None	Success
recvfrom-sendto.c	Success	None	Success
simple-select.c	Success	None	Success
simple_epoll.c	Success	None	Success
socket.c	Success	None	Success
socket_cloexec.c	Success	None	Success
socketpair.c	Success	None	Success
tcp_connect_single.c	Success	None	Success
Process Tests
chain_thread.c	Success	None	Success
exit.c	Success	None	Success
fork2malloc.c	Success	None	Success
forkexecv-arg.c	Success	None	Success
forkexecv.c	Success	None	Success
forkmalloc.c	Success	None	Success
function-ptr.c	Success	None	Success
getpid.c	Success	None	Success
getppid.c	Success	None	Success
getuid.c	Success	None	Success
hello-arg.c	Success	None	Success
hello.c	Success	None	Success
longjmp.c	Success	None	Success
mutex.c	Success	None	Success
noforkfiles.c	Success	None	Success
sem_forks.c	Success	None	Success
setsid.c	Success	None	Success
template.c	Success	None	Success
thread-test.c	Success	None	Success
thread.c	Success	None	Success
wait.c	Success	None	Success
waitpid_anychild.c	Success	None	Success
waitpid_wnohang.c	Success	None	Success
Signal Tests
alarm.c	Success	None	Success
setitimer.c	Success	None	Success
sigalrm.c	Success	None	Success
sigchld.c	Success	None	Success
signal-fork.c	Success	None	Success
signal-simple.c	Success	None	Success
signal_SIGCHLD.c	Success	None	Success
signal_int_ignored.c	Success	None	Success
sigprocmask.c	Success	None	Success

Non Deterministic Tests

Summary

Metric	Count
Total Test Cases	21
Number of Successes	21
Number of Failures	0
Number of Compilation Failure Native	0
Number of Runtime Failure Native	0
Number of Segmentation Fault Native	0
Number of Timeout During Native	0
Number of Lind Wasm Compile Failure	0
Number of Lind Wasm Runtime Failure	0
Number of Lind Wasm Segmentation Failure	0
Number of Timeout During Lind Wasm run	0
Number of Unknown Failure	0
Number of C Compiler and Wasm Output mismatch	0
Number of Fail Test: Native Succeeded (Should Fail)	0
Number of Fail Test: Wasm Succeeded (Should Fail)	0
Number of Fail Test: Both Native and Wasm Succeeded (Should Fail)	0
Number of Fail Test: Native Compilation Failure (Should Succeed)	0
Number of Fail Test: Wasm Compilation Failure (Should Succeed)	0

Test Results by Category

Test Case	Status	Error Type	Output
File Tests
clock_gettime_highlevel.c	Success	None	Success
dup.c	Success	None	Success
read.c	Success	None	Success
Memory Tests
mmap_complicated.c	Success	None	Success
segfault.c	Success	None	Success
shm.c	Success	None	Success
vtable.c	Success	None	Success
Networking Tests
dnstest.c	Success	None	Success
getifaddrs.c	Success	None	Success
shutdown_fork.c	Success	None	Success
Process Tests
fork_simple.c	Success	None	Success
forkandopen.c	Success	None	Success
forkfiles.c	Success	None	Success
forknodup.c	Success	None	Success
Signal Tests
signal.c	Success	None	Success
signal_fork.c	Success	None	Success
signal_int_thread.c	Success	None	Success
signal_longjmp.c	Success	None	Success
signal_nodefer.c	Success	None	Success
signal_procmask.c	Success	None	Success
signal_sa_mask.c	Success	None	Success

Fail Tests

Summary

Metric	Count
Total Test Cases	1
Number of Successes	1
Number of Failures	0
Number of Compilation Failure Native	0
Number of Runtime Failure Native	0
Number of Segmentation Fault Native	0
Number of Timeout During Native	0
Number of Lind Wasm Compile Failure	0
Number of Lind Wasm Runtime Failure	0
Number of Lind Wasm Segmentation Failure	0
Number of Timeout During Lind Wasm run	0
Number of Unknown Failure	0
Number of C Compiler and Wasm Output mismatch	0
Number of Fail Test: Native Succeeded (Should Fail)	0
Number of Fail Test: Wasm Succeeded (Should Fail)	0
Number of Fail Test: Both Native and Wasm Succeeded (Should Fail)	0
Number of Fail Test: Native Compilation Failure (Should Succeed)	0
Number of Fail Test: Wasm Compilation Failure (Should Succeed)	0

Test Results by Category

Test Case	Status	Error Type	Output
Memory Tests
mmap-negative1.c	Success	None	Success

* Convert pipeinput, pipeinput2, pipeonestring, and pipewrite to deterministic assert-based tests - Replace non-deterministic printf statements with assert() calls - Remove printing of PIDs, FD numbers, return values, and message contents - Add required assertions for pipe(), fork(), write(), read(), memcmp(), close(), and waitpid() - Ensure tests fail via assert() on incorrect behavior - Use fixed messages with explicit length checks - Child processes read until full message length is received - Parent processes verify child exit status via waitpid() Addresses issue #603: Deprecate non-deterministic tests * fix: assert * moved non deterministic to deterministic folder * updated skip test

ChinmayShringi added 2 commits January 21, 2026 03:22

fix: assert

f6af144

ChinmayShringi requested a review from rennergade January 21, 2026 03:26

moved non deterministic to deterministic folder

735cc35

updated skip test

b752aae

ChinmayShringi force-pushed the convert-pipe-tests-deterministic-part2 branch from a708adc to b752aae Compare January 21, 2026 17:42

ChinmayShringi mentioned this pull request Jan 21, 2026

waitpid() return value mismatch with requested child PID in deterministic pipe/fork test #625

Closed

Merge main into convert-pipe-tests-deterministic-part2

60ff19f

rennergade merged commit a9fc26b into main Jan 28, 2026
3 checks passed

Conversation

ChinmayShringi commented Jan 21, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Purpose

Changes

Modified Files

Testing

Uh oh!

github-actions bot commented Jan 21, 2026

End-to-End Test Report

Summary

Test Results by Category

Summary

Test Results by Category

Summary

Test Results by Category

Uh oh!

rennergade commented Jan 21, 2026

Uh oh!

github-actions bot commented Jan 21, 2026

End-to-End Test Report

Summary

Test Results by Category

Summary

Test Results by Category

Summary

Test Results by Category

Uh oh!

github-actions bot commented Jan 21, 2026

End-to-End Test Report

Summary

Test Results by Category

Summary

Test Results by Category

Summary

Test Results by Category

Uh oh!

github-actions bot commented Jan 21, 2026

End-to-End Test Report

Summary

Test Results by Category

Summary

Test Results by Category

Summary

Test Results by Category

Uh oh!

github-actions bot commented Jan 28, 2026

End-to-End Test Report

Summary

Test Results by Category

Summary

Test Results by Category

Summary

Test Results by Category

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

ChinmayShringi commented Jan 21, 2026 •

edited

Loading