Add test case for exit failure

[Yaxuan-w]

Add test case for exit failure. Currently this isn't working on lind-wasm, so put into skipped list.

[github-actions]

End-to-End Test Report

Test Preview

Test Report

Deterministic Tests

Summary

Metric	Count
Total Test Cases	149
Number of Successes	149
Number of Failures	0
Number of Compilation Failure Native	0
Number of Runtime Failure Native	0
Number of Segmentation Fault Native	0
Number of Timeout During Native	0
Number of Lind Wasm Compile Failure	0
Number of Lind Wasm Runtime Failure	0
Number of Lind Wasm Segmentation Failure	0
Number of Timeout During Lind Wasm run	0
Number of Unknown Failure	0
Number of C Compiler and Wasm Output mismatch	0
Number of Fail Test: Native Succeeded (Should Fail)	0
Number of Fail Test: Wasm Succeeded (Should Fail)	0
Number of Fail Test: Both Native and Wasm Succeeded (Should Fail)	0
Number of Fail Test: Native Compilation Failure (Should Succeed)	0
Number of Fail Test: Wasm Compilation Failure (Should Succeed)	0

Test Results by Category

Test Case	Status	Error Type	Native Time	Wasm Time	Output
File Tests
chartests.c	Success	None	0.049715s	4.129001s	Success
chdir_getcwd.c	Success	None	0.049434s	4.133585s	Success
chmod.c	Success	None	0.056079s	4.107250s	Success
clock_gettime_highlevel.c	Success	None	0.113963s	4.272445s	Success
clock_gettime_simple.c	Success	None	0.042448s	4.079696s	Success
cloexec.c	Success	None	0.053447s	3.720763s	Success
close.c	Success	None	0.060949s	4.047023s	Success
creat_access.c	Success	None	0.052895s	4.066433s	Success
doubleclose.c	Success	None	0.044902s	3.695216s	Success
dup.c	Success	None	0.045227s	4.073606s	Success
dup2.c	Success	None	0.049131s	3.690514s	Success
dup3.c	Success	None	0.047356s	4.063416s	Success
dupwrite.c	Success	None	0.049592s	3.673011s	Success
fchdir.c	Success	None	0.055342s	4.067690s	Success
fchmod.c	Success	None	0.054229s	4.118324s	Success
fcntl.c	Success	None	0.051324s	4.080962s	Success
fdatasync.c	Success	None	0.051516s	4.077433s	Success
filetest.c	Success	None	0.049352s	3.729782s	Success
filetest1000.c	Success	None	0.060128s	3.706283s	Success
flock.c	Success	None	0.058933s	4.131934s	Success
fstat.c	Success	None	0.054183s	4.068827s	Success
fstatfs.c	Success	None	0.047124s	4.126793s	Success
fsync.c	Success	None	0.048367s	4.087730s	Success
ftruncate.c	Success	None	0.056262s	4.162776s	Success
getcwd.c	Success	None	0.048150s	4.061527s	Success
getrandom.c	Success	None	0.052221s	4.066748s	Success
ioctl.c	Success	None	0.056208s	4.101806s	Success
link.c	Success	None	0.052649s	4.096774s	Success
lseek.c	Success	None	0.052698s	4.072266s	Success
mkdir_rmdir.c	Success	None	0.049599s	4.040519s	Success
open.c	Success	None	0.046903s	4.028383s	Success
pread_pwrite.c	Success	None	0.050099s	4.104147s	Success
printf.c	Success	None	0.044193s	3.713127s	Success
read.c	Success	None	0.051006s	4.078155s	Success
readbytes.c	Success	None	0.047420s	3.656359s	Success
readlink.c	Success	None	0.051794s	4.127574s	Success
readlinkat.c	Success	None	0.054290s	4.057733s	Success
rename.c	Success	None	0.053013s	4.051773s	Success
sc-writev.c	Success	None	0.048903s	4.035705s	Success
stat.c	Success	None	0.052973s	4.069561s	Success
statfs.c	Success	None	0.046507s	4.040547s	Success
sync_file_range.c	Success	None	0.049632s	4.023032s	Success
truncate.c	Success	None	0.053847s	4.107589s	Success
unlink.c	Success	None	0.051962s	4.081207s	Success
unlinkat.c	Success	None	0.053761s	4.154812s	Success
write.c	Success	None	0.043941s	3.658990s	Success
writeloop.c	Success	None	0.055572s	3.786629s	Success
writepartial.c	Success	None	0.052806s	3.729862s	Success
writev.c	Success	None	0.051142s	4.087268s	Success
Math Tests
math_link_smoke.c	Success	None	0.056463s	3.763538s	Success
math_tests.c	Success	None	0.057771s	3.842560s	Success
Memory Tests
brk.c	Success	None	0.047376s	4.011758s	Success
malloc.c	Success	None	0.047562s	3.642924s	Success
malloc_large.c	Success	None	0.048871s	4.011718s	Success
memcpy.c	Success	None	0.045224s	3.615420s	Success
memory_error_test.c	Success	None	0.055612s	4.059752s	Success
mmap.c	Success	None	0.043513s	4.062612s	Success
mmap_aligned.c	Success	None	0.044574s	4.034227s	Success
mmap_complicated.c	Success	None	0.052026s	4.115657s	Success
mmap_file.c	Success	None	0.052689s	3.995096s	Success
mmap_shared.c	Success	None	0.049379s	4.079872s	Success
mmaptest.c	Success	None	0.045866s	4.009612s	Success
mprotect.c	Success	None	0.044419s	4.071887s	Success
mprotect_boundary.c	Success	None	0.045754s	4.002124s	Success
mprotect_end_region.c	Success	None	0.045562s	4.090346s	Success
mprotect_middle_region.c	Success	None	0.044498s	4.074940s	Success
mprotect_multiple_times.c	Success	None	0.044856s	4.005466s	Success
mprotect_same_value.c	Success	None	0.046261s	4.057085s	Success
mprotect_spanning_regions.c	Success	None	0.044602s	4.051202s	Success
sbrk.c	Success	None	0.047673s	4.024505s	Success
segfault.c	Success	None	0.052270s	4.064519s	Success
shm.c	Success	None	0.052082s	4.064100s	Success
shmtest.c	Success	None	0.048747s	4.031549s	Success
vtable.c	Success	None	0.058960s	3.693808s	Success
Networking Tests
dnstest.c	Success	None	0.050229s	4.128745s	Success
epollcreate1.c	Success	None	0.054467s	4.094473s	Success
gethostname.c	Success	None	0.046066s	3.689083s	Success
getsockname.c	Success	None	0.054892s	4.084412s	Success
getsockopt.c	Success	None	0.053999s	4.066512s	Success
makepipe.c	Success	None	0.046282s	3.694968s	Success
pipe.c	Success	None	0.052699s	4.117699s	Success
pipe2.c	Success	None	0.051165s	4.019548s	Success
pipeinput.c	Success	None	0.053852s	4.137379s	Success
pipeinput2.c	Success	None	0.055732s	4.130517s	Success
pipeonestring.c	Success	None	0.053545s	4.097480s	Success
pipepong.c	Success	None	0.055536s	4.102723s	Success
pipewrite.c	Success	None	0.049249s	4.075072s	Success
poll.c	Success	None	0.052411s	4.129309s	Success
recvfrom-sendto.c	Success	None	0.052816s	4.091879s	Success
serverclient.c	Success	None	0.054069s	3.746914s	Success
shutdown.c	Success	None	0.055919s	3.725057s	Success
shutdown_fork.c	Success	None	0.052499s	4.128453s	Success
simple-select.c	Success	None	0.055914s	4.075994s	Success
simple_epoll.c	Success	None	0.053742s	4.121005s	Success
socket.c	Success	None	0.052972s	3.701311s	Success
socket_cloexec.c	Success	None	0.049436s	4.069581s	Success
socketepoll.c	Success	None	0.052418s	3.746649s	Success
socketpair.c	Success	None	0.051194s	4.143269s	Success
socketselect.c	Success	None	0.050347s	4.078237s	Success
tcp_connect_single.c	Success	None	0.051628s	4.061430s	Success
uds-getsockname.c	Success	None	0.053574s	4.075877s	Success
uds-socketselect.c	Success	None	0.053029s	3.720313s	Success
Process Tests
chain_thread.c	Success	None	1.054197s	5.273948s	Success
exit.c	Success	None	0.049197s	3.698427s	Success
fork2malloc.c	Success	None	0.053203s	4.056807s	Success
fork_select.c	Success	None	0.052216s	4.067741s	Success
fork_simple.c	Success	None	0.048061s	4.036076s	Success
fork_syscall.c	Success	None	0.058995s	4.191294s	Success
forkandopen.c	Success	None	0.055737s	4.086070s	Success
forkdup.c	Success	None	0.053301s	3.725642s	Success
forkexecuid.c	Success	None	0.050320s	4.145102s	Success
forkexecv-arg.c	Success	None	0.048965s	4.083856s	Success
forkexecv.c	Success	None	0.050054s	4.131812s	Success
forkfiles.c	Success	None	0.052394s	4.097669s	Success
forkmalloc.c	Success	None	0.067910s	4.071690s	Success
forknodup.c	Success	None	0.056008s	4.168539s	Success
function-ptr.c	Success	None	0.049477s	4.027199s	Success
getegid_syscall.c	Success	None	0.050978s	4.144526s	Success
getgid_syscall.c	Success	None	0.053003s	4.133221s	Success
getpid.c	Success	None	0.046440s	4.062409s	Success
getpid_syscall.c	Success	None	0.055696s	4.132165s	Success
getppid.c	Success	None	0.051076s	4.139354s	Success
getppid_syscall.c	Success	None	0.057111s	4.212595s	Success
getuid.c	Success	None	0.050899s	4.050847s	Success
getuid_syscall.c	Success	None	0.052316s	4.085108s	Success
hello-arg.c	Success	None	0.044005s	3.708978s	Success
hello.c	Success	None	0.044677s	3.670938s	Success
longjmp.c	Success	None	0.042752s	3.710507s	Success
mutex.c	Success	None	2.060007s	6.336702s	Success
sem_forks.c	Success	None	0.056305s	4.112071s	Success
setsid.c	Success	None	0.046103s	3.713537s	Success
template.c	Success	None	0.050852s	4.140161s	Success
test_exec_nofork.c	Success	None	0.049254s	4.058081s	Success
test_unlink_open_file.c	Success	None	0.047591s	3.703003s	Success
thread.c	Success	None	0.045587s	4.233391s	Success
uname.c	Success	None	0.045310s	4.075141s	Success
wait.c	Success	None	2.049933s	5.736926s	Success
waitpid_anychild.c	Success	None	0.050280s	4.102142s	Success
waitpid_syscall.c	Success	None	1.053035s	5.087132s	Success
waitpid_wnohang.c	Success	None	0.053227s	3.722945s	Success
Signal Tests
alarm.c	Success	None	7.052833s	10.746360s	Success
setitimer.c	Success	None	7.050809s	10.745016s	Success
sigalrm.c	Success	None	2.050213s	5.699683s	Success
sigchld.c	Success	None	1.051683s	4.766478s	Success
signal-fork.c	Success	None	4.053810s	7.695348s	Success
signal-simple.c	Success	None	0.051161s	3.668203s	Success
signal_fork.c	Success	None	0.048135s	4.095880s	Success
signal_int_ignored.c	Success	None	2.053422s	6.106337s	Success
sigprocmask.c	Success	None	1.053381s	4.681997s	Success

Fail Tests

Summary

Metric	Count
Total Test Cases	2
Number of Successes	2
Number of Failures	0
Number of Compilation Failure Native	0
Number of Runtime Failure Native	0
Number of Segmentation Fault Native	0
Number of Timeout During Native	0
Number of Lind Wasm Compile Failure	0
Number of Lind Wasm Runtime Failure	0
Number of Lind Wasm Segmentation Failure	0
Number of Timeout During Lind Wasm run	0
Number of Unknown Failure	0
Number of C Compiler and Wasm Output mismatch	0
Number of Fail Test: Native Succeeded (Should Fail)	0
Number of Fail Test: Wasm Succeeded (Should Fail)	0
Number of Fail Test: Both Native and Wasm Succeeded (Should Fail)	0
Number of Fail Test: Native Compilation Failure (Should Succeed)	0
Number of Fail Test: Wasm Compilation Failure (Should Succeed)	0

Test Results by Category

Test Case	Status	Error Type	Native Time	Wasm Time	Output
Memory Tests
mmap-negative1.c	Success	None	0.119574s	4.308601s	Success
mmap-negative2.c	Success	None	0.150603s	3.930167s	Success