LFUZZ Experiment

[vwrewsge]

Hi, @DonggeLiu

I've added a new fuzzer called lfuzz. Could you please help me run experiments with it?
I have already completed the following tasks in advance:

1. I have already run all the target programs locally for one hour each, and they all executed successfully.
2. I have already added a dummy comment! as requested.

Thanks!

[vwrewsge]

/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name 2024-05-15-aflpp --fuzzers lfuzz --benchmarks bloaty_fuzz_target freetype2_ftfuzzer harfbuzz_hb-shape-fuzzer lcms_cms_transform_fuzzer libjpeg-turbo_libjpeg_turbo_fuzzer libpcap_fuzz_both libpng_libpng_read_fuzzer openssl_x509 vorbis_decode_fuzzer woff2_convert_woff2ttf_fuzzer zlib_zlib_uncompress_fuzzer

[DonggeLiu]

/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name 2024-05-15-aflpp --fuzzers lfuzz --benchmarks bloaty_fuzz_target freetype2_ftfuzzer harfbuzz_hb-shape-fuzzer lcms_cms_transform_fuzzer libjpeg-turbo_libjpeg_turbo_fuzzer libpcap_fuzz_both libpng_libpng_read_fuzzer openssl_x509 vorbis_decode_fuzzer woff2_convert_woff2ttf_fuzzer zlib_zlib_uncompress_fuzzer

[vwrewsge]

It still failed on some programs... It is weird, as I didn't change any dependencies, and it was working successfully before. Let me check again.

[vwrewsge]

Hi, @DonggeLiu

The issue arises during the execution of make install-dependencies. When installing the same library, it succeeds in some containers but fails in others (first image fails, second image succeeds).

This problem doesn't seem to be related to the new fuzzer I added. Do you have any suggestions?

[vwrewsge]

Hi, @DonggeLiu

The issue arises during the execution of make install-dependencies. When installing the same library, it succeeds in some containers but fails in others (first image fails, second image succeeds).

This problem doesn't seem to be related to the new fuzzer I added. Do you have any suggestions?

It seems I have identified the issue. In all the unsuccessful builds, the download of Orange3-3.33.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl failed. In the successful builds, the download speed for Orange3-3.33.0 was 70-80MB/s, whereas in the unsuccessful ones, the download speed was only 3.8MB/s or less.

I'm not sure if network fluctuations would affect experiment building in the design of Fuzzbench.
Therefore, I suspect that network fluctuations might be causing some builds to fail. Perhaps rerunning the builds could work?

/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name 2024-05-15-aflpp --fuzzers lfuzz --benchmarks bloaty_fuzz_target freetype2_ftfuzzer harfbuzz_hb-shape-fuzzer lcms_cms_transform_fuzzer libjpeg-turbo_libjpeg_turbo_fuzzer libpcap_fuzz_both libpng_libpng_read_fuzzer openssl_x509 vorbis_decode_fuzzer woff2_convert_woff2ttf_fuzzer zlib_zlib_uncompress_fuzzer

[DonggeLiu]

/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name 2024-05-16-aflpp --fuzzers lfuzz --benchmarks bloaty_fuzz_target freetype2_ftfuzzer harfbuzz_hb-shape-fuzzer lcms_cms_transform_fuzzer libjpeg-turbo_libjpeg_turbo_fuzzer libpcap_fuzz_both libpng_libpng_read_fuzzer openssl_x509 vorbis_decode_fuzzer woff2_convert_woff2ttf_fuzzer zlib_zlib_uncompress_fuzzer

[vwrewsge]

/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name 2024-05-16-aflpp --fuzzers lfuzz --benchmarks bloaty_fuzz_target freetype2_ftfuzzer harfbuzz_hb-shape-fuzzer lcms_cms_transform_fuzzer libjpeg-turbo_libjpeg_turbo_fuzzer libpcap_fuzz_both libpng_libpng_read_fuzzer openssl_x509 vorbis_decode_fuzzer woff2_convert_woff2ttf_fuzzer zlib_zlib_uncompress_fuzzer

It looks like all the checks have passed successfully, but where's the link to the experiment data and report?

[DonggeLiu]

Here : )
Experiment 2024-05-16-aflpp data and results will be available later at:
The experiment data.
The experiment report.
The experiment report(experimental).

[DonggeLiu]

BTW, could you see the links on this page?
https://github.com/google/fuzzbench/pull/1987/checks?check_run_id=25028089144

We can add the data and report links to them if you can access them.

[vwrewsge]

Thanks a lot !!!