[CHORE] (Revert:) Add rust cache to s3 build artifacts action

[jaychia]

Reverts #3144

The rust cache did not work as intended. We should try sccache instead.

[codspeed-hq]

CodSpeed Performance Report

Merging #3147 will not alter performance

_{Comparing revert-3144-jay/rust-cache-build-s3 (3280efc) with main (14b2246)}

Summary

✅ 17 untouched benchmarks

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 78.79%. Comparing base (14b2246) to head (3280efc).
Report is 1 commits behind head on main.

Additional details and impacted files

@@           Coverage Diff           @@
##             main    #3147   +/-   ##
=======================================
  Coverage   78.79%   78.79%           
=======================================
  Files         621      621           
  Lines       74807    74807           
=======================================
  Hits        58947    58947           
  Misses      15860    15860