[Bug] Out of memory will caclulating checksum of compressed files

[taki-eddine-47]

RomM version
3.5.1

Describe the bug
I found that ROMM use a lot of memory when scannes 7z files (big size).

To Reproduce
Steps to reproduce the behavior:

1. Add new compressed file in any library with large size (ex: 100GB)
2. Start a Complete rescan for that library
3. Watch the memory usage of ROMM worker process.
4. Wait until system crashes 🥲.

Expected behavior
ROMM should use better way to calculate the hashe of a file without loading it all in memory (read and calculate by chunk ?).

Screenshots

Desktop (please complete the following information):

• OS: K3S (NixOS)
• Browser: Firefox
• Version: 131

Smartphone (please complete the following information):

• Device: [e.g. iPhone6]
• OS: [e.g. iOS8.1]
• Browser [e.g. stock browser, safari]
• Version [e.g. 22]

Additional context

romm/backend/handler/scan_handler.py

Line 235 in 6022d36

rom_hashes = fs_rom_handler.get_rom_hashes(rom_attrs["file_name"], roms_path)

romm/backend/handler/filesystem/roms_handler.py

Line 251 in 6022d36

for chunk in read_7z_file(file_path):

romm/backend/handler/filesystem/roms_handler.py

Line 115 in 6022d36

for _name, bio in f.readall().items():

[danblu3]

#1226

Aware and being worked on for future release