Skip to content

INTEGRITY: Continuing set.dat's processing #32

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 23 commits into
base: integrity
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
23 commits
Select commit Hold shift + click to select a range
161abd5
INTEGRITY: Increase character limit size for log text
ShivangNagta Jul 4, 2025
94cd1d9
INTEGRITY: Separate the additional checksum add logic from insert_fil…
ShivangNagta Jul 4, 2025
cc82c6f
INTEGRITY: Add filtering by platform for set.dat to reduce manual merge.
ShivangNagta Jul 4, 2025
599d2f1
INTEGRITY: Avoid adding a fileset as candidate if it was marked as pa…
ShivangNagta Jul 7, 2025
6ea2bba
INTEGRITY: Add additional filtering logic for glk engines
ShivangNagta Jul 7, 2025
3028d19
INTEGRITY: Add timestamp field in scan.dat and filtering support via …
ShivangNagta Jul 7, 2025
19b19c0
INTEGRITY: Add all size variants to scan.dat - size, size-r and size-rd.
ShivangNagta Jul 7, 2025
074da92
INTEGRITY: Fix clear database hang issue. Now the database is dropped…
ShivangNagta Jul 8, 2025
31b7d4f
INTEGRITY: Remove global database connection object from fileset.py, …
ShivangNagta Jul 8, 2025
e125227
INTEGRITY: Filter manual merge candidates if size mismatch.
ShivangNagta Jul 9, 2025
898ffd0
INTEGRITY: Add metadata for set.dat
ShivangNagta Jul 10, 2025
8970cd6
INTEGRITY: Add navbar with logo.
ShivangNagta Jul 10, 2025
bd3f2f4
INTEGRITY: Add modification timestamps for macfiles
ShivangNagta Jul 10, 2025
8575f8e
INTEGIRTY: Add punycode encoding for scan utlity.
ShivangNagta Jul 10, 2025
df41d7a
INTEGRITY: Fix the navbar on top.
ShivangNagta Jul 10, 2025
c38881c
INTEGRITY: Limit match fileset to 1 in remove_manual_merge_if_size_mi…
ShivangNagta Jul 14, 2025
e86f982
INTEGRITY: Improve console logging with progress update.
ShivangNagta Jul 14, 2025
7dcb20b
INTEGRITY: Remove custom recursive path split function.
ShivangNagta Jul 14, 2025
96d9cf4
INTEGRITY: Use INFORMATION_SCHEMA.COLUMNS instead of relying on error…
ShivangNagta Jul 14, 2025
4c9a5e7
INTEGRITY: Add scan processing logic.
ShivangNagta Jul 14, 2025
33cac5a
INTEGRITY: Add additional modification-time column in file table.
ShivangNagta Jul 14, 2025
90ffe1a
INTEGRITY: Additional error handling while extracing keys from scummv…
ShivangNagta Jul 14, 2025
493acb5
INTEGRITY: Traverse set.dat instead of candidate fileset while search…
ShivangNagta Jul 14, 2025
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
295 changes: 230 additions & 65 deletions compute_hash.py

Large diffs are not rendered by default.

3 changes: 3 additions & 0 deletions dat_parser.py
Original file line number Diff line number Diff line change
Expand Up @@ -33,6 +33,9 @@ def map_checksum_data(content_string):
elif tokens[i] == "size-rd":
current_rom["size-rd"] = int(tokens[i + 1])
i += 2
elif tokens[i] == "modification-time":
current_rom["modification-time"] = tokens[i + 1]
i += 2
else:
checksum_key = tokens[i]
checksum_value = tokens[i + 1] if len(tokens) >= 6 else "0"
Expand Down
Loading