Skip to content

Things TO DO

Jump to bottom
Mike edited this page Oct 11, 2019 · 50 revisions

List of things to do before I'll call it "Done"

  • Full Wizard & Source/Filter Test
  • Expand tests to include more files/all Handlers
  • Text-scraping implementation, of some variety.
  • Chase down remaining TODOs
  • Auto-building Docker container for RMD.
  • Ability to Delete and/or Interrupt Downloaded/Downloading files.

Pre-3.0

  • New Icon
  • Build Wiki documentation.
  • Adjust all guide links in UI to new Wiki pages
  • 2FA login has to be implemented, in at least some capacity.
    • Maybe just make all new users register via oAuth, and prompt old users in the UI.
    • Automatic oAuth page registration is stalled indefinitely until PRAW fixes their stuff.
  • Running the actual download process needs to work.
  • Settings need to detect if a reboot is needed, and restart from bootstrap.
  • Verify all threads cleanly exit & cleanup after download.

Done:

  • Source for the user's Home Page Feed
  • Since it's all threaded now, loading posts could be queued in realtime to accelerate startup.
  • The Manifest should store filemtime and hashjar's Hash, rather than re-hashing old files.
  • It may be time, in the interest of large batches, to move manifest information into a SQLite DB.
  • (Probably) include a fix for broken Win10 Directories.
  • The Manifest test should actually verify the SQL integrity.
  • GUI would be nice.

Low Priority:

Logging System: RMD needs a way to (optionally) push event information to a global log file. This should be easy to do with a simple static class and lock.

Settings Changes: I likely need to build a more clever way to handle settings. They don't need to be rebuilt from the ground up, but they probably do need to be adjusted. The current hand-off method between the Settings and the Command Line is ugly. I should figure out if I'm okay with adding new settings on-the-fly, or if it would be far better to standardize the settings template (and perhaps clean up the settings actually required a bit).

Enhanced File Deduplication: Now that hash and visual deduplication work, consider checking metadata for larger files to try and cut down on copies of larger video files.

Direct URL Download: It'd be kinda cool to let the user directly pass in a raw URL, which would then be pushed through the Handlers. Maybe look at expanding threading support for albums to accompany this change.

Multi-File Concurrent Downloading: If Posts link to pages with multiple files, these files should (ideally) be split up and added to a thread pool. This would allow larger Imgur albums/Tumblr posts/etc to download faster, in the event the other Handlers have finished processing other Posts. This would also allow RMD to download multiple different forms of media from the same page, from sites like Tumblr. This is a larger change, as it requires an extra layer between Post finding and the URL Handlers.

Clone this wiki locally