Considerations for DbCleanup

[danielplohmann]

• think of orphan query samples and functions that don't have a job connected to them
• think of doing a DB compact afterwards

[yankovs]

Hey!

I also want to add about failed query jobs. In the doDbCleanup, in this section:

mcrit/mcrit/Worker.py

Lines 190 to 192 in 765195b

	unmapped_finished = self.getQueueData(0, 0, method="getMatchesForUnmappedBinary", state="finished")
	mapped_finished = self.getQueueData(0, 0, method="getMatchesForMappedBinary", state="finished")
	smda_finished = self.getQueueData(0, 0, method="getMatchesForSmdaReport", state="finished")

it should also get the query jobs that have failed status. It should then delete those failed queries

Regarding DB compact, in the MongoDbStorage class we can have a method that runs:

db.runCommand({ compact: "query_samples" })
db.runCommand({ compact: "query_functions" })

and have it run at the end of doDbCleanup