Make sure processing files persist in the knowledge table

[colegoldsmith]

No description provided.

[colegoldsmith]

This work has opened a little can of worms with how to handle failed files if we decide to persist task files in the knowledge table.

Route 1: We continue this work to make task files persist in the table.

• This ensure entries in the table are not ephemeral and potentially disappear on reload (because they are only in local frontend state)
• If we want to show failed files, they will always show unless we have a mechanism to delete tasks. This has implications with recording keeping, do we want to ensure tasks are always kept around?

Route 2: Keep task files in local frontend state

• This makes in progress and failed files ephemeral and disappear on reload.