-
Notifications
You must be signed in to change notification settings - Fork 176
Open
Description
pickle is insecure and it's not very efficient for larger, more complex datasets.
This will be a multiple steps plan towards moving into sqlite-backed storage:
- Remove rarely used features
- Deprecate objectdb and history compression: This was never the default and disk space nowadays makes this unlikely to be an issue nowadays, maybe we can re-introduce compression when sqlite migration is complete (Remove .ropeproject/history and .ropeproject/objectdb compression #606)
- Deprecate importing of old format (
objectdb.pickleandhistory.pickle): rope hasn't been generating this for decades (Remove _DataFiles._import_old_files() #607)
- Make ScopeInfo JSON-serializable: there are some data here that are python class instances, but they really doesn't need to be, we can just
__getstate__()/__setstate__()them instead when de/serializing. Implement JSON DataFile serialization #611 - Implement sqlite database schema versioning Automatically purge autoimport.db when there is schema change #565
- These files contains a bunch of nested dictionaries, these can be translated to sqlite tables in a straightforward manner, we'll likely will still store JSON documents inside the sqlite tables instead of normalizing everything
- Make sure that the tables have appropriate indexes
- Remove write support for legacy objectdb and history files
- Remove read support for legacy objectdb and history files
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
No labels