InvalidStateError: A mutation operation was attempted on a database that did not allow mutations.

[daspri]

Prerequisites

• I verified that this is not a filter issue
  • Filter issues MUST be reported at filter issue tracker
• This is not a support issue or a question
  • Support issues and questions are handled at /r/uBlockOrigin
• I performed a cursory search of the issue tracker to avoid opening a duplicate issue
  • Your issue may already be reported.
• I tried to reproduce the issue when...
  • uBlock Origin is the only extension
  • uBlock Origin with default lists/settings
  • using a new, unmodified browser profile
• I am running the latest version of uBlock Origin
• I checked the documentation to understand that the issue I report is not a normal behavior

Description

Fails to update filters

A specific URL where the issue occurs

moz-extension://d879bf29-1bac-4212-8cbb-be53485d7ab0/dashboard.html

Steps to Reproduce

Open Firefox's "Browser Console" to see the error

1. Go to Filter Lists
2. Click 'Update Now'

Expected behavior:

Filters should update.

Actual behavior:

Filters do not update.

XHRGET https://raw.githubusercontent.com/gorhill/uBlock/master/assets/assets.json?_=212819
XHRGET https://publicsuffix.org/list/public_suffix_list.dat?_=212819
XHRGET https://raw.githubusercontent.com/uBlockOrigin/uAssets/master/filters/filters.txt?_=212819
XHRGET https://raw.githubusercontent.com/uBlockOrigin/uAssets/master/filters/badware.txt?_=212819
XHRGET https://raw.githubusercontent.com/uBlockOrigin/uAssets/master/filters/privacy.txt?_=212819
XHRGET https://raw.githubusercontent.com/uBlockOrigin/uAssets/master/filters/resource-abuse.txt?_=212819
XHRGET https://raw.githubusercontent.com/uBlockOrigin/uAssets/master/filters/unbreak.txt?_=212819
XHRGET https://easylist.to/easylist/easylist.txt?_=212819
15:53:46.412 [uBlock0CacheStorage] <unavailable>
vapi-cachestorage.js:94:9
genericErrorHandler
moz-extension://d879bf29-1bac-4212-8cbb-be53485d7ab0/js/vapi-cachestorage.js:94:9
XHRGET https://easylist.to/easylist/easyprivacy.txt?_=212819
[HTTP/2.0 200 OK 16ms]
15:53:46.993  InvalidStateError: A mutation operation was attempted on a database that did not allow mutations. vapi-cachestorage.js:230
putToDb/<
moz-extension://d879bf29-1bac-4212-8cbb-be53485d7ab0/js/vapi-cachestorage.js:230:17
getDb
moz-extension://d879bf29-1bac-4212-8cbb-be53485d7ab0/js/vapi-cachestorage.js:115:20
putToDb
moz-extension://d879bf29-1bac-4212-8cbb-be53485d7ab0/js/vapi-cachestorage.js:219:9
set
moz-extension://d879bf29-1bac-4212-8cbb-be53485d7ab0/js/vapi-cachestorage.js:77:9
onReady
moz-extension://d879bf29-1bac-4212-8cbb-be53485d7ab0/js/assets.js:533:9
getAssetCacheRegistry
moz-extension://d879bf29-1bac-4212-8cbb-be53485d7ab0/js/assets.js:426:9
assetCacheWrite
moz-extension://d879bf29-1bac-4212-8cbb-be53485d7ab0/js/assets.js:536:5
onRemoteContentLoaded
moz-extension://d879bf29-1bac-4212-8cbb-be53485d7ab0/js/assets.js:791:9
onLocalLoadSuccess
moz-extension://d879bf29-1bac-4212-8cbb-be53485d7ab0/js/assets.js:217:9
onLoadEvent
moz-extension://d879bf29-1bac-4212-8cbb-be53485d7ab0/js/assets.js:128:9

Your environment

• uBlock Origin version:
• Browser Name and version:
• Operating System and version:

uBlock Origin v1.16.14
Firefox 61.0.1
Windows 7 x64

gorhill/uBlock#2985

How much free disk space you have?

[daspri]

118,292,480 bytes free on that firefox drive

(browser.cache.disk.parent_directory is on a different drive with much more free space)

[gorhill]

Not much I will be able to do, apparently Firefox errors when uBO tries to write to the indexedDB.

If you search for firefox "A mutation operation was attempted on a database that did not allow mutations", you will find plenty of results. You may want to look into this. For example, did you set dom.indexedDB.enabled to false in about:config?

[daspri]

No, that setting is still set "true".

If I disable EasyList and restart firefox and Update Now, the update completes.

If I then Purge Cache and Update Now, it fails with the same error but after a different list (unbreak).

Briefly searching for this error mentions the dom.indexedDB.enabled setting (which I have set "true"), but results also suggest it can be caused by not waiting for an objectstore to be created before using it (async operations).

[uBlock-user]

Can't reproduce. Filters updating as expected. Reset Firefox settings to default(including the ones you set in about:config) and try again.

118,292,480 bytes free

~120 megabytes? I have problems with filters update on my Android when free space is below ~350MB

[gorhill]

According to Browser storage limits and eviction criteria, the global limit is 50% of free disk space, so ~60 MB in the current case.

From this, there is a group limit, which if I understand correctly is that at most 20% of the global limit can by assigned to uBO, so 12 MB in the current case. So yes, it does seem like an issue with low disk space.

@gorhill it is possible to detect this case and show some dialog?

[gorhill]

It's kind of a catastrophic error, the documentation said:

The group limit is also called the "hard limit": it doesn't trigger origin eviction

When this occurs, there is no fallback possible. This occurs deep in the code, when using Firefox API, and there might be no uBO UI available, aside the icon in the toolbar (assuming it has not been hidden by the user).

At this point, if I am going to throw lot of coding work at this, I rather work on the feasibility of compressing the data so as to reduce the storage footprint -- well it would be nice if Firefox's implementation of indexedDB did this for everybody.

At this point however, those suffering that sort of issue will have to free disk space. In the current case, ~120 MB is atypically low, regardless of uBO.

When this happens filter lists are shown as outdated and when I click on "Update now" animation is spinning indefinitely - a way to fix only this case?

[gorhill]

when I click on "Update now" animation is spinning indefinitely - a way to fix only this case?

From what I see in the call stack above, this fails at the database level, not at the transaction level. There are error handlers at the transaction level. But it's a bit more complicated at the database level because the handlers at that level do not know about which callers need to be notified. It just means it's possible but not trivial to fix this. If I instead work on compressing (assuming feasability), this would possibly prevent uBO from failing (except in even more extreme cases of low disk space).

I can reproduce after filling my disk by dd if=/dev/zero of=zero bs=1M and then updating filters:

Browser console log

14:14:22.938 [uBlock0CacheStorage] 
abort
​
bubbles: true
​
cancelBubble: false
​
cancelable: false
​
composed: false
​
currentTarget: null
​
defaultPrevented: false
​
eventPhase: 0
​
explicitOriginalTarget: IDBTransaction { mode: "readwrite", db: IDBDatabase, error: DOMException, … }
​
isTrusted: true
​
originalTarget: IDBTransaction { mode: "readwrite", db: IDBDatabase, error: DOMException, … }
​
srcElement: IDBTransaction { mode: "readwrite", db: IDBDatabase, error: DOMException, … }
​
target: IDBTransaction { mode: "readwrite", db: IDBDatabase, error: DOMException, … }
​
timeStamp: 1038957
​
type: "abort"
​
<prototype>: EventPrototype { composedPath: composedPath(), stopPropagation: stopPropagation(), stopImmediatePropagation: stopImmediatePropagation(), … }
vapi-cachestorage.js:94:9
genericErrorHandler
moz-extension://a41ed17e-8cfa-48fa-8853-8be569753609/js/vapi-cachestorage.js:94:9
(Async: EventHandlerNonNull) getDb/req.onsuccess
moz-extension://a41ed17e-8cfa-48fa-8853-8be569753609/js/vapi-cachestorage.js:152:13
(Async: EventHandlerNonNull) getDb
moz-extension://a41ed17e-8cfa-48fa-8853-8be569753609/js/vapi-cachestorage.js:149:9
vAPI.cacheStorage<
moz-extension://a41ed17e-8cfa-48fa-8853-8be569753609/js/vapi-cachestorage.js:55:5
<anonymous>
moz-extension://a41ed17e-8cfa-48fa-8853-8be569753609/js/vapi-cachestorage.js:41:22
14:14:23.104 [uBlock0CacheStorage] 
abort
​
bubbles: true
​
cancelBubble: false
​
cancelable: false
​
composed: false
​
currentTarget: null
​
defaultPrevented: false
​
eventPhase: 0
​
explicitOriginalTarget: IDBTransaction { mode: "readwrite", db: IDBDatabase, error: DOMException, … }
​
isTrusted: true
​
originalTarget: IDBTransaction { mode: "readwrite", db: IDBDatabase, error: DOMException, … }
​
srcElement: IDBTransaction { mode: "readwrite", db: IDBDatabase, error: DOMException, … }
​
target: IDBTransaction { mode: "readwrite", db: IDBDatabase, error: DOMException, … }
​
timeStamp: 1039123
​
type: "abort"
​
<prototype>: EventPrototype { composedPath: composedPath(), stopPropagation: stopPropagation(), stopImmediatePropagation: stopImmediatePropagation(), … }
vapi-cachestorage.js:94:9
genericErrorHandler
moz-extension://a41ed17e-8cfa-48fa-8853-8be569753609/js/vapi-cachestorage.js:94:9
(Async: EventHandlerNonNull) getDb/req.onsuccess
moz-extension://a41ed17e-8cfa-48fa-8853-8be569753609/js/vapi-cachestorage.js:152:13
(Async: EventHandlerNonNull) getDb
moz-extension://a41ed17e-8cfa-48fa-8853-8be569753609/js/vapi-cachestorage.js:149:9
vAPI.cacheStorage<
moz-extension://a41ed17e-8cfa-48fa-8853-8be569753609/js/vapi-cachestorage.js:55:5
<anonymous>
moz-extension://a41ed17e-8cfa-48fa-8853-8be569753609/js/vapi-cachestorage.js:41:22
14:14:34.596 [uBlock0CacheStorage] 
abort
​
bubbles: true
​
cancelBubble: false
​
cancelable: false
​
composed: false
​
currentTarget: null
​
defaultPrevented: false
​
eventPhase: 0
​
explicitOriginalTarget: IDBTransaction { mode: "readwrite", db: IDBDatabase, error: DOMException, … }
​
isTrusted: true
​
originalTarget: IDBTransaction { mode: "readwrite", db: IDBDatabase, error: DOMException, … }
​
srcElement: IDBTransaction { mode: "readwrite", db: IDBDatabase, error: DOMException, … }
​
target: IDBTransaction { mode: "readwrite", db: IDBDatabase, error: DOMException, … }
​
timeStamp: 1050616
​
type: "abort"
​
<prototype>: EventPrototype { composedPath: composedPath(), stopPropagation: stopPropagation(), stopImmediatePropagation: stopImmediatePropagation(), … }
vapi-cachestorage.js:94:9
genericErrorHandler
moz-extension://a41ed17e-8cfa-48fa-8853-8be569753609/js/vapi-cachestorage.js:94:9
(Async: EventHandlerNonNull) getDb/req.onsuccess
moz-extension://a41ed17e-8cfa-48fa-8853-8be569753609/js/vapi-cachestorage.js:152:13
(Async: EventHandlerNonNull) getDb
moz-extension://a41ed17e-8cfa-48fa-8853-8be569753609/js/vapi-cachestorage.js:149:9
vAPI.cacheStorage<
moz-extension://a41ed17e-8cfa-48fa-8853-8be569753609/js/vapi-cachestorage.js:55:5
<anonymous>
moz-extension://a41ed17e-8cfa-48fa-8853-8be569753609/js/vapi-cachestorage.js:41:22
14:14:34.628 [uBlock0CacheStorage] 
abort
​
bubbles: true
​
cancelBubble: false
​
cancelable: false
​
composed: false
​
currentTarget: null
​
defaultPrevented: false
​
eventPhase: 0
​
explicitOriginalTarget: IDBTransaction { mode: "readwrite", db: IDBDatabase, error: DOMException, … }
​
isTrusted: true
​
originalTarget: IDBTransaction { mode: "readwrite", db: IDBDatabase, error: DOMException, … }
​
srcElement: IDBTransaction { mode: "readwrite", db: IDBDatabase, error: DOMException, … }
​
target: IDBTransaction { mode: "readwrite", db: IDBDatabase, error: DOMException, … }
​
timeStamp: 1050646
​
type: "abort"
​
<prototype>: EventPrototype { composedPath: composedPath(), stopPropagation: stopPropagation(), stopImmediatePropagation: stopImmediatePropagation(), … }
vapi-cachestorage.js:94:9
genericErrorHandler
moz-extension://a41ed17e-8cfa-48fa-8853-8be569753609/js/vapi-cachestorage.js:94:9
(Async: EventHandlerNonNull) getDb/req.onsuccess
moz-extension://a41ed17e-8cfa-48fa-8853-8be569753609/js/vapi-cachestorage.js:152:13
(Async: EventHandlerNonNull) getDb
moz-extension://a41ed17e-8cfa-48fa-8853-8be569753609/js/vapi-cachestorage.js:149:9
vAPI.cacheStorage<
moz-extension://a41ed17e-8cfa-48fa-8853-8be569753609/js/vapi-cachestorage.js:55:5
<anonymous>
moz-extension://a41ed17e-8cfa-48fa-8853-8be569753609/js/vapi-cachestorage.js:41:22
14:14:34.910 [uBlock0CacheStorage] 
abort
​
bubbles: true
​
cancelBubble: false
​
cancelable: false
​
composed: false
​
currentTarget: null
​
defaultPrevented: false
​
eventPhase: 0
​
explicitOriginalTarget: IDBTransaction { mode: "readwrite", db: IDBDatabase, error: DOMException, … }
​
isTrusted: true
​
originalTarget: IDBTransaction { mode: "readwrite", db: IDBDatabase, error: DOMException, … }
​
srcElement: IDBTransaction { mode: "readwrite", db: IDBDatabase, error: DOMException, … }
​
target: IDBTransaction { mode: "readwrite", db: IDBDatabase, error: DOMException, … }
​
timeStamp: 1050928
​
type: "abort"
​
<prototype>: EventPrototype { composedPath: composedPath(), stopPropagation: stopPropagation(), stopImmediatePropagation: stopImmediatePropagation(), … }
vapi-cachestorage.js:94:9
genericErrorHandler
moz-extension://a41ed17e-8cfa-48fa-8853-8be569753609/js/vapi-cachestorage.js:94:9
(Async: EventHandlerNonNull) getDb/req.onsuccess
moz-extension://a41ed17e-8cfa-48fa-8853-8be569753609/js/vapi-cachestorage.js:152:13
(Async: EventHandlerNonNull) getDb
moz-extension://a41ed17e-8cfa-48fa-8853-8be569753609/js/vapi-cachestorage.js:149:9
vAPI.cacheStorage<
moz-extension://a41ed17e-8cfa-48fa-8853-8be569753609/js/vapi-cachestorage.js:55:5
<anonymous>
moz-extension://a41ed17e-8cfa-48fa-8853-8be569753609/js/vapi-cachestorage.js:41:22
14:14:35.038 [Show/hide message details.] InvalidStateError: A mutation operation was attempted on a database that did not allow mutations. vapi-cachestorage.js:230
putToDb/<
moz-extension://a41ed17e-8cfa-48fa-8853-8be569753609/js/vapi-cachestorage.js:230:17
getDb
moz-extension://a41ed17e-8cfa-48fa-8853-8be569753609/js/vapi-cachestorage.js:115:20
putToDb
moz-extension://a41ed17e-8cfa-48fa-8853-8be569753609/js/vapi-cachestorage.js:219:9
set
moz-extension://a41ed17e-8cfa-48fa-8853-8be569753609/js/vapi-cachestorage.js:77:9
onReady
moz-extension://a41ed17e-8cfa-48fa-8853-8be569753609/js/assets.js:533:9
getAssetCacheRegistry
moz-extension://a41ed17e-8cfa-48fa-8853-8be569753609/js/assets.js:426:9
assetCacheWrite
moz-extension://a41ed17e-8cfa-48fa-8853-8be569753609/js/assets.js:536:5
onRemoteContentLoaded
moz-extension://a41ed17e-8cfa-48fa-8853-8be569753609/js/assets.js:791:9
onLocalLoadSuccess
moz-extension://a41ed17e-8cfa-48fa-8853-8be569753609/js/assets.js:217:9
onLoadEvent
moz-extension://a41ed17e-8cfa-48fa-8853-8be569753609/js/assets.js:128:9