Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Prevent cookie lists from being selected at the same time #3231

Open
9 tasks done
ghost opened this issue May 5, 2024 · 15 comments
Open
9 tasks done

Prevent cookie lists from being selected at the same time #3231

ghost opened this issue May 5, 2024 · 15 comments

Comments

@ghost
Copy link

ghost commented May 5, 2024

Prerequisites

  • I verified that this is not a filter list issue. Report any issues with filter lists or broken website functionality in the uAssets issue tracker.
  • This is NOT a YouTube, Facebook or Twitch report. These sites MUST be reported by clicking their respective links.
  • This is not a support issue or a question. For support, questions, or help, visit /r/uBlockOrigin.
  • I performed a cursory search of the issue tracker to avoid opening a duplicate issue.
  • The issue is not present after disabling uBO in the browser.
  • I checked the documentation to understand that the issue I am reporting is not normal behavior.

I tried to reproduce the issue when...

  • uBO is the only extension.
  • uBO uses default lists and settings.
  • using a new, unmodified browser profile.

Description

AdGuard/uBO – Cookie Notices and EasyList/uBO – Cookie Notices have filters that reload webpages after changing cookie values.

If they're programmed to set cookies to different values, this may cause an infinite refresh loop.

Consider adding a check to prevent them from being selected at the same time. This would prevent conflicts without having to remove either list from the extension.

If a user has selected EasyList/uBO – Cookie Notices, and then click on AdGuard/uBO – Cookie Notices , the extension will deselect EasyList/uBO – Cookie Notices, and vice-versa.

A specific URL where the issue occurs.

See https://github.com/uBlockOrigin/uAssets/issues/23562

Steps to Reproduce

Expected behavior

Actual behavior

uBO version

1.57.2

Browser name and version

Firefox 125.0.3

Operating System and version

Hannah Montana Linux

@ghost ghost mentioned this issue May 5, 2024
11 tasks
@jackrjli
Copy link

jackrjli commented May 5, 2024

This kind of breakage can occur with any list that uses set-cookie/set-cookie-reload. Making people choose either AdGuard or EasyList Cookie Notices wouldn't solve the issue beyond this particular case, and would get in the way of people with legitimate reasons to use both lists (they don't cover all the same sites).

@u-RraaLL
Copy link
Contributor

u-RraaLL commented May 5, 2024

I wonder if uBO should discard a second filter trying to set the same cookie just as if it were an exact duplicate.

@stephenhawk8054
Copy link
Member

stephenhawk8054 commented May 5, 2024

There were actually other issues prior to the above case with 2 cookie lists conflicted to each other. I agree with the solution of only choosing 1 list for cookie. Other lists can use set-cookie but these 2 setlists are the ones using it the most extensively and can highly likely cause conflictions, especially when this is the only scriptlet with a reload option which can cause more severe issue than other filters.

We don't encourage users to enable more lists to cover different sites any way, and all of the breakages will just be reported to uBO volunteers to solve. Breakage is always a more important issue than lack of sites' coverages. Reporting to respective list maintainers is the correct way to solve the latter.

@u-RraaLL
Copy link
Contributor

u-RraaLL commented May 5, 2024

Agreed. In this particular case, though, the user had a custom AG Annoyance added to his lists (instead of enabled AG Cookie Notices itself), so the issue would've still arisen.

@stephenhawk8054
Copy link
Member

Yes, I think we can just try to cover the most obvious/popular case here since it's impossible to cover all edge cases (even the same list can have same issue if there are some mistakes)

@gorhill
Copy link
Member

gorhill commented May 5, 2024

Consider adding a check to prevent them from being selected at the same time. This would prevent conflicts without having to remove either list from the extension.

This would make it difficult to diagnose filter issues since whichever one takes effect first is undetermined.

@garry-ut99
Copy link

garry-ut99 commented May 5, 2024

The most conflicts are between EasyList cookies and AdGuard cookies, but on the other hand the both lists are reasonably unique and are good supplements to each other, hence forcing to "enable only one cookie list at once" will significantly reduce the effectiveness of blocking cookie notices, the optimal solution would be to fix conflicts at set-cookie scriptlet level if possible.

@krystian3w
Copy link

In the past set-constant was similar breakage: #156 (comment)

@ghost
Copy link
Author

ghost commented May 6, 2024

This would make it difficult to diagnose filter issues since whichever one takes effect first is undetermined.

My proposal is to make it possible to select only one of them in the GUI.

By "without having to remove either list from the extension", I meant "without having to remove them from the list of available lists" (in the other issue, someone hinted that you should remove the AdGuard list from uBlock Origin altogether).

@gorhill
Copy link
Member

gorhill commented Jul 5, 2024

Originally, a long time ago, the AdGuard lists were introduced as stock lists because EasyList lists didn't support extended filtering syntax, limiting itself to only ABP-compatible syntax. It has been a while now that EasyList supports extended syntax, and it might be that AdGuard's lists are no longer needed -- so maybe we should just remove them as stock lists? (Except where there is no alternative)

@dportvine
Copy link

As far as I can see, the problem will only be with the rules for mobile. Rules for them can be added to EasyList and regional lists. If this is a complex case, add it to uBlock filters.

@garry-ut99
Copy link

AdGuard filter lists are good supplements for EasyList/uBlock filter lists because they cover big amount of unique websites not covered by EasyList/uBlock filter lists, these websites can be covered in EasyList/uBlock over time, but it will take months or years for EasyList/uBlock filter lists to catch up the similiar coverage. Statistics show that 36% of uBlock users have at least 1 AdGuard filter list enabled.

On the other hand, keeping AdGuard lists in uBlock, causes occasional conflicts/breakages, and inhibits the growth rate of EasyList/uBlock own filters, because less sites are reported to EasyList/uBlock's filter trackers, by users who have AdGuard lists enabled. Removing AdGuard lists from uBlock will cause some of these users to re-add AdGuard lists via "Import" list feature, but some other users will not re-add and will start reporting uncovered sites to EasyList/uBlock filter trackers, helping and assisting in the growth of EasyList/uBlock own filters.

The explanation of why AdGuard dominated EasyList/uBlock filter lists, in number of websites, is:

  • AdGuard introduced built-in website reporting feature years ago before uBlock
  • AdGuard built-in website reporting feature doesn't require github account to report websites

it caused AdGuard to achieve a massive amount of websites reported: ~170000 issues reported on their AdGuard filter tracker, compared to ~41000 on [ EasyList (~21000) + uAssets (~20000) ] filter trackers combined.

(the calculations for EasyList-related filter reports are the following: 1502 in Fanboy old tracker + [ 7430 in EasyList new tracker + 22923 EasyList forum tracker 1 + 8157 EasyList forum tracker 2 ] / 2 = 1502 + 38510 / 2 = ~21000, it has been divided by 2 because we need to exclude websites reports related to main EasyList, which I don't know how many % it is, so I just blind-shooted to be 50%, because it would be too difficult and time-consuming to calculate precisely).

Now is time to decide: either EasyList/uBlock still includes AdGuard useful lists, or drop them to fix conflicts and to grow faster on its own at the cost of a noticeable reduction in effectiveness (amount of websites covered).

@Marko-98
Copy link

Just stumbled upon this issue and was thinking about reporting it. Now I see I'm not the only one...

Recording.2024-07-30.093928.mp4

@krystian3w
Copy link

That is correct, GDPR at this page block load videos: AdguardTeam/AdguardFilters#137106

Therefore, you should check how to unblock the video in EasyList Cookies to eventually finally repair the player in uBo Cookie Notices.

@Marko-98
Copy link

Marko-98 commented Aug 2, 2024

That is correct, GDPR at this page block load videos: AdguardTeam/AdguardFilters#137106

Therefore, you should check how to unblock the video in EasyList Cookies to eventually finally repair the player in uBo Cookie Notices.

Huh, I didn't realize the videos aren't working (I'm not visiting this website often). But I will open an issue on uAssets regarding this.

Edited: Issue reported here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

8 participants