Add a script to update the region/geolocation files

[absidue]

Add a script to update the region/geolocation files

Pull Request Type

• Bugfix
• Feature Implementation

Related issue

close #3441

Description

Currently FreeTube lists a bunch geolocations for trending that YouTube doesn't support and is also missing some that YouTube does support, this is because the locations were taken from a repository that had location information translated into various different languages.

This pull request adds a script that extracts the geolocations from YouTube in as many of the active languages in FreeTube as possible, that way we have an accurate list and also have them translated into various different languages.

For some languages I've added manual mappings, like French which is fr-FR in FreeTube but fr on YouTube.

The script currently only collects geolocation translations for whitelisted/active languages in FreeTube, it doesn't for any of the other languages.

Here is the script output:

yarn get-regions
yarn run v1.22.19
$ node _scripts/getRegions.mjs
Active FreeTube languages that aren't available on YouTube:
[ 'es-MX', 'es_AR', 'he', 'pt-BR' ]
YouTube languages that don't have an equivalent active FreeTube language:
[
  'af',     'am',    'as',    'az',
  'be',     'bn',    'bs',    'en-IN',
  'es-419', 'es-US', 'fa',    'fil',
  'fr-CA',  'gu',    'hi',    'hy',
  'iw',     'ka',    'kk',    'km',
  'kn',     'ky',    'lo',    'lv',
  'mk',     'ml',    'mn',    'mr',
  'ms',     'my',    'ne',    'or',
  'pa',     'si',    'sq',    'sr-Latn',
  'sw',     'ta',    'te',    'th',
  'ur',     'uz',    'zh-HK', 'zu'
]
Done in 2.70s.

Screenshots

Testing

Test trending with various locations, none of them should error like they did before.

[PikachuEXE]

What do you mean by "Test trending with various locations" ?_?
On of the options in settings? (I haven't used that part ever)

[efb4f5ff-1298-471a-8973-3d47447115dc]

Messaging should be changed.

Not sure if we need to do anything about this but if u select some languages the alphabetic order of the list gets a bit messed up.

VirtualBoxVM_CtQbk8SbMw.mp4

VirtualBoxVM_g0iU9pMSu1.mp4

[absidue]

Added language sensitive sorting, the only language that changed was de-DE, I even intentionally changed the order of the cs language but it went back to putting Chile after Hong Kong, so in the first video the sorting seems to be correct.

[github-actions]

This pull request has conflicts, please resolve those before we can evaluate the pull request.

[github-actions]

Conflicts have been resolved. A maintainer will review the pull request shortly.

[absidue]

Removed the extra sentence and added sorting for the languages, any that looks incorrectly sorted now, is correct unless the standard javascript Intl.Collator API is broken, which i highly doubt.