This server periodically goes through the mods posted in the Celeste category on GameBanana, and saves a few files that may be used by various services that need to know more information about mods.
I'm currently running this server, some of its features are made available through APIs and others are used internally.
When running, the bot generates a file named uploads/everestupdate.yaml containing information on all Celeste mods published on GameBanana including an everest.yaml. For example:
SuperHotMod:
URL: https://gamebanana.com/mmdl/430983
GameBananaType: Mod
Version: 2.0.0
LastUpdate: 1567660611
Size: 26223
GameBananaId: 53639
GameBananaFileId: 430983
xxHash: [ab8e6117a0ef3cab]
MirrorURL: https://celestemodupdater.0x0a.de/banana-mirror/430983.zip- Everest uses this file for its "Check for Mod Updates" feature. For all mods someone has installed as a zip with an everest.yaml, Everest can check if the hash matches what is present in this file, to know if the mod is up-to-date (regardless of version number, since some modders don't update this one).
- The Banana Mirror Browser uses it to get the list of files present in the mirror.
This file is publicly accessible at https://maddie480.ovh/celeste/everest_update.yaml.
A file is generated at uploads/modsearchdatabase.yaml with extensive info about all mods. It can be used as a database of mod names, authors and descriptions on GameBanana. A mod in this file looks like this:
- PageURL: https://gamebanana.com/mods/150453
GameBananaType: Mod
GameBananaId: 150453
Name: Glyph
Author: marshall h
Description: Maddie goes on a journey through the mind & memories of one that are
not her own.
Likes: 94
Views: 202540
Downloads: 5860
Text: 'Hi thanks for playing this map! this was created by marshall h (marshall#9752
on discord)<br><br>I do this for fun and personal development, but I aspire to
do game development / music for a living someday, and I''d definitely appreciate
support. You can purchase the soundtrack for this Mod on <a href="https://mwhatt.bandcamp.com/releases"
target="_blank">Bandcamp</a>. [...]'
CreatedDate: 1588357721
ModifiedDate: 1641636742
UpdatedDate: 1638481949
Screenshots: ['https://images.gamebanana.com/img/ss/mods/60e5d6e408360.jpg']
MirroredScreenshots: ['https://celestemodupdater.0x0a.de/banana-mirror-images/img_ss_mods_60e5d6e408360.png']
Files:
- {Description: v2.3.2, HasEverestYaml: true, Size: 29179347, CreatedDate: 1638481866,
Downloads: 1471, URL: 'https://gamebanana.com/dl/703925', Name: glyph_d2f43.zip}
- {Description: v2.3.1, HasEverestYaml: true, Size: 23273323, CreatedDate: 1629786878,
Downloads: 466, URL: 'https://gamebanana.com/dl/643617', Name: glyph_d8867.zip}
- {Description: v2.3.0, HasEverestYaml: true, Size: 23270154, CreatedDate: 1626888153,
Downloads: 214, URL: 'https://gamebanana.com/dl/619609', Name: glyph_b4c4f.zip}
- {Description: v2.2.0, HasEverestYaml: true, Size: 18559501, CreatedDate: 1610265120,
Downloads: 2328, URL: 'https://gamebanana.com/dl/506897', Name: glyph_6ec44.zip}
CategoryId: 6800
CategoryName: Maps
Featured: {Category: alltime, Position: 1}- The GameBanana search API uses it to find mods.
- The GameBanana sorted list API (deprecated) uses it to be able to give a list of mod IDs sorted by likes, views, or downloads.
- The Banana Mirror Browser takes all mod information it displays (name, description, stats, etc) from it.
- The Custom Entity Catalog uses it to get category names for each listed mod.
This file is publicly accessible at https://maddie480.ovh/celeste/mod_search_database.yaml.
The mod files database is a folder contaning information about mods in the form of yaml files:
modfilesdatabase/list.yamlis a list of all detected modsmodfilesdatabase/file_ids.yamlis a list of all Celeste file IDs that exist on GameBanana. The ID is the number at the end of GameBanana file downloads:https://gamebanana.com/dl/xxxxxmodfilesdatabase/[itemtype]/[itemid]/info.yamlis a file containing the name of the mod and its file list:
Files: ['523435', '513691']
Name: Extended Variant Modemodfilesdatabase/[itemtype]/[itemid]/[fileid].yamlis a file listing all the zip contents. It will contain an empty list for anything that is not a zip.modfilesdatabase/[itemtype]/[itemid]/ahorn_[fileid].yamlis a file listing all Ahorn entity, trigger and effect IDs defined in[fileid]'s Ahorn plugins:
Triggers: [MaxHelpingHand/AllBlackholesStrengthTrigger, MaxHelpingHand/AmbienceVolumeTrigger,
MaxHelpingHand/CameraCatchupSpeedTrigger, MaxHelpingHand/ColorGradeFadeTrigger,
...]
Effects: [MaxHelpingHand/BlackholeCustomColors, MaxHelpingHand/CustomPlanets, MaxHelpingHand/CustomStars,
MaxHelpingHand/HeatWaveNoColorGrade, MaxHelpingHand/NorthernLightsCustomColors,
MaxHelpingHand/SnowCustomColors]
Entities: [MaxHelpingHand/CoreModeSpikesUp, MaxHelpingHand/CoreModeSpikesDown, MaxHelpingHand/CoreModeSpikesLeft,
MaxHelpingHand/CoreModeSpikesRight, MaxHelpingHand/CustomizableCrumblePlatform,
...]modfilesdatabase/[itemtype]/[itemid]/loenn_[fileid].yamlis a file listing all Lönn entity, trigger and effect IDs defined in[fileid]'s Lönn plugins, in the same format as Ahorn plugins above. This file only exists for zips that include aLoenn/lang/en_gb.langfile, since the detection is based on this file.modfilesdatabase/ahorn_vanilla.yamlis a list of all vanilla and Everest entities, triggers and effects defined in Maple, in the same format as above.modfilesdatabase/loenn_vanilla.yamlis a list of all vanilla and Everest entities, triggers and effects defined in Lönn, in the same format as above.
- The Custom Entity Catalog uses it to get the file names of Ahorn plugins, and be able to list out what each mod contains.
- The Mod Structure Verifier Discord bot uses it to know which assets each mod used as a dependency contains, and which entities helpers contain.
You can download the modfilesdatabase directory as a zip at https://maddie480.ovh/celeste/mod_files_database.zip.
The update checker uploads copies of the latest versions of all mods with an everest.yaml from GameBanana to a SFTP server, in order to have a backup in case of GameBanana issues or slowness.
It will do the same with the 2 first screenshots of each Celeste mod on GameBanana, after converting them to PNG and shrinking them to 220x220. Combine those mirrored files with the mod search database to get enough info to make a backup website in case GameBanana goes down.
Files and images are uploaded to 0x0ade's server. You can download all files directly from there directly, but since files are named after their GameBanana file IDs, you can use this website to navigate in it with mod names, descriptions and 1-click install buttons: https://maddie480.ovh/celeste/banana-mirror-browser
Everest and Olympus will also automatically use it as a substitute for GameBanana if it is down and you try to download or update a mod. Olympus uses the mirrored images instead of ones from GameBanana when they are in the webp format, since the mirror has them all converted to PNG.
This file is generated at uploads/moddependencygraph.yaml and lists what each mod in everestupdate.yaml depends on:
WitheredPassage:
OptionalDependencies: {}
Dependencies:
FrostHelper: 1.17.8
MoreDasheline: 1.6.0
Everest: 1.1884.0
MaxHelpingHand: 1.5.0
ContortHelper: 1.0.0
DJMapHelper: 1.8.13
URL: https://gamebanana.com/mmdl/484636The Custom Entity Catalog uses it to show how many mods depend on each helper.
This can also be used whenever it is needed to know which mods depend on a particular one, for example to evaluate impacts after a helper is deleted from GameBanana, or to check which mods have dependencies on big maps.
It is possible to download a mod and all dependencies, including transitive ones, by building a graph from this file.
This file is publicly accessible at https://maddie480.ovh/celeste/mod_dependency_graph.yaml, in an everest.yaml-like format:
WitheredPassage:
OptionalDependencies: []
Dependencies:
- Name: FrostHelper
Version: 1.17.8
- Name: MoreDasheline
Version: 1.6.0
- Name: Everest
Version: 1.1884.0
- Name: MaxHelpingHand
Version: 1.5.0
- Name: ContortHelper
Version: 1.0.0
- Name: DJMapHelper
Version: 1.8.13
URL: https://gamebanana.com/mmdl/484636You shouldn't need this unless Maddie vanishes from the Celeste community, but here it is anyway. 😅
You can get the update checker server by checking the Releases tab.
If you download this to take over Everest's update server, preferably ask Maddie for the latest yaml files to spare you some massive downloading from GameBanana.
Get Maven, then run the following command at the project root:
mvn clean package
This will build the project to target/update-checker-0.8.0.jar.
First, follow these steps to set it up:
- Get the JAR that was produced by Maven, or download it in the Releases tab.
- Fill in the
update_checker_config.yamlfile present in this repository with Banana Mirror info, and drop it in the same directory as the JAR.
Then, to run the project, browse to where the JAR is in a terminal / command prompt, then run
java -jar update-checker-0.8.0.jar [minutes]
[minutes] is the wait delay in minutes between two GameBanana checks (defaults to 30). Be aware that the program makes ~13 API calls per check, and that the GameBanana API has a cap at 250 requests/hour.
Some mods may need editing the database manually: that is, all cases where a mod offers multiple downloads. These cases need manual editing of the database.
Those mods be defined with two hashes in everestupdate.yaml, so that the updater can tell if the version the user has is one of the up-to-date ones.
DJMapHelper:
Version: 1.6.4
LastUpdate: 1552491224
xxHash: [a7334bfe1b464ee6, e04c6c7d01fdfbe3]
URL: https://gamebanana.com/mmdl/413533(Please note DJ Map Helper no longer has two separate downloads, and no mod currently needs this anymore, this is just an example if this happens again.)
Mods that have multiple entries in their everest.yaml (for example, Monika's D-Sides and Ruby'sEntities) will be registered multiple times in the database.
To prevent that from happening, you can add the ID of the mod you don't want in everestupdateexcluded.yaml:
Ruby'sEntities: Part of D-sides- SnakeYAML, licensed under the Apache License 2.0
- Apache Commons IO
- Apache Commons Lang
- Logback, licensed under GNU LGPL version 2.1
- LZ4 Java, licensed under Apache License 2.0, used for xxHash hash calculation
- JSch, licensed under a BSD-style license
- JSON in Java (license)
- Thumbnailator, licensed under the MIT license
- webp-imageio, licensed under the Apache License 2.0