Tool to generate a gradle-specified repository for Android and Java dependencies.
fetch_all.py [--help]
This script creates a temporary build directory, where it will, for each
of the dependencies specified in build.gradle
, take care of the following:
- Download the library
- Generate a README.chromium file
- Download the LICENSE
- Generate a GN target in BUILD.gn
- Generate .info files for AAR libraries
- Generate CIPD yaml files describing the packages
- Generate a
deps
entry in DEPS.
It will then compare the build directory with your current workspace, and print the differences (i.e. new/updated/deleted packages names).
Full steps to add a new third party library:
-
Add dependency to
build.gradle
-
Run
fetch_all.py
to verify the newbuild.gradle
file and that all dependencies could be downloaded properly. This does not modify your workspace. If not, fix yourbuild.gradle
file and try again. -
Run
fetch_all.py --update-all
to update your current workspace with the changes. This will update, among other things, your top-level DEPS file, and print a series of commands to create new CIPD packages.- Every package in CIPD has to have a unique tag other wise it will cause
problems. The cipd commands output by
fetch_all.py --update-all
already check for uniqueness of the tag before uploading a new version. You can also supply a new suffix in your package using FALLBACK_PROPERTIES in third_party/android_deps/buildSrc/src/main/groovy/ChromiumDepGraph.goovy
- Every package in CIPD has to have a unique tag other wise it will cause
problems. The cipd commands output by
-
Run the commands printed at step 3 to create new and updated packages via cipd.
- In order to do this, you will need write access. Ask anyone from this list to add you to the group.
- Just make sure to copy the commands exactly, as uploading an instance
with the same package and tag as an existing instance currently in use
can break all builds, and there is no easy way to delete an instance.
- If this happens, file an infra-trooper bug immediately.
-
Thoroughly test your change on a clean checkout.
- Run the following command:
rm -rf third_party/android_deps/libs/[!O]* && third_party/android_deps/fetch_all.py --update-all
. - This ensures that all your deps are fresh. You do not need to run the commands printed out in this step.
- Run the following command:
-
Create a commit & follow
//docs/adding_to_third_party.md
for the review.- This is not necessary if you are only upgrading existing packages or adding packages from the same source and license (e.g. gms)
Note that if you're not satisfied with the results, you can use
fetch_all.py --reset-workspace
to reset your workspace to its HEAD state,
including the original CIPD symlinks under
third_party/android_deps/repository/
. This commands preserves local
build.gradle
modifications.
If you are updating any of the gms dependencies, please ensure that the license file that they use, explained in the README.chromium is up-to-date with the one on android's website, last updated date is at the bottom.
The script invokes a Gradle plugin to leverage its dependency resolution features. An alternative way to implement it is to mix gradle to purely fetch dependencies and their pom.xml files, and use Python to process and generate the files. This approach was not as successful, as some information about the dependencies does not seem to be available purely from the POM file, which resulted in expecting dependencies that gradle considered unnecessary.