Skip to content

Yamato jobs refactor with Ruamel #127

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 98 commits into from
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
98 commits
Select commit Hold shift + click to select a range
9cd4125
draft of using ruamel to create yml files for universal project
Mar 12, 2020
7d67644
Merge branch 'master' into ruamel/refactor-yml-draft
Mar 17, 2020
8c15321
generalized jobs
Mar 19, 2020
17d884f
drafts for all projects
Mar 26, 2020
aabaf53
removed upm-ci prefixes
Mar 26, 2020
8d7a825
added editor priming draft
Mar 26, 2020
c878462
fixed testplatforms
Apr 2, 2020
889b990
merged non-standalone jobs
Apr 2, 2020
dac94c9
added --upgrade, upm_registry and rtx2080
Apr 2, 2020
cc8d980
plain conversion of existing abv jobs to python
Apr 2, 2020
52d0062
plain conversion of packages into python
Apr 6, 2020
e41408c
separated files
Apr 7, 2020
838b242
added packages
Apr 8, 2020
9efd969
added abv files
Apr 8, 2020
2ceb12b
Merge branch 'master' into ruamel/refactor-yml-draft
Apr 8, 2020
7406f9f
added android, get jobids and files as functions
Apr 8, 2020
f5e7a11
added split osx_metal and linux
Apr 14, 2020
8b98a35
more changes with splits
Apr 14, 2020
896c96d
removed split property check, and split hdrp_dxr
Apr 15, 2020
b8274f3
fix for missing api.name and api.cmd
Apr 16, 2020
34f3c33
testplatformargs parameter for build
Apr 16, 2020
3eb0c73
removed agents from toplevel jobs
Apr 16, 2020
cda44d7
made nightly dependent on abv, extended abv config
Apr 16, 2020
52a55ce
fixed typo on packages
Apr 17, 2020
127f611
use paths as constants
Apr 17, 2020
f27e352
moved agents to metafiles
Apr 17, 2020
9a061e2
smoke test folder name
Apr 17, 2020
9b85b4e
removed test_dependencies from all_package_ci
Apr 17, 2020
9a12df5
added hybrids
Apr 20, 2020
0824ba4
construct yml by class instead of dict
Apr 20, 2020
724e006
append commands
Apr 20, 2020
d1172d5
moved all job definition func inside classes
Apr 20, 2020
e195e87
renamed module
Apr 20, 2020
7fffa40
some more tiny changes
Apr 20, 2020
40b9137
remove missed upm-ci path
Apr 20, 2020
cf3a8b3
added preview_publish
Apr 22, 2020
cd828a9
added template jobs
Apr 22, 2020
4aa9f07
replaced umpci url
Apr 22, 2020
a529915
change to defaultdict to avoid overwriting values
Apr 22, 2020
e1797db
added dx12 to urp and nightly
Apr 24, 2020
23a2fb4
everything synced with master, except project ymls
Apr 24, 2020
2283dbe
merge hdrp_standalone into hdrp
Apr 27, 2020
62990bd
append triggers instead of overwrite
Apr 27, 2020
68b428d
temporarily remove subdirectories for project ymls and copy all jobs …
Apr 27, 2020
bc2b71d
renamed all_ jobs, clean up old jobs on the go
Apr 27, 2020
c586868
added rest of the editor versions
Apr 27, 2020
461ad76
save automatically to root directory, no need for copy script
Apr 27, 2020
358bc88
added some comments to metafiles
Apr 27, 2020
7a466f0
Squashe merge master into refactor
May 1, 2020
d6dafcd
change utr slash
May 1, 2020
61d92b3
switch utr slash for win in ymls
May 1, 2020
7f26c48
switch to notsplit build for osx_metal
May 1, 2020
f30b58c
switch to notsplit build for linux
May 1, 2020
d1618d3
remove osx_openglcore standalone jobs
May 1, 2020
081de21
add nightly dependency for package publish jobs
May 1, 2020
ffce7d3
change packages path
May 4, 2020
a2942cd
add artifacts-path on pack
May 4, 2020
d72c755
switch the path again for pack
May 4, 2020
3202cdf
add upm-ci back
May 4, 2020
d6e7e3c
update templates path
May 4, 2020
d347e5e
fix typo
May 4, 2020
e25121c
updated copycmd
May 4, 2020
0384d7b
added upm-ci back to templates copycmd
May 4, 2020
20ea6e3
remove standalone from linux openglcore
May 6, 2020
edea49c
fix hdrp test folders
May 6, 2020
8575a07
add standalone to hdrp all
May 6, 2020
1377c6b
add standalone to hdrp ymls too
May 6, 2020
19295f2
remove linux openglcore for hdrp
May 6, 2020
e2b85c0
merge hdrp standalone with hdrp in abv
May 11, 2020
a9e374f
sync vfxmain with hdrp platforms
May 11, 2020
ee0590e
comment out urp dx12 for now
May 11, 2020
176b424
remove urp dx12 also from all_ job
May 11, 2020
655e982
add new preview publish jobs
May 15, 2020
914f4b4
add editors to shared file and update rerun strategy to always
May 15, 2020
0f33c1e
abv get rerun strategy from shared file
May 15, 2020
426d8b3
specify target branch in one shared location
May 15, 2020
6c52853
allow overriding shared editors in specific files
May 15, 2020
32e619d
add iphone for urp
May 18, 2020
2d603de
remove hardcoded build player paths
May 18, 2020
4279671
add ios in editor
May 18, 2020
7dbd9bb
added platforms to shared file with option to override (for projects)
May 20, 2020
1b37a2d
renamed some fields
May 20, 2020
b1f225f
moved testplatforms to shared
May 20, 2020
85e1130
update nonproject jobs to use the shared file
May 20, 2020
635d489
unified dependencies between abv and all_
May 20, 2020
14a0066
added hdrp depencencies to dx12, vulkan and dxr
May 20, 2020
79d3e0d
update abv dependencies, remove 2020.1 jobs
May 20, 2020
62209a9
updated abv to use editors supported by current master
May 20, 2020
befc85f
use shared agents in packages and templates
May 20, 2020
41d283a
fix playmode underscores
May 20, 2020
1534619
specify trunk verification jobs in metafile, add missing standalone t…
May 20, 2020
51242a1
Squash merge from master
May 24, 2020
f15e48d
Revert "Squash merge from master"
May 24, 2020
c9041ae
Squash merge again
May 24, 2020
8a8f01e
Revert "Squash merge again"
May 24, 2020
d712308
fix utr cmd for smoke test
May 24, 2020
46cce91
some small fixes
May 24, 2020
b4fe012
change players path for win standalone
May 25, 2020
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
The diff you're trying to view is too large. We only load the first 3000 changed files.
2 changes: 1 addition & 1 deletion .github/PULL_REQUEST_TEMPLATE.md
Original file line number Diff line number Diff line change
Expand Up @@ -33,7 +33,7 @@ Why is this PR needed, what hard problem is it solving/fixing?
**Automated Tests**: What did you setup? (Add a screenshot or the reference image of the test please)

**Yamato**: (Select your branch):
https://yamato.prd.cds.internal.unity3d.com/jobs/78-ScriptableRenderPipeline
https://yamato.prd.cds.internal.unity3d.com/jobs/902-Graphics

Any test projects to go with this to help reviewers?

Expand Down
363 changes: 363 additions & 0 deletions .yamato/_abv.yml

Large diffs are not rendered by default.

275 changes: 275 additions & 0 deletions .yamato/_editor.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,275 @@
editor:priming:trunk:macos:
name: '[trunk,macos] Editor priming'
agent:
type: Unity::VM
image: cds-ops/ubuntu-16.04-base:stable
flavor: b1.small
skip_checkout: true
variables:
PATH: /home/bokken/bin:/home/bokken/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/home/bokken/.npm-global/bin
DISPLAY: ":0"
UPM_REGISTRY: https://artifactory-slo.bf.unity3d.com/artifactory/api/npm/upm-candidates
commands:
- pip install unity-downloader-cli --user --upgrade --extra-index-url https://artifactory.internal.unity3d.com/api/pypi/common-python/simple --upgrade
- unity-downloader-cli -u trunk -o macos --wait --skip-download -c editor -c il2cpp > unity_revision.txt
artifacts:
unity_revision.zip:
paths:
- "unity_revision.txt"
editor:priming:fast-trunk:macos:
name: '[fast-trunk,macos] Editor priming'
agent:
type: Unity::VM
image: cds-ops/ubuntu-16.04-base:stable
flavor: b1.small
skip_checkout: true
variables:
PATH: /home/bokken/bin:/home/bokken/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/home/bokken/.npm-global/bin
DISPLAY: ":0"
UPM_REGISTRY: https://artifactory-slo.bf.unity3d.com/artifactory/api/npm/upm-candidates
commands:
- pip install unity-downloader-cli --user --upgrade --extra-index-url https://artifactory.internal.unity3d.com/api/pypi/common-python/simple --upgrade
- unity-downloader-cli -u trunk --fast -o macos --wait --skip-download -c editor -c il2cpp > unity_revision.txt
artifacts:
unity_revision.zip:
paths:
- "unity_revision.txt"
editor:priming:CUSTOM-REVISION:macos:
name: '[CUSTOM-REVISION,macos] Editor priming'
agent:
type: Unity::VM
image: cds-ops/ubuntu-16.04-base:stable
flavor: b1.small
skip_checkout: true
variables:
PATH: /home/bokken/bin:/home/bokken/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/home/bokken/.npm-global/bin
DISPLAY: ":0"
UPM_REGISTRY: https://artifactory-slo.bf.unity3d.com/artifactory/api/npm/upm-candidates
CUSTOM_REVISION: custom_revision_not_set
commands:
- pip install unity-downloader-cli --user --upgrade --extra-index-url https://artifactory.internal.unity3d.com/api/pypi/common-python/simple --upgrade
- unity-downloader-cli -u $CUSTOM_REVISION -o macos --wait --skip-download -c editor -c il2cpp > unity_revision.txt
artifacts:
unity_revision.zip:
paths:
- "unity_revision.txt"
editor:priming:trunk:android:
name: '[trunk,android] Editor priming'
agent:
type: Unity::VM
image: cds-ops/ubuntu-16.04-base:stable
flavor: b1.small
skip_checkout: true
variables:
PATH: /home/bokken/bin:/home/bokken/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/home/bokken/.npm-global/bin
DISPLAY: ":0"
UPM_REGISTRY: https://artifactory-slo.bf.unity3d.com/artifactory/api/npm/upm-candidates
commands:
- pip install unity-downloader-cli --user --upgrade --extra-index-url https://artifactory.internal.unity3d.com/api/pypi/common-python/simple --upgrade
- unity-downloader-cli -u trunk -o windows --wait --skip-download -c editor -c il2cpp -c android > unity_revision.txt
artifacts:
unity_revision.zip:
paths:
- "unity_revision.txt"
editor:priming:fast-trunk:android:
name: '[fast-trunk,android] Editor priming'
agent:
type: Unity::VM
image: cds-ops/ubuntu-16.04-base:stable
flavor: b1.small
skip_checkout: true
variables:
PATH: /home/bokken/bin:/home/bokken/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/home/bokken/.npm-global/bin
DISPLAY: ":0"
UPM_REGISTRY: https://artifactory-slo.bf.unity3d.com/artifactory/api/npm/upm-candidates
commands:
- pip install unity-downloader-cli --user --upgrade --extra-index-url https://artifactory.internal.unity3d.com/api/pypi/common-python/simple --upgrade
- unity-downloader-cli -u trunk --fast -o windows --wait --skip-download -c editor -c il2cpp -c android > unity_revision.txt
artifacts:
unity_revision.zip:
paths:
- "unity_revision.txt"
editor:priming:CUSTOM-REVISION:android:
name: '[CUSTOM-REVISION,android] Editor priming'
agent:
type: Unity::VM
image: cds-ops/ubuntu-16.04-base:stable
flavor: b1.small
skip_checkout: true
variables:
PATH: /home/bokken/bin:/home/bokken/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/home/bokken/.npm-global/bin
DISPLAY: ":0"
UPM_REGISTRY: https://artifactory-slo.bf.unity3d.com/artifactory/api/npm/upm-candidates
CUSTOM_REVISION: custom_revision_not_set
commands:
- pip install unity-downloader-cli --user --upgrade --extra-index-url https://artifactory.internal.unity3d.com/api/pypi/common-python/simple --upgrade
- unity-downloader-cli -u $CUSTOM_REVISION -o windows --wait --skip-download -c editor -c il2cpp -c android > unity_revision.txt
artifacts:
unity_revision.zip:
paths:
- "unity_revision.txt"
editor:priming:trunk:windows:
name: '[trunk,windows] Editor priming'
agent:
type: Unity::VM
image: cds-ops/ubuntu-16.04-base:stable
flavor: b1.small
skip_checkout: true
variables:
PATH: /home/bokken/bin:/home/bokken/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/home/bokken/.npm-global/bin
DISPLAY: ":0"
UPM_REGISTRY: https://artifactory-slo.bf.unity3d.com/artifactory/api/npm/upm-candidates
commands:
- pip install unity-downloader-cli --user --upgrade --extra-index-url https://artifactory.internal.unity3d.com/api/pypi/common-python/simple --upgrade
- unity-downloader-cli -u trunk -o windows --wait --skip-download -c editor -c il2cpp > unity_revision.txt
artifacts:
unity_revision.zip:
paths:
- "unity_revision.txt"
editor:priming:fast-trunk:windows:
name: '[fast-trunk,windows] Editor priming'
agent:
type: Unity::VM
image: cds-ops/ubuntu-16.04-base:stable
flavor: b1.small
skip_checkout: true
variables:
PATH: /home/bokken/bin:/home/bokken/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/home/bokken/.npm-global/bin
DISPLAY: ":0"
UPM_REGISTRY: https://artifactory-slo.bf.unity3d.com/artifactory/api/npm/upm-candidates
commands:
- pip install unity-downloader-cli --user --upgrade --extra-index-url https://artifactory.internal.unity3d.com/api/pypi/common-python/simple --upgrade
- unity-downloader-cli -u trunk --fast -o windows --wait --skip-download -c editor -c il2cpp > unity_revision.txt
artifacts:
unity_revision.zip:
paths:
- "unity_revision.txt"
editor:priming:CUSTOM-REVISION:windows:
name: '[CUSTOM-REVISION,windows] Editor priming'
agent:
type: Unity::VM
image: cds-ops/ubuntu-16.04-base:stable
flavor: b1.small
skip_checkout: true
variables:
PATH: /home/bokken/bin:/home/bokken/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/home/bokken/.npm-global/bin
DISPLAY: ":0"
UPM_REGISTRY: https://artifactory-slo.bf.unity3d.com/artifactory/api/npm/upm-candidates
CUSTOM_REVISION: custom_revision_not_set
commands:
- pip install unity-downloader-cli --user --upgrade --extra-index-url https://artifactory.internal.unity3d.com/api/pypi/common-python/simple --upgrade
- unity-downloader-cli -u $CUSTOM_REVISION -o windows --wait --skip-download -c editor -c il2cpp > unity_revision.txt
artifacts:
unity_revision.zip:
paths:
- "unity_revision.txt"
editor:priming:trunk:linux:
name: '[trunk,linux] Editor priming'
agent:
type: Unity::VM
image: cds-ops/ubuntu-16.04-base:stable
flavor: b1.small
skip_checkout: true
variables:
PATH: /home/bokken/bin:/home/bokken/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/home/bokken/.npm-global/bin
DISPLAY: ":0"
UPM_REGISTRY: https://artifactory-slo.bf.unity3d.com/artifactory/api/npm/upm-candidates
commands:
- pip install unity-downloader-cli --user --upgrade --extra-index-url https://artifactory.internal.unity3d.com/api/pypi/common-python/simple --upgrade
- unity-downloader-cli -u trunk -o linux --wait --skip-download -c editor -c il2cpp > unity_revision.txt
artifacts:
unity_revision.zip:
paths:
- "unity_revision.txt"
editor:priming:fast-trunk:linux:
name: '[fast-trunk,linux] Editor priming'
agent:
type: Unity::VM
image: cds-ops/ubuntu-16.04-base:stable
flavor: b1.small
skip_checkout: true
variables:
PATH: /home/bokken/bin:/home/bokken/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/home/bokken/.npm-global/bin
DISPLAY: ":0"
UPM_REGISTRY: https://artifactory-slo.bf.unity3d.com/artifactory/api/npm/upm-candidates
commands:
- pip install unity-downloader-cli --user --upgrade --extra-index-url https://artifactory.internal.unity3d.com/api/pypi/common-python/simple --upgrade
- unity-downloader-cli -u trunk --fast -o linux --wait --skip-download -c editor -c il2cpp > unity_revision.txt
artifacts:
unity_revision.zip:
paths:
- "unity_revision.txt"
editor:priming:CUSTOM-REVISION:linux:
name: '[CUSTOM-REVISION,linux] Editor priming'
agent:
type: Unity::VM
image: cds-ops/ubuntu-16.04-base:stable
flavor: b1.small
skip_checkout: true
variables:
PATH: /home/bokken/bin:/home/bokken/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/home/bokken/.npm-global/bin
DISPLAY: ":0"
UPM_REGISTRY: https://artifactory-slo.bf.unity3d.com/artifactory/api/npm/upm-candidates
CUSTOM_REVISION: custom_revision_not_set
commands:
- pip install unity-downloader-cli --user --upgrade --extra-index-url https://artifactory.internal.unity3d.com/api/pypi/common-python/simple --upgrade
- unity-downloader-cli -u $CUSTOM_REVISION -o linux --wait --skip-download -c editor -c il2cpp > unity_revision.txt
artifacts:
unity_revision.zip:
paths:
- "unity_revision.txt"
editor:priming:trunk:ios:
name: '[trunk,ios] Editor priming'
agent:
type: Unity::VM
image: cds-ops/ubuntu-16.04-base:stable
flavor: b1.small
skip_checkout: true
variables:
PATH: /home/bokken/bin:/home/bokken/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/home/bokken/.npm-global/bin
DISPLAY: ":0"
UPM_REGISTRY: https://artifactory-slo.bf.unity3d.com/artifactory/api/npm/upm-candidates
commands:
- pip install unity-downloader-cli --user --upgrade --extra-index-url https://artifactory.internal.unity3d.com/api/pypi/common-python/simple --upgrade
- unity-downloader-cli -u trunk -o macos --wait --skip-download -c editor -c iOS > unity_revision.txt
artifacts:
unity_revision.zip:
paths:
- "unity_revision.txt"
editor:priming:fast-trunk:ios:
name: '[fast-trunk,ios] Editor priming'
agent:
type: Unity::VM
image: cds-ops/ubuntu-16.04-base:stable
flavor: b1.small
skip_checkout: true
variables:
PATH: /home/bokken/bin:/home/bokken/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/home/bokken/.npm-global/bin
DISPLAY: ":0"
UPM_REGISTRY: https://artifactory-slo.bf.unity3d.com/artifactory/api/npm/upm-candidates
commands:
- pip install unity-downloader-cli --user --upgrade --extra-index-url https://artifactory.internal.unity3d.com/api/pypi/common-python/simple --upgrade
- unity-downloader-cli -u trunk --fast -o macos --wait --skip-download -c editor -c iOS > unity_revision.txt
artifacts:
unity_revision.zip:
paths:
- "unity_revision.txt"
editor:priming:CUSTOM-REVISION:ios:
name: '[CUSTOM-REVISION,ios] Editor priming'
agent:
type: Unity::VM
image: cds-ops/ubuntu-16.04-base:stable
flavor: b1.small
skip_checkout: true
variables:
PATH: /home/bokken/bin:/home/bokken/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/sbin:/home/bokken/.npm-global/bin
DISPLAY: ":0"
UPM_REGISTRY: https://artifactory-slo.bf.unity3d.com/artifactory/api/npm/upm-candidates
CUSTOM_REVISION: custom_revision_not_set
commands:
- pip install unity-downloader-cli --user --upgrade --extra-index-url https://artifactory.internal.unity3d.com/api/pypi/common-python/simple --upgrade
- unity-downloader-cli -u $CUSTOM_REVISION -o macos --wait --skip-download -c editor -c iOS > unity_revision.txt
artifacts:
unity_revision.zip:
paths:
- "unity_revision.txt"
Loading