Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Conda Publishing #17889

Merged
merged 61 commits into from
Apr 13, 2021
Merged
Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
61 commits
Select commit Hold shift + click to select a range
ae2730d
skeleton getting set up for the addition of conda artifacts to our bu…
scbedd Mar 26, 2021
8dcf31b
pass CondaArtifacts to jobs/archetype-sdk-client.yml
scbedd Mar 26, 2021
4e635bb
fix a couple issues with bad yaml that daniel identified
scbedd Mar 26, 2021
16cc743
more scaffolding! almost ready to get the builds working!
scbedd Mar 27, 2021
aaf6296
fully flesh out the structure that creates the combined SDIST.
scbedd Mar 29, 2021
689ad60
adding skeleton. time to combine the sdists
scbedd Mar 29, 2021
6830924
updating the location of the yaml for get-tagged-code
scbedd Mar 29, 2021
ae60d48
adding the steps to combine output and generate a combined sdist from…
scbedd Mar 30, 2021
e76bd01
apply black
scbedd Mar 30, 2021
907e483
clean up the failing builds
scbedd Mar 30, 2021
e9a1fb0
sdists should assemble now!
scbedd Mar 30, 2021
a7d5753
resolve spacing issues
scbedd Mar 30, 2021
ec593f4
update to clean up the targetPath of the clone
scbedd Mar 30, 2021
ec71549
correct a pshell boolean comparison
scbedd Mar 30, 2021
9582a88
resolve issue with setting the Package.Clone location
scbedd Mar 30, 2021
bcd5a45
correct target path
scbedd Mar 30, 2021
bf499cf
add debug output to build_conda_artifacts.py. pass the actual artifac…
scbedd Mar 31, 2021
bcdc24f
temporarily disable docs build
scbedd Mar 31, 2021
c2712d9
cleanup progress
scbedd Mar 31, 2021
1c66f77
add final pieces! almost there!
scbedd Mar 31, 2021
f271ce4
don't call activate
scbedd Mar 31, 2021
4d783b8
call it appropriately
scbedd Mar 31, 2021
59c3aed
default conda to pshell
scbedd Mar 31, 2021
f0cc2d0
swap to use bash instead of pwsh tasks.
scbedd Mar 31, 2021
79dd0ea
remove bad commands
scbedd Mar 31, 2021
d66d4ab
proper print
scbedd Mar 31, 2021
5116bd7
swap the conda environment to be named on a per artifact basis
scbedd Mar 31, 2021
352a275
additional documentation
scbedd Apr 2, 2021
2726c6c
line items
scbedd Apr 2, 2021
f345f43
add the core artifact such that it builds before we do.
scbedd Apr 5, 2021
4f5b220
storage needed a requirement update
scbedd Apr 5, 2021
55a5571
handle singular artifact (build the target only). pull from for combi…
scbedd Apr 6, 2021
eb0bd26
add azsdk channel to conda build invocation
scbedd Apr 7, 2021
019edef
resolve conflicts
scbedd Apr 7, 2021
65f2b10
remove wonky pre-dep
scbedd Apr 7, 2021
895fd32
disable build docs until we're satisfied with the results. add missin…
scbedd Apr 7, 2021
603be52
fixed small bug
scbedd Apr 7, 2021
6089976
resolve yml vs yaml naming issues
scbedd Apr 8, 2021
87fec6c
update requests-oauthlib to actually have the correct name!
scbedd Apr 8, 2021
cec19c2
handle generation issues with the sdist
scbedd Apr 8, 2021
fca430d
resolve issue with single dependency conda builds
scbedd Apr 8, 2021
cdae4a0
black. add comment describing the build folder requirement.
scbedd Apr 8, 2021
f4ab22c
the manifest.in that gets output
scbedd Apr 8, 2021
7f509bd
Update sdk/storage/ci.yml
scbedd Apr 9, 2021
df38c20
Apply suggestions from code review
scbedd Apr 10, 2021
35ea605
update to remove doc disable. update the template to remove py35 and …
scbedd Apr 10, 2021
3c3030e
Merge branch 'feature/add-conda-publishing' of https://github.com/Azu…
scbedd Apr 10, 2021
608ab46
correct a slight spelling issue
scbedd Apr 10, 2021
dec9710
update to consume common template
scbedd Apr 12, 2021
75c87db
cannot have muliple checkout: none steps in the same job
scbedd Apr 12, 2021
a4b0206
disable checkout: none
scbedd Apr 12, 2021
1995e9d
correct yml syntax
scbedd Apr 12, 2021
05579ab
dumb typo
scbedd Apr 12, 2021
69539a7
debugging
scbedd Apr 12, 2021
dbf667d
instead of using temp directory, try using the sources directory
scbedd Apr 12, 2021
f4ea5ad
stop attempting to clean up. clone to fresh directory each time
scbedd Apr 12, 2021
12fae40
merge master
scbedd Apr 12, 2021
a054d66
undo changes to sparse-checkout
scbedd Apr 13, 2021
9cd849e
restore to master
scbedd Apr 13, 2021
7b120ed
make my own safename
scbedd Apr 13, 2021
bc53822
update name of the conda release so a dev can discern the difference
scbedd Apr 13, 2021
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
add debug output to build_conda_artifacts.py. pass the actual artifac…
…t name to the build script
  • Loading branch information
scbedd committed Mar 31, 2021
commit bf499cfe03994cc7c6984680e32589d5af026759
2 changes: 1 addition & 1 deletion eng/pipelines/templates/steps/build-conda-artifacts.yml
Original file line number Diff line number Diff line change
Expand Up @@ -61,7 +61,7 @@ steps:
displayName: 'Build Combined SDIST'
inputs:
scriptPath: 'scripts/devops_tasks/build_conda_artifacts.py'
arguments: '-d "$(conda.output)" -b "$(conda.build)" -m "$(Build.SourcesDirectory)/sdk/${{ parameters.ServiceDirectory }}/${{ artifact.meta_source }}" -r "${{ artifact.common_root }}" -n "${{ parameters.name }}" -s "${{ parameters.ServiceDirectory }}" -o "${{ upper(parameters.ServiceDirectory) }}_SOURCE_DISTRIBUTION"'
arguments: '-d "$(conda.output)" -b "$(conda.build)" -m "$(Build.SourcesDirectory)/sdk/${{ parameters.ServiceDirectory }}/${{ artifact.meta_source }}" -r "${{ artifact.common_root }}" -n "${{ artifact.name }}" -s "${{ parameters.ServiceDirectory }}" -o "${{ upper(parameters.ServiceDirectory) }}_SOURCE_DISTRIBUTION"'

- pwsh: |
Write-Host "Does the environment variable have a properly set output location?"
Expand Down
3 changes: 3 additions & 0 deletions scripts/devops_tasks/build_conda_artifacts.py
Original file line number Diff line number Diff line change
Expand Up @@ -96,6 +96,9 @@ def create_sdist_skeleton(build_directory, artifact_name, common_root):
if p != artifact_name
]

print('I see the following packages in the build directory')
print(pkgs_for_consumption)

for pkg in pkgs_for_consumption:
pkg_till_common_root = os.path.join(pkg, common_root)

Expand Down