Skip to content

Commit

Permalink
[Storage] Add data plane Datalake Storage swagger (#15789)
Browse files Browse the repository at this point in the history
* Storage Dataplane Preview (#7027)

* Adding Azure Storage Dataplane REST API Specs

These are all Preview swagger specs and we do expect to make changes.

- Add readme.md files to suppress --azure-validator rules
- Fix trivial error about an x-ms-client-name mathing a name that won't change the
code generation
- We'll need to fix the semantic/avocado pipeline issues and get this properly reviewed before merging from the `storage-dataplane-preview` fork into `master`.

* Fixed blob swagger for CPK (#7045)

* Fixed blob swagger for CPK

* Add share permission body to storage files (#7081)

* Add share permission body to storage files

* Add produces to getPermission

* Move response body from create to get

* Adding SAS Error Codes (#7322)

* [Fix]Addressing the Things Below (#7304)

1.	create of Page Blob is missing tier parameter.
2.	For upload_pages_from_url of Page Blob, the generated code doesn’t extract header encryption-key-sha256 from raw response, which resulted in the response to client doesn’t have encryption-key-sha256 info.
3.	For append_block_from_url of Append Blob, currently the generated code is not extracting the response header request-server-encrypted from raw response(server returned response) which resulted in client doesn’t have request-server-encrypted info.
4.	get_permission of Storage File has file_permission_key parameter which should be required instead of optional

* Remove delimiter from list blob flat segment response (#7376)

Resolves #7350

* Updated DataLake swagger (#7408)

* Additional DataLake swagger updates (#7445)

* Additional DataLake swagger updates

* refactored fileSystemResource param and added md5 to pathHttpHeaders (#7525)

* Updated ContentMD5 parameter in DataLake swagger (#7534)

* Updated ContentMD5 parameter in DataLake swagger

* separated contentMD5 from transactionalContentMD5

* Add transactional md5 support for blockBlobUpload (#7553)

* Added File Storage 2019-07-07 service version (#7825)

* Added premium share properties to File Shares (#7826)

* Added x-ms-number-of-handles-failed to File and Directory ForceCloseHandles (#7833)

* Added new FileCopy() headers (#7837)

* Added File Lease (#7845)

* [Blob] Added missing headers for copy blob from URL (#7820)

* Added 2019-07-07 Blobs Swagger (#7849)

* Added additional FileLease parameters (#7892)

* Added additional File Lease request and response headers (#7910)

* Added encryption scopes to Blob Storage (#7929)

* Storage/features/more cpk n (#7940)

* Added previous snapshot url header to PageBlob.GetPageRangeDiff (#7951)

* Made LeaseId optional on File Break Lease (#7952)

* Added EncryptionScope and DenyDefaultEncryptionScopeOverride to ContainerProperties (#8001)

* Added rest parity attributes to start copy response (#8009)

* Modified swagger to fix some descriptions (#8014)

* undid rest parity start copy response (#8016)

* Added new ErrorCode (#8071)

* Added FileSystem Get/SetAccessControl and SetPermissions (#8081)

* Revert "Added FileSystem Get/SetAccessControl and SetPermissions (#8081)" (#8134)

This reverts commit 855877c.

* Renamed DenyEncryptionScopeOverride -> PreventEncryptionScopeOverride (#8245)

* Renamed denyEncryptionScopeOverride to preventEncryptionScopeOverride (#8247)

* Added 2019-12-12 storage service version (#8396)

* make AccessPolicy's fields optional in blob and queue (#7992)

* Updated swagger to include Quick Query (#8407)

* Removed '&' from comment in 2019-12-12 blobs swagger (#8510)

* Minor Quick Query update (#8523)

* Another quick query update (#8549)

* Added DataLake 2019-12-12 swagger file (#8594)

* Changed name of hasHeaders to headersPresent (#8612)

* [Storage][Blob]Blob Versioning (#8515)

* Storage/feature/recursive acl (#8666)

* added set acl recursive operation

* added set acl recursive operation

* added set acl recursive operation

* remove invalid parameters

* rename mode enum and strip list entry per review feedback (#8698)

* [Storage][Blob]Blob Versioning: listBlobs add include {versions} and undo set metadata (#8735)

* [Blob Versioning] listBlobs add include {versions} and undo set metadata

* add response headers to syncCopyFromURL and abortCopyFromURL

* undo abortCopyFromURL

* Revert "undo abortCopyFromURL"

This reverts commit 886c9a3.

* add versionId to setMetaData and incrementalCopy's response headers

* [Storage][Blob]Blob Versioning Update (#8762)

 Undo abortCopyFromURL and pageBlob incrementalCopy

* [Storage] add version headers for get blob properties (#8775)

* [Storage] add version headers for get blob properties

* dot

* add versionId to getBlob response headers (#8786)

Co-authored-by: Lin Jian <ljian3377@gmail.com>

* [Storage][Recursive ACL] Tweak mode enum to allow hiding it in transforms (#8789)

* added x-ms-client-name tot DataLakeStorageError's inner error (#8739)

* block can be now up to 4000MB (#8912)

* Undid breaking change (#8939)

* Fixed typo (#8941)

* Feature/storage/blob tags (#8936)

* Fixing Tags swagger (#8948)

* minor tags update (#8950)

* Added container soft delete (#9013)

* Added Share Soft Delete (#9015)

* Added Append Blob Seal (#9016)

* Minor addition to Append Seal (#9039)

* More Append Seal stuff (#9059)

* Removed contentLength from setTags (#9061)

* Feature/storage/set expiry (#9079)

* Added Snapshot and Version to Blob Set Tier (#9086)

* Object Replication update to swagger (update from James OR branch) (#9024)

* Object Replication update to swagger (update from James OR branch)

* Adding object replication to code 206

* Adding in x-ms-or-policy-id header

* Blob tags serialization fix (#9087)

* Blob tags serialization fix (#9142)

* Removed contentLength from setTags (#9061)

* Fixed BlobTags serialization

* Added tag count to properties returned on listing

* Renaming BlobProperties to BlobPropertiesInternal (#9183)

* Rename ObjectReplicationRuleStatus to ObjectReplicationRules (#9186)

* Remove snapshot from set tags (#9184)

* Removed contentLength from setTags (#9061)

* Fixed BlobTags serialization

* Added tag count to properties returned on listing

* Removed snapshot from setTags

* Renamed quick query to query (#9504)

* x-ms-client-name to DataLakeStorageError's inner error (#9506)

* Added Set Expiry to Data Lake (#9620)

* Update CODEOWNERS

* Feature/storage/blob conditional headers (#9695)

* list blobs ors (#9698)

* Added x-ms-source-if-tags to Blob Async Copy (#9744)

* fix typo in comments (#9758)

Co-authored-by: Lin Jian <ljian3377@gmail.com>

* fix typo in comments (#9783)

Co-authored-by: Lin Jian <ljian3377@gmail.com>

* remove TagValue (#9830)

* Revert "remove TagValue (#9830)"

This reverts commit 6af58bf.

* Adding STG74 2020-02-02 swagger for DataLake (#9915)

* Adding STG74 2020-02-02 swagger

* Adding forceflag for recursive acl in datalake (#9916)

* Added support for Get/SetBlobServiceProperties StaticWebsite.DefaultIndexDocumentPath (#9940)

* Added RehydratePriority response header to GetBlobProperties and ListBlobs (#9951)

* Fixed bug where AccountKind was missing BlockBlobStorage and FileStorage (#9961)

* Fixed Enum values (#9970)

* Added new swagger files for STG 74 (#10074)

* Storage/add if tags to set tier (#10092)

* removed source if tags from start copy from url (#10093)

Co-authored-by: Gauri Prasad <gapra@microsoft.com>

* Storage/sealblob (#10201)

* Added back source ifTags (#10206)

* Added tag to storage readme (#10218)

* add iftags for clearPage, incrementalcopy, resize, UpdateSequenceNumber and query (#10238)

Co-authored-by: Lin Jian <ljian3377@gmail.com>

* Concurrent Append (#10279)

* Inital commit for Concurrent Append swagger

* another update

* PR comments

* make queue message body optional (#10477)

* Added Get File Range Diff (#10399)

* [Storage] Make message required for enqueue. (#10480)

* make queue message body optional

* require queue message for post

* colons

* SMB Multichannel (#10329)

* Changed setAclRecursiveMode to be a method param (#10509)

* Feature/storage/share lease (#10351)

* Removed Concurrent Append (#10544)

* Feature/storage/new quick query features (#10571)

* Added Last Access Time (#10339)

* [Storage][DataLake]Update API Version (#10663)

* Added missing error code (#10744)

* [storage-blob] fix typo "laster" -> "later" (#10751)

* fix typo laster

* fix 4tb file documentation

Co-authored-by: Lin Jian <ljian3377@gmail.com>

* Renamed SmbSettings and ProtocolSettings, Removed lease duration headers.  (#10835)

* Removed lease duration from response headers for all lease APIs except break lease

* Modified names according to arch board review

Co-authored-by: Gauri Prasad <gapra@microsoft.com>

* Fixed FileClient.GetRangeListDiff (#10896)

* Set File Tier (#10368)

* Added swagger files for new Storage service version (#11031)

* Added include leased to DeleteSnapshots (#11108)

* Added 2020-06-12 blob swagger (#11445)

* Added DataLake 2020-06-12 file (#11446)

* fix description of enqueue message's visibilityTimeout (#11459)

* don't rename (#11461)

* Feature/storage/blob tags75 (#11305)

* Permanent Delete (#11359)

* Feature/storage/put blob from url (#11197)

* Feature/storage/share enable protocol share squash root (#11304)

* added source content MD5 (#11715)

* Applied 2020-04-08 blob changes to 2020-06-12 (#11786)

* minor fix (#11804)

* Add "x-ms-is-hns-enabled" to ServiceGetAccountInfoResponse (#11871)

* Renamed IsHnsEnabled (#11904)

* added enum for api version (#12164)

* added enum for api version

* added version for all api versions

* Added version id for DownloadBlob 206 response (#12193)

* added version id for download blob 206 response

* removed from versions prior to 2019-12-12

* added current version

* Feature/storage/container rename (#11791)

* Added container scoped batch (#11927)

* Remove/move XML name mapping when ref is provided (#12341)

* testing

* removed more fileshare ignored xml names

* fixed silly indents

* fixed silly indents

* Update DataLakeStorage.json (#13145)

* GetBlockList returns long block sizes (#13188)

* Added 2020-08-04 swagger file for Blob (#13526)

* Fixed date (#13529)

* Feature/storage/hns soft delete (#11741)

* Added Quick Query Parquet (#13589)

* added resource type header to list deleted paths (#13719)

* added resource type header

* added resource type header

* [Storage] Version Level Worm (#13527)

* Switched back to using BlobImmutabilityPolicy enum (#13753)

Co-authored-by: Sean McCullough <=>

* Added BlobErrorCode.BlobUsesCustomerSpecifiedEncryption (#13930)

* Fix typo (#14081)

* Fix typo

* Update blob.json

* Update queue.json

* wip

* Added 2020-10-02 blob swagger (#14193)

* Added 2020-10-02 file swagger (#14207)

* Updated swagger to reflect VLW changes (#14357)

* Added Files 2020-06-12 service version (#14383)

* [Storage] Oauth support for copy source (#14404)

* List Delete Root Blob With Versions (#14195)

* Added support for List File V2 (#14385)

* Align with service and documentation where Blob Quick Query XML elements are optional instead of required (#14688)

* Changed order of BlobImmutabilityPolicyMode (#14764)

* Cleaned up Storage Swagger to get validation tools and CI green (#15015)

* removed tags as a requirement (#15106)

* Added 2020-12-06 service version for Data Lake (#15234)

* Revert "Added 2020-12-06 service version for Data Lake (#15234)" (#15235)

* Added new Data Lake swagger version (#15508)

Co-authored-by: Sean McCullough <=>

* Added Blob 2020-12-06 service version (#15519)

* Added encryption scope to blob sync copy (#15521)

* FileSystem.GetPaths() (#15534)

* storage swaggers

* sort

* Added Datalake Spec

* revert custom words

* readme path

* moved datalake swagger and supressed warning

* moved datalake swagger and supressed warning

* fixing existing error

* reverted

Co-authored-by: tg-msft <tg-msft@users.noreply.github.com>
Co-authored-by: Sean McCullough <44180881+seanmcc-msft@users.noreply.github.com>
Co-authored-by: Jianghao Lu <jianghaolu@users.noreply.github.com>
Co-authored-by: Amanda Nguyen <48961492+amnguye@users.noreply.github.com>
Co-authored-by: Xiaoxi Fu <49707495+xiafu-msft@users.noreply.github.com>
Co-authored-by: Jeremy Meng <yumeng@microsoft.com>
Co-authored-by: Gauri Prasad <51212198+gapra-msft@users.noreply.github.com>
Co-authored-by: Rick Ley <frley@microsoft.com>
Co-authored-by: Ze Qian Zhang <zezha@microsoft.com>
Co-authored-by: Lin Jian <ljian3377@gmail.com>
Co-authored-by: Kamil Sobol <61715331+kasobol-msft@users.noreply.github.com>
Co-authored-by: Lin Jian <1215122919@qq.com>
Co-authored-by: iscai-msft <43154838+iscai-msft@users.noreply.github.com>
Co-authored-by: Gauri Prasad <gapra@microsoft.com>
Co-authored-by: Lin Jian <lijian2@microsoft.com>
Co-authored-by: bharathsreenivas <bharathb@microsoft.com>
Co-authored-by: James <41338290+jaschrep-msft@users.noreply.github.com>
  • Loading branch information
18 people authored Sep 7, 2021
1 parent ab1f7f1 commit 771d318
Show file tree
Hide file tree
Showing 5 changed files with 3,380 additions and 199 deletions.
Loading

0 comments on commit 771d318

Please sign in to comment.