Skip to content

Commit

Permalink
Rebasing master into feature/communication-ServerCalling (#22185)
Browse files Browse the repository at this point in the history
* Exposes management node in azure-core-amqp (#22095)

* Update AmqpConnection to have a getManagementNode.

* Adding AmqpManagementNode.

* Update AmqpConnection, AmqpManagementNode, AmqpSession to use AsyncCloseable.

* Adding AsyncCloseable to AmqpLink.

* ClaimsBasedSecurityNode.java uses AsyncCloseable.

* Implements CbsNode's closeAsync() and adds tests.

* ReactorSession implements closeAsync()

* ReactorConnection uses closeAsync(). Renames dispose() to closeAsync(). Fixes errors where some close operations were not subscribed to.

* RequestResponseChannel. Remove close operation with message.

* Adding DeliveryOutcome models and DeliveryState enum.

* Add authorization scope to connection options.

* Add MessageUtils to serialize and deserialize AmqpAnnotatedMessage

* Update AmqpManagementNode to expose delivery outcomes because they can be associated with messages.

* Adding MessageUtil support for converting DeliveryOutcome and Outcomes.

* Fixing build breaks from ConnectionOptions.

* Adding management channel class.

* Adding management channel into ReactorConnection.

* Update ExceptionUtil to return instead of throwing on unknown amqp error codes.

* Moving ManagementChannel formatting.

* Add javadocs to ReceivedDeliveryOutcome.

* Add tests for ManagementChannel

* Adding tests for message utils.

* Fix javadoc on ModifiedDeliveryOutcome

* ReactorConnection: Hook up dispose method.

* EventHubs: Fixing instances of ConnectionOptions.

* ServiceBus: Fix build errors using ConnectionOptions.

* Adding MessageUtilsTests.

* Updating CHANGELOG.

* Annotate HttpRange with Immutable (#22119)

* Cosmos Spark: Changing inferSchema.forceNullableProperties default to true (#22049)

* Changing default

* Docs

* Tests

* new test

* doc update

* Change log

* Make getScopes in the ARM Authentication Policy Public (#22120)

Make getScopes in the ARM Authentication Policy Public

* [Communication]: Update version, changelog, and dependency for June release (#22061)

* Update version, changelog, and dependency for June release

* Update Chat, SMS, and PhoneNumbers for release

* Correction for chat version number

* Typo in chat pom

* Unrelease Chat; update change logs for other sdks

* Nit fix

Co-authored-by: JP Chen <jiach@microsoft.com>

* Increment version for videoanalyzer releases (#21814)

* Increment package version after release of com.azure azure-media-videoanalyzer-edge

* Update version_client.txt

Co-authored-by: giakas <giakas@microsoft.com>

* Add module-info to jca and jca test module and change package name of jca test module (#22041)

* Fix error in aad-starter-sample (#22109)

* EventGrid Add 4.4.0 new system events. (#22126)

* Updates to monitor query based on API review feedback (#22114)

* API consistency review feedback

* Remove commented code

* fix tests

* Refactor building prefer header

* Fix Management Bug (#22122)

* Adding missing return statement.

* Using common logic for status codes.

* Adding isSuccessful.

* mgmt, upgrade aks (#22136)

* Add domain_hint in aad-stater. (#22134)

* Increment version for core releases (#22124)

Increment package version after release of Core libraries

* Update datafeed tests to remove error code asserts (#22121)

* Made Tables service interfaces public (#22130)

* Made service interfaces public for Key Vault and Tables impl clients.

* Removed kvErrorStrings.properties files from Key Vault SDKs. Made KeyVaultErrorCodeStrings store the constants that were in the files.

* Added check for null credentials in Key Vault Administration Builders.

* Reverted changes made to KV libraries.

* Adding lmolkova as owner for core, opentelemetry, and azure monitor exporter (#22128)

* Re-generate EventGrid 4.4.0 events without FarmsBeat events (#22148)

* Client throughput control: Deferring store invocation (#22144)

* Dummy

* Deferring teh request when ClinetThrouhgputControl is enabled

* Client throughput control: defer store invocation

* Adding additional test-coverage in throughput tests

* Reacting to code review feedback.

* Adding back createItem_withBulk test

* Sync eng/common directory with azure-sdk-tools for PR 1633 (#22145)

* Update format of new Changelog Entry

* Add parsing of changelog sections

* Update ChangeLog Logic

Co-authored-by: Chidozie Ononiwu <chononiw@microsoft.com>

* [Communication]: Update readme to release version (#22149)

* Update readme to release version

* Ignore transitive API errors from core

Co-authored-by: JP Chen <jiach@microsoft.com>

* Update pom (#22155)

Co-authored-by: JP Chen <jiach@microsoft.com>

* Update EventGrid Version to 4.4.0 (#22156)

* Prepared storage for GA release of STG77 (#22152)

* Identity versions Update June 2021 (#22153)

* updated keyvault jca changelog for local jre keystore certificates (#22133)

* mgmt, support vm boot diagnostics on managed storage account (#22162)

* Cosmos Spark: Not-nullable properties to include "id" (#22143)

* Id not nullable

* Unit tests

* Adding _ts

* Integration tests

* Update the release dates (#22169)

* Increment package version after release of com.azure azure-identity (#22168)

* Added support for metadata in messages (#22158)

* Added support for metadata in messages

* Updated tests to reflect various PATCH scenarios. Reverted the autorest convention change

* Re-added V2021_03_07

Co-authored-by: Andrei Giurgiu <agiurg@microsoft.com>

* Fix Azure Core Amqp Sample issue #18806 by lihong 202105271344 (#21885)

* Change Track 2 SB sendMessages() API for messages are being sent at a slow pace (#21014)

* [BUG] Track 2 SB API (Batch Send Messages) doesn't seem to work. Messages are being sent at a slow pace. #16127

* Implement an Event Hubs Shared Access Key Credential (#21228)

* Fix issue#16466 Implement an Event Hubs Shared Access Key Credential 202105061703 by  LiHong

* Prepare for metricsadvisor Beta release (#22175)

* Prepare monitor query for release (#22166)

* Increment version for communication releases (#22171)

* Increment package version after release of com.azure azure-communication-identity

* Increment package version after release of com.azure azure-communication-common

* Increment package version after release of com.azure azure-communication-phonenumbers

* Increment package version after release of com.azure azure-communication-sms

* Increment package version after release of com.azure azure-ai-metricsadvisor (#22179)

* Update azure-search-documents After Release (#22176)

* Fix title in changelog (#22181)

* Increment version for storage releases (#22172)

* Increment package version after release of com.azure azure-storage-internal-avro

* Increment package version after release of com.azure azure-storage-common

* Increment package version after release of com.azure azure-storage-blob

* Increment package version after release of com.azure azure-storage-queue

* Increment package version after release of com.azure azure-storage-file-share

* Increment package version after release of com.azure azure-storage-blob-batch

* Increment package version after release of com.azure azure-storage-blob-nio

* Increment package version after release of com.azure azure-storage-blob-cryptography

* Increment package version after release of com.azure azure-storage-file-datalake

* Increment package version after release of com.azure azure-storage-blob-changefeed

* Adding IoT Hub connection string sample (#22157)

* Adding IoTHubConnection string sample.

* Tables list/get access policies changes (#22161)

* Fixed serialization issues with listAccessPolicies() and setAccessPolicies in TableAsyncClient and TableClient. Added tests.

* Added a test for service properties and statistics.

* Fixed CheckStyle issues.

* Applied PR feedback.

* Fixed compilation error(?).

* Made TableAccessPolicies final.

* Fixed another CheckStyle issue.

* Fixed another CheckStyle issue.

Co-authored-by: Connie Yau <conniey@microsoft.com>
Co-authored-by: Alan Zimmer <48699787+alzimmermsft@users.noreply.github.com>
Co-authored-by: Matias Quaranta <ealsur@users.noreply.github.com>
Co-authored-by: Jianping Chen <jp.chen.jianping@gmail.com>
Co-authored-by: JP Chen <jiach@microsoft.com>
Co-authored-by: Azure SDK Bot <53356347+azure-sdk@users.noreply.github.com>
Co-authored-by: giakas <giakas@microsoft.com>
Co-authored-by: michaelqi793 <78671298+michaelqi793@users.noreply.github.com>
Co-authored-by: Rujun Chen <Rujun.Chen@microsoft.com>
Co-authored-by: Yijun Xie <48257664+YijunXieMS@users.noreply.github.com>
Co-authored-by: Srikanta <51379715+srnagar@users.noreply.github.com>
Co-authored-by: Weidong Xu <weidxu@microsoft.com>
Co-authored-by: gaohan <1135494872@qq.com>
Co-authored-by: Sameeksha Vaity <savaity@microsoft.com>
Co-authored-by: vcolin7 <vicolina@microsoft.com>
Co-authored-by: Liudmila Molkova <limolkova@microsoft.com>
Co-authored-by: Fabian Meiswinkel <fabianm@microsoft.com>
Co-authored-by: Chidozie Ononiwu <chononiw@microsoft.com>
Co-authored-by: Gauri Prasad <51212198+gapra-msft@users.noreply.github.com>
Co-authored-by: Vinay Gera <vigera@microsoft.com>
Co-authored-by: ankitarorabit <48968483+ankitarorabit@users.noreply.github.com>
Co-authored-by: angiurgiu <angiurgiu@gmail.com>
Co-authored-by: Andrei Giurgiu <agiurg@microsoft.com>
Co-authored-by: Hong Li(MSFT) <74638143+hongli750210@users.noreply.github.com>
  • Loading branch information
25 people authored and chrwhit committed Jun 10, 2021
1 parent 880f186 commit 694ba9f
Show file tree
Hide file tree
Showing 3 changed files with 9 additions and 61 deletions.
10 changes: 5 additions & 5 deletions eng/jacoco-test-coverage/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -64,22 +64,22 @@
<dependency>
<groupId>com.azure</groupId>
<artifactId>azure-communication-common</artifactId>
<version>1.0.2</version> <!-- {x-version-update;com.azure:azure-communication-common;current} -->
<version>1.1.0-beta.1</version> <!-- {x-version-update;com.azure:azure-communication-common;current} -->
</dependency>
<dependency>
<groupId>com.azure</groupId>
<artifactId>azure-communication-identity</artifactId>
<version>1.1.1</version> <!-- {x-version-update;com.azure:azure-communication-identity;current} -->
<version>1.2.0-beta.1</version> <!-- {x-version-update;com.azure:azure-communication-identity;current} -->
</dependency>
<dependency>
<groupId>com.azure</groupId>
<artifactId>azure-communication-sms</artifactId>
<version>1.0.3</version> <!-- {x-version-update;com.azure:azure-communication-sms;current} -->
<version>1.1.0-beta.1</version> <!-- {x-version-update;com.azure:azure-communication-sms;current} -->
</dependency>
<dependency>
<groupId>com.azure</groupId>
<artifactId>azure-communication-phonenumbers</artifactId>
<version>1.0.3</version> <!-- {x-version-update;com.azure:azure-communication-phonenumbers;current} -->
<version>1.1.0-beta.1</version> <!-- {x-version-update;com.azure:azure-communication-phonenumbers;current} -->
</dependency>
<dependency>
<groupId>com.azure</groupId>
Expand Down Expand Up @@ -194,7 +194,7 @@
<dependency>
<groupId>com.azure</groupId>
<artifactId>azure-identity</artifactId>
<version>1.3.1</version> <!-- {x-version-update;com.azure:azure-identity;current} -->
<version>1.4.0-beta.1</version> <!-- {x-version-update;com.azure:azure-identity;current} -->
</dependency>
<dependency>
<groupId>com.azure</groupId>
Expand Down
9 changes: 4 additions & 5 deletions eng/versioning/version_client.txt
Original file line number Diff line number Diff line change
Expand Up @@ -51,12 +51,11 @@ com.azure:azure-analytics-synapse-artifacts;1.0.0-beta.4;1.0.0-beta.5
com.azure:azure-analytics-synapse-spark;1.0.0-beta.3;1.0.0-beta.4
com.azure:azure-analytics-synapse-managedprivateendpoints;1.0.0-beta.3;1.0.0-beta.4
com.azure:azure-analytics-synapse-monitoring;1.0.0-beta.3;1.0.0-beta.4
com.azure:azure-communication-callingserver;1.0.0;1.0.0-beta.1
com.azure:azure-communication-chat;1.0.0;1.1.0-beta.1
com.azure:azure-communication-common;1.0.2;1.0.2
com.azure:azure-communication-sms;1.0.1;1.0.3
com.azure:azure-communication-identity;1.1.0;1.1.1
com.azure:azure-communication-phonenumbers;1.0.1;1.0.3
com.azure:azure-communication-common;1.0.2;1.1.0-beta.1
com.azure:azure-communication-sms;1.0.3;1.1.0-beta.1
com.azure:azure-communication-identity;1.1.1;1.2.0-beta.1
com.azure:azure-communication-phonenumbers;1.0.3;1.1.0-beta.1
com.azure:azure-containers-containerregistry;1.0.0-beta.2;1.0.0-beta.3
com.azure:azure-core;1.17.0;1.18.0-beta.1
com.azure:azure-core-amqp;2.0.6;2.1.0-beta.1
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -524,57 +524,6 @@ class SparkE2EQueryITest
}
}

"spark query" can "when forceNullableProperties is false and rows have different schema" in {
val cosmosEndpoint = TestConfigurations.HOST
val cosmosMasterKey = TestConfigurations.MASTER_KEY
val samplingSize = 100
val expectedResults = samplingSize * 2
val container = cosmosClient.getDatabase(cosmosDatabase).getContainer(cosmosContainer)

// Inserting documents with slightly different schema
for( _ <- 1 to expectedResults) {
val objectNode = Utils.getSimpleObjectMapper.createObjectNode()
val arr = objectNode.putArray("object_array")
val nested = Utils.getSimpleObjectMapper.createObjectNode()
nested.put("A", "test")
nested.put("B", "test")
arr.add(nested)
objectNode.put("id", UUID.randomUUID().toString)
container.createItem(objectNode).block()
}

for( _ <- 1 to samplingSize) {
val objectNode2 = Utils.getSimpleObjectMapper.createObjectNode()
val arr = objectNode2.putArray("object_array")
val nested = Utils.getSimpleObjectMapper.createObjectNode()
nested.put("A", "test")
arr.add(nested)
objectNode2.put("id", UUID.randomUUID().toString)
container.createItem(objectNode2).block()
}

val cfgWithInference = Map("spark.cosmos.accountEndpoint" -> cosmosEndpoint,
"spark.cosmos.accountKey" -> cosmosMasterKey,
"spark.cosmos.database" -> cosmosDatabase,
"spark.cosmos.container" -> cosmosContainer,
"spark.cosmos.read.inferSchema.enabled" -> "true",
"spark.cosmos.read.inferSchema.forceNullableProperties" -> "false",
"spark.cosmos.read.inferSchema.samplingSize" -> samplingSize.toString,
"spark.cosmos.read.inferSchema.query" -> "SELECT * FROM c ORDER BY c._ts",
"spark.cosmos.read.partitioning.strategy" -> "Restrictive"
)

val dfWithInference = spark.read.format("cosmos.oltp").options(cfgWithInference).load()
try {
dfWithInference.collect()
fail("Should have thrown an exception")
}
catch {
case inner: Exception =>
inner.toString.contains("The 1th field 'B' of input row cannot be null") shouldBe true
}
}

"spark query" can "use custom sampling size" in {
val cosmosEndpoint = TestConfigurations.HOST
val cosmosMasterKey = TestConfigurations.MASTER_KEY
Expand Down

0 comments on commit 694ba9f

Please sign in to comment.