Skip to content

Conversation

@taherkl
Copy link
Contributor

@taherkl taherkl commented Mar 12, 2025

No description provided.

taherkl and others added 30 commits November 27, 2024 20:19
Use [self-hosted, it] for prepare java cache workflow (GoogleCloudPlatform#2080)
Support avro arrays for postgres insertion. (GoogleCloudPlatform#2154)
* Addition of Load Tests in SpannerToSourceDB For Cassandra
Referesh `SpannerToSourceDbCustomTransformationIT` tables for re-runs…
taherkl and others added 24 commits March 3, 2025 10:28
Co-authored-by: pawankashyapollion <v-pawan.kumar@ollion.com>
* Adding test table for Map types

* Adding support for cassandra map
* add inf fix to ts

fixing bug on timestamp type

* Update FormatDatastreamRecordToJson.java

use equals not ==
* Upgrade Beam version to 2.63.0

* add cache factory to local spanner io

* remove cache pass to ReadChangeStreamPartitionDoFn

* Add unimplemented/unused stubs to TestChangeStreamMutation

* Use java Instant instead of threeten Instant

* Fix low watermark setter call

* fix testchangestreammutation

* Recreate validation PR

* fix import order

* linux-env requirements files

* fix v1 pom
* Add load test for cross db txn

* Change test timeout to 2 days

* Revert spanner-pr.yml changes
* Report Lineage for CsvToBigQuery template

* Reply beampr-32662 to CsvConverters
* Changes to write read interleave type from information schema, and write/read the type to/from avro. No change to tests yet.

* Fix warnings, bug in InformationSchemaScanner, and bug in AvroSchemaToDdlConverter. Also properly default to IN PARENT when emitting ddl, in case the interleave type is not set (really only necessary for tests, since otherwise it will always be set.

* Set interleaveType in InfoSchemaScanner

* Style fixes, and only generate INTERLEAVE IN ddl for gsql.

* another style fix - remove unused import

* Make conditions more readable and add comments

* Tests

* Fix condition

* Add interleave in table to ExportPipelineIT
…oudPlatform#2181)

Added SCRAM-SHA-512 authentication support to Kafka to Kafka, Kafka to GCS, and Kafka to BigQuery templates.
* Uncomment kinesis

* bump protoc to 4 in v2
…y template (GoogleCloudPlatform#2084)

* Support partitioned reads for DateTime column type

* minor changes

* Support backward compatibility and timezone in lower/upper bounds

* removed test cases for bounds in unit tests as derby does not support timezone

* Fixed typo's in JdbcToBigQuery.java
Corrected testcases expected output

* Corrected unit test cases expected output. Removed DateTime integration test cases.

* Corrected a typo

* Added default value for partitionColumnType

* spotless apply
…#2220)

* disabling flaky test to unblock dataflow release

* minor change
* skip runnerv2 tests in TemplateTestBase

* add logic to skip use_runner_v2 experiment in the launchTemplate

* Remove redundant property skipRunnerV2Test in pom and update logic in launchTemplate

* Fix format violations using mvn spotless:apply
…#2185)

* SpannerExceptionClassifier class and IT

* Unit tests and Integration tests

* Formatting changes

* Correcting UT

* Unit test for SpannerResourceManager

* Creating Spanner Migration Exception

* Formatting changes

* Correcting tests

* Addressing comments

* Correcting a UT

* Addressing comments

* Changing SpannerMigrationException to extend RuntimeException
@taherkl taherkl requested a review from a team as a code owner March 12, 2025 06:41
@taherkl taherkl requested review from VardhanThigle and pratickchokhani and removed request for a team March 12, 2025 06:41
@shreyakhajanchi shreyakhajanchi merged commit aeebae4 into GoogleCloudPlatform:load-test-branch Mar 12, 2025
16 of 18 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.