forked from GoogleCloudPlatform/DataflowTemplates
-
Notifications
You must be signed in to change notification settings - Fork 0
RR custom transformation feature #102
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merged
taherkl
merged 31 commits into
cassandra_rr_custom_transformation_it
from
rr-custom-transformation-feature
Feb 18, 2025
Merged
RR custom transformation feature #102
taherkl
merged 31 commits into
cassandra_rr_custom_transformation_it
from
rr-custom-transformation-feature
Feb 18, 2025
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sync master
Sync main branch
Sync main branch
tests: Adding Forward Migration Tests (GoogleCloudPlatform#2001)
Sync main branch
Use [self-hosted, it] for prepare java cache workflow (GoogleCloudPlatform#2080)
Sync main branch
Sync main branch
Sync main branch
Sync main branch
Metadata config and pipeline options (GoogleCloudPlatform#2081)
fix: eager source row fetching logic (GoogleCloudPlatform#2071)
sync upstream/main
Sync main with upstream
Sync main branch
Support avro arrays for postgres insertion. (GoogleCloudPlatform#2154)
taherkl
suggested changes
Feb 17, 2025
...rcedb/src/test/java/com/google/cloud/teleport/v2/templates/SpannerToCassandraSourceDbIT.java
Outdated
Show resolved
Hide resolved
...rcedb/src/test/java/com/google/cloud/teleport/v2/templates/SpannerToCassandraSourceDbIT.java
Show resolved
Hide resolved
taherkl
approved these changes
Feb 18, 2025
aee07b4
into
cassandra_rr_custom_transformation_it
1 check failed
pawankashyapollion
added a commit
that referenced
this pull request
Feb 18, 2025
commit aee07b4 Author: pawankashyapollion <v-pawan.kumar@ollion.com> Date: Tue Feb 18 12:04:19 2025 +0530 RR custom transformation feature (#102) * sync upstream/main (#98) * Custom transformation fixes * Added Custom Transformation * Added Custom Transformation * Added Fixes * Address null to all columns * Added Null Assert * Added Timeout fixes * Added Spotless fixes * reverse merge the main * Added Custom Fixes * Added Drop Keys ---------
pawankashyapollion
added a commit
that referenced
this pull request
Feb 18, 2025
commit 2360a1b Author: pawankashyapollion <v-pawan.kumar@ollion.com> Date: Tue Feb 18 17:35:02 2025 +0530 Added Custom Transformation UT commit 72d104b Merge: 2735241 3f7e766 Author: pawankashyapollion <v-pawan.kumar@ollion.com> Date: Tue Feb 18 17:29:22 2025 +0530 Merge branch 'cassandra_rr_custom_transformation_it' into rr-custom-transformation-feature commit 2735241 Author: pawankashyapollion <v-pawan.kumar@ollion.com> Date: Tue Feb 18 17:28:24 2025 +0530 Added Null Pointer Fixes commit 3f7e766 Author: pawankashyapollion <v-pawan.kumar@ollion.com> Date: Tue Feb 18 16:48:26 2025 +0530 Null fix commit 4a4bdbd Author: pawankashyapollion <v-pawan.kumar@ollion.com> Date: Tue Feb 18 15:43:32 2025 +0530 Added Null Fixes commit e721049 Merge: a694901 df151c9 Author: pawankashyapollion <v-pawan.kumar@ollion.com> Date: Tue Feb 18 15:38:44 2025 +0530 Merge branch 'cassandra_rr_custom_transformation_it' into rr-custom-transformation-feature commit a694901 Author: pawankashyapollion <v-pawan.kumar@ollion.com> Date: Tue Feb 18 15:33:32 2025 +0530 remove unwanted commit df151c9 Author: pawankashyapollion <v-pawan.kumar@ollion.com> Date: Tue Feb 18 15:00:34 2025 +0530 Issue fix commit a49b37d Merge: feca407 5b599a4 Author: pawankashyapollion <v-pawan.kumar@ollion.com> Date: Tue Feb 18 14:19:22 2025 +0530 Merge branch 'cassandra_rr_custom_transformation_it' into rr-custom-transformation-feature commit feca407 Author: pawankashyapollion <v-pawan.kumar@ollion.com> Date: Tue Feb 18 14:18:56 2025 +0530 Added Custom and Null Pointer Exception handling commit dbf7671 Author: pawankashyapollion <v-pawan.kumar@ollion.com> Date: Tue Feb 18 14:15:45 2025 +0530 Added Fixes commit 5b599a4 Merge: e9f0beb 810e553 Author: Taher Lakdawala <78196491+taherkl@users.noreply.github.com> Date: Tue Feb 18 13:16:21 2025 +0530 Merge pull request #109 from GoogleCloudPlatform/main Referesh `SpannerToSourceDbCustomTransformationIT` tables for re-runs… commit e9f0beb Author: pawankashyapollion <v-pawan.kumar@ollion.com> Date: Tue Feb 18 13:12:40 2025 +0530 Move null test case into previous tests Move null test case into previous tests commit 38dcf46 Merge: c87c4bd aee07b4 Author: pawankashyapollion <v-pawan.kumar@ollion.com> Date: Tue Feb 18 13:09:27 2025 +0530 Merge branch 'cassandra_rr_custom_transformation_it' into rr-custom-transformation-feature commit c87c4bd Author: pawankashyapollion <v-pawan.kumar@ollion.com> Date: Tue Feb 18 13:06:18 2025 +0530 Squashed commit of the following: commit aee07b4 Author: pawankashyapollion <v-pawan.kumar@ollion.com> Date: Tue Feb 18 12:04:19 2025 +0530 RR custom transformation feature (#102) * sync upstream/main (#98) * Custom transformation fixes * Added Custom Transformation * Added Custom Transformation * Added Fixes * Address null to all columns * Added Null Assert * Added Timeout fixes * Added Spotless fixes * reverse merge the main * Added Custom Fixes * Added Drop Keys --------- commit e9e54d0 Author: pawankashyapollion <v-pawan.kumar@ollion.com> Date: Tue Feb 18 12:45:38 2025 +0530 Added Check style fixes commit db8c8c1 Merge: 8a24829 dc5e904 Author: pawankashyapollion <v-pawan.kumar@ollion.com> Date: Tue Feb 18 12:33:59 2025 +0530 Merge branch 'main' into rr-custom-transformation-feature commit 8a24829 Author: pawankashyapollion <v-pawan.kumar@ollion.com> Date: Tue Feb 18 12:28:01 2025 +0530 Cosolidate Null with same test case commit aee07b4 Author: pawankashyapollion <v-pawan.kumar@ollion.com> Date: Tue Feb 18 12:04:19 2025 +0530 RR custom transformation feature (#102) * sync upstream/main (#98) * Custom transformation fixes * Added Custom Transformation * Added Custom Transformation * Added Fixes * Address null to all columns * Added Null Assert * Added Timeout fixes * Added Spotless fixes * reverse merge the main * Added Custom Fixes * Added Drop Keys --------- commit 3ba25ed Author: pawankashyapollion <v-pawan.kumar@ollion.com> Date: Tue Feb 18 11:39:30 2025 +0530 Added Drop Keys commit 252d5b9 Author: pawankashyapollion <v-pawan.kumar@ollion.com> Date: Tue Feb 18 11:38:39 2025 +0530 Added Custom Fixes commit 8778c42 Merge: 2ca52bc f54e3de Author: pawankashyapollion <v-pawan.kumar@ollion.com> Date: Mon Feb 17 18:11:56 2025 +0530 Merge branch 'cassandra_rr_custom_transformation_it' into rr-custom-transformation-feature commit 2ca52bc Author: pawankashyapollion <v-pawan.kumar@ollion.com> Date: Mon Feb 17 18:07:38 2025 +0530 reverse merge the main commit 1bdca73 Author: pawankashyapollion <v-pawan.kumar@ollion.com> Date: Mon Feb 17 17:34:55 2025 +0530 Added Spotless fixes commit 33e561e Author: pawankashyapollion <v-pawan.kumar@ollion.com> Date: Mon Feb 17 17:33:07 2025 +0530 Added Timeout fixes commit c83f2e9 Author: pawankashyapollion <v-pawan.kumar@ollion.com> Date: Mon Feb 17 16:59:08 2025 +0530 Added Null Assert
taherkl
added a commit
that referenced
this pull request
Mar 4, 2025
…latform#2201) * RR custom transformation feature (#102) * sync upstream/main (#98) * Custom transformation fixes * Added Custom Transformation * Added Custom Transformation * Added Fixes * Address null to all columns * Added Null Assert * Added Timeout fixes * Added Spotless fixes * reverse merge the main * Added Custom Fixes * Added Drop Keys --------- * Move null test case into previous tests Move null test case into previous tests * Issue fix * Null fix * Null fix for varint * Removed unwanted code * Added Bytes Fixes * Missing Bytes Error Code Pushed * PR comment fixes (#114) * Regex fixes to validate binary string vs base64 * Added Review Comments (#122) * Added Review Comments * Address TODO * Added POM File * Added Ignore Case in table name check * Reference Mismatch * Added full_name as we are skiping extra column and adding as null * Schema Fixes * Added Missing Alignment issue with CustomTransformation * Removed binaryString encoded Support * removed unwanted log * Keep Log Level As warm --------- Co-authored-by: pawankashyapollion <v-pawan.kumar@ollion.com>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.