Skip to content

Conversation

@realiteer
Copy link

Dataflow templates

realiteer added 2 commits April 30, 2019 16:52
…sub topic, transforms the event via customizable JavaScript, and then emits the transformed event on a separate topic
… pubsub events and determines if any currently running strategies have triggers that care. If so, the event is re-emitted on a separate topic. This saves us thousands of dollars a month as we handle the firehose of all events in dataflow and then handle only the interesting events in strategy-engine-api.
@googlebot
Copy link

Thanks for your pull request. It looks like this may be your first contribution to a Google open source project (if not, look below for help). Before we can look at your pull request, you'll need to sign a Contributor License Agreement (CLA).

📝 Please visit https://cla.developers.google.com/ to sign.

Once you've signed (or fixed any issues), please reply here (e.g. I signed it!) and we'll verify it.


What to do if you already signed the CLA

Individual signers
Corporate signers

ℹ️ Googlers: Go here for more info.

@googlebot googlebot added the cla: no The PR submitter does not have a CLA label Apr 30, 2019
@realiteer realiteer closed this Apr 30, 2019
@realiteer realiteer deleted the data-1172-dataflow branch April 30, 2019 23:56
@realiteer realiteer restored the data-1172-dataflow branch April 30, 2019 23:56
@realiteer realiteer deleted the data-1172-dataflow branch May 1, 2019 00:06
@realiteer
Copy link
Author

realiteer commented May 1, 2019 via email

shreyakhajanchi pushed a commit that referenced this pull request Jan 7, 2025
* Added Connection Helper

* Added Formatter

* Added File Reader

* Refectored

* Added Changes for Schema and Spanner Schema

* Added Schema Changes to read Spanner Table in Schema object

* Added Schema Changes

* Added Changes for Schma

* Added Source Writn Fn Changes

* Added Source Factory Changes

* Added Fixed for the Source factory and Casssandra Connection helper

* Added Cassandra Schema Reader

* Added Pipeline Process

* Removed Unwanted Validation

* Added Access validator

* removed unwanted Return

* Added Thread safe optimization in cassandra Connection helper

* Applied  spotless:apply

* spotless:apply

* Added Constructor for Test case

* Added DUMMY Generator For UT

* Fixed UT for Metadata config (#30)

Co-authored-by: Narendra Rajput <narendra.rajput@ollion.com>

Cassandra metadata PR To accomodate Driver Loader Class (#33)

* Removed *

* Create README.md for UDF samples (#2083)

This commit adds a README.md file to the  directory. The README file provides descriptions for each of the sample Javascript UDF files in the directory, including their purpose and usage examples.

Co-authored-by: labs-code-app[bot] <161369871+labs-code-app[bot]@users.noreply.github.com>

* CassandraDriverConfigLoader from GCS (#2077)

* Added Config File Path

* Added Fix for Loading Driver Options

* Added Dependecy Fixes

* Fix UT

---------

Co-authored-by: labs-code-app[bot] <161369871+labs-code-app[bot]@users.noreply.github.com>
Co-authored-by: Vardhan Vinay Thigle <39047439+VardhanThigle@users.noreply.github.com>

* PR Review Comments (#35)

* Convert it to builder Pattern

* Convert Waring to Error

* remove the unwanted comments

* Removed Unwanted options

* Address the PR

* Address the PR Comments

* Added Missing Getter for Configuration

* Address to removed configuration changes

* removed unwanted getters

* Removal of getter from cassandra dao and test case fixes

* Handle Optionmap in cassandra DAO for serialization

* removed dependecy of getKeyOrder

* Removed And Update Exception

* Fix Checkstyle Voilation

* Missing UT Added (#37)

* Added Dummy Test case

* Removed * from import

* removed unwanted

* Added Fixes

* Added test case and fixes

* Added Some more PR comments

* Added Test case for Cassandra Reader

* Added New testcase

* Added Dependecny

* Update test case  and remove Dependency of Jupiter (#39)

* Update test case  and remove Dependecy of jupiter

* Added UT fixes

* Added Missing Getter for Configuration

* [Sourcedb-to-spanner] Bulk migration Mysql to spanner 1tb Load test (#2063)

* [Sourcedb-to-spanner] Bulk migration Mysql to spanner 1tb Load test

* Updating row counts, added static sql resources

* Renaming the test and addressing comments

* PipelineController Changes for Cassandra (#2086)

* Fix Spanner Load tests and add display test report (#2092)

* correcting lt failures

* Adding test report

* Meta code coverage (#41)

Meta code coverage

* Pr bug fixes (#42)

* Schema Reader Optimization (#43)

* Added Pr Fix related to Changes Year in Javadoc

* Address the revert of 2025 and removal of extra constructor

* Added Extra Testcase to reach target patch

---------

Co-authored-by: taherkl <taher.lakdawala@ollion.com>
Co-authored-by: Taher Lakdawala <78196491+taherkl@users.noreply.github.com>
Co-authored-by: pawankashyapollion <v-pawan.kumar@ollion.com>
Co-authored-by: labs-code-app[bot] <161369871+labs-code-app[bot]@users.noreply.github.com>
Co-authored-by: Vardhan Vinay Thigle <39047439+VardhanThigle@users.noreply.github.com>
Co-authored-by: darshan-sj <darshan-sj@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

cla: no The PR submitter does not have a CLA

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants