Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

sync original #1

Merged
merged 63 commits into from
Nov 10, 2024
Merged

sync original #1

merged 63 commits into from
Nov 10, 2024

Conversation

hiracky16
Copy link
Owner

No description provided.

Ekrekr and others added 30 commits June 21, 2024 12:08
* fix: format options

* fix

* fix: list type
* Basic POC for assertions configs as protos

* Add test for SQLX specific, tidy up session and action builder

* Fix assertion schema application via constructor

* Tidy

* Tidy

* Add legacy config type, and use Resolvable

* Fix lint
* fix vscode crash on windows

* fix linter
* Split tests for tables according to kind of table

* Fix

* revert configs proto changes to head
)

* Fix protected default, add a general unit test for SQLX config parameters

* Tidy

* Remove test for incremental tables that is now duplicate

* Remove protected field from being expected in actions where it is invalid

* Reset run_tests script
…action configs fields tests (#1762)

* Progress adding action config tests for different actions

* Add remaining table test types, fix support for table assertions and hermeticity

* Regenerate docs, tidy merge files
* Initial skeleton for moving view to its own Action constructor

* Add working column descriptors, add tags field for their config proto

* Fix view query field and population

* Fix legacy conversion

* Tidy

* Fix lint

* Fix double file query

* Tidy test

* Make legacy config conversion only apply when the type field is present
* Incremental tables as protos, via a new class

* Fix integration test
* Update operation to use config action fields

* Fix tests, tidy filename

* Tidy
* make vscode ctrl+click can handle ref with database and schema

* fix linter

* remove unnecessary comments
)

* add workflow_settings.yaml validation to vscode extension

* fix: shows errors on unknown properties
* feat: more intutive compile errors

* chore: rename variable to be more intuitive
* Added proto definitions for Data Preparations

* Moved Data preparation protos into a separate file
* Add logic to handle Data preparation definitions and parse data preparation YAML into the proto representation of the operation.

* Addressed PR Comments

* Fixed lint warnings
* Fix vscode server linting

* Fix
* Regenerate configs reference with data preparation, add comment about camel case

* Update to use camel casing

* tidy
* Add better tests, fix proto conversion from config to compiled graph

* Tidy, fix some tests

* Extract target conversion for pure targets and action configs to separate functions, to fix include on dependency assertions

* Tidy

* Fix lint

* Force check retry
* Bumped version to 3.0.1

Updated dataform core package to include data preparation proto.

* Force check retry

---------

Co-authored-by: Elias Kassell <elias@dataform.co>
* Fix catchall errors on require

* Bump version

* Fix lint
Ekrekr and others added 29 commits August 22, 2024 16:14
* Added support for compilation overrides in Data Preparations

* Added explicit test for unknown properties.

* Fixed tests order

* Fixed whitespace

* Removed logic to ignore schema mismatch

* Add error table to resolution.

* Add error table to resolution.

* Addressed PR Comments
* Bump dataprep proto to latest config

* Remove license header
* fix: vscode extension crash on windows due to *.cmd spawn

* fix: vscode extension build
* update: unit test's result messages

* update: unit test's result messages
* restore ability to unit test views

* apply suggested style changes

Co-authored-by: Elias Kassell <eliaskassell@gmail.com>

* apply suggested style change: newline

* fix bug introduced by style change

---------

Co-authored-by: Barna Magyarkuti <barna.magyarkuti@sap.com>
Co-authored-by: Elias Kassell <eliaskassell@gmail.com>
Bumps [elliptic](https://github.com/indutny/elliptic) from 6.5.4 to 6.5.7.
- [Commits](indutny/elliptic@v6.5.4...v6.5.7)

---
updated-dependencies:
- dependency-name: elliptic
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* Update Data Preparation processor to remove proto dependency. The data preparation in the compiled graph now contains the resolved YAML after compiling.

* Fixed compilation issue
* MOSSC1: Build and publish with GCB

* Update both packages

* Revert "fix: dry run fails when table/view/assertion already does not exsist …" (#1834)

This reverts commit 4d20929.

* Fixes and explanations

* Fixes and explanations

* Cloudbuild.yaml for old trigger

* Cloudbuild

* resolve comments.

* Convert cloudbuild to bash scripts

* newline

* GH PR assign to dataform-co/dataform-reviewers

* Local test cap

* New line

* Script fix

* script fix

* rename test scripts

---------

Co-authored-by: Elias Kassell <elias@dataform.co>
* Permissions on create_gh_pr script

* Permissions on update_version script

* Branch name fix
* Remove data preparation proto definition.

Clean up unused code in data preparation action.

* Removed missed unused code
* Local test fix with npm install on cloudbuild

* update Publish script

* fix publishing image url
* Fixing the name for automaticallty created PR

* Changing monthly with Dataform
* Creating release notes as part of publishing process

* Variable name fix

* Move token outside current directory

* Move token outside current directory

* typo fix
…dating the Data Preparation YAML. (#1866)

* Added logic to fully resolve targets (with prefixes/suffixes) when updating the Data Preparation YAML.

* Added logic for target finalization.
* Bump rollup from 2.8.0 to 2.79.2

Bumps [rollup](https://github.com/rollup/rollup) from 2.8.0 to 2.79.2.
- [Release notes](https://github.com/rollup/rollup/releases)
- [Changelog](https://github.com/rollup/rollup/blob/master/CHANGELOG.md)
- [Commits](rollup/rollup@v2.8.0...v2.79.2)

---
updated-dependencies:
- dependency-name: rollup
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

* Update rollup.js to use the "externals" variable
as a function instead of as an array

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: George McGowan <zerogravitas@google.com>
@hiracky16 hiracky16 merged commit f796515 into hiracky16:main Nov 10, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

10 participants