Skip to content

Conversation

@bansalrajat
Copy link

@bansalrajat bansalrajat commented Aug 31, 2019

When the output of tap-gitlab is used with target-bigquery , it is not able to write the projects table in the bigquery dataset .

Command Used:
tap-gitlab --config ~/config.json | target-bigquery -c tap-gitlab-bigquery-config.json

Before Change - Failing Output:
INFO Sync complete
Errors: [{'index': 0, 'errors': [{'reason': 'invalid', 'location': 'users', 'debugInfo': '', 'message': 'no such field.'}]}]
Loaded 1 row(s) into samples:branches /projects/avengers-77/datasets/samples/tables/branches
Loaded 9 row(s) into samples:commits /projects/avengers-77/datasets/samples/tables/commits
Loaded 1 row(s) into samples:issues /projects/avengers-77/datasets/samples/tables/issues
Loaded 0 row(s) into samples:project_milestones /projects/avengers-77/datasets/samples/tables/project_milestones
Loaded 0 row(s) into samples:group_milestones /projects/avengers-77/datasets/samples/tables/group_milestones
Loaded 1 row(s) into samples:users /projects/avengers-77/datasets/samples/tables/users
Loaded 1 row(s) into samples:groups /projects/avengers-77/datasets/samples/tables/groups

After changing the order:
INFO Sync complete
Loaded 1 row(s) into samples:projects /projects/avengers-77/datasets/samples/tables/projects
Loaded 1 row(s) into samples:branches /projects/avengers-77/datasets/samples/tables/branches
Loaded 9 row(s) into samples:commits /projects/avengers-77/datasets/samples/tables/commits
Loaded 1 row(s) into samples:issues /projects/avengers-77/datasets/samples/tables/issues
Loaded 0 row(s) into samples:project_milestones /projects/avengers-77/datasets/samples/tables/project_milestones
Loaded 0 row(s) into samples:group_milestones /projects/avengers-77/datasets/samples/tables/group_milestones
Loaded 1 row(s) into samples:users /projects/avengers-77/datasets/samples/tables/users
Loaded 1 row(s) into samples:groups /projects/avengers-77/datasets/samples/tables/groups

@cmerrick
Copy link
Contributor

Hi @bansalrajat, thanks for your contribution!

In order for us to evaluate and accept your PR, we ask that you sign a contribution license agreement. It's all electronic and will take just minutes.

@cmerrick
Copy link
Contributor

You did it @bansalrajat!

Thank you for signing the Singer Contribution License Agreement.

Copy link

@sapedevops sapedevops left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good.

@NikolaiGulatz
Copy link

Any update on this?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants