Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clarify coders for side inputs on err output. #27568

Merged
merged 2 commits into from
Jul 20, 2023

Conversation

lostluck
Copy link
Contributor

@lostluck lostluck commented Jul 19, 2023

Tiny change that was necessary to understand how prism was mis-matching coders. Clarify bundle construction failures as part of ProcessBundle, and fail the instruction. Ensure data errors are treated as errors.

See #27550 and #24789.


Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:

  • Mention the appropriate issue in your description (for example: addresses #123), if applicable. This will automatically add a link to the pull request in the issue. If you would like the issue to automatically close on merging the pull request, comment fixes #<ISSUE NUMBER> instead.
  • Update CHANGES.md with noteworthy changes.
  • If this contribution is large, please file an Apache Individual Contributor License Agreement.

See the Contributor Guide for more tips on how to make review process smoother.

To check the build health, please visit https://github.com/apache/beam/blob/master/.test-infra/BUILD_STATUS.md

GitHub Actions Tests Status (on master branch)

Build python source distribution and wheels
Python tests
Java tests
Go tests

See CI.md for more information about GitHub Actions CI.

@github-actions github-actions bot added the go label Jul 19, 2023
@codecov
Copy link

codecov bot commented Jul 19, 2023

Codecov Report

Merging #27568 (11a3fde) into master (b2e00ef) will increase coverage by 0.00%.
The diff coverage is 20.00%.

@@           Coverage Diff           @@
##           master   #27568   +/-   ##
=======================================
  Coverage   71.14%   71.15%           
=======================================
  Files         861      861           
  Lines      104560   104570   +10     
=======================================
+ Hits        74389    74402   +13     
+ Misses      28621    28619    -2     
+ Partials     1550     1549    -1     
Flag Coverage Δ
go 53.67% <20.00%> (+0.02%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

Files Changed Coverage Δ
sdks/go/pkg/beam/core/runtime/exec/sideinput.go 42.57% <0.00%> (ø)
sdks/go/pkg/beam/core/runtime/harness/harness.go 11.08% <0.00%> (-0.05%) ⬇️
sdks/go/pkg/beam/core/runtime/exec/pardo.go 64.08% <100.00%> (ø)

... and 4 files with indirect coverage changes

📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more

@github-actions
Copy link
Contributor

Assigning reviewers. If you would like to opt out of this review, comment assign to next reviewer:

R: @jrmccluskey for label go.

Available commands:

  • stop reviewer notifications - opt out of the automated review tooling
  • remind me after tests pass - tag the comment author after tests pass
  • waiting on author - shift the attention set back to the author (any comment or push by the author will return the attention set to the reviewers)

The PR bot will only process comments in the main thread (not review comments).

Copy link
Contributor

@jrmccluskey jrmccluskey left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@jrmccluskey jrmccluskey merged commit a950ac9 into apache:master Jul 20, 2023
6 of 7 checks passed
@lostluck lostluck deleted the improveSideInputDebugging branch July 20, 2023 18:36
bullet03 pushed a commit to akvelon/beam that referenced this pull request Aug 11, 2023
* Clarify coders for side inputs on err output.

* error tracking in harness.

---------

Co-authored-by: lostluck <13907733+lostluck@users.noreply.github.com>
cushon pushed a commit to cushon/beam that referenced this pull request May 24, 2024
* Clarify coders for side inputs on err output.

* error tracking in harness.

---------

Co-authored-by: lostluck <13907733+lostluck@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants