Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

ccl/streamingccl/streamingest: TestTenantStreamingUnavailableStreamAddress failed #86287

Closed
cockroach-teamcity opened this issue Aug 17, 2022 · 3 comments
Closed

ccl/streamingccl/streamingest: TestTenantStreamingUnavailableStreamAddress failed #86287

cockroach-teamcity opened this issue Aug 17, 2022 · 3 comments
Assignees
@samiskin
Labels
A-tenant-streaming Including cluster streaming branch-master Failures and bugs on the master branch. C-test-failure Broken test (automatically or manually discovered). O-robot Originated from a bot. skipped-test
Milestone
22.2

Comments

@cockroach-teamcity
Copy link
Member

cockroach-teamcity commented Aug 17, 2022 •
edited by cockroach-jira-scripts
Loading

ccl/streamingccl/streamingest.TestTenantStreamingUnavailableStreamAddress failed with artifacts on master @ b173a16715e71e94115820374da1eb350b3b459d:

=== RUN   TestTenantStreamingUnavailableStreamAddress
    test_log_scope.go:162: test logs captured to: /artifacts/tmp/_tmp/045fecfe9e18c9da6f776a53d446f2c5/logTestTenantStreamingUnavailableStreamAddress3405555953
    test_log_scope.go:80: use -show-logs to present logs inline
    stream_replication_e2e_test.go:286: error executing '
          CREATE TABLE d.scattered (key INT PRIMARY KEY);
          INSERT INTO d.scattered (key) SELECT * FROM generate_series(1, 1000);
          ALTER TABLE d.scattered SPLIT AT (SELECT * FROM generate_series(20, 980, 20));
          ALTER TABLE d.scattered SCATTER;
          ': dial tcp 127.0.0.1:37609: connect: connection refused
    panic.go:500: -- test log scope end --
--- FAIL: TestTenantStreamingUnavailableStreamAddress (523.73s)

Parameters: TAGS=bazel,gss,deadlock

Help

See also: How To Investigate a Go Test Failure (internal)

/cc @cockroachdb/tenant-streaming

This test on roachdash | Improve this report!

Jira issue: CRDB-18667
@cockroach-teamcity cockroach-teamcity added branch-master Failures and bugs on the master branch. C-test-failure Broken test (automatically or manually discovered). O-robot Originated from a bot. labels Aug 17, 2022
@cockroach-teamcity cockroach-teamcity added this to the 22.2 milestone Aug 17, 2022
@cockroach-teamcity
Copy link
Member Author

ccl/streamingccl/streamingest.TestTenantStreamingUnavailableStreamAddress failed with artifacts on master @ b173a16715e71e94115820374da1eb350b3b459d:

=== RUN   TestTenantStreamingUnavailableStreamAddress
    test_log_scope.go:162: test logs captured to: /artifacts/tmp/_tmp/045fecfe9e18c9da6f776a53d446f2c5/logTestTenantStreamingUnavailableStreamAddress1832417074
    test_log_scope.go:80: use -show-logs to present logs inline
    stream_replication_e2e_test.go:805: condition failed to evaluate within 2m0s: expected job status succeeded, but got paused
    panic.go:500: -- test log scope end --
--- FAIL: TestTenantStreamingUnavailableStreamAddress (210.39s)

Parameters: TAGS=bazel,gss

Help

See also: How To Investigate a Go Test Failure (internal)

This test on roachdash | Improve this report!

@samiskin samiskin mentioned this issue Aug 17, 2022
Merged
craig bot pushed a commit that referenced this issue Aug 17, 2022
@e-mbrown @ecwall
@knz @xinhaoz @ZhouXing19 @ajwerner @samiskin
Merge #84999 #86165 #86212 #86264 #86282 #86288 #86302
3b84166 
84999: sql: Secondary Region Followup r=e-mbrown a=e-mbrown

Resolves #68358

For 22.2 we've decided that secondary and super regions should have
minimal interaction. Secondary regions are tied to the primary region,
both wither have to be outside of inside of a super region. In the case
of multiple super regions, the primary and secondary region must be within
the same super region.

Release note (sql change): Secondary regions, like the primary regions can
either be set inside or outside of a super region. In order to move a
secondary region `alter_primary_region_super_region_override` must be enabled
and the primary region moved.

Release justification: Low-risk update to new functionality

86165: sql: Move SplitTable into TestCluster r=rafiss a=ecwall

refs #85800

Move this function to make it accessible by the TTL (and other) tests.

Release note: None

Release justification: Test refactor for TTL.

86212: sql: avoid running lint tests under race/deadlock/stress r=erikgrinaker,srosenberg a=knz

Release justification: changes to test-only code

Release note: None

86264: ui/cluster-ui: add context to inform ui if on cockroach cloud r=xinhaoz a=xinhaoz

Closes #86245

This commit introduces a context `CockroachCloudCountext` that
signifies whether or not the app is within cockroach cloud or
not. This allows us to enable/disable certain features depending
on the platform without plumbing any values. The default context
value is true in order to not set the context explicitly for
cloud components and within the managed-service repo. The
context is provided as false for the db-console app.

This commit also disables the `Time Spent Waiting` column
in active execution tables for CC, since that feature is not yet
available.

Release justification: bug fix, low risk update to existing
functionality
Release note (ui change): The `time spent waiting` columns for
active execution tables has been  hidden on CC

86282: docker: fix the test r=rail a=ZhouXing19

fixes #82747 

We now update the path of the fsnotify binary to mount on the docker.

Release justification: bug fix
Release note: none

86288: testccl/sqlccl: deflake TestTenantTempTableCleanup r=ajwerner a=ajwerner

Fixes #85657

I don't know why we miss this, I guess it has something to do
with not detecting the session is dead on time. A retry works just
fine.

Release justification: testing only change

Release note: None

86302: streamingccl: skip flaky multinode tests r=samiskin a=samiskin

skip these multinode tests until we figure out the nightly flakes.  
Wasn't able to reproduce locally even after 1.5h of stress running 
so I don't know how long it'll  take to figure out.

Both of them fail on the same error which is just creating the
scattered table.  It looks like one of the nodes just dies and
there are other errors related to not being able to connect to it.

Failures: #86287 and #86206

Release justification: test-only changes
Release note: None

Co-authored-by: e-mbrown <ebsonari@gmail.com>
Co-authored-by: Evan Wall <wall@cockroachlabs.com>
Co-authored-by: Raphael 'kena' Poss <knz@thaumogen.net>
Co-authored-by: Xin Hao Zhang <xzhang@cockroachlabs.com>
Co-authored-by: Jane Xing <zhouxing@uchicago.edu>
Co-authored-by: Andrew Werner <ajwerner@cockroachlabs.com>
Co-authored-by: Shiranka Miskin <shiranka.miskin@gmail.com>
@yuzefovich yuzefovich added skipped-test A-tenant-streaming Including cluster streaming labels Aug 18, 2022
@adityamaru adityamaru assigned adityamaru and unassigned samiskin Sep 7, 2022
@adityamaru
Copy link
Contributor

adityamaru commented Sep 7, 2022 •
edited
Loading

I think one of these failures are all under deadlock, I'll try re-running this test under stress and under stress with deadlock. Maybe these heavy weight tests should be skipped exclusively under deadlock instead of always.

@adityamaru adityamaru mentioned this issue Sep 8, 2022
Merged
@adityamaru
Copy link
Contributor

Potentially fixed by #87027, if it fails again it'll reopen an issue.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@samiskin samiskin

Labels
A-tenant-streaming Including cluster streaming branch-master Failures and bugs on the master branch. C-test-failure Broken test (automatically or manually discovered). O-robot Originated from a bot. skipped-test
Projects
None yet
Milestone
22.2
Development

No branches or pull requests
4 participants
@yuzefovich @samiskin @adityamaru @cockroach-teamcity