Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

#3530 enhance sanity testing framework #958

Conversation

samuelcostae
Copy link
Contributor

Description

Enhanced Sanity Tests

Issues Resolved

#3530

Check List

  • Commits are signed per the DCO using --signoff

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

Signed-off-by: Sam <samuel.costa@eliatra.com>
Signed-off-by: Sam <samuel.costa@eliatra.com>
@samuelcostae samuelcostae force-pushed the #3530_Enhance_sanity_testing_framework branch from 1060c69 to 03187b8 Compare November 21, 2023 14:02
Signed-off-by: Sam <samuel.costa@eliatra.com>
Signed-off-by: Sam <samuel.costa@eliatra.com>
Signed-off-by: Sam <samuel.costa@eliatra.com>
Signed-off-by: Sam <samuel.costa@eliatra.com>
@samuelcostae samuelcostae marked this pull request as ready for review November 30, 2023 14:53
@samuelcostae samuelcostae changed the title DRAFT #3530 enhance sanity testing framework #3530 enhance sanity testing framework Nov 30, 2023
Signed-off-by: Sam <samuel.costa@eliatra.com>
@samuelcostae
Copy link
Contributor Author

@DarshitChanpura the tests are basically done, but based on the clarification on the issue discussion, i still have to replace the actual calls to the backend with mock responses.

I'm moving this out of draft without having complete that step I can get any feedback on the overall structure of the tests

Signed-off-by: Sam <samuel.costa@eliatra.com>
Signed-off-by: Sam <samuel.costa@eliatra.com>
@samuelcostae samuelcostae force-pushed the #3530_Enhance_sanity_testing_framework branch from b1d4517 to f28dba4 Compare December 2, 2023 02:23
samuelcostae and others added 3 commits December 4, 2023 18:47
Signed-off-by: Sam <samuel.costa@eliatra.com>
Signed-off-by: Sam <samuel.costa@eliatra.com>
@samuelcostae
Copy link
Contributor Author

@DarshitChanpura can you review this and let me know your thoughts? thanks

@samuelcostae
Copy link
Contributor Author

@DarshitChanpura friendly ping

Copy link
Member

@DarshitChanpura DarshitChanpura left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@DarshitChanpura
Copy link
Member

Could we get some maintainer reviews on this?

In the latest CI run, cy.wait didn't seem to have caused any issues

@ruanyl
Copy link
Member

ruanyl commented Jan 30, 2024

@samuelcostae should this backport to 2.x?

@DarshitChanpura
Copy link
Member

@samuelcostae should this backport to 2.x?

yes.

@DarshitChanpura
Copy link
Member

@SuZhou-Joe @xluo-aws @Hailong-am @ruanyl @wanglam @raintygao Can we get some reviews on this PR? Last update was more than a month ago.

samuelcostae and others added 3 commits March 6, 2024 13:57
Check if pattern was acually created

Signed-off-by: Sam <samuel.costa@eliatra.com>
…mework' into #3530_Enhance_sanity_testing_framework
@Hailong-am
Copy link
Collaborator

Hailong-am commented Mar 8, 2024

@samuelcostae would you mind paste local run result? The CI flow not running for the security-dashbaord-plugin and create an issue to track #1139

@samuelcostae
Copy link
Contributor Author

samuelcostae commented Mar 8, 2024

@samuelcostae would you mind past local run result? The CI flow not running for the security-dashbaord-plugin and create an issue to track #1139

Uploading Screenshot 2024-03-08 at 09.49.30.png…

  OpenSearch Dashboards Security Plugin - Enhanced Sanity Tests
    ✓ should create new tenant successfully by selecting `Create tenant` (19060ms)
    ✓ should create a new internal user (6521ms)
    ✓ should create a new role with specific permissions (17944ms)
    ✓ should add a new role mapping
    ✓ should create a new index pattern (58404ms)


  5 passing (2m)

 

@DarshitChanpura
Copy link
Member

@SuZhou-Joe @xluo-aws @ruanyl @wanglam @raintygao Can we get 1 more review on this PR?

@DarshitChanpura
Copy link
Member

@SuZhou-Joe @xluo-aws @ruanyl @wanglam @raintygao Can we get 1 more review on this PR please?

@DarshitChanpura
Copy link
Member

DarshitChanpura commented Mar 15, 2024

@davidlago @wbeckler can you please help get this unblocked?

@samuelcostae
Copy link
Contributor Author

@davidlago @wbeckler can you please help get this unblocked?

@davidlago @wbeckler Just a friendly ping for a second review.

Let us know any further work is required.

@DarshitChanpura
Copy link
Member

@SuZhou-Joe @xluo-aws @ruanyl @wanglam @raintygao Pinging for 1 more review on this PR please.

@DarshitChanpura
Copy link
Member

@SuZhou-Joe @xluo-aws @ruanyl @wanglam @raintygao Pinging for 1 more review on this PR please. This has been lingering for more than 2 weeks now.

@SuZhou-Joe SuZhou-Joe merged commit e1e0716 into opensearch-project:main Mar 28, 2024
84 checks passed
opensearch-trigger-bot bot pushed a commit that referenced this pull request Mar 28, 2024
* initial skeleton

Signed-off-by: Sam <samuel.costa@eliatra.com>

* first two sections

Signed-off-by: Sam <samuel.costa@eliatra.com>

* first two sections

Signed-off-by: Sam <samuel.costa@eliatra.com>

* index pattern creation

Signed-off-by: Sam <samuel.costa@eliatra.com>

* index pattern creation

Signed-off-by: Sam <samuel.costa@eliatra.com>

* Bug Fixes

Signed-off-by: Sam <samuel.costa@eliatra.com>

* Cleanup

Signed-off-by: Sam <samuel.costa@eliatra.com>

* Cleanup

Signed-off-by: Sam <samuel.costa@eliatra.com>

* Cleanup

Signed-off-by: Sam <samuel.costa@eliatra.com>

* Refactor

Signed-off-by: Sam <samuel.costa@eliatra.com>

* Comment/ Extra line removal

Signed-off-by: Sam <samuel.costa@eliatra.com>

* Using loadSampleData command instead of custom method.
Check if pattern was acually created

Signed-off-by: Sam <samuel.costa@eliatra.com>

---------

Signed-off-by: Sam <samuel.costa@eliatra.com>
(cherry picked from commit e1e0716)
@kavilla
Copy link
Member

kavilla commented Apr 2, 2024

One comment is that we should consider on cleaning up the addition of the sample data within the test itself. Otherwise it leaves the cluster in a dirty state and could case the next test to fail.

I would also verify that the expected test index isn't already existing to avoid transient failures.

@samuelcostae

SuZhou-Joe pushed a commit that referenced this pull request Apr 30, 2024
* initial skeleton

Signed-off-by: Sam <samuel.costa@eliatra.com>

* first two sections

Signed-off-by: Sam <samuel.costa@eliatra.com>

* first two sections

Signed-off-by: Sam <samuel.costa@eliatra.com>

* index pattern creation

Signed-off-by: Sam <samuel.costa@eliatra.com>

* index pattern creation

Signed-off-by: Sam <samuel.costa@eliatra.com>

* Bug Fixes

Signed-off-by: Sam <samuel.costa@eliatra.com>

* Cleanup

Signed-off-by: Sam <samuel.costa@eliatra.com>

* Cleanup

Signed-off-by: Sam <samuel.costa@eliatra.com>

* Cleanup

Signed-off-by: Sam <samuel.costa@eliatra.com>

* Refactor

Signed-off-by: Sam <samuel.costa@eliatra.com>

* Comment/ Extra line removal

Signed-off-by: Sam <samuel.costa@eliatra.com>

* Using loadSampleData command instead of custom method.
Check if pattern was acually created

Signed-off-by: Sam <samuel.costa@eliatra.com>

---------

Signed-off-by: Sam <samuel.costa@eliatra.com>
(cherry picked from commit e1e0716)
LDrago27 pushed a commit to LDrago27/opensearch-dashboards-functional-test that referenced this pull request May 3, 2024
* initial skeleton

Signed-off-by: Sam <samuel.costa@eliatra.com>

* first two sections

Signed-off-by: Sam <samuel.costa@eliatra.com>

* first two sections

Signed-off-by: Sam <samuel.costa@eliatra.com>

* index pattern creation

Signed-off-by: Sam <samuel.costa@eliatra.com>

* index pattern creation

Signed-off-by: Sam <samuel.costa@eliatra.com>

* Bug Fixes

Signed-off-by: Sam <samuel.costa@eliatra.com>

* Cleanup

Signed-off-by: Sam <samuel.costa@eliatra.com>

* Cleanup

Signed-off-by: Sam <samuel.costa@eliatra.com>

* Cleanup

Signed-off-by: Sam <samuel.costa@eliatra.com>

* Refactor

Signed-off-by: Sam <samuel.costa@eliatra.com>

* Comment/ Extra line removal

Signed-off-by: Sam <samuel.costa@eliatra.com>

* Using loadSampleData command instead of custom method.
Check if pattern was acually created

Signed-off-by: Sam <samuel.costa@eliatra.com>

---------

Signed-off-by: Sam <samuel.costa@eliatra.com>
SuZhou-Joe pushed a commit that referenced this pull request May 14, 2024
* initial skeleton

Signed-off-by: Sam <samuel.costa@eliatra.com>

* first two sections

Signed-off-by: Sam <samuel.costa@eliatra.com>

* first two sections

Signed-off-by: Sam <samuel.costa@eliatra.com>

* index pattern creation

Signed-off-by: Sam <samuel.costa@eliatra.com>

* index pattern creation

Signed-off-by: Sam <samuel.costa@eliatra.com>

* Bug Fixes

Signed-off-by: Sam <samuel.costa@eliatra.com>

* Cleanup

Signed-off-by: Sam <samuel.costa@eliatra.com>

* Cleanup

Signed-off-by: Sam <samuel.costa@eliatra.com>

* Cleanup

Signed-off-by: Sam <samuel.costa@eliatra.com>

* Refactor

Signed-off-by: Sam <samuel.costa@eliatra.com>

* Comment/ Extra line removal

Signed-off-by: Sam <samuel.costa@eliatra.com>

* Using loadSampleData command instead of custom method.
Check if pattern was acually created

Signed-off-by: Sam <samuel.costa@eliatra.com>

---------

Signed-off-by: Sam <samuel.costa@eliatra.com>
(cherry picked from commit e1e0716)
SuZhou-Joe pushed a commit that referenced this pull request Sep 3, 2024
* initial skeleton

Signed-off-by: Sam <samuel.costa@eliatra.com>

* first two sections

Signed-off-by: Sam <samuel.costa@eliatra.com>

* first two sections

Signed-off-by: Sam <samuel.costa@eliatra.com>

* index pattern creation

Signed-off-by: Sam <samuel.costa@eliatra.com>

* index pattern creation

Signed-off-by: Sam <samuel.costa@eliatra.com>

* Bug Fixes

Signed-off-by: Sam <samuel.costa@eliatra.com>

* Cleanup

Signed-off-by: Sam <samuel.costa@eliatra.com>

* Cleanup

Signed-off-by: Sam <samuel.costa@eliatra.com>

* Cleanup

Signed-off-by: Sam <samuel.costa@eliatra.com>

* Refactor

Signed-off-by: Sam <samuel.costa@eliatra.com>

* Comment/ Extra line removal

Signed-off-by: Sam <samuel.costa@eliatra.com>

* Using loadSampleData command instead of custom method.
Check if pattern was acually created

Signed-off-by: Sam <samuel.costa@eliatra.com>

---------

Signed-off-by: Sam <samuel.costa@eliatra.com>
(cherry picked from commit e1e0716)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants