Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: working on running all component tests together #8703

Merged
merged 27 commits into from
Nov 3, 2020

Conversation

bahmutov
Copy link
Contributor

@bahmutov bahmutov commented Sep 30, 2020

User facing changelog

Run all integration specs or all component specs (or filtered list of specs) by clicking the appropriate button, see the video below

Additional details

How has the user experience changed?

PR Tasks

  • display the number of filtered specs for each type inside the button, like "Run 1 spec" for integration and "Run 5 specs" for component button below

Implemented

  • remove the original "Run all specs" button, since now we have two separate buttons
  • update the button text and labels depending on the running situation

run-n

Notes

I have looked how the current implementation in develop sets the active class on the clicked spec, or on all running specs, and have left it as is. But I think it is incorrect and in the future we should fix it. Right now, when you click on a single spec, it starts running, BUT the "Running All Specs" button is still enabled, since it does not have "active" class. Thus you can click on it, which seems wrong. I think it should be required to stop running spec first before clicking on the "Run all ..." button is allowed.

  • @jennifer-shehane likes UI
  • Have tests been added/updated?
  • Has the original issue been tagged with a release in ZenHub?

@cypress-bot
Copy link
Contributor

cypress-bot bot commented Sep 30, 2020

Thanks for taking the time to open a PR!

@cypress
Copy link

cypress bot commented Sep 30, 2020



Test summary

3855 0 55 1


Run details

Project cypress
Status Passed
Commit deef398
Started Nov 3, 2020 6:47 AM
Ended Nov 3, 2020 6:57 AM
Duration 10:48 💡
OS Linux Debian - 10.2
Browser Firefox 77

View run in Cypress Dashboard ➡️


This comment has been generated by cypress-bot as a result of this project's GitHub integration settings. You can manage this integration in this project's settings in the Cypress Dashboard

@bahmutov bahmutov changed the title working on running all component tests together feat: working on running all component tests together Oct 5, 2020
Copy link
Member

@jennifer-shehane jennifer-shehane left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This closes this issue: #8203

The concept seems fine to me to move forward. Just need to fix some css and add some tests. 👍

  1. The 'running' text runs into the scrollbar if its present on the list.

Screen Shot 2020-10-13 at 12 57 29 PM copy

  1. The 'running' button also floats above the scrolled list when you scroll.

Screen Shot 2020-10-13 at 12 58 54 PM copy

@bahmutov
Copy link
Contributor Author

Fixed positions on scroll

flex

Now just updating the tests

@bahmutov
Copy link
Contributor Author

Current problem - while all tests are running, the user can change the search mask - and the label on the button changes

changing-number-while-running

I might just change that label to be "Running integration specs" instead of being explicit "Running N integration specs"

@bahmutov bahmutov marked this pull request as ready for review October 30, 2020 20:33
Copy link
Member

@jennifer-shehane jennifer-shehane left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You gotta love CSS. The expand arrow was now comically tiny, I fixed this.

Screen Shot 2020-11-03 at 12 38 56 PM

Nitpick: The spec name shown in the Test Runner doesn't seem to match the new logic. Maybe this isn't that important.

  • It always shows 'All Specs' for either integration/component tests.

Screen Shot 2020-11-03 at 12 50 29 PM

  • As well as the filtered specs (this matched 2 integration and 2 component tests), and I ran component tests but it just says 'specs matching "nav"'.

Screen Shot 2020-11-03 at 12 52 27 PM

I also just realized we're mixing 'specs' and 'tests' terminology. The tab says 'Tests', the panel says 'Tests', but the buttons / titles in the Test Runner say 'specs'. I'm mostly just talking out loud about this.

@bahmutov
Copy link
Contributor Author

bahmutov commented Nov 3, 2020

@jennifer-shehane you are right - the problem is that the browser has very little info about what it is running. This even creates problems for the desktop-gui, since it gets an even from the browser "running tests" and all it knows is the URL, but not the type of the tests for example, or the search pattern. That should be refactored I feel in a separate PR to be consistent and good.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Component tests not run when clicking 'Run n specs' button
2 participants