Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

--test_verbose_timeout_warnings: test execution time tracking is broken for cached tests #13103

Open
davido opened this issue Feb 25, 2021 · 1 comment
Labels
P2 We'll consider working on this in future. (Assignee optional) team-OSS Issues for the Bazel OSS team: installation, release processBazel packaging, website type: bug

Comments

@davido
Copy link
Contributor

davido commented Feb 25, 2021

Detected on Bazel 4.0.0. If this options is passed: --test_verbose_timeout_warnings, and if the tests are cached then the warning is erroneously reported.

Here is example build for Gerrit project on RBE:

INFO: 1197 processes: 447 remote cache hit, 739 internal, 11 remote.
INFO: Build completed successfully, 1197 total actions
//Documentation:check_licenses                                  (cached) PASSED in 0.2s
  WARNING: //Documentation:check_licenses: Test execution time (0.2s excluding execution overhead) outside of range for MODERATE tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance:acceptance_framework_tests (cached) PASSED in 0.6s
  WARNING: //javatests/com/google/gerrit/acceptance:acceptance_framework_tests: Test execution time (0.6s excluding execution overhead) outside of range for MODERATE tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/annotation:annotation  (cached) PASSED in 0.8s
  WARNING: //javatests/com/google/gerrit/acceptance/annotation:annotation: Test execution time (0.8s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/api/accounts:api_account (cached) PASSED in 1.1s
  WARNING: //javatests/com/google/gerrit/acceptance/api/accounts:api_account: Test execution time (1.1s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/api/change:AbandonIT   (cached) PASSED in 0.5s
  WARNING: //javatests/com/google/gerrit/acceptance/api/change:AbandonIT: Test execution time (0.5s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/api/change:ChangeIT    (cached) PASSED in 0.5s
  WARNING: //javatests/com/google/gerrit/acceptance/api/change:ChangeIT: Test execution time (0.5s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/api/change:ChangeIdIT  (cached) PASSED in 0.9s
  WARNING: //javatests/com/google/gerrit/acceptance/api/change:ChangeIdIT: Test execution time (0.9s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/api/change:ChangeSubmitRequirementIT (cached) PASSED in 0.5s
  WARNING: //javatests/com/google/gerrit/acceptance/api/change:ChangeSubmitRequirementIT: Test execution time (0.5s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/api/change:CreateMergePatchSetIT (cached) PASSED in 0.5s
  WARNING: //javatests/com/google/gerrit/acceptance/api/change:CreateMergePatchSetIT: Test execution time (0.5s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/api/change:DisablePrivateChangesIT (cached) PASSED in 0.5s
  WARNING: //javatests/com/google/gerrit/acceptance/api/change:DisablePrivateChangesIT: Test execution time (0.5s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/api/change:MergeListIT (cached) PASSED in 0.5s
  WARNING: //javatests/com/google/gerrit/acceptance/api/change:MergeListIT: Test execution time (0.5s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/api/change:PluginFieldsIT (cached) PASSED in 0.6s
  WARNING: //javatests/com/google/gerrit/acceptance/api/change:PluginFieldsIT: Test execution time (0.6s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/api/change:PluginOperatorsIT (cached) PASSED in 0.6s
  WARNING: //javatests/com/google/gerrit/acceptance/api/change:PluginOperatorsIT: Test execution time (0.6s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/api/change:PostReviewIT (cached) PASSED in 0.6s
  WARNING: //javatests/com/google/gerrit/acceptance/api/change:PostReviewIT: Test execution time (0.6s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/api/change:PrivateChangeIT (cached) PASSED in 0.4s
  WARNING: //javatests/com/google/gerrit/acceptance/api/change:PrivateChangeIT: Test execution time (0.4s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/api/change:QueryChangesIT (cached) PASSED in 0.5s
  WARNING: //javatests/com/google/gerrit/acceptance/api/change:QueryChangesIT: Test execution time (0.5s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/api/change:RevertIT    (cached) PASSED in 0.5s
  WARNING: //javatests/com/google/gerrit/acceptance/api/change:RevertIT: Test execution time (0.5s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/api/change:StickyApprovalsIT (cached) PASSED in 0.4s
  WARNING: //javatests/com/google/gerrit/acceptance/api/change:StickyApprovalsIT: Test execution time (0.4s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/api/change:SubmitTypeRuleIT (cached) PASSED in 0.4s
  WARNING: //javatests/com/google/gerrit/acceptance/api/change:SubmitTypeRuleIT: Test execution time (0.4s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/api/change:SubmitWithStickyApprovalDiffIT (cached) PASSED in 0.6s
  WARNING: //javatests/com/google/gerrit/acceptance/api/change:SubmitWithStickyApprovalDiffIT: Test execution time (0.6s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/api/config:api_config  (cached) PASSED in 0.5s
  WARNING: //javatests/com/google/gerrit/acceptance/api/config:api_config: Test execution time (0.5s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/api/group:api_group    (cached) PASSED in 1.2s
  WARNING: //javatests/com/google/gerrit/acceptance/api/group:api_group: Test execution time (1.2s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/api/plugin:api_plugin  (cached) PASSED in 0.7s
  WARNING: //javatests/com/google/gerrit/acceptance/api/plugin:api_plugin: Test execution time (0.7s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/api/project:api_project (cached) PASSED in 0.8s
  WARNING: //javatests/com/google/gerrit/acceptance/api/project:api_project: Test execution time (0.8s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/api/revision:GetBlameIT (cached) PASSED in 0.8s
  WARNING: //javatests/com/google/gerrit/acceptance/api/revision:GetBlameIT: Test execution time (0.8s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/api/revision:PortedCommentsIT (cached) PASSED in 0.8s
  WARNING: //javatests/com/google/gerrit/acceptance/api/revision:PortedCommentsIT: Test execution time (0.8s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/api/revision:RevisionDiffIT (cached) PASSED in 0.9s
  WARNING: //javatests/com/google/gerrit/acceptance/api/revision:RevisionDiffIT: Test execution time (0.9s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/api/revision:RevisionDiffIntralineIT (cached) PASSED in 1.0s
  WARNING: //javatests/com/google/gerrit/acceptance/api/revision:RevisionDiffIntralineIT: Test execution time (1.0s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/api/revision:RevisionIT (cached) PASSED in 1.0s
  WARNING: //javatests/com/google/gerrit/acceptance/api/revision:RevisionIT: Test execution time (1.0s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/api/revision:RevisionNewDiffCacheIT (cached) PASSED in 1.0s
  WARNING: //javatests/com/google/gerrit/acceptance/api/revision:RevisionNewDiffCacheIT: Test execution time (1.0s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/api/revision:RobotCommentsIT (cached) PASSED in 0.8s
  WARNING: //javatests/com/google/gerrit/acceptance/api/revision:RobotCommentsIT: Test execution time (0.8s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/config:config          (cached) PASSED in 0.7s
  WARNING: //javatests/com/google/gerrit/acceptance/config:config: Test execution time (0.7s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/edit:edit              (cached) PASSED in 0.5s
  WARNING: //javatests/com/google/gerrit/acceptance/edit:edit: Test execution time (0.5s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/filter:filter          (cached) PASSED in 0.7s
  WARNING: //javatests/com/google/gerrit/acceptance/filter:filter: Test execution time (0.7s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/git:GitOverHttpServletIT (cached) PASSED in 0.9s
  WARNING: //javatests/com/google/gerrit/acceptance/git:GitOverHttpServletIT: Test execution time (0.9s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/git:GitOverHttpServletWithSshdEnabledIT (cached) PASSED in 1.0s
  WARNING: //javatests/com/google/gerrit/acceptance/git:GitOverHttpServletWithSshdEnabledIT: Test execution time (1.0s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/git:GitmodulesIT       (cached) PASSED in 0.8s
  WARNING: //javatests/com/google/gerrit/acceptance/git:GitmodulesIT: Test execution time (0.8s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/git:HttpForcePushIT    (cached) PASSED in 0.8s
  WARNING: //javatests/com/google/gerrit/acceptance/git:HttpForcePushIT: Test execution time (0.8s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/git:HttpSubmitOnPushIT (cached) PASSED in 0.6s
  WARNING: //javatests/com/google/gerrit/acceptance/git:HttpSubmitOnPushIT: Test execution time (0.6s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/git:ImplicitMergeCheckIT (cached) PASSED in 0.5s
  WARNING: //javatests/com/google/gerrit/acceptance/git:ImplicitMergeCheckIT: Test execution time (0.5s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/git:PushAccountIT      (cached) PASSED in 0.9s
  WARNING: //javatests/com/google/gerrit/acceptance/git:PushAccountIT: Test execution time (0.9s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/git:PushPermissionsIT  (cached) PASSED in 0.9s
  WARNING: //javatests/com/google/gerrit/acceptance/git:PushPermissionsIT: Test execution time (0.9s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/git:RefAdvertisementIT (cached) PASSED in 0.8s
  WARNING: //javatests/com/google/gerrit/acceptance/git:RefAdvertisementIT: Test execution time (0.8s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/git:RefOperationValidationIT (cached) PASSED in 0.9s
  WARNING: //javatests/com/google/gerrit/acceptance/git:RefOperationValidationIT: Test execution time (0.9s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/git:SshForcePushIT     (cached) PASSED in 0.5s
  WARNING: //javatests/com/google/gerrit/acceptance/git:SshForcePushIT: Test execution time (0.5s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/git:SshPushForReviewIT (cached) PASSED in 1.0s
  WARNING: //javatests/com/google/gerrit/acceptance/git:SshPushForReviewIT: Test execution time (1.0s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/git:SshSubmitOnPushIT  (cached) PASSED in 0.7s
  WARNING: //javatests/com/google/gerrit/acceptance/git:SshSubmitOnPushIT: Test execution time (0.7s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/git:SubmoduleSubscriptionsIT (cached) PASSED in 0.9s
  WARNING: //javatests/com/google/gerrit/acceptance/git:SubmoduleSubscriptionsIT: Test execution time (0.9s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/git:SubmoduleSubscriptionsWholeTopicMergeIT (cached) PASSED in 1.1s
  WARNING: //javatests/com/google/gerrit/acceptance/git:SubmoduleSubscriptionsWholeTopicMergeIT: Test execution time (1.1s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/pgm:pgm                (cached) PASSED in 0.9s
  WARNING: //javatests/com/google/gerrit/acceptance/pgm:pgm: Test execution time (0.9s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/rest:rest_bindings_collection (cached) PASSED in 1.2s
  WARNING: //javatests/com/google/gerrit/acceptance/rest:rest_bindings_collection: Test execution time (1.2s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/rest/account:rest_account (cached) PASSED in 1.0s
  WARNING: //javatests/com/google/gerrit/acceptance/rest/account:rest_account: Test execution time (1.0s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/rest/auth:auth         (cached) PASSED in 0.9s
  WARNING: //javatests/com/google/gerrit/acceptance/rest/auth:auth: Test execution time (0.9s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/rest/binding:rest_bindings (cached) PASSED in 0.9s
  WARNING: //javatests/com/google/gerrit/acceptance/rest/binding:rest_bindings: Test execution time (0.9s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/rest/change:SubmitByCherryPickIT (cached) PASSED in 0.9s
  WARNING: //javatests/com/google/gerrit/acceptance/rest/change:SubmitByCherryPickIT: Test execution time (0.9s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/rest/change:SubmitByFastForwardIT (cached) PASSED in 0.8s
  WARNING: //javatests/com/google/gerrit/acceptance/rest/change:SubmitByFastForwardIT: Test execution time (0.8s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/rest/change:SubmitByMergeAlwaysIT (cached) PASSED in 1.0s
  WARNING: //javatests/com/google/gerrit/acceptance/rest/change:SubmitByMergeAlwaysIT: Test execution time (1.0s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/rest/change:SubmitByMergeIfNecessaryIT (cached) PASSED in 0.8s
  WARNING: //javatests/com/google/gerrit/acceptance/rest/change:SubmitByMergeIfNecessaryIT: Test execution time (0.8s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/rest/change:SubmitByRebaseAlwaysIT (cached) PASSED in 0.9s
  WARNING: //javatests/com/google/gerrit/acceptance/rest/change:SubmitByRebaseAlwaysIT: Test execution time (0.9s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/rest/change:SubmitByRebaseIfNecessaryIT (cached) PASSED in 1.1s
  WARNING: //javatests/com/google/gerrit/acceptance/rest/change:SubmitByRebaseIfNecessaryIT: Test execution time (1.1s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/rest/change:SubmitResolvingMergeCommitIT (cached) PASSED in 0.6s
  WARNING: //javatests/com/google/gerrit/acceptance/rest/change:SubmitResolvingMergeCommitIT: Test execution time (0.6s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/rest/change:rest_change_other (cached) PASSED in 1.0s
  WARNING: //javatests/com/google/gerrit/acceptance/rest/change:rest_change_other: Test execution time (1.0s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/rest/config:rest_config (cached) PASSED in 0.8s
  WARNING: //javatests/com/google/gerrit/acceptance/rest/config:rest_config: Test execution time (0.8s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/rest/group:rest_group  (cached) PASSED in 0.4s
  WARNING: //javatests/com/google/gerrit/acceptance/rest/group:rest_group: Test execution time (0.4s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/rest/project:AccessIT  (cached) PASSED in 0.5s
  WARNING: //javatests/com/google/gerrit/acceptance/rest/project:AccessIT: Test execution time (0.5s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/rest/project:BanCommitIT (cached) PASSED in 0.9s
  WARNING: //javatests/com/google/gerrit/acceptance/rest/project:BanCommitIT: Test execution time (0.9s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/rest/project:CheckMergeabilityIT (cached) PASSED in 0.7s
  WARNING: //javatests/com/google/gerrit/acceptance/rest/project:CheckMergeabilityIT: Test execution time (0.7s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/rest/project:CreateBranchIT (cached) PASSED in 0.6s
  WARNING: //javatests/com/google/gerrit/acceptance/rest/project:CreateBranchIT: Test execution time (0.6s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/rest/project:CreateChangeIT (cached) PASSED in 0.8s
  WARNING: //javatests/com/google/gerrit/acceptance/rest/project:CreateChangeIT: Test execution time (0.8s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/rest/project:CreateLabelIT (cached) PASSED in 0.5s
  WARNING: //javatests/com/google/gerrit/acceptance/rest/project:CreateLabelIT: Test execution time (0.5s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/rest/project:CreateProjectIT (cached) PASSED in 0.7s
  WARNING: //javatests/com/google/gerrit/acceptance/rest/project:CreateProjectIT: Test execution time (0.7s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/rest/project:DeleteBranchIT (cached) PASSED in 0.5s
  WARNING: //javatests/com/google/gerrit/acceptance/rest/project:DeleteBranchIT: Test execution time (0.5s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/rest/project:DeleteBranchesIT (cached) PASSED in 0.6s
  WARNING: //javatests/com/google/gerrit/acceptance/rest/project:DeleteBranchesIT: Test execution time (0.6s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/rest/project:DeleteLabelIT (cached) PASSED in 0.5s
  WARNING: //javatests/com/google/gerrit/acceptance/rest/project:DeleteLabelIT: Test execution time (0.5s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/rest/project:DeleteTagIT (cached) PASSED in 0.8s
  WARNING: //javatests/com/google/gerrit/acceptance/rest/project:DeleteTagIT: Test execution time (0.8s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/rest/project:DeleteTagsIT (cached) PASSED in 0.7s
  WARNING: //javatests/com/google/gerrit/acceptance/rest/project:DeleteTagsIT: Test execution time (0.7s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/rest/project:FileBranchIT (cached) PASSED in 0.5s
  WARNING: //javatests/com/google/gerrit/acceptance/rest/project:FileBranchIT: Test execution time (0.5s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/rest/project:FilesInCommitIT (cached) PASSED in 0.6s
  WARNING: //javatests/com/google/gerrit/acceptance/rest/project:FilesInCommitIT: Test execution time (0.6s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/rest/project:GarbageCollectionIT (cached) PASSED in 0.5s
  WARNING: //javatests/com/google/gerrit/acceptance/rest/project:GarbageCollectionIT: Test execution time (0.5s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/rest/project:GetBranchIT (cached) PASSED in 0.7s
  WARNING: //javatests/com/google/gerrit/acceptance/rest/project:GetBranchIT: Test execution time (0.7s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/rest/project:GetChildProjectIT (cached) PASSED in 0.7s
  WARNING: //javatests/com/google/gerrit/acceptance/rest/project:GetChildProjectIT: Test execution time (0.7s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/rest/project:GetCommitIT (cached) PASSED in 0.6s
  WARNING: //javatests/com/google/gerrit/acceptance/rest/project:GetCommitIT: Test execution time (0.6s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/rest/project:GetLabelIT (cached) PASSED in 1.1s
  WARNING: //javatests/com/google/gerrit/acceptance/rest/project:GetLabelIT: Test execution time (1.1s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/rest/project:GetProjectIT (cached) PASSED in 0.6s
  WARNING: //javatests/com/google/gerrit/acceptance/rest/project:GetProjectIT: Test execution time (0.6s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/rest/project:HttpPushAnnotatedTagIT (cached) PASSED in 0.8s
  WARNING: //javatests/com/google/gerrit/acceptance/rest/project:HttpPushAnnotatedTagIT: Test execution time (0.8s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/rest/project:HttpPushLightweightTagIT (cached) PASSED in 0.7s
  WARNING: //javatests/com/google/gerrit/acceptance/rest/project:HttpPushLightweightTagIT: Test execution time (0.7s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/rest/project:ListBranchesIT (cached) PASSED in 0.9s
  WARNING: //javatests/com/google/gerrit/acceptance/rest/project:ListBranchesIT: Test execution time (0.9s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/rest/project:ListChildProjectsIT (cached) PASSED in 0.8s
  WARNING: //javatests/com/google/gerrit/acceptance/rest/project:ListChildProjectsIT: Test execution time (0.8s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/rest/project:ListCommitFilesIT (cached) PASSED in 0.5s
  WARNING: //javatests/com/google/gerrit/acceptance/rest/project:ListCommitFilesIT: Test execution time (0.5s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/rest/project:ListLabelsIT (cached) PASSED in 0.6s
  WARNING: //javatests/com/google/gerrit/acceptance/rest/project:ListLabelsIT: Test execution time (0.6s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/rest/project:ListProjectsIT (cached) PASSED in 0.8s
  WARNING: //javatests/com/google/gerrit/acceptance/rest/project:ListProjectsIT: Test execution time (0.8s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/rest/project:PluginAccessIT (cached) PASSED in 0.5s
  WARNING: //javatests/com/google/gerrit/acceptance/rest/project:PluginAccessIT: Test execution time (0.5s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/rest/project:PostLabelsIT (cached) PASSED in 0.7s
  WARNING: //javatests/com/google/gerrit/acceptance/rest/project:PostLabelsIT: Test execution time (0.7s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/rest/project:ProjectLevelConfigIT (cached) PASSED in 0.6s
  WARNING: //javatests/com/google/gerrit/acceptance/rest/project:ProjectLevelConfigIT: Test execution time (0.6s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/rest/project:SetLabelIT (cached) PASSED in 0.7s
  WARNING: //javatests/com/google/gerrit/acceptance/rest/project:SetLabelIT: Test execution time (0.7s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/rest/project:SshPushAnnotatedTagIT (cached) PASSED in 0.5s
  WARNING: //javatests/com/google/gerrit/acceptance/rest/project:SshPushAnnotatedTagIT: Test execution time (0.5s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/rest/project:SshPushLightweightTagIT (cached) PASSED in 0.6s
  WARNING: //javatests/com/google/gerrit/acceptance/rest/project:SshPushLightweightTagIT: Test execution time (0.6s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/rest/project:TagsIT    (cached) PASSED in 0.6s
  WARNING: //javatests/com/google/gerrit/acceptance/rest/project:TagsIT: Test execution time (0.6s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/rest/revision:rest_revision (cached) PASSED in 0.5s
  WARNING: //javatests/com/google/gerrit/acceptance/rest/revision:rest_revision: Test execution time (0.5s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/server/account:server_account (cached) PASSED in 0.7s
  WARNING: //javatests/com/google/gerrit/acceptance/server/account:server_account: Test execution time (0.7s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/server/change:server_change (cached) PASSED in 1.0s
  WARNING: //javatests/com/google/gerrit/acceptance/server/change:server_change: Test execution time (1.0s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/server/config:server_config (cached) PASSED in 0.5s
  WARNING: //javatests/com/google/gerrit/acceptance/server/config:server_config: Test execution time (0.5s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/server/event:server_event (cached) PASSED in 0.5s
  WARNING: //javatests/com/google/gerrit/acceptance/server/event:server_event: Test execution time (0.5s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/server/experiments:server_experiments (cached) PASSED in 0.8s
  WARNING: //javatests/com/google/gerrit/acceptance/server/experiments:server_experiments: Test execution time (0.8s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/server/git/receive:receive (cached) PASSED in 0.6s
  WARNING: //javatests/com/google/gerrit/acceptance/server/git/receive:receive: Test execution time (0.6s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/server/httpd:server_httpd (cached) PASSED in 1.1s
  WARNING: //javatests/com/google/gerrit/acceptance/server/httpd:server_httpd: Test execution time (1.1s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/server/mail:ChangeNotificationsIT (cached) PASSED in 0.7s
  WARNING: //javatests/com/google/gerrit/acceptance/server/mail:ChangeNotificationsIT: Test execution time (0.7s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/server/mail:EmailValidatorIT (cached) PASSED in 0.5s
  WARNING: //javatests/com/google/gerrit/acceptance/server/mail:EmailValidatorIT: Test execution time (0.5s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/server/mail:ListMailFilterIT (cached) PASSED in 0.9s
  WARNING: //javatests/com/google/gerrit/acceptance/server/mail:ListMailFilterIT: Test execution time (0.9s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/server/mail:MailIT     (cached) PASSED in 0.6s
  WARNING: //javatests/com/google/gerrit/acceptance/server/mail:MailIT: Test execution time (0.6s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/server/mail:MailMetadataIT (cached) PASSED in 0.8s
  WARNING: //javatests/com/google/gerrit/acceptance/server/mail:MailMetadataIT: Test execution time (0.8s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/server/mail:MailProcessorIT (cached) PASSED in 0.4s
  WARNING: //javatests/com/google/gerrit/acceptance/server/mail:MailProcessorIT: Test execution time (0.4s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/server/mail:MailSenderIT (cached) PASSED in 0.7s
  WARNING: //javatests/com/google/gerrit/acceptance/server/mail:MailSenderIT: Test execution time (0.7s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/server/mail:NotificationMailFormatIT (cached) PASSED in 0.8s
  WARNING: //javatests/com/google/gerrit/acceptance/server/mail:NotificationMailFormatIT: Test execution time (0.8s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/server/mail:SignedTokenEmailTokenVerifierIT (cached) PASSED in 0.6s
  WARNING: //javatests/com/google/gerrit/acceptance/server/mail:SignedTokenEmailTokenVerifierIT: Test execution time (0.6s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/server/notedb:server_notedb (cached) PASSED in 0.9s
  WARNING: //javatests/com/google/gerrit/acceptance/server/notedb:server_notedb: Test execution time (0.9s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/server/permissions:server_permissions (cached) PASSED in 0.6s
  WARNING: //javatests/com/google/gerrit/acceptance/server/permissions:server_permissions: Test execution time (0.6s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/server/project:server_project (cached) PASSED in 0.6s
  WARNING: //javatests/com/google/gerrit/acceptance/server/project:server_project: Test execution time (0.6s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/server/quota:server_quota (cached) PASSED in 0.5s
  WARNING: //javatests/com/google/gerrit/acceptance/server/quota:server_quota: Test execution time (0.5s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/server/rules:server_rules (cached) PASSED in 0.7s
  WARNING: //javatests/com/google/gerrit/acceptance/server/rules:server_rules: Test execution time (0.7s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/server/util:server_util (cached) PASSED in 0.6s
  WARNING: //javatests/com/google/gerrit/acceptance/server/util:server_util: Test execution time (0.6s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/acceptance/ssh:ssh                (cached) PASSED in 1.1s
  WARNING: //javatests/com/google/gerrit/acceptance/ssh:ssh: Test execution time (1.1s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/auth:auth_tests                   (cached) PASSED in 0.3s
  WARNING: //javatests/com/google/gerrit/auth:auth_tests: Test execution time (0.3s excluding execution overhead) outside of range for MODERATE tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/common/data:data_tests            (cached) PASSED in 0.6s
  WARNING: //javatests/com/google/gerrit/common/data:data_tests: Test execution time (0.6s excluding execution overhead) outside of range for MODERATE tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/entities:entities_tests           (cached) PASSED in 0.6s
  WARNING: //javatests/com/google/gerrit/entities:entities_tests: Test execution time (0.6s excluding execution overhead) outside of range for MODERATE tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/entities/converter:proto_converter_tests (cached) PASSED in 0.8s
  WARNING: //javatests/com/google/gerrit/entities/converter:proto_converter_tests: Test execution time (0.8s excluding execution overhead) outside of range for MODERATE tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/extensions:extensions_api_tests   (cached) PASSED in 0.7s
//javatests/com/google/gerrit/extensions/conditions:conditions_tests (cached) PASSED in 0.8s
  WARNING: //javatests/com/google/gerrit/extensions/conditions:conditions_tests: Test execution time (0.8s excluding execution overhead) outside of range for MODERATE tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/git:medium_tests                  (cached) PASSED in 0.5s
//javatests/com/google/gerrit/git:small_tests                   (cached) PASSED in 0.9s
//javatests/com/google/gerrit/git/testing:testing_tests         (cached) PASSED in 0.8s
  WARNING: //javatests/com/google/gerrit/git/testing:testing_tests: Test execution time (0.8s excluding execution overhead) outside of range for MODERATE tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/gpg:gpg_tests                     (cached) PASSED in 1.0s
  WARNING: //javatests/com/google/gerrit/gpg:gpg_tests: Test execution time (1.0s excluding execution overhead) outside of range for MODERATE tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/httpd:httpd_tests                 (cached) PASSED in 1.1s
  WARNING: //javatests/com/google/gerrit/httpd:httpd_tests: Test execution time (1.1s excluding execution overhead) outside of range for MODERATE tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/index:tests                       (cached) PASSED in 0.7s
//javatests/com/google/gerrit/integration/git:upload-archive    (cached) PASSED in 0.6s
  WARNING: //javatests/com/google/gerrit/integration/git:upload-archive: Test execution time (0.6s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/integration/ssh:peer-keys-auth    (cached) PASSED in 0.8s
  WARNING: //javatests/com/google/gerrit/integration/ssh:peer-keys-auth: Test execution time (0.8s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/json:json_tests                   (cached) PASSED in 0.8s
  WARNING: //javatests/com/google/gerrit/json:json_tests: Test execution time (0.8s excluding execution overhead) outside of range for MODERATE tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/mail:maillib_tests                (cached) PASSED in 1.1s
//javatests/com/google/gerrit/metrics/dropwizard:dropwizard_tests (cached) PASSED in 0.8s
  WARNING: //javatests/com/google/gerrit/metrics/dropwizard:dropwizard_tests: Test execution time (0.8s excluding execution overhead) outside of range for MODERATE tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/metrics/proc:proc_tests           (cached) PASSED in 0.5s
//javatests/com/google/gerrit/pgm:pgm_license_test              (cached) PASSED in 1.3s
  WARNING: //javatests/com/google/gerrit/pgm:pgm_license_test: Test execution time (1.3s excluding execution overhead) outside of range for MODERATE tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/pgm:pgm_tests                     (cached) PASSED in 0.8s
  WARNING: //javatests/com/google/gerrit/pgm:pgm_tests: Test execution time (0.8s excluding execution overhead) outside of range for MODERATE tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/prettify:prettify_tests           (cached) PASSED in 0.6s
  WARNING: //javatests/com/google/gerrit/prettify:prettify_tests: Test execution time (0.6s excluding execution overhead) outside of range for MODERATE tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/proto:proto_tests                 (cached) PASSED in 0.8s
  WARNING: //javatests/com/google/gerrit/proto:proto_tests: Test execution time (0.8s excluding execution overhead) outside of range for MODERATE tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/server:server_tests               (cached) PASSED in 0.6s
  WARNING: //javatests/com/google/gerrit/server:server_tests: Test execution time (0.6s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/server/cache:server_cache         (cached) PASSED in 0.9s
  WARNING: //javatests/com/google/gerrit/server/cache:server_cache: Test execution time (0.9s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/server/cache:tests                (cached) PASSED in 0.5s
  WARNING: //javatests/com/google/gerrit/server/cache:tests: Test execution time (0.5s excluding execution overhead) outside of range for MODERATE tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/server/cache/h2:tests             (cached) PASSED in 0.8s
  WARNING: //javatests/com/google/gerrit/server/cache/h2:tests: Test execution time (0.8s excluding execution overhead) outside of range for MODERATE tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/server/cache/serialize:tests      (cached) PASSED in 0.7s
  WARNING: //javatests/com/google/gerrit/server/cache/serialize:tests: Test execution time (0.7s excluding execution overhead) outside of range for MODERATE tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/server/cache/serialize/entities:tests (cached) PASSED in 0.7s
  WARNING: //javatests/com/google/gerrit/server/cache/serialize/entities:tests: Test execution time (0.7s excluding execution overhead) outside of range for MODERATE tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/server/events:events_tests        (cached) PASSED in 0.8s
  WARNING: //javatests/com/google/gerrit/server/events:events_tests: Test execution time (0.8s excluding execution overhead) outside of range for MODERATE tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/server/group/db:db_tests          (cached) PASSED in 0.8s
//javatests/com/google/gerrit/server/ioutil:ioutil_tests        (cached) PASSED in 0.8s
//javatests/com/google/gerrit/server/query/account:lucene_query_test (cached) PASSED in 0.7s
  WARNING: //javatests/com/google/gerrit/server/query/account:lucene_query_test: Test execution time (0.7s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/server/query/change:LuceneQueryChangesLatestIndexVersionTest (cached) PASSED in 1.3s
  WARNING: //javatests/com/google/gerrit/server/query/change:LuceneQueryChangesLatestIndexVersionTest: Test execution time (1.3s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/server/query/change:LuceneQueryChangesPreviousIndexVersionTest (cached) PASSED in 1.1s
  WARNING: //javatests/com/google/gerrit/server/query/change:LuceneQueryChangesPreviousIndexVersionTest: Test execution time (1.1s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/server/query/change:small_tests   (cached) PASSED in 0.7s
//javatests/com/google/gerrit/server/query/group:lucene_query_test (cached) PASSED in 0.9s
  WARNING: //javatests/com/google/gerrit/server/query/group:lucene_query_test: Test execution time (0.9s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/server/query/project:lucene_query_test (cached) PASSED in 1.0s
  WARNING: //javatests/com/google/gerrit/server/query/project:lucene_query_test: Test execution time (1.0s excluding execution overhead) outside of range for LONG tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/server/rules:prolog_tests         (cached) PASSED in 0.9s
  WARNING: //javatests/com/google/gerrit/server/rules:prolog_tests: Test execution time (0.9s excluding execution overhead) outside of range for MODERATE tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/server/submit:submit_tests        (cached) PASSED in 0.7s
//javatests/com/google/gerrit/server/update:small_tests         (cached) PASSED in 0.9s
//javatests/com/google/gerrit/server/util/git:git_tests         (cached) PASSED in 0.8s
//javatests/com/google/gerrit/sshd:sshd_tests                   (cached) PASSED in 0.8s
  WARNING: //javatests/com/google/gerrit/sshd:sshd_tests: Test execution time (0.8s excluding execution overhead) outside of range for MODERATE tests. Consider setting timeout="short" or size="small".
//javatests/com/google/gerrit/testing:testing_tests             (cached) PASSED in 0.7s
//javatests/com/google/gerrit/util/http:http_tests              (cached) PASSED in 0.8s
  WARNING: //javatests/com/google/gerrit/util/http:http_tests: Test execution time (0.8s excluding execution overhead) outside of range for MODERATE tests. Consider setting timeout="short" or size="small".
//lib:nongoogle_test                                            (cached) PASSED in 1.3s
  WARNING: //lib:nongoogle_test: Test execution time (1.3s excluding execution overhead) outside of range for MODERATE tests. Consider setting timeout="short" or size="small".
//plugins/delete-project:delete-project_tests                   (cached) PASSED in 1.0s
  WARNING: //plugins/delete-project:delete-project_tests: Test execution time (1.0s excluding execution overhead) outside of range for MODERATE tests. Consider setting timeout="short" or size="small".
//plugins/hooks:hooks_tests                                     (cached) PASSED in 0.8s
  WARNING: //plugins/hooks:hooks_tests: Test execution time (0.8s excluding execution overhead) outside of range for MODERATE tests. Consider setting timeout="short" or size="small".
//plugins/singleusergroup:singleusergroup_tests                 (cached) PASSED in 0.5s
  WARNING: //plugins/singleusergroup:singleusergroup_tests: Test execution time (0.5s excluding execution overhead) outside of range for MODERATE tests. Consider setting timeout="short" or size="small".
//plugins/webhooks:webhooks_tests                               (cached) PASSED in 0.8s
  WARNING: //plugins/webhooks:webhooks_tests: Test execution time (0.8s excluding execution overhead) outside of range for MODERATE tests. Consider setting timeout="short" or size="small".
//resources/com/google/gerrit/server:commit-msg_test            (cached) PASSED in 1.0s
  WARNING: //resources/com/google/gerrit/server:commit-msg_test: Test execution time (1.0s excluding execution overhead) outside of range for MODERATE tests. Consider setting timeout="short" or size="small".
//tools/bzl:always_pass_test                                    (cached) PASSED in 0.9s
  WARNING: //tools/bzl:always_pass_test: Test execution time (0.9s excluding execution overhead) outside of range for MODERATE tests. Consider setting timeout="short" or size="small".
lucamilanesio pushed a commit to GerritCodeReview/gerrit-ci-scripts that referenced this issue Feb 25, 2021
On recent Bazel version this option is erroneously reporting every
cached tests result with "excluding execution overhead", e.g.:

  //Documentation:check_licenses             (cached) PASSED in 0.2s
  WARNING: //Documentation:check_licenses: Test execution time
  (0.2s excluding execution overhead) outside of range for MODERATE
  tests. Consider setting timeout="short" or size="small".

See this upstream issue for more details: [1].

Remove this option for now, as it's messing up the test results, and
consider to enable it later when upstream issue is fixed and new bazel
version is released.

[1] bazelbuild/bazel#13103

Change-Id: I1310edfedaafbc16f3229e8587905a70c52bc93b
@jin jin added team-Local-Exec Issues and PRs for the Execution (Local) team untriaged labels Mar 1, 2021
@meisterT meisterT added team-OSS Issues for the Bazel OSS team: installation, release processBazel packaging, website and removed team-Local-Exec Issues and PRs for the Execution (Local) team labels Jun 16, 2021
@Wyverald Wyverald added P2 We'll consider working on this in future. (Assignee optional) type: bug and removed untriaged labels Jan 24, 2022
@uhthomas
Copy link
Contributor

Hi we're also seeing this. Makes the flag useless really.

Any ideas on when this issue may be triaged?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
P2 We'll consider working on this in future. (Assignee optional) team-OSS Issues for the Bazel OSS team: installation, release processBazel packaging, website type: bug
Projects
None yet
Development

No branches or pull requests

5 participants