Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

tests: Add new tests to bgp-basic-functionality-topo1 #6925

Merged
merged 1 commit into from
Aug 30, 2020

Conversation

kuldeepkash
Copy link
Contributor

  1. Added new tests to bgp-basic-functionality-topo1
  2. Execution time increased by 55 sec

Signed-off-by: Kuldeep Kashyap kashyapk@vmware.com

@polychaeta polychaeta added the tests Topotests, make check, etc label Aug 17, 2020
@LabN-CI
Copy link
Collaborator

LabN-CI commented Aug 17, 2020

Outdated results 💚

Basic BGPD CI results: SUCCESS, 0 tests failed

_ _
Result SUCCESS git merge/6925 4711993
Date 08/16/2020
Start 22:45:30
Finish 23:11:33
Run-Time 26:03
Total 1815
Pass 1815
Fail 0
Valgrind-Errors 0
Valgrind-Loss 0
Details vncregress-2020-08-16-22:45:30.txt
Log autoscript-2020-08-16-22:46:30.log.bz2
Memory 495 494 424

For details, please contact louberger

@NetDEF-CI
Copy link
Collaborator

NetDEF-CI commented Aug 17, 2020

Continuous Integration Result: SUCCESSFUL

Continuous Integration Result: SUCCESSFUL

Congratulations, this patch passed basic tests

Tested-by: NetDEF / OpenSourceRouting.org CI System

CI System Testrun URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-13643/

This is a comment from an automated CI system.
For questions and feedback in regards to this CI system, please feel free to email
Martin Winter - mwinter (at) opensourcerouting.org.

Warnings Generated during build:

Debian 10 amd64 build: Successful with additional warnings

Debian Package lintian failed for Debian 10 amd64 build:
(see full package build log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-13643/artifact/DEB10BUILD/ErrorLog/log_lintian.txt)

W: frr source: pkg-js-tools-test-is-missing
W: frr source: newer-standards-version 4.4.1 (current is 4.3.0)
W: frr source: pkg-js-tools-test-is-missing
W: frr source: newer-standards-version 4.4.1 (current is 4.3.0)
W: frr-snmp: changelog-file-missing-explicit-entry 6.0-2 -> 7.5-dev-20200817-00-g4711993b2-0 (missing) -> 7.5-dev-20200817-00-g4711993b2-0~deb10u1
W: frr-rpki-rtrlib: changelog-file-missing-explicit-entry 6.0-2 -> 7.5-dev-20200817-00-g4711993b2-0 (missing) -> 7.5-dev-20200817-00-g4711993b2-0~deb10u1
W: frr-doc: changelog-file-missing-explicit-entry 6.0-2 -> 7.5-dev-20200817-00-g4711993b2-0 (missing) -> 7.5-dev-20200817-00-g4711993b2-0~deb10u1
W: frr-pythontools: changelog-file-missing-explicit-entry 6.0-2 -> 7.5-dev-20200817-00-g4711993b2-0 (missing) -> 7.5-dev-20200817-00-g4711993b2-0~deb10u1
W: frr: changelog-file-missing-explicit-entry 6.0-2 -> 7.5-dev-20200817-00-g4711993b2-0 (missing) -> 7.5-dev-20200817-00-g4711993b2-0~deb10u1

Copy link
Member

@rzalamena rzalamena left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

See comments, once you updated it I'll run it locally to see if it is passing consistently.

@@ -36,6 +36,7 @@
import ConfigParser
import traceback
import socket
import ipaddr
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Same comment as the other PR:

nit: I'm no python expert, but I think we've been trying to move to ipaddress so we don't require the ipaddr package anymore.

8b547a6

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@rzalamena, Thank you. I have updated the code.

@@ -665,6 +667,9 @@ def generate_support_bundle():
rnode.run("mkdir -p {}".format(dst_bundle))
rnode.run("mv -f {}/* {}".format(src_bundle, dst_bundle))

"""
pass
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Same comment as the other PR:
#6926 (comment)

@kuldeepkash can you fix this so I can test it, please?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@rzalamena , Thank you. I have fixed it.

@kuldeepkash kuldeepkash force-pushed the bgp_basic_functionality branch from 4711993 to 6fc8cd2 Compare August 23, 2020 16:56
@LabN-CI
Copy link
Collaborator

LabN-CI commented Aug 23, 2020

Outdated results 💚

Basic BGPD CI results: SUCCESS, 0 tests failed

_ _
Result SUCCESS git merge/6925 6fc8cd2
Date 08/23/2020
Start 13:00:30
Finish 13:26:25
Run-Time 25:55
Total 1815
Pass 1815
Fail 0
Valgrind-Errors 0
Valgrind-Loss 0
Details vncregress-2020-08-23-13:00:30.txt
Log autoscript-2020-08-23-13:01:27.log.bz2
Memory 477 498 424

For details, please contact louberger

@NetDEF-CI
Copy link
Collaborator

NetDEF-CI commented Aug 23, 2020

Continuous Integration Result: SUCCESSFUL

Continuous Integration Result: SUCCESSFUL

Congratulations, this patch passed basic tests

Tested-by: NetDEF / OpenSourceRouting.org CI System

CI System Testrun URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-13783/

This is a comment from an automated CI system.
For questions and feedback in regards to this CI system, please feel free to email
Martin Winter - mwinter (at) opensourcerouting.org.

Warnings Generated during build:

Debian 10 amd64 build: Successful with additional warnings

Debian Package lintian failed for Debian 10 amd64 build:
(see full package build log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-13783/artifact/DEB10BUILD/ErrorLog/log_lintian.txt)

W: frr source: pkg-js-tools-test-is-missing
W: frr source: newer-standards-version 4.4.1 (current is 4.3.0)
W: frr source: pkg-js-tools-test-is-missing
W: frr source: newer-standards-version 4.4.1 (current is 4.3.0)
W: frr-snmp: changelog-file-missing-explicit-entry 6.0-2 -> 7.5-dev-20200823-01-g6fc8cd2f3-0 (missing) -> 7.5-dev-20200823-01-g6fc8cd2f3-0~deb10u1
W: frr: changelog-file-missing-explicit-entry 6.0-2 -> 7.5-dev-20200823-01-g6fc8cd2f3-0 (missing) -> 7.5-dev-20200823-01-g6fc8cd2f3-0~deb10u1
W: frr-rpki-rtrlib: changelog-file-missing-explicit-entry 6.0-2 -> 7.5-dev-20200823-01-g6fc8cd2f3-0 (missing) -> 7.5-dev-20200823-01-g6fc8cd2f3-0~deb10u1
W: frr-pythontools: changelog-file-missing-explicit-entry 6.0-2 -> 7.5-dev-20200823-01-g6fc8cd2f3-0 (missing) -> 7.5-dev-20200823-01-g6fc8cd2f3-0~deb10u1
W: frr-doc: changelog-file-missing-explicit-entry 6.0-2 -> 7.5-dev-20200823-01-g6fc8cd2f3-0 (missing) -> 7.5-dev-20200823-01-g6fc8cd2f3-0~deb10u1

Copy link
Member

@rzalamena rzalamena left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

New tests looks fine.

I don't know what was the run time before, but my current run times (with ASAN) are:

  • 293.48 seconds
  • 293.76 seconds
  • 297.50 seconds
  • 298.65 seconds
  • 295.28 seconds
  • 294.81 seconds


for st_rt in ip_list:
st_rt = str(ipaddress.ip_network(unicode(st_rt)))
#st_rt = str(ipaddr.IPNetwork(unicode(st_rt)))
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Commented code.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks Rafael, I have fixed it.

@kuldeepkash kuldeepkash force-pushed the bgp_basic_functionality branch from 6fc8cd2 to 19f4da0 Compare August 28, 2020 12:23
1. Added new tests to bgp-basic-functionality-topo1
3. Execution time increased by 55 sec

Signed-off-by: Kuldeep Kashyap <kashyapk@vmware.com>
@LabN-CI
Copy link
Collaborator

LabN-CI commented Aug 28, 2020

💚 Basic BGPD CI results: SUCCESS, 0 tests failed

Results table
_ _
Result SUCCESS git merge/6925 19f4da0
Date 08/28/2020
Start 09:06:41
Finish 09:32:46
Run-Time 26:05
Total 1815
Pass 1815
Fail 0
Valgrind-Errors 0
Valgrind-Loss 0
Details vncregress-2020-08-28-09:06:41.txt
Log autoscript-2020-08-28-09:07:40.log.bz2
Memory 492 501 425

For details, please contact louberger

1 similar comment
@LabN-CI
Copy link
Collaborator

LabN-CI commented Aug 28, 2020

💚 Basic BGPD CI results: SUCCESS, 0 tests failed

Results table
_ _
Result SUCCESS git merge/6925 19f4da0
Date 08/28/2020
Start 09:06:41
Finish 09:32:46
Run-Time 26:05
Total 1815
Pass 1815
Fail 0
Valgrind-Errors 0
Valgrind-Loss 0
Details vncregress-2020-08-28-09:06:41.txt
Log autoscript-2020-08-28-09:07:40.log.bz2
Memory 492 501 425

For details, please contact louberger

@NetDEF-CI
Copy link
Collaborator

NetDEF-CI commented Aug 28, 2020

Continuous Integration Result: FAILED

Continuous Integration Result: FAILED

See below for issues.
CI System Testrun URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-13897/

This is a comment from an automated CI system.
For questions and feedback in regards to this CI system, please feel free to email
Martin Winter - mwinter (at) opensourcerouting.org.

Get source / Pull Request: Successful

Building Stage: Successful

Basic Tests: Failed

Topo tests part 2 on Ubuntu 18.04 arm8: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPO2U18ARM8-13897/test

Topology Tests failed for Topo tests part 2 on Ubuntu 18.04 arm8:

*** Error setting resource limits. Mininet's performance may be affected.
2020-08-28 13:07:56,725 ERROR: ******************************************************************************
2020-08-28 13:07:56,726 ERROR: Test Target Summary                                                  Pass Fail
2020-08-28 13:07:56,726 ERROR: ******************************************************************************
2020-08-28 13:07:56,726 ERROR: FILE: scripts/adjacencies.py
2020-08-28 13:07:56,727 ERROR: 9    r4     PE->P2 (loopback) ping +0.03 secs                        0    1
2020-08-28 13:07:56,728 ERROR: See /tmp/topotests/bgp_l3vpn_to_bgp_direct.test_bgp_l3vpn_to_bgp_direct/output.log for details of errors
2020-08-28 13:07:56,729 ERROR: assert failed at "bgp_l3vpn_to_bgp_direct.test_bgp_l3vpn_to_bgp_direct/test_adjacencies": 1 tests failed
2020-08-28 13:07:56,930 ERROR: r4: bgpd left a dead pidfile (pid=10035)
2020-08-28 13:14:03,968 ERROR: Traceback (most recent call last):
  File "/root/share/topotests/lib/common_config.py", line 2094, in create_bgp_community_lists
    tgen, router, config_data, "bgp_community_list", build=build
  File "/root/share/topotests/lib/common_config.py", line 281, in create_common_configuration
    load_config_to_router(tgen, router)
  File "/root/share/topotests/lib/common_config.py", line 555, in load_config_to_router
    raise InvalidCLIError("%s" % output)
InvalidCLIError: % Malformed community-list value
line 2: Failure to communicate[13] to bgpd, line: bgp community-list standard ANY permit 0:-1 



2020-08-28 13:14:04,233 ERROR: Traceback (most recent call last):
  File "/root/share/topotests/lib/common_config.py", line 2094, in create_bgp_community_lists
    tgen, router, config_data, "bgp_community_list", build=build
  File "/root/share/topotests/lib/common_config.py", line 281, in create_common_configuration
    load_config_to_router(tgen, router)
  File "/root/share/topotests/lib/common_config.py", line 555, in load_config_to_router
    raise InvalidCLIError("%s" % output)
InvalidCLIError: % Malformed community-list value
line 2: Failure to communicate[13] to bgpd, line: bgp community-list standard ANY permit 0:65536 



2020-08-28 13:14:04,497 ERROR: Traceback (most recent call last):
  File "/root/share/topotests/lib/common_config.py", line 2094, in create_bgp_community_lists
    tgen, router, config_data, "bgp_community_list", build=build
  File "/root/share/topotests/lib/common_config.py", line 281, in create_common_configuration
    load_config_to_router(tgen, router)
  File "/root/share/topotests/lib/common_config.py", line 555, in load_config_to_router
    raise InvalidCLIError("%s" % output)
InvalidCLIError: % Malformed community-list value
line 2: Failure to communicate[13] to bgpd, line: bgp large-community-list standard ANY permit 0:4294967296 



2020-08-28 13:14:04,758 ERROR: Traceback (most recent call last):
  File "/root/share/topotests/lib/common_config.py", line 2094, in create_bgp_community_lists
    tgen, router, config_data, "bgp_community_list", build=build
  File "/root/share/topotests/lib/common_config.py", line 281, in create_common_configuration
    load_config_to_router(tgen, router)
  File "/root/share/topotests/lib/common_config.py", line 555, in load_config_to_router
    raise InvalidCLIError("%s" % output)
InvalidCLIError: % Malformed community-list value
line 2: Failure to communicate[13] to bgpd, line: bgp large-community-list standard ANY permit 0:-1:1 



2020-08-28 13:17:10,924 ERROR: Traceback (most recent call last):
  File "/root/share/topotests/lib/common_config.py", line 2094, in create_bgp_community_lists
    tgen, router, config_data, "bgp_community_list", build=build
  File "/root/share/topotests/lib/common_config.py", line 281, in create_common_configuration
    load_config_to_router(tgen, router)
  File "/root/share/topotests/lib/common_config.py", line 555, in load_config_to_router
    raise InvalidCLIError("%s" % output)
InvalidCLIError: line 2: % Command incomplete[4]: bgp large-community-list standard Test1 permit  

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-13897/artifact/TOPO2U18ARM8/ErrorLog/log_topotests.txt

Successful on other platforms/tests
  • IPv4 protocols on Ubuntu 18.04
  • Topo tests part 0 on Ubuntu 16.04 i386
  • Topo tests part 1 on Ubuntu 18.04 arm8
  • Debian 10 deb pkg check
  • Static analyzer (clang)
  • Topo tests part 2 on Ubuntu 16.04 i386
  • Topo tests part 1 on Ubuntu 16.04 i386
  • Fedora 29 rpm pkg check
  • Ubuntu 16.04 deb pkg check
  • Topo tests part 0 on Ubuntu 18.04 arm8
  • Addresssanitizer topotests part 0
  • IPv4 ldp protocol on Ubuntu 18.04
  • Debian 8 deb pkg check
  • Addresssanitizer topotests part 2
  • Topo tests part 0 on Ubuntu 16.04 amd64
  • Ubuntu 18.04 deb pkg check
  • Topo tests part 1 on Ubuntu 18.04 amd64
  • Ubuntu 20.04 deb pkg check
  • Debian 9 deb pkg check
  • CentOS 7 rpm pkg check
  • Topo tests part 2 on Ubuntu 18.04 amd64
  • Topo tests part 2 on Ubuntu 16.04 amd64
  • IPv6 protocols on Ubuntu 18.04
  • Topo tests part 0 on Ubuntu 18.04 amd64
  • Addresssanitizer topotests part 1
  • Topo tests part 1 on Ubuntu 16.04 amd64

Warnings Generated during build:

Debian 10 amd64 build: Successful with additional warnings

Debian Package lintian failed for Debian 10 amd64 build:
(see full package build log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-13897/artifact/DEB10BUILD/ErrorLog/log_lintian.txt)

W: frr source: pkg-js-tools-test-is-missing
W: frr source: newer-standards-version 4.4.1 (current is 4.3.0)
W: frr source: pkg-js-tools-test-is-missing
W: frr source: newer-standards-version 4.4.1 (current is 4.3.0)
W: frr-doc: changelog-file-missing-explicit-entry 6.0-2 -> 7.5-dev-20200828-01-g19f4da0be-0 (missing) -> 7.5-dev-20200828-01-g19f4da0be-0~deb10u1
W: frr-rpki-rtrlib: changelog-file-missing-explicit-entry 6.0-2 -> 7.5-dev-20200828-01-g19f4da0be-0 (missing) -> 7.5-dev-20200828-01-g19f4da0be-0~deb10u1
W: frr-pythontools: changelog-file-missing-explicit-entry 6.0-2 -> 7.5-dev-20200828-01-g19f4da0be-0 (missing) -> 7.5-dev-20200828-01-g19f4da0be-0~deb10u1
W: frr-snmp: changelog-file-missing-explicit-entry 6.0-2 -> 7.5-dev-20200828-01-g19f4da0be-0 (missing) -> 7.5-dev-20200828-01-g19f4da0be-0~deb10u1
W: frr: changelog-file-missing-explicit-entry 6.0-2 -> 7.5-dev-20200828-01-g19f4da0be-0 (missing) -> 7.5-dev-20200828-01-g19f4da0be-0~deb10u1

@rzalamena
Copy link
Member

CI:rerun

@rzalamena
Copy link
Member

This test test_bgp_l3vpn_to_bgp_direct test_adjacencies has been failing more often recently on ARM8. It is not related with this PR.

image

@NetDEF-CI
Copy link
Collaborator

Continuous Integration Result: SUCCESSFUL

Congratulations, this patch passed basic tests

Tested-by: NetDEF / OpenSourceRouting.org CI System

CI System Testrun URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-13900/

This is a comment from an automated CI system.
For questions and feedback in regards to this CI system, please feel free to email
Martin Winter - mwinter (at) opensourcerouting.org.

Warnings Generated during build:

Debian 10 amd64 build: Successful with additional warnings

Debian Package lintian failed for Debian 10 amd64 build:
(see full package build log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-13900/artifact/DEB10BUILD/ErrorLog/log_lintian.txt)

W: frr source: pkg-js-tools-test-is-missing
W: frr source: newer-standards-version 4.4.1 (current is 4.3.0)
W: frr source: pkg-js-tools-test-is-missing
W: frr source: newer-standards-version 4.4.1 (current is 4.3.0)
W: frr-doc: changelog-file-missing-explicit-entry 6.0-2 -> 7.5-dev-20200828-01-g19f4da0be-0 (missing) -> 7.5-dev-20200828-01-g19f4da0be-0~deb10u1
W: frr-rpki-rtrlib: changelog-file-missing-explicit-entry 6.0-2 -> 7.5-dev-20200828-01-g19f4da0be-0 (missing) -> 7.5-dev-20200828-01-g19f4da0be-0~deb10u1
W: frr: changelog-file-missing-explicit-entry 6.0-2 -> 7.5-dev-20200828-01-g19f4da0be-0 (missing) -> 7.5-dev-20200828-01-g19f4da0be-0~deb10u1
W: frr-snmp: changelog-file-missing-explicit-entry 6.0-2 -> 7.5-dev-20200828-01-g19f4da0be-0 (missing) -> 7.5-dev-20200828-01-g19f4da0be-0~deb10u1
W: frr-pythontools: changelog-file-missing-explicit-entry 6.0-2 -> 7.5-dev-20200828-01-g19f4da0be-0 (missing) -> 7.5-dev-20200828-01-g19f4da0be-0~deb10u1

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
tests Topotests, make check, etc
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants