*: vrf northbound callbacks #5987

chiragshah6 · 2020-03-11T23:35:52Z

This PR contains northbound callbacks for yang/frr-vrf.yang module.

Add vrf northbound callbacks.
Insert vrf module in daemons init sequence.


{
  "frr-vrf:lib": {
    "vrf": [
      {
        "name": "default",
        "id": 0,
        "active": true
      }
    ]
  }
}

Signed-off-by: Chirag Shah chirag@cumulusnetworks.com

module: frr-vrf +--rw lib +--rw vrf* [name] +--rw name string +--ro id? uint32 +--ro active? boolean <false> +--rw netns {netns}? +--rw name? string Signed-off-by: Chirag Shah <chirag@cumulusnetworks.com>

lib: Adding frr-vrf yang module to common place so it can be accessed from all frr modules. Signed-off-by: Chirag Shah <chirag@cumulusnetworks.com>

yang: add vrf model

module: frr-vrf +--rw lib +--rw vrf* [name] +--rw name string +--ro id? uint32 +--ro active? boolean <false> +--rw netns {netns}? +--rw name? string Signed-off-by: Chirag Shah <chirag@cumulusnetworks.com>

lib: Adding frr-vrf yang module to common place so it can be accessed from all frr modules. Signed-off-by: Chirag Shah <chirag@cumulusnetworks.com>

…o nb_conversions

module: frr-interface +--rw lib +--rw interface* [name vrf] +--rw name string +--rw vrf frr-vrf:vrf-ref +--rw description? string Signed-off-by: Chirag Shah <chirag@cumulusnetworks.com>

yang: add vrf ref to interface model

Yang files for staticd to use northbound APIs Co-authored-by: Santosh P K <sapk@vmware.com> Co-authored-by: vishaldhingra <vdhingra@vmware.com> Signed-off-by: vishaldhingra <vdhingra@vmware.com>

Yang files for basic frr-routing used by other daemons like staticd and pim Co-authored-by: Santosh P K <sapk@vmware.com> Co-authored-by: vishaldhingra <vdhingra@vmware.com> Signed-off-by: vishaldhingra <vdhingra@vmware.com>

A common nexthop and group nexthop yang data model for all protocols in FRR. Co-authored-by: Santosh P K <sapk@vmware.com> Co-authored-by: Vishaldhingra <vdhingra@vmware.com> Signed-off-by: Santosh P K <sapk@vmware.com>

lib: FRR next-hop yang data model.

staticd: yang definition

lib: yang defination for basic routing frr-routing

module: frr-vrf +--rw lib +--rw vrf* [name] +--rw name string +--ro id? uint32 +--ro active? boolean <false> +--rw netns {netns}? +--rw name? string Signed-off-by: Chirag Shah <chirag@cumulusnetworks.com>

lib: Adding frr-vrf yang module to common place so it can be accessed from all frr modules. Signed-off-by: Chirag Shah <chirag@cumulusnetworks.com>

module: frr-interface +--rw lib +--rw interface* [name vrf] +--rw name string +--rw vrf frr-vrf:vrf-ref +--rw description? string Signed-off-by: Chirag Shah <chirag@cumulusnetworks.com>

A common nexthop and group nexthop yang data model for all protocols in FRR. Co-authored-by: Santosh P K <sapk@vmware.com> Co-authored-by: Vishaldhingra <vdhingra@vmware.com> Signed-off-by: Santosh P K <sapk@vmware.com>

Yang files for staticd to use northbound APIs Co-authored-by: Santosh P K <sapk@vmware.com> Co-authored-by: vishaldhingra <vdhingra@vmware.com> Signed-off-by: vishaldhingra <vdhingra@vmware.com>

Yang files for basic frr-routing used by other daemons like staticd and pim Co-authored-by: Santosh P K <sapk@vmware.com> Co-authored-by: vishaldhingra <vdhingra@vmware.com> Signed-off-by: vishaldhingra <vdhingra@vmware.com>

…o nb_conversions

module: frr-vrf +--rw lib +--rw vrf* [name] +--rw name string +--ro id? uint32 +--ro active? boolean <false> +--rw netns {netns}? +--rw name? string Signed-off-by: Chirag Shah <chirag@cumulusnetworks.com>

lib: Adding frr-vrf yang module to common place so it can be accessed from all frr modules. Signed-off-by: Chirag Shah <chirag@cumulusnetworks.com>

module: frr-interface +--rw lib +--rw interface* [name vrf] +--rw name string +--rw vrf frr-vrf:vrf-ref +--rw description? string Signed-off-by: Chirag Shah <chirag@cumulusnetworks.com>

A common nexthop and group nexthop yang data model for all protocols in FRR. Co-authored-by: Santosh P K <sapk@vmware.com> Co-authored-by: Vishaldhingra <vdhingra@vmware.com> Signed-off-by: Santosh P K <sapk@vmware.com>

Yang files for staticd to use northbound APIs Co-authored-by: Santosh P K <sapk@vmware.com> Co-authored-by: vishaldhingra <vdhingra@vmware.com> Signed-off-by: vishaldhingra <vdhingra@vmware.com>

Yang files for basic frr-routing used by other daemons like staticd and pim Co-authored-by: Santosh P K <sapk@vmware.com> Co-authored-by: vishaldhingra <vdhingra@vmware.com> Signed-off-by: vishaldhingra <vdhingra@vmware.com>

…o nb_conversions

Signed-off-by: Chirag Shah <chirag@cumulusnetworks.com>

polychaeta

Thanks for your contribution to FRR!

Click for style suggestions

To apply these suggestions:

curl -s https://gist.githubusercontent.com/polychaeta/4adc999df8ac4ef7eeef04541fa91259/raw/0d98ae21e9ee39e4034330de7f2f96aafc726e57/cr_5987_1583969756.diff | git apply

diff --git a/lib/yang.c b/lib/yang.c
index a0d1695c3..ce3a50b66 100644
--- a/lib/yang.c
+++ b/lib/yang.c
@@ -73,12 +73,8 @@ static const char *yang_module_imp_clb(const char *mod_name,
 }
 
 static const char *const frr_native_modules[] = {
-	"frr-interface",
-	"frr-vrf",
-	"frr-ripd",
-	"frr-ripngd",
-	"frr-isisd",
-	"frr-vrrpd",
+	"frr-interface", "frr-vrf",   "frr-ripd",
+	"frr-ripngd",    "frr-isisd", "frr-vrrpd",
 };
 
 /* Generate the yang_modules tree. */

If you are a new contributor to FRR, please see our contributing guidelines.

LabN-CI · 2020-03-12T00:06:28Z

💚 Basic BGPD CI results: SUCCESS, 0 tests failed

Results table

_	_
Result	SUCCESS git merge/5987 `4495296`
Date	03/11/2020
Start	19:40:33
Finish	20:06:23
Run-Time	25:50
Total	1815
Pass	1815
Fail	0
Valgrind-Errors	0
Valgrind-Loss	0
Details	vncregress-2020-03-11-19:40:33.txt
Log	autoscript-2020-03-11-19:41:33.log.bz2
Memory	484 491 418

For details, please contact louberger

NetDEF-CI · 2020-03-12T02:35:51Z

Continuous Integration Result: FAILED

Test incomplete. See below for issues.
CI System Testrun URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-11094/

This is a comment from an automated CI system.
For questions and feedback in regards to this CI system, please feel free to email
Martin Winter - mwinter (at) opensourcerouting.org.

Get source / Pull Request: Successful

Building Stage: Successful

Basic Tests: Incomplete

CentOS 7 rpm pkg check: Failed (click for details)

CentOS 7 rpm pkg check: Unknown Log URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-11094/artifact/CENTOS7RPM/ErrorLog/log_package_start.txt CentOS 7 rpm pkg check: No useful log found

Topology tests on Ubuntu 18.04 amd64: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOU1804-11094/test

Topology Tests failed for Topology tests on Ubuntu 18.04 amd64:

Failed check for StdErr Output on daemons:
r1 OSPF6d StdErr Output:
% Configuration failed: validation error.

Please check the logs for more details.
r1 ISISd StdErr Output:

% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.r%s Zebra StdErr Output:
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.

Known issue - IGNORING. See https://github.com/FRRouting/frr/issues/349
r1 failed IP Routing table check:
--- Actual IP Routing Table
+++ Expected IP RoutingTable
@@ -1,9 +1,23 @@
+C>* 192.168.0.0/24 is directly connected, r1-eth0, XX:XX:XX
+C>* 192.168.1.0/26 is directly connected, r1-eth1, XX:XX:XX
+C>* 192.168.2.0/26 is directly connected, r1-eth2, XX:XX:XX
+C>* 192.168.3.0/26 is directly connected, r1-eth3, XX:XX:XX
+C>* 192.168.4.0/26 is directly connected, r1-eth4, XX:XX:XX
+C>* 192.168.5.0/26 is directly connected, r1-eth5, XX:XX:XX
+C>* 192.168.6.0/26 is directly connected, r1-eth6, XX:XX:XX
+C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX
+C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX
+C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX
+O   192.168.0.0/24 [110/10] is directly connected, r1-eth0, XX:XX:XX
+O   192.168.3.0/26 [110/10] is directly connected, r1-eth3, XX:XX:XX
 S>* 1.1.1.1/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
 S>* 1.1.1.2/32 [1/0] is directly connected, r1-eth1, XX:XX:XX
-S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0 onlink, XX:XX:XX
+S>* 4.5.6.10/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
+S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
 S>* 4.5.6.12/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
 S>* 4.5.6.13/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.14/32 [1/0] unreachable (blackhole), XX:XX:XX
+S   4.5.6.15/32 [255/0] via 192.168.0.2, r1-eth0, XX:XX:XX
 S>* 4.5.6.7/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.8/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.9/32 [1/0] unreachable (ICMP unreachable), XX:XX:XX
2020-03-12 00:02:58,900 ERROR: assert failed at "test_all_protocol_startup/test_converge_protocols": IP Routing table failed for r1
  --- Actual IP Routing Table
  +++ Expected IP RoutingTable
  @@ -1,9 +1,23 @@
  +C>* 192.168.0.0/24 is directly connected, r1-eth0, XX:XX:XX
  +C>* 192.168.1.0/26 is directly connected, r1-eth1, XX:XX:XX
  +C>* 192.168.2.0/26 is directly connected, r1-eth2, XX:XX:XX
  +C>* 192.168.3.0/26 is directly connected, r1-eth3, XX:XX:XX
  +C>* 192.168.4.0/26 is directly connected, r1-eth4, XX:XX:XX
  +C>* 192.168.5.0/26 is directly connected, r1-eth5, XX:XX:XX
  +C>* 192.168.6.0/26 is directly connected, r1-eth6, XX:XX:XX
  +C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX
  +C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX
  +C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX
  +O   192.168.0.0/24 [110/10] is directly connected, r1-eth0, XX:XX:XX
  +O   192.168.3.0/26 [110/10] is directly connected, r1-eth3, XX:XX:XX
   S>* 1.1.1.1/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
   S>* 1.1.1.2/32 [1/0] is directly connected, r1-eth1, XX:XX:XX
  -S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0 onlink, XX:XX:XX
  +S>* 4.5.6.10/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
  +S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
   S>* 4.5.6.12/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
   S>* 4.5.6.13/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.14/32 [1/0] unreachable (blackhole), XX:XX:XX
  +S   4.5.6.15/32 [255/0] via 192.168.0.2, r1-eth0, XX:XX:XX
   S>* 4.5.6.7/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.8/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.9/32 [1/0] unreachable (ICMP unreachable), XX:XX:XX
assert 1 == 0
  -1
  +0
r1 failed IP RIP status check:
--- actual IP RIP status
+++ expected IP RIP status
@@ -7,6 +7,7 @@
   Redistributing:
   Default version control: send version 2, receive version 2 
     Interface        Send  Recv   Key-chain
+    r1-eth1          2     2      
   Routing for Networks:
     192.168.1.0/26
   Routing Information Sources:
2020-03-12 00:02:59,653 ERROR: assert failed at "test_all_protocol_startup/test_rip_status": IP RIP status failed for router r1:
  --- actual IP RIP status
  +++ expected IP RIP status
  @@ -7,6 +7,7 @@
     Redistributing:
     Default version control: send version 2, receive version 2 
       Interface        Send  Recv   Key-chain
  +    r1-eth1          2     2      
     Routing for Networks:
       192.168.1.0/26
     Routing Information Sources:
assert 1 == 0
  -1
  +0
r1 failed IPv6 RIPng status check:
--- actual IPv6 RIPng status
+++ expected IPv6 RIPng status
@@ -7,6 +7,7 @@
   Redistributing:
   Default version control: send version 1, receive version 1 
     Interface        Send  Recv
+    r1-eth2          1     1  
   Routing for Networks:
     fc00:0:0:2::/64
   Routing Information Sources:
2020-03-12 00:02:59,807 ERROR: assert failed at "test_all_protocol_startup/test_ripng_status": IPv6 RIPng status failed for router r1:
  --- actual IPv6 RIPng status
  +++ expected IPv6 RIPng status
  @@ -7,6 +7,7 @@
     Redistributing:
     Default version control: send version 1, receive version 1 
       Interface        Send  Recv
  +    r1-eth2          1     1  
     Routing for Networks:
       fc00:0:0:2::/64
     Routing Information Sources:
assert 1 == 0
  -1
  +0
r1 failed SHOW IP OSPF INTERFACE check:
--- actual SHOW IP OSPF INTERFACE
+++ expected SHOW IP OSPF INTERFACE
@@ -1 +1,22 @@
-
+r1-eth0 is up
+  ifindex X, MTU 1500 bytes, BW XX Mbit <UP,BROADCAST,RUNNING,MULTICAST>
+  Internet Address 192.168.0.1/24, Broadcast 192.168.0.255, Area 0.0.0.0
+  MTU mismatch detection: enabled
+  Router ID 192.168.0.1, Network Type BROADCAST, Cost: 10
+  Transmit Delay is 1 sec, State DR, Priority 1
+  No backup designated router on this network
+  Multicast group memberships: OSPFAllRouters OSPFDesignatedRouters
+  Timer intervals configured, Hello 10s, Dead 40s, Wait 40s, Retransmit 5
+    Hello due in XX.XXXs
+  Neighbor Count is 0, Adjacent neighbor count is 0
+r1-eth3 is up
+  ifindex X, MTU 1500 bytes, BW XX Mbit <UP,BROADCAST,RUNNING,MULTICAST>
+  Internet Address 192.168.3.1/26, Broadcast 192.168.3.63, Area 0.0.0.0
+  MTU mismatch detection: enabled
+  Router ID 192.168.0.1, Network Type BROADCAST, Cost: 10
+  Transmit Delay is 1 sec, State DR, Priority 1
+  No backup designated router on this network
+  Multicast group memberships: OSPFAllRouters OSPFDesignatedRouters
+  Timer intervals configured, Hello 10s, Dead 40s, Wait 40s, Retransmit 5
+    Hello due in XX.XXXs
+  Neighbor Count is 0, Adjacent neighbor count is 0
Known issue - IGNORING. See https://github.com/FRRouting/frr/issues/348
r1 failed SHOW ISIS INTERFACE DETAIL check:
--- actual SHOW ISIS INTERFACE DETAIL
+++ expected SHOW ISIS OSPF6 INTERFACE DETAIL
@@ -1 +1,28 @@
 Area test:
+  Interface: r1-eth5, State: Up, Active, Circuit Id: 0xXX
+    Type: lan, Level: L1, SNPA: XXXX.XXXX.XXXX
+    Level-1 Information:
+      Metric: 10, Active neighbors: 0
+      Hello interval: 3, Holddown count: 10 (pad)
+      CNSP interval: 10, PSNP interval: 2
+      LAN Priority: 64, is not DIS
+    IP Prefix(es):
+      192.168.5.1/26
+    IPv6 Link-Locals:
+      fe80::XXXX:XXXX:XXXX:XXXX/64
+    IPv6 Prefixes:
+      fc00:0:0:5::1/64
+
+  Interface: r1-eth6, State: Up, Active, Circuit Id: 0xXX
+    Type: lan, Level: L2, SNPA: XXXX.XXXX.XXXX
+    Level-2 Information:
+      Metric: 10, Active neighbors: 0
+      Hello interval: 3, Holddown count: 10 (pad)
+      CNSP interval: 10, PSNP interval: 2
+      LAN Priority: 64, is not DIS
+    IP Prefix(es):
+      192.168.6.1/26
+    IPv6 Link-Locals:
+      fe80::XXXX:XXXX:XXXX:XXXX/64
+    IPv6 Prefixes:
+      fc00:0:0:6::1/64
2020-03-12 00:03:00,104 ERROR: assert failed at "test_all_protocol_startup/test_isis_interfaces": SHOW ISIS INTERFACE DETAIL failed for router r1:
  --- actual SHOW ISIS INTERFACE DETAIL
  +++ expected SHOW ISIS OSPF6 INTERFACE DETAIL
  @@ -1 +1,28 @@
   Area test:
  +  Interface: r1-eth5, State: Up, Active, Circuit Id: 0xXX
  +    Type: lan, Level: L1, SNPA: XXXX.XXXX.XXXX
  +    Level-1 Information:
  +      Metric: 10, Active neighbors: 0
  +      Hello interval: 3, Holddown count: 10 (pad)
  +      CNSP interval: 10, PSNP interval: 2
  +      LAN Priority: 64, is not DIS
  +    IP Prefix(es):
  +      192.168.5.1/26
  +    IPv6 Link-Locals:
  +      fe80::XXXX:XXXX:XXXX:XXXX/64
  +    IPv6 Prefixes:
  +      fc00:0:0:5::1/64
  +
  +  Interface: r1-eth6, State: Up, Active, Circuit Id: 0xXX
  +    Type: lan, Level: L2, SNPA: XXXX.XXXX.XXXX
  +    Level-2 Information:
  +      Metric: 10, Active neighbors: 0
  +      Hello interval: 3, Holddown count: 10 (pad)
  +      CNSP interval: 10, PSNP interval: 2
  +      LAN Priority: 64, is not DIS
  +    IP Prefix(es):
  +      192.168.6.1/26
  +    IPv6 Link-Locals:
  +      fe80::XXXX:XXXX:XXXX:XXXX/64
  +    IPv6 Prefixes:
  +      fc00:0:0:6::1/64
assert 1 == 0
  -1
  +0
r1 failed MPLS LDP Interface status Check:
--- actual MPLS LDP interface status
+++ expected MPLS LDP interface status
@@ -1,3 +1,3 @@
 AF   Interface   State  Uptime   Hello Timers  ac
-ipv4 r1-eth9     DOWN   xx:xx:xx 5/15           0
+ipv4 r1-eth9     ACTIVE xx:xx:xx 5/15           0
 ipv6 r1-eth9     ACTIVE xx:xx:xx 5/15           0
2020-03-12 00:03:01,822 ERROR: assert failed at "test_all_protocol_startup/test_mpls_interfaces": MPLS LDP Interface status failed for router r1:
  --- actual MPLS LDP interface status
  +++ expected MPLS LDP interface status
  @@ -1,3 +1,3 @@
   AF   Interface   State  Uptime   Hello Timers  ac
  -ipv4 r1-eth9     DOWN   xx:xx:xx 5/15           0
  +ipv4 r1-eth9     ACTIVE xx:xx:xx 5/15           0
   ipv6 r1-eth9     ACTIVE xx:xx:xx 5/15           0
assert 1 == 0
  -1
  +0
2020-03-12 00:03:37,276 ERROR: 'router_json_cmp' failed after 25.62 seconds
2020-03-12 00:03:37,282 ERROR: assert failed at "test_bfd_bgp_cbit_topo3/test_protocols_convergence": "r1" JSON output mismatches
assert expected key(s) [u'2001:db8:4::/64', u'2001:db8:6::/64', u'2001:db8:7::/64', u'2001:db8:1::/64'] in json (have [u'fe80::/64']):
  --- Expected value
  +++ Current value
  @@ -2 +2 @@
  -    "2001:db8:1::/64": [
  +    "fe80::/64": [
  @@ -4 +3,0 @@
  -            "destSelected": true, 
  @@ -5,0 +5,5 @@
  +            "installed": true, 
  +            "internalFlags": 0, 
  +            "internalNextHopActiveNum": 1, 
  +            "internalNextHopNum": 1, 
  +            "internalStatus": 16, 
  @@ -12,0 +17 @@
  +                    "interfaceIndex": 2, 
  @@ -16 +21 @@
  -            "prefix": "2001:db8:1::/64", 
  +            "prefix": "fe80::/64", 
  @@ -18,4 +23,3 @@
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:4::/64": [
  +            "table": 254, 
  +            "uptime": "00:00:28"
  +        }, 
  @@ -24 +28,6 @@
  -            "distance": 1, 
  +            "distance": 0, 
  +            "installed": true, 
  +            "internalFlags": 8, 
  +            "internalNextHopActiveNum": 1, 
  +            "internalNextHopNum": 1, 
  +            "internalStatus": 16, 
  @@ -29 +38 @@
  -                    "afi": "ipv6", 
  +                    "directlyConnected": true, 
  @@ -32 +41,2 @@
  -                    "interfaceName": "r1-eth0"
  +                    "interfaceIndex": 1, 
  +                    "interfaceName": "lo"
  @@ -35,51 +45,5 @@
  -            "prefix": "2001:db8:4::/64", 
  -            "protocol": "static", 
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:6::/64": [
  -        {
  -            "destSelected": true, 
  -            "distance": 20, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "afi": "ipv6", 
  -                    "ip": "2001:db8:4::1", 
  -                    "recursive": true
  -                }, 
  -                {
  -                    "afi": "ipv6", 
  -                    "fib": true, 
  -                    "interfaceName": "r1-eth0", 
  -                    "ip": "2001:db8:1::2"
  -                }
  -            ], 
  -            "prefix": "2001:db8:6::/64", 
  -            "protocol": "bgp", 
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:7::/64": [
  -        {
  -            "destSelected": true, 
  -            "distance": 20, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "afi": "ipv6", 
  -                    "ip": "2001:db8:4::1", 
  -                    "recursive": true
  -                }, 
  -                {
  -                    "afi": "ipv6", 
  -                    "fib": true, 
  -                    "interfaceName": "r1-eth0", 
  -                    "ip": "2001:db8:1::2"
  -                }
  -            ], 
  -            "prefix": "2001:db8:7::/64", 
  -            "protocol": "bgp", 
  -            "selected": true
  +            "prefix": "fe80::/64", 
  +            "protocol": "connected", 
  +            "selected": true, 
  +            "table": 254, 
  +            "uptime": "00:00:30"
2020-03-12 00:03:42,564 ERROR: 'router_json_cmp' failed after 5.13 seconds
2020-03-12 00:03:42,566 ERROR: assert failed at "test_bfd_bgp_cbit_topo3/test_bfd_comes_back_again": "r1" JSON output mismatches
assert json too few items (have 0, expected 1:
   --- Expected value
  +++ Current value
  @@ -1,16 +1 @@
  -[
  -    {
  -        "diagnostic": "ok", 
  -        "echo-interval": 0, 
  -        "local": "2001:db8:1::1", 
  -        "multihop": true, 
  -        "peer": "2001:db8:4::1", 
  -        "receive-interval": 300, 
  -        "remote-diagnostic": "ok", 
  -        "remote-echo-interval": 50, 
  -        "remote-receive-interval": 300, 
  -        "remote-transmit-interval": 300, 
  -        "status": "up", 
  -        "transmit-interval": 300
  -    }
  -]
  +[])
2020-03-12 00:03:57,912 ERROR: 'router_json_cmp' failed after 5.07 seconds
2020-03-12 00:03:57,915 ERROR: assert failed at "test_bfd_topo1/test_bfd_connection": "r4" JSON output mismatches
assert json value is different (
  --- Expected value
  +++ Current value
  @@ -2,0 +3,6 @@
  +        "detect-multiplier": 3, 
  +        "diagnostic": "ok", 
  +        "downtime": 10, 
  +        "echo-interval": 0, 
  +        "id": 652141113, 
  +        "multihop": false, 
  @@ -4 +10,10 @@
  -        "status": "up"
  +        "receive-interval": 2000, 
  +        "remote-detect-multiplier": 3, 
  +        "remote-diagnostic": "ok", 
  +        "remote-echo-interval": 0, 
  +        "remote-id": 0, 
  +        "remote-receive-interval": 1000, 
  +        "remote-transmit-interval": 1000, 
  +        "status": "down", 
  +        "transmit-interval": 2000, 
  +        "vrf": "default")
2020-03-12 00:05:51,444 ERROR: 'router_json_cmp' failed after 102.31 seconds
2020-03-12 00:05:51,452 ERROR: assert failed at "test_bfd_topo2/test_protocols_convergence": "r4" JSON output mismatches
assert expected key(s) [u'10.254.254.4/32'] in json (have []):
  --- Expected value
  +++ Current value
  @@ -1,24 +1 @@
  -{
  -    "10.254.254.4/32": [
  -        {
  -            "distance": 0, 
  -            "installed": true, 
  -            "internalFlags": 8, 
  -            "internalStatus": 16, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "directlyConnected": true, 
  -                    "fib": true, 
  -                    "flags": 3, 
  -                    "interfaceIndex": 1, 
  -                    "interfaceName": "lo"
  -                }
  -            ], 
  -            "prefix": "10.254.254.4/32", 
  -            "protocol": "connected", 
  -            "selected": true
  -        }
  -    ]
  -}
  +{}
2020-03-12 00:06:07,900 ERROR: 'router_json_cmp' failed after 5.20 seconds
2020-03-12 00:06:07,907 ERROR: assert failed at "test_bfd_vrf_topo1/test_bfd_connection": "r4" JSON output mismatches
assert json value is different (
  --- Expected value
  +++ Current value
  @@ -2,0 +3,6 @@
  +        "detect-multiplier": 3, 
  +        "diagnostic": "ok", 
  +        "downtime": 11, 
  +        "echo-interval": 0, 
  +        "id": 2408931776, 
  +        "multihop": false, 
  @@ -4 +10,10 @@
  -        "status": "up"
  +        "receive-interval": 2000, 
  +        "remote-detect-multiplier": 3, 
  +        "remote-diagnostic": "ok", 
  +        "remote-echo-interval": 0, 
  +        "remote-id": 0, 
  +        "remote-receive-interval": 1000, 
  +        "remote-transmit-interval": 1000, 
  +        "status": "down", 
  +        "transmit-interval": 2000, 
  +        "vrf": "r4-cust1")
2020-03-12 00:07:13,984 ERROR: '_output_summary_cmp' failed after 39.16 seconds
2020-03-12 00:07:13,991 ERROR: assert failed at "test_bgp_ecmp_topo1/test_bgp_convergence": BGP router network did not converge
assert json["ipv4Unicast"]["peers"]["10.0.2.107"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.107"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.118"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.118"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.103"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.103"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.102"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.102"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.101"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.101"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.111"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.111"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.105"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.105"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.104"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.104"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.119"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.119"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.112"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.112"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.110"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.110"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.108"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.108"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.109"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.109"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.113"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.113"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.106"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.106"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.115"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.115"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.120"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.120"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.116"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.116"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.114"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.114"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.117"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.117"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
*** defaultIntf: warning: r1 has no interfaces
2020-03-12 00:08:47,496 ERROR: '_bgp_converge' failed after 19.39 seconds
2020-03-12 00:08:47,503 ERROR: assert failed at "test_bgp_aggregate-address_origin/test_bgp_aggregate_address_origin": Failed to see bgp convergence in "TopoGear<name="r2",links=["r2-eth0"<->"s1-eth1"]> TopoRouter<>"
assert json["192.168.255.1"]["bgpState"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["192.168.255.1"]["addressFamilyInfo"]["ipv4Unicast"]["acceptedPrefixCounter"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -3
  +0)
2020-03-12 00:09:12,336 ERROR: '_bgp_converge' failed after 19.22 seconds
2020-03-12 00:09:12,341 ERROR: assert failed at "test_bgp_aggregate-address_route-map/test_bgp_maximum_prefix_invalid": Failed to see bgp convergence in "TopoGear<name="r2",links=["r2-eth0"<->"s1-eth1"]> TopoRouter<>"
assert json["192.168.255.1"]["bgpState"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["192.168.255.1"]["addressFamilyInfo"]["ipv4Unicast"]["acceptedPrefixCounter"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -3
  +0)

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-11094/artifact/TOPOU1804/ErrorLog/log_topotests.txt

IPv6 protocols on Ubuntu 14.04: Failed (click for details)

CentOS 7 rpm pkg check: Failed (click for details)

CentOS 7 rpm pkg check: Unknown Log URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-11094/artifact/CENTOS7RPM/ErrorLog/log_package_start.txt CentOS 7 rpm pkg check: No useful log found

Topology tests on Ubuntu 18.04 amd64: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOU1804-11094/test

Topology Tests failed for Topology tests on Ubuntu 18.04 amd64:

Failed check for StdErr Output on daemons:
r1 OSPF6d StdErr Output:
% Configuration failed: validation error.

Please check the logs for more details.
r1 ISISd StdErr Output:

% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.r%s Zebra StdErr Output:
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.

Known issue - IGNORING. See https://github.com/FRRouting/frr/issues/349
r1 failed IP Routing table check:
--- Actual IP Routing Table
+++ Expected IP RoutingTable
@@ -1,9 +1,23 @@
+C>* 192.168.0.0/24 is directly connected, r1-eth0, XX:XX:XX
+C>* 192.168.1.0/26 is directly connected, r1-eth1, XX:XX:XX
+C>* 192.168.2.0/26 is directly connected, r1-eth2, XX:XX:XX
+C>* 192.168.3.0/26 is directly connected, r1-eth3, XX:XX:XX
+C>* 192.168.4.0/26 is directly connected, r1-eth4, XX:XX:XX
+C>* 192.168.5.0/26 is directly connected, r1-eth5, XX:XX:XX
+C>* 192.168.6.0/26 is directly connected, r1-eth6, XX:XX:XX
+C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX
+C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX
+C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX
+O   192.168.0.0/24 [110/10] is directly connected, r1-eth0, XX:XX:XX
+O   192.168.3.0/26 [110/10] is directly connected, r1-eth3, XX:XX:XX
 S>* 1.1.1.1/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
 S>* 1.1.1.2/32 [1/0] is directly connected, r1-eth1, XX:XX:XX
-S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0 onlink, XX:XX:XX
+S>* 4.5.6.10/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
+S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
 S>* 4.5.6.12/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
 S>* 4.5.6.13/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.14/32 [1/0] unreachable (blackhole), XX:XX:XX
+S   4.5.6.15/32 [255/0] via 192.168.0.2, r1-eth0, XX:XX:XX
 S>* 4.5.6.7/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.8/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.9/32 [1/0] unreachable (ICMP unreachable), XX:XX:XX
2020-03-12 00:02:58,900 ERROR: assert failed at "test_all_protocol_startup/test_converge_protocols": IP Routing table failed for r1
  --- Actual IP Routing Table
  +++ Expected IP RoutingTable
  @@ -1,9 +1,23 @@
  +C>* 192.168.0.0/24 is directly connected, r1-eth0, XX:XX:XX
  +C>* 192.168.1.0/26 is directly connected, r1-eth1, XX:XX:XX
  +C>* 192.168.2.0/26 is directly connected, r1-eth2, XX:XX:XX
  +C>* 192.168.3.0/26 is directly connected, r1-eth3, XX:XX:XX
  +C>* 192.168.4.0/26 is directly connected, r1-eth4, XX:XX:XX
  +C>* 192.168.5.0/26 is directly connected, r1-eth5, XX:XX:XX
  +C>* 192.168.6.0/26 is directly connected, r1-eth6, XX:XX:XX
  +C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX
  +C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX
  +C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX
  +O   192.168.0.0/24 [110/10] is directly connected, r1-eth0, XX:XX:XX
  +O   192.168.3.0/26 [110/10] is directly connected, r1-eth3, XX:XX:XX
   S>* 1.1.1.1/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
   S>* 1.1.1.2/32 [1/0] is directly connected, r1-eth1, XX:XX:XX
  -S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0 onlink, XX:XX:XX
  +S>* 4.5.6.10/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
  +S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
   S>* 4.5.6.12/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
   S>* 4.5.6.13/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.14/32 [1/0] unreachable (blackhole), XX:XX:XX
  +S   4.5.6.15/32 [255/0] via 192.168.0.2, r1-eth0, XX:XX:XX
   S>* 4.5.6.7/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.8/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.9/32 [1/0] unreachable (ICMP unreachable), XX:XX:XX
assert 1 == 0
  -1
  +0
r1 failed IP RIP status check:
--- actual IP RIP status
+++ expected IP RIP status
@@ -7,6 +7,7 @@
   Redistributing:
   Default version control: send version 2, receive version 2 
     Interface        Send  Recv   Key-chain
+    r1-eth1          2     2      
   Routing for Networks:
     192.168.1.0/26
   Routing Information Sources:
2020-03-12 00:02:59,653 ERROR: assert failed at "test_all_protocol_startup/test_rip_status": IP RIP status failed for router r1:
  --- actual IP RIP status
  +++ expected IP RIP status
  @@ -7,6 +7,7 @@
     Redistributing:
     Default version control: send version 2, receive version 2 
       Interface        Send  Recv   Key-chain
  +    r1-eth1          2     2      
     Routing for Networks:
       192.168.1.0/26
     Routing Information Sources:
assert 1 == 0
  -1
  +0
r1 failed IPv6 RIPng status check:
--- actual IPv6 RIPng status
+++ expected IPv6 RIPng status
@@ -7,6 +7,7 @@
   Redistributing:
   Default version control: send version 1, receive version 1 
     Interface        Send  Recv
+    r1-eth2          1     1  
   Routing for Networks:
     fc00:0:0:2::/64
   Routing Information Sources:
2020-03-12 00:02:59,807 ERROR: assert failed at "test_all_protocol_startup/test_ripng_status": IPv6 RIPng status failed for router r1:
  --- actual IPv6 RIPng status
  +++ expected IPv6 RIPng status
  @@ -7,6 +7,7 @@
     Redistributing:
     Default version control: send version 1, receive version 1 
       Interface        Send  Recv
  +    r1-eth2          1     1  
     Routing for Networks:
       fc00:0:0:2::/64
     Routing Information Sources:
assert 1 == 0
  -1
  +0
r1 failed SHOW IP OSPF INTERFACE check:
--- actual SHOW IP OSPF INTERFACE
+++ expected SHOW IP OSPF INTERFACE
@@ -1 +1,22 @@
-
+r1-eth0 is up
+  ifindex X, MTU 1500 bytes, BW XX Mbit <UP,BROADCAST,RUNNING,MULTICAST>
+  Internet Address 192.168.0.1/24, Broadcast 192.168.0.255, Area 0.0.0.0
+  MTU mismatch detection: enabled
+  Router ID 192.168.0.1, Network Type BROADCAST, Cost: 10
+  Transmit Delay is 1 sec, State DR, Priority 1
+  No backup designated router on this network
+  Multicast group memberships: OSPFAllRouters OSPFDesignatedRouters
+  Timer intervals configured, Hello 10s, Dead 40s, Wait 40s, Retransmit 5
+    Hello due in XX.XXXs
+  Neighbor Count is 0, Adjacent neighbor count is 0
+r1-eth3 is up
+  ifindex X, MTU 1500 bytes, BW XX Mbit <UP,BROADCAST,RUNNING,MULTICAST>
+  Internet Address 192.168.3.1/26, Broadcast 192.168.3.63, Area 0.0.0.0
+  MTU mismatch detection: enabled
+  Router ID 192.168.0.1, Network Type BROADCAST, Cost: 10
+  Transmit Delay is 1 sec, State DR, Priority 1
+  No backup designated router on this network
+  Multicast group memberships: OSPFAllRouters OSPFDesignatedRouters
+  Timer intervals configured, Hello 10s, Dead 40s, Wait 40s, Retransmit 5
+    Hello due in XX.XXXs
+  Neighbor Count is 0, Adjacent neighbor count is 0
Known issue - IGNORING. See https://github.com/FRRouting/frr/issues/348
r1 failed SHOW ISIS INTERFACE DETAIL check:
--- actual SHOW ISIS INTERFACE DETAIL
+++ expected SHOW ISIS OSPF6 INTERFACE DETAIL
@@ -1 +1,28 @@
 Area test:
+  Interface: r1-eth5, State: Up, Active, Circuit Id: 0xXX
+    Type: lan, Level: L1, SNPA: XXXX.XXXX.XXXX
+    Level-1 Information:
+      Metric: 10, Active neighbors: 0
+      Hello interval: 3, Holddown count: 10 (pad)
+      CNSP interval: 10, PSNP interval: 2
+      LAN Priority: 64, is not DIS
+    IP Prefix(es):
+      192.168.5.1/26
+    IPv6 Link-Locals:
+      fe80::XXXX:XXXX:XXXX:XXXX/64
+    IPv6 Prefixes:
+      fc00:0:0:5::1/64
+
+  Interface: r1-eth6, State: Up, Active, Circuit Id: 0xXX
+    Type: lan, Level: L2, SNPA: XXXX.XXXX.XXXX
+    Level-2 Information:
+      Metric: 10, Active neighbors: 0
+      Hello interval: 3, Holddown count: 10 (pad)
+      CNSP interval: 10, PSNP interval: 2
+      LAN Priority: 64, is not DIS
+    IP Prefix(es):
+      192.168.6.1/26
+    IPv6 Link-Locals:
+      fe80::XXXX:XXXX:XXXX:XXXX/64
+    IPv6 Prefixes:
+      fc00:0:0:6::1/64
2020-03-12 00:03:00,104 ERROR: assert failed at "test_all_protocol_startup/test_isis_interfaces": SHOW ISIS INTERFACE DETAIL failed for router r1:
  --- actual SHOW ISIS INTERFACE DETAIL
  +++ expected SHOW ISIS OSPF6 INTERFACE DETAIL
  @@ -1 +1,28 @@
   Area test:
  +  Interface: r1-eth5, State: Up, Active, Circuit Id: 0xXX
  +    Type: lan, Level: L1, SNPA: XXXX.XXXX.XXXX
  +    Level-1 Information:
  +      Metric: 10, Active neighbors: 0
  +      Hello interval: 3, Holddown count: 10 (pad)
  +      CNSP interval: 10, PSNP interval: 2
  +      LAN Priority: 64, is not DIS
  +    IP Prefix(es):
  +      192.168.5.1/26
  +    IPv6 Link-Locals:
  +      fe80::XXXX:XXXX:XXXX:XXXX/64
  +    IPv6 Prefixes:
  +      fc00:0:0:5::1/64
  +
  +  Interface: r1-eth6, State: Up, Active, Circuit Id: 0xXX
  +    Type: lan, Level: L2, SNPA: XXXX.XXXX.XXXX
  +    Level-2 Information:
  +      Metric: 10, Active neighbors: 0
  +      Hello interval: 3, Holddown count: 10 (pad)
  +      CNSP interval: 10, PSNP interval: 2
  +      LAN Priority: 64, is not DIS
  +    IP Prefix(es):
  +      192.168.6.1/26
  +    IPv6 Link-Locals:
  +      fe80::XXXX:XXXX:XXXX:XXXX/64
  +    IPv6 Prefixes:
  +      fc00:0:0:6::1/64
assert 1 == 0
  -1
  +0
r1 failed MPLS LDP Interface status Check:
--- actual MPLS LDP interface status
+++ expected MPLS LDP interface status
@@ -1,3 +1,3 @@
 AF   Interface   State  Uptime   Hello Timers  ac
-ipv4 r1-eth9     DOWN   xx:xx:xx 5/15           0
+ipv4 r1-eth9     ACTIVE xx:xx:xx 5/15           0
 ipv6 r1-eth9     ACTIVE xx:xx:xx 5/15           0
2020-03-12 00:03:01,822 ERROR: assert failed at "test_all_protocol_startup/test_mpls_interfaces": MPLS LDP Interface status failed for router r1:
  --- actual MPLS LDP interface status
  +++ expected MPLS LDP interface status
  @@ -1,3 +1,3 @@
   AF   Interface   State  Uptime   Hello Timers  ac
  -ipv4 r1-eth9     DOWN   xx:xx:xx 5/15           0
  +ipv4 r1-eth9     ACTIVE xx:xx:xx 5/15           0
   ipv6 r1-eth9     ACTIVE xx:xx:xx 5/15           0
assert 1 == 0
  -1
  +0
2020-03-12 00:03:37,276 ERROR: 'router_json_cmp' failed after 25.62 seconds
2020-03-12 00:03:37,282 ERROR: assert failed at "test_bfd_bgp_cbit_topo3/test_protocols_convergence": "r1" JSON output mismatches
assert expected key(s) [u'2001:db8:4::/64', u'2001:db8:6::/64', u'2001:db8:7::/64', u'2001:db8:1::/64'] in json (have [u'fe80::/64']):
  --- Expected value
  +++ Current value
  @@ -2 +2 @@
  -    "2001:db8:1::/64": [
  +    "fe80::/64": [
  @@ -4 +3,0 @@
  -            "destSelected": true, 
  @@ -5,0 +5,5 @@
  +            "installed": true, 
  +            "internalFlags": 0, 
  +            "internalNextHopActiveNum": 1, 
  +            "internalNextHopNum": 1, 
  +            "internalStatus": 16, 
  @@ -12,0 +17 @@
  +                    "interfaceIndex": 2, 
  @@ -16 +21 @@
  -            "prefix": "2001:db8:1::/64", 
  +            "prefix": "fe80::/64", 
  @@ -18,4 +23,3 @@
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:4::/64": [
  +            "table": 254, 
  +            "uptime": "00:00:28"
  +        }, 
  @@ -24 +28,6 @@
  -            "distance": 1, 
  +            "distance": 0, 
  +            "installed": true, 
  +            "internalFlags": 8, 
  +            "internalNextHopActiveNum": 1, 
  +            "internalNextHopNum": 1, 
  +            "internalStatus": 16, 
  @@ -29 +38 @@
  -                    "afi": "ipv6", 
  +                    "directlyConnected": true, 
  @@ -32 +41,2 @@
  -                    "interfaceName": "r1-eth0"
  +                    "interfaceIndex": 1, 
  +                    "interfaceName": "lo"
  @@ -35,51 +45,5 @@
  -            "prefix": "2001:db8:4::/64", 
  -            "protocol": "static", 
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:6::/64": [
  -        {
  -            "destSelected": true, 
  -            "distance": 20, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "afi": "ipv6", 
  -                    "ip": "2001:db8:4::1", 
  -                    "recursive": true
  -                }, 
  -                {
  -                    "afi": "ipv6", 
  -                    "fib": true, 
  -                    "interfaceName": "r1-eth0", 
  -                    "ip": "2001:db8:1::2"
  -                }
  -            ], 
  -            "prefix": "2001:db8:6::/64", 
  -            "protocol": "bgp", 
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:7::/64": [
  -        {
  -            "destSelected": true, 
  -            "distance": 20, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "afi": "ipv6", 
  -                    "ip": "2001:db8:4::1", 
  -                    "recursive": true
  -                }, 
  -                {
  -                    "afi": "ipv6", 
  -                    "fib": true, 
  -                    "interfaceName": "r1-eth0", 
  -                    "ip": "2001:db8:1::2"
  -                }
  -            ], 
  -            "prefix": "2001:db8:7::/64", 
  -            "protocol": "bgp", 
  -            "selected": true
  +            "prefix": "fe80::/64", 
  +            "protocol": "connected", 
  +            "selected": true, 
  +            "table": 254, 
  +            "uptime": "00:00:30"
2020-03-12 00:03:42,564 ERROR: 'router_json_cmp' failed after 5.13 seconds
2020-03-12 00:03:42,566 ERROR: assert failed at "test_bfd_bgp_cbit_topo3/test_bfd_comes_back_again": "r1" JSON output mismatches
assert json too few items (have 0, expected 1:
   --- Expected value
  +++ Current value
  @@ -1,16 +1 @@
  -[
  -    {
  -        "diagnostic": "ok", 
  -        "echo-interval": 0, 
  -        "local": "2001:db8:1::1", 
  -        "multihop": true, 
  -        "peer": "2001:db8:4::1", 
  -        "receive-interval": 300, 
  -        "remote-diagnostic": "ok", 
  -        "remote-echo-interval": 50, 
  -        "remote-receive-interval": 300, 
  -        "remote-transmit-interval": 300, 
  -        "status": "up", 
  -        "transmit-interval": 300
  -    }
  -]
  +[])
2020-03-12 00:03:57,912 ERROR: 'router_json_cmp' failed after 5.07 seconds
2020-03-12 00:03:57,915 ERROR: assert failed at "test_bfd_topo1/test_bfd_connection": "r4" JSON output mismatches
assert json value is different (
  --- Expected value
  +++ Current value
  @@ -2,0 +3,6 @@
  +        "detect-multiplier": 3, 
  +        "diagnostic": "ok", 
  +        "downtime": 10, 
  +        "echo-interval": 0, 
  +        "id": 652141113, 
  +        "multihop": false, 
  @@ -4 +10,10 @@
  -        "status": "up"
  +        "receive-interval": 2000, 
  +        "remote-detect-multiplier": 3, 
  +        "remote-diagnostic": "ok", 
  +        "remote-echo-interval": 0, 
  +        "remote-id": 0, 
  +        "remote-receive-interval": 1000, 
  +        "remote-transmit-interval": 1000, 
  +        "status": "down", 
  +        "transmit-interval": 2000, 
  +        "vrf": "default")
2020-03-12 00:05:51,444 ERROR: 'router_json_cmp' failed after 102.31 seconds
2020-03-12 00:05:51,452 ERROR: assert failed at "test_bfd_topo2/test_protocols_convergence": "r4" JSON output mismatches
assert expected key(s) [u'10.254.254.4/32'] in json (have []):
  --- Expected value
  +++ Current value
  @@ -1,24 +1 @@
  -{
  -    "10.254.254.4/32": [
  -        {
  -            "distance": 0, 
  -            "installed": true, 
  -            "internalFlags": 8, 
  -            "internalStatus": 16, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "directlyConnected": true, 
  -                    "fib": true, 
  -                    "flags": 3, 
  -                    "interfaceIndex": 1, 
  -                    "interfaceName": "lo"
  -                }
  -            ], 
  -            "prefix": "10.254.254.4/32", 
  -            "protocol": "connected", 
  -            "selected": true
  -        }
  -    ]
  -}
  +{}
2020-03-12 00:06:07,900 ERROR: 'router_json_cmp' failed after 5.20 seconds
2020-03-12 00:06:07,907 ERROR: assert failed at "test_bfd_vrf_topo1/test_bfd_connection": "r4" JSON output mismatches
assert json value is different (
  --- Expected value
  +++ Current value
  @@ -2,0 +3,6 @@
  +        "detect-multiplier": 3, 
  +        "diagnostic": "ok", 
  +        "downtime": 11, 
  +        "echo-interval": 0, 
  +        "id": 2408931776, 
  +        "multihop": false, 
  @@ -4 +10,10 @@
  -        "status": "up"
  +        "receive-interval": 2000, 
  +        "remote-detect-multiplier": 3, 
  +        "remote-diagnostic": "ok", 
  +        "remote-echo-interval": 0, 
  +        "remote-id": 0, 
  +        "remote-receive-interval": 1000, 
  +        "remote-transmit-interval": 1000, 
  +        "status": "down", 
  +        "transmit-interval": 2000, 
  +        "vrf": "r4-cust1")
2020-03-12 00:07:13,984 ERROR: '_output_summary_cmp' failed after 39.16 seconds
2020-03-12 00:07:13,991 ERROR: assert failed at "test_bgp_ecmp_topo1/test_bgp_convergence": BGP router network did not converge
assert json["ipv4Unicast"]["peers"]["10.0.2.107"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.107"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.118"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.118"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.103"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.103"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.102"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.102"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.101"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.101"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.111"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.111"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.105"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.105"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.104"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.104"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.119"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.119"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.112"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.112"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.110"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.110"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.108"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.108"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.109"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.109"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.113"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.113"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.106"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.106"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.115"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.115"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.120"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.120"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.116"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.116"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.114"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.114"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.117"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.117"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
*** defaultIntf: warning: r1 has no interfaces
2020-03-12 00:08:47,496 ERROR: '_bgp_converge' failed after 19.39 seconds
2020-03-12 00:08:47,503 ERROR: assert failed at "test_bgp_aggregate-address_origin/test_bgp_aggregate_address_origin": Failed to see bgp convergence in "TopoGear<name="r2",links=["r2-eth0"<->"s1-eth1"]> TopoRouter<>"
assert json["192.168.255.1"]["bgpState"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["192.168.255.1"]["addressFamilyInfo"]["ipv4Unicast"]["acceptedPrefixCounter"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -3
  +0)
2020-03-12 00:09:12,336 ERROR: '_bgp_converge' failed after 19.22 seconds
2020-03-12 00:09:12,341 ERROR: assert failed at "test_bgp_aggregate-address_route-map/test_bgp_maximum_prefix_invalid": Failed to see bgp convergence in "TopoGear<name="r2",links=["r2-eth0"<->"s1-eth1"]> TopoRouter<>"
assert json["192.168.255.1"]["bgpState"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["192.168.255.1"]["addressFamilyInfo"]["ipv4Unicast"]["acceptedPrefixCounter"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -3
  +0)

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-11094/artifact/TOPOU1804/ErrorLog/log_topotests.txt

IPv6 protocols on Ubuntu 14.04: Failed (click for details)

Addresssanitizer topotest: Incomplete

(check logs for details)

Topology tests on Ubuntu 16.04 amd64: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOU1604-11094/test

Topology Tests failed for Topology tests on Ubuntu 16.04 amd64:

Failed check for StdErr Output on daemons:
r1 OSPF6d StdErr Output:
% Configuration failed: validation error.

Please check the logs for more details.
r1 ISISd StdErr Output:

% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.r%s Zebra StdErr Output:
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.

Known issue - IGNORING. See https://github.com/FRRouting/frr/issues/349
r1 failed IP Routing table check:
--- Actual IP Routing Table
+++ Expected IP RoutingTable
@@ -1,9 +1,23 @@
+C>* 192.168.0.0/24 is directly connected, r1-eth0, XX:XX:XX
+C>* 192.168.1.0/26 is directly connected, r1-eth1, XX:XX:XX
+C>* 192.168.2.0/26 is directly connected, r1-eth2, XX:XX:XX
+C>* 192.168.3.0/26 is directly connected, r1-eth3, XX:XX:XX
+C>* 192.168.4.0/26 is directly connected, r1-eth4, XX:XX:XX
+C>* 192.168.5.0/26 is directly connected, r1-eth5, XX:XX:XX
+C>* 192.168.6.0/26 is directly connected, r1-eth6, XX:XX:XX
+C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX
+C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX
+C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX
+O   192.168.0.0/24 [110/10] is directly connected, r1-eth0, XX:XX:XX
+O   192.168.3.0/26 [110/10] is directly connected, r1-eth3, XX:XX:XX
 S>* 1.1.1.1/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
 S>* 1.1.1.2/32 [1/0] is directly connected, r1-eth1, XX:XX:XX
-S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0 onlink, XX:XX:XX
+S>* 4.5.6.10/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
+S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
 S>* 4.5.6.12/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
 S>* 4.5.6.13/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.14/32 [1/0] unreachable (blackhole), XX:XX:XX
+S   4.5.6.15/32 [255/0] via 192.168.0.2, r1-eth0, XX:XX:XX
 S>* 4.5.6.7/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.8/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.9/32 [1/0] unreachable (ICMP unreachable), XX:XX:XX
2020-03-12 01:03:25,683 ERROR: assert failed at "test_all_protocol_startup/test_converge_protocols": IP Routing table failed for r1
  --- Actual IP Routing Table
  +++ Expected IP RoutingTable
  @@ -1,9 +1,23 @@
  +C>* 192.168.0.0/24 is directly connected, r1-eth0, XX:XX:XX
  +C>* 192.168.1.0/26 is directly connected, r1-eth1, XX:XX:XX
  +C>* 192.168.2.0/26 is directly connected, r1-eth2, XX:XX:XX
  +C>* 192.168.3.0/26 is directly connected, r1-eth3, XX:XX:XX
  +C>* 192.168.4.0/26 is directly connected, r1-eth4, XX:XX:XX
  +C>* 192.168.5.0/26 is directly connected, r1-eth5, XX:XX:XX
  +C>* 192.168.6.0/26 is directly connected, r1-eth6, XX:XX:XX
  +C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX
  +C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX
  +C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX
  +O   192.168.0.0/24 [110/10] is directly connected, r1-eth0, XX:XX:XX
  +O   192.168.3.0/26 [110/10] is directly connected, r1-eth3, XX:XX:XX
   S>* 1.1.1.1/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
   S>* 1.1.1.2/32 [1/0] is directly connected, r1-eth1, XX:XX:XX
  -S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0 onlink, XX:XX:XX
  +S>* 4.5.6.10/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
  +S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
   S>* 4.5.6.12/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
   S>* 4.5.6.13/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.14/32 [1/0] unreachable (blackhole), XX:XX:XX
  +S   4.5.6.15/32 [255/0] via 192.168.0.2, r1-eth0, XX:XX:XX
   S>* 4.5.6.7/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.8/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.9/32 [1/0] unreachable (ICMP unreachable), XX:XX:XX
assert 1 == 0
  -1
  +0
r1 failed IP RIP status check:
--- actual IP RIP status
+++ expected IP RIP status
@@ -7,6 +7,7 @@
   Redistributing:
   Default version control: send version 2, receive version 2 
     Interface        Send  Recv   Key-chain
+    r1-eth1          2     2      
   Routing for Networks:
     192.168.1.0/26
   Routing Information Sources:
2020-03-12 01:03:26,357 ERROR: assert failed at "test_all_protocol_startup/test_rip_status": IP RIP status failed for router r1:
  --- actual IP RIP status
  +++ expected IP RIP status
  @@ -7,6 +7,7 @@
     Redistributing:
     Default version control: send version 2, receive version 2 
       Interface        Send  Recv   Key-chain
  +    r1-eth1          2     2      
     Routing for Networks:
       192.168.1.0/26
     Routing Information Sources:
assert 1 == 0
  -1
  +0
r1 failed IPv6 RIPng status check:
--- actual IPv6 RIPng status
+++ expected IPv6 RIPng status
@@ -7,6 +7,7 @@
   Redistributing:
   Default version control: send version 1, receive version 1 
     Interface        Send  Recv
+    r1-eth2          1     1  
   Routing for Networks:
     fc00:0:0:2::/64
   Routing Information Sources:
2020-03-12 01:03:26,497 ERROR: assert failed at "test_all_protocol_startup/test_ripng_status": IPv6 RIPng status failed for router r1:
  --- actual IPv6 RIPng status
  +++ expected IPv6 RIPng status
  @@ -7,6 +7,7 @@
     Redistributing:
     Default version control: send version 1, receive version 1 
       Interface        Send  Recv
  +    r1-eth2          1     1  
     Routing for Networks:
       fc00:0:0:2::/64
     Routing Information Sources:
assert 1 == 0
  -1
  +0
r1 failed SHOW IP OSPF INTERFACE check:
--- actual SHOW IP OSPF INTERFACE
+++ expected SHOW IP OSPF INTERFACE
@@ -1 +1,22 @@
-
+r1-eth0 is up
+  ifindex X, MTU 1500 bytes, BW XX Mbit <UP,BROADCAST,RUNNING,MULTICAST>
+  Internet Address 192.168.0.1/24, Broadcast 192.168.0.255, Area 0.0.0.0
+  MTU mismatch detection: enabled
+  Router ID 192.168.0.1, Network Type BROADCAST, Cost: 10
+  Transmit Delay is 1 sec, State DR, Priority 1
+  No backup designated router on this network
+  Multicast group memberships: OSPFAllRouters OSPFDesignatedRouters
+  Timer intervals configured, Hello 10s, Dead 40s, Wait 40s, Retransmit 5
+    Hello due in XX.XXXs
+  Neighbor Count is 0, Adjacent neighbor count is 0
+r1-eth3 is up
+  ifindex X, MTU 1500 bytes, BW XX Mbit <UP,BROADCAST,RUNNING,MULTICAST>
+  Internet Address 192.168.3.1/26, Broadcast 192.168.3.63, Area 0.0.0.0
+  MTU mismatch detection: enabled
+  Router ID 192.168.0.1, Network Type BROADCAST, Cost: 10
+  Transmit Delay is 1 sec, State DR, Priority 1
+  No backup designated router on this network
+  Multicast group memberships: OSPFAllRouters OSPFDesignatedRouters
+  Timer intervals configured, Hello 10s, Dead 40s, Wait 40s, Retransmit 5
+    Hello due in XX.XXXs
+  Neighbor Count is 0, Adjacent neighbor count is 0
Known issue - IGNORING. See https://github.com/FRRouting/frr/issues/348
r1 failed SHOW ISIS INTERFACE DETAIL check:
--- actual SHOW ISIS INTERFACE DETAIL
+++ expected SHOW ISIS OSPF6 INTERFACE DETAIL
@@ -1 +1,28 @@
 Area test:
+  Interface: r1-eth5, State: Up, Active, Circuit Id: 0xXX
+    Type: lan, Level: L1, SNPA: XXXX.XXXX.XXXX
+    Level-1 Information:
+      Metric: 10, Active neighbors: 0
+      Hello interval: 3, Holddown count: 10 (pad)
+      CNSP interval: 10, PSNP interval: 2
+      LAN Priority: 64, is not DIS
+    IP Prefix(es):
+      192.168.5.1/26
+    IPv6 Link-Locals:
+      fe80::XXXX:XXXX:XXXX:XXXX/64
+    IPv6 Prefixes:
+      fc00:0:0:5::1/64
+
+  Interface: r1-eth6, State: Up, Active, Circuit Id: 0xXX
+    Type: lan, Level: L2, SNPA: XXXX.XXXX.XXXX
+    Level-2 Information:
+      Metric: 10, Active neighbors: 0
+      Hello interval: 3, Holddown count: 10 (pad)
+      CNSP interval: 10, PSNP interval: 2
+      LAN Priority: 64, is not DIS
+    IP Prefix(es):
+      192.168.6.1/26
+    IPv6 Link-Locals:
+      fe80::XXXX:XXXX:XXXX:XXXX/64
+    IPv6 Prefixes:
+      fc00:0:0:6::1/64
2020-03-12 01:03:26,751 ERROR: assert failed at "test_all_protocol_startup/test_isis_interfaces": SHOW ISIS INTERFACE DETAIL failed for router r1:
  --- actual SHOW ISIS INTERFACE DETAIL
  +++ expected SHOW ISIS OSPF6 INTERFACE DETAIL
  @@ -1 +1,28 @@
   Area test:
  +  Interface: r1-eth5, State: Up, Active, Circuit Id: 0xXX
  +    Type: lan, Level: L1, SNPA: XXXX.XXXX.XXXX
  +    Level-1 Information:
  +      Metric: 10, Active neighbors: 0
  +      Hello interval: 3, Holddown count: 10 (pad)
  +      CNSP interval: 10, PSNP interval: 2
  +      LAN Priority: 64, is not DIS
  +    IP Prefix(es):
  +      192.168.5.1/26
  +    IPv6 Link-Locals:
  +      fe80::XXXX:XXXX:XXXX:XXXX/64
  +    IPv6 Prefixes:
  +      fc00:0:0:5::1/64
  +
  +  Interface: r1-eth6, State: Up, Active, Circuit Id: 0xXX
  +    Type: lan, Level: L2, SNPA: XXXX.XXXX.XXXX
  +    Level-2 Information:
  +      Metric: 10, Active neighbors: 0
  +      Hello interval: 3, Holddown count: 10 (pad)
  +      CNSP interval: 10, PSNP interval: 2
  +      LAN Priority: 64, is not DIS
  +    IP Prefix(es):
  +      192.168.6.1/26
  +    IPv6 Link-Locals:
  +      fe80::XXXX:XXXX:XXXX:XXXX/64
  +    IPv6 Prefixes:
  +      fc00:0:0:6::1/64
assert 1 == 0
  -1
  +0
r1 failed MPLS LDP Interface status Check:
--- actual MPLS LDP interface status
+++ expected MPLS LDP interface status
@@ -1,3 +1,3 @@
 AF   Interface   State  Uptime   Hello Timers  ac
-ipv4 r1-eth9     DOWN   xx:xx:xx 5/15           0
+ipv4 r1-eth9     ACTIVE xx:xx:xx 5/15           0
 ipv6 r1-eth9     ACTIVE xx:xx:xx 5/15           0
2020-03-12 01:03:28,418 ERROR: assert failed at "test_all_protocol_startup/test_mpls_interfaces": MPLS LDP Interface status failed for router r1:
  --- actual MPLS LDP interface status
  +++ expected MPLS LDP interface status
  @@ -1,3 +1,3 @@
   AF   Interface   State  Uptime   Hello Timers  ac
  -ipv4 r1-eth9     DOWN   xx:xx:xx 5/15           0
  +ipv4 r1-eth9     ACTIVE xx:xx:xx 5/15           0
   ipv6 r1-eth9     ACTIVE xx:xx:xx 5/15           0
assert 1 == 0
  -1
  +0
2020-03-12 01:04:03,487 ERROR: 'router_json_cmp' failed after 25.56 seconds
2020-03-12 01:04:03,489 ERROR: assert failed at "test_bfd_bgp_cbit_topo3/test_protocols_convergence": "r1" JSON output mismatches
assert expected key(s) [u'2001:db8:4::/64', u'2001:db8:6::/64', u'2001:db8:7::/64', u'2001:db8:1::/64'] in json (have [u'fe80::/64']):
  --- Expected value
  +++ Current value
  @@ -2 +2 @@
  -    "2001:db8:1::/64": [
  +    "fe80::/64": [
  @@ -4 +3,0 @@
  -            "destSelected": true, 
  @@ -5,0 +5,5 @@
  +            "installed": true, 
  +            "internalFlags": 0, 
  +            "internalNextHopActiveNum": 1, 
  +            "internalNextHopNum": 1, 
  +            "internalStatus": 16, 
  @@ -12,0 +17 @@
  +                    "interfaceIndex": 2, 
  @@ -16 +21 @@
  -            "prefix": "2001:db8:1::/64", 
  +            "prefix": "fe80::/64", 
  @@ -18,4 +23,3 @@
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:4::/64": [
  +            "table": 254, 
  +            "uptime": "00:00:27"
  +        }, 
  @@ -24 +28,6 @@
  -            "distance": 1, 
  +            "distance": 0, 
  +            "installed": true, 
  +            "internalFlags": 8, 
  +            "internalNextHopActiveNum": 1, 
  +            "internalNextHopNum": 1, 
  +            "internalStatus": 16, 
  @@ -29 +38 @@
  -                    "afi": "ipv6", 
  +                    "directlyConnected": true, 
  @@ -32 +41,2 @@
  -                    "interfaceName": "r1-eth0"
  +                    "interfaceIndex": 1, 
  +                    "interfaceName": "lo"
  @@ -35,51 +45,5 @@
  -            "prefix": "2001:db8:4::/64", 
  -            "protocol": "static", 
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:6::/64": [
  -        {
  -            "destSelected": true, 
  -            "distance": 20, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "afi": "ipv6", 
  -                    "ip": "2001:db8:4::1", 
  -                    "recursive": true
  -                }, 
  -                {
  -                    "afi": "ipv6", 
  -                    "fib": true, 
  -                    "interfaceName": "r1-eth0", 
  -                    "ip": "2001:db8:1::2"
  -                }
  -            ], 
  -            "prefix": "2001:db8:6::/64", 
  -            "protocol": "bgp", 
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:7::/64": [
  -        {
  -            "destSelected": true, 
  -            "distance": 20, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "afi": "ipv6", 
  -                    "ip": "2001:db8:4::1", 
  -                    "recursive": true
  -                }, 
  -                {
  -                    "afi": "ipv6", 
  -                    "fib": true, 
  -                    "interfaceName": "r1-eth0", 
  -                    "ip": "2001:db8:1::2"
  -                }
  -            ], 
  -            "prefix": "2001:db8:7::/64", 
  -            "protocol": "bgp", 
  -            "selected": true
  +            "prefix": "fe80::/64", 
  +            "protocol": "connected", 
  +            "selected": true, 
  +            "table": 254, 
  +            "uptime": "00:00:29"
2020-03-12 01:04:08,728 ERROR: 'router_json_cmp' failed after 5.08 seconds
2020-03-12 01:04:08,730 ERROR: assert failed at "test_bfd_bgp_cbit_topo3/test_bfd_comes_back_again": "r1" JSON output mismatches
assert json too few items (have 0, expected 1:
   --- Expected value
  +++ Current value
  @@ -1,16 +1 @@
  -[
  -    {
  -        "diagnostic": "ok", 
  -        "echo-interval": 0, 
  -        "local": "2001:db8:1::1", 
  -        "multihop": true, 
  -        "peer": "2001:db8:4::1", 
  -        "receive-interval": 300, 
  -        "remote-diagnostic": "ok", 
  -        "remote-echo-interval": 50, 
  -        "remote-receive-interval": 300, 
  -        "remote-transmit-interval": 300, 
  -        "status": "up", 
  -        "transmit-interval": 300
  -    }
  -]
  +[])
2020-03-12 01:04:22,741 ERROR: 'router_json_cmp' failed after 5.03 seconds
2020-03-12 01:04:22,743 ERROR: assert failed at "test_bfd_topo1/test_bfd_connection": "r4" JSON output mismatches
assert json value is different (
  --- Expected value
  +++ Current value
  @@ -2,0 +3,6 @@
  +        "detect-multiplier": 3, 
  +        "diagnostic": "ok", 
  +        "downtime": 10, 
  +        "echo-interval": 0, 
  +        "id": 2707230238, 
  +        "multihop": false, 
  @@ -4 +10,10 @@
  -        "status": "up"
  +        "receive-interval": 2000, 
  +        "remote-detect-multiplier": 3, 
  +        "remote-diagnostic": "ok", 
  +        "remote-echo-interval": 0, 
  +        "remote-id": 0, 
  +        "remote-receive-interval": 1000, 
  +        "remote-transmit-interval": 1000, 
  +        "status": "down", 
  +        "transmit-interval": 2000, 
  +        "vrf": "default")
2020-03-12 01:06:15,217 ERROR: 'router_json_cmp' failed after 102.06 seconds
2020-03-12 01:06:15,219 ERROR: assert failed at "test_bfd_topo2/test_protocols_convergence": "r4" JSON output mismatches
assert expected key(s) [u'10.254.254.4/32'] in json (have []):
  --- Expected value
  +++ Current value
  @@ -1,24 +1 @@
  -{
  -    "10.254.254.4/32": [
  -        {
  -            "distance": 0, 
  -            "installed": true, 
  -            "internalFlags": 8, 
  -            "internalStatus": 16, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "directlyConnected": true, 
  -                    "fib": true, 
  -                    "flags": 3, 
  -                    "interfaceIndex": 1, 
  -                    "interfaceName": "lo"
  -                }
  -            ], 
  -            "prefix": "10.254.254.4/32", 
  -            "protocol": "connected", 
  -            "selected": true
  -        }
  -    ]
  -}
  +{}
2020-03-12 01:06:29,990 ERROR: 'router_json_cmp' failed after 5.02 seconds
2020-03-12 01:06:29,992 ERROR: assert failed at "test_bfd_vrf_topo1/test_bfd_connection": "r4" JSON output mismatches
assert json value is different (
  --- Expected value
  +++ Current value
  @@ -2,0 +3,6 @@
  +        "detect-multiplier": 3, 
  +        "diagnostic": "ok", 
  +        "downtime": 10, 
  +        "echo-interval": 0, 
  +        "id": 3582770390, 
  +        "multihop": false, 
  @@ -4 +10,10 @@
  -        "status": "up"
  +        "receive-interval": 2000, 
  +        "remote-detect-multiplier": 3, 
  +        "remote-diagnostic": "ok", 
  +        "remote-echo-interval": 0, 
  +        "remote-id": 0, 
  +        "remote-receive-interval": 1000, 
  +        "remote-transmit-interval": 1000, 
  +        "status": "down", 
  +        "transmit-interval": 2000, 
  +        "vrf": "r4-cust1")
2020-03-12 01:07:33,749 ERROR: '_output_summary_cmp' failed after 38.44 seconds
2020-03-12 01:07:33,753 ERROR: assert failed at "test_bgp_ecmp_topo1/test_bgp_convergence": BGP router network did not converge
assert json["ipv4Unicast"]["peers"]["10.0.2.107"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.107"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.118"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.118"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.103"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.103"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.102"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.102"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.101"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.101"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.111"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.111"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.105"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.105"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.104"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.104"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.119"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.119"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.112"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.112"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.110"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.110"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.108"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.108"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.109"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.109"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.113"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.113"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.106"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.106"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.115"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.115"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.120"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.120"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.116"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.116"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.114"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.114"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.117"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.117"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
*** defaultIntf: warning: r1 has no interfaces
2020-03-12 01:09:00,835 ERROR: '_bgp_converge' failed after 19.12 seconds
2020-03-12 01:09:00,837 ERROR: assert failed at "test_bgp_aggregate-address_origin/test_bgp_aggregate_address_origin": Failed to see bgp convergence in "TopoGear<name="r2",links=["r2-eth0"<->"s1-eth1"]> TopoRouter<>"
assert json["192.168.255.1"]["bgpState"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["192.168.255.1"]["addressFamilyInfo"]["ipv4Unicast"]["acceptedPrefixCounter"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -3
  +0)
2020-03-12 01:09:25,219 ERROR: '_bgp_converge' failed after 19.03 seconds
2020-03-12 01:09:25,221 ERROR: assert failed at "test_bgp_aggregate-address_route-map/test_bgp_maximum_prefix_invalid": Failed to see bgp convergence in "TopoGear<name="r2",links=["r2-eth0"<->"s1-eth1"]> TopoRouter<>"
assert json["192.168.255.1"]["bgpState"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["192.168.255.1"]["addressFamilyInfo"]["ipv4Unicast"]["acceptedPrefixCounter"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -3
  +0)

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-11094/artifact/TOPOU1604/ErrorLog/log_topotests.txt

IPv4 protocols on Ubuntu 14.04: Failed (click for details)

IPv4 ldp protocol on Ubuntu 16.04: Failed (click for details)

Topotest tests on Ubuntu 16.04 i386: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOI386-11094/test

Topology Tests failed for Topotest tests on Ubuntu 16.04 i386:

Failed check for StdErr Output on daemons:
r1 OSPF6d StdErr Output:
% Configuration failed: validation error.

Please check the logs for more details.
r1 ISISd StdErr Output:

% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.r%s Zebra StdErr Output:
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.

Known issue - IGNORING. See https://github.com/FRRouting/frr/issues/349
r1 failed IP Routing table check:
--- Actual IP Routing Table
+++ Expected IP RoutingTable
@@ -1,9 +1,23 @@
+C>* 192.168.0.0/24 is directly connected, r1-eth0, XX:XX:XX
+C>* 192.168.1.0/26 is directly connected, r1-eth1, XX:XX:XX
+C>* 192.168.2.0/26 is directly connected, r1-eth2, XX:XX:XX
+C>* 192.168.3.0/26 is directly connected, r1-eth3, XX:XX:XX
+C>* 192.168.4.0/26 is directly connected, r1-eth4, XX:XX:XX
+C>* 192.168.5.0/26 is directly connected, r1-eth5, XX:XX:XX
+C>* 192.168.6.0/26 is directly connected, r1-eth6, XX:XX:XX
+C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX
+C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX
+C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX
+O   192.168.0.0/24 [110/10] is directly connected, r1-eth0, XX:XX:XX
+O   192.168.3.0/26 [110/10] is directly connected, r1-eth3, XX:XX:XX
 S>* 1.1.1.1/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
 S>* 1.1.1.2/32 [1/0] is directly connected, r1-eth1, XX:XX:XX
-S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0 onlink, XX:XX:XX
+S>* 4.5.6.10/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
+S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
 S>* 4.5.6.12/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
 S>* 4.5.6.13/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.14/32 [1/0] unreachable (blackhole), XX:XX:XX
+S   4.5.6.15/32 [255/0] via 192.168.0.2, r1-eth0, XX:XX:XX
 S>* 4.5.6.7/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.8/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.9/32 [1/0] unreachable (ICMP unreachable), XX:XX:XX
2020-03-11 17:02:53,740 ERROR: assert failed at "test_all_protocol_startup/test_converge_protocols": IP Routing table failed for r1
  --- Actual IP Routing Table
  +++ Expected IP RoutingTable
  @@ -1,9 +1,23 @@
  +C>* 192.168.0.0/24 is directly connected, r1-eth0, XX:XX:XX
  +C>* 192.168.1.0/26 is directly connected, r1-eth1, XX:XX:XX
  +C>* 192.168.2.0/26 is directly connected, r1-eth2, XX:XX:XX
  +C>* 192.168.3.0/26 is directly connected, r1-eth3, XX:XX:XX
  +C>* 192.168.4.0/26 is directly connected, r1-eth4, XX:XX:XX
  +C>* 192.168.5.0/26 is directly connected, r1-eth5, XX:XX:XX
  +C>* 192.168.6.0/26 is directly connected, r1-eth6, XX:XX:XX
  +C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX
  +C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX
  +C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX
  +O   192.168.0.0/24 [110/10] is directly connected, r1-eth0, XX:XX:XX
  +O   192.168.3.0/26 [110/10] is directly connected, r1-eth3, XX:XX:XX
   S>* 1.1.1.1/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
   S>* 1.1.1.2/32 [1/0] is directly connected, r1-eth1, XX:XX:XX
  -S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0 onlink, XX:XX:XX
  +S>* 4.5.6.10/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
  +S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
   S>* 4.5.6.12/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
   S>* 4.5.6.13/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.14/32 [1/0] unreachable (blackhole), XX:XX:XX
  +S   4.5.6.15/32 [255/0] via 192.168.0.2, r1-eth0, XX:XX:XX
   S>* 4.5.6.7/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.8/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.9/32 [1/0] unreachable (ICMP unreachable), XX:XX:XX
assert 1 == 0
  -1
  +0
r1 failed IP RIP status check:
--- actual IP RIP status
+++ expected IP RIP status
@@ -7,6 +7,7 @@
   Redistributing:
   Default version control: send version 2, receive version 2 
     Interface        Send  Recv   Key-chain
+    r1-eth1          2     2      
   Routing for Networks:
     192.168.1.0/26
   Routing Information Sources:
2020-03-11 17:02:54,599 ERROR: assert failed at "test_all_protocol_startup/test_rip_status": IP RIP status failed for router r1:
  --- actual IP RIP status
  +++ expected IP RIP status
  @@ -7,6 +7,7 @@
     Redistributing:
     Default version control: send version 2, receive version 2 
       Interface        Send  Recv   Key-chain
  +    r1-eth1          2     2      
     Routing for Networks:
       192.168.1.0/26
     Routing Information Sources:
assert 1 == 0
  -1
  +0
r1 failed IPv6 RIPng status check:
--- actual IPv6 RIPng status
+++ expected IPv6 RIPng status
@@ -7,6 +7,7 @@
   Redistributing:
   Default version control: send version 1, receive version 1 
     Interface        Send  Recv
+    r1-eth2          1     1  
   Routing for Networks:
     fc00:0:0:2::/64
   Routing Information Sources:
2020-03-11 17:02:54,782 ERROR: assert failed at "test_all_protocol_startup/test_ripng_status": IPv6 RIPng status failed for router r1:
  --- actual IPv6 RIPng status
  +++ expected IPv6 RIPng status
  @@ -7,6 +7,7 @@
     Redistributing:
     Default version control: send version 1, receive version 1 
       Interface        Send  Recv
  +    r1-eth2          1     1  
     Routing for Networks:
       fc00:0:0:2::/64
     Routing Information Sources:
assert 1 == 0
  -1
  +0
r1 failed SHOW IP OSPF INTERFACE check:
--- actual SHOW IP OSPF INTERFACE
+++ expected SHOW IP OSPF INTERFACE
@@ -1 +1,22 @@
-
+r1-eth0 is up
+  ifindex X, MTU 1500 bytes, BW XX Mbit <UP,BROADCAST,RUNNING,MULTICAST>
+  Internet Address 192.168.0.1/24, Broadcast 192.168.0.255, Area 0.0.0.0
+  MTU mismatch detection: enabled
+  Router ID 192.168.0.1, Network Type BROADCAST, Cost: 10
+  Transmit Delay is 1 sec, State DR, Priority 1
+  No backup designated router on this network
+  Multicast group memberships: OSPFAllRouters OSPFDesignatedRouters
+  Timer intervals configured, Hello 10s, Dead 40s, Wait 40s, Retransmit 5
+    Hello due in XX.XXXs
+  Neighbor Count is 0, Adjacent neighbor count is 0
+r1-eth3 is up
+  ifindex X, MTU 1500 bytes, BW XX Mbit <UP,BROADCAST,RUNNING,MULTICAST>
+  Internet Address 192.168.3.1/26, Broadcast 192.168.3.63, Area 0.0.0.0
+  MTU mismatch detection: enabled
+  Router ID 192.168.0.1, Network Type BROADCAST, Cost: 10
+  Transmit Delay is 1 sec, State DR, Priority 1
+  No backup designated router on this network
+  Multicast group memberships: OSPFAllRouters OSPFDesignatedRouters
+  Timer intervals configured, Hello 10s, Dead 40s, Wait 40s, Retransmit 5
+    Hello due in XX.XXXs
+  Neighbor Count is 0, Adjacent neighbor count is 0
Known issue - IGNORING. See https://github.com/FRRouting/frr/issues/348
r1 failed SHOW ISIS INTERFACE DETAIL check:
--- actual SHOW ISIS INTERFACE DETAIL
+++ expected SHOW ISIS OSPF6 INTERFACE DETAIL
@@ -1 +1,28 @@
 Area test:
+  Interface: r1-eth5, State: Up, Active, Circuit Id: 0xXX
+    Type: lan, Level: L1, SNPA: XXXX.XXXX.XXXX
+    Level-1 Information:
+      Metric: 10, Active neighbors: 0
+      Hello interval: 3, Holddown count: 10 (pad)
+      CNSP interval: 10, PSNP interval: 2
+      LAN Priority: 64, is not DIS
+    IP Prefix(es):
+      192.168.5.1/26
+    IPv6 Link-Locals:
+      fe80::XXXX:XXXX:XXXX:XXXX/64
+    IPv6 Prefixes:
+      fc00:0:0:5::1/64
+
+  Interface: r1-eth6, State: Up, Active, Circuit Id: 0xXX
+    Type: lan, Level: L2, SNPA: XXXX.XXXX.XXXX
+    Level-2 Information:
+      Metric: 10, Active neighbors: 0
+      Hello interval: 3, Holddown count: 10 (pad)
+      CNSP interval: 10, PSNP interval: 2
+      LAN Priority: 64, is not DIS
+    IP Prefix(es):
+      192.168.6.1/26
+    IPv6 Link-Locals:
+      fe80::XXXX:XXXX:XXXX:XXXX/64
+    IPv6 Prefixes:
+      fc00:0:0:6::1/64
2020-03-11 17:02:55,127 ERROR: assert failed at "test_all_protocol_startup/test_isis_interfaces": SHOW ISIS INTERFACE DETAIL failed for router r1:
  --- actual SHOW ISIS INTERFACE DETAIL
  +++ expected SHOW ISIS OSPF6 INTERFACE DETAIL
  @@ -1 +1,28 @@
   Area test:
  +  Interface: r1-eth5, State: Up, Active, Circuit Id: 0xXX
  +    Type: lan, Level: L1, SNPA: XXXX.XXXX.XXXX
  +    Level-1 Information:
  +      Metric: 10, Active neighbors: 0
  +      Hello interval: 3, Holddown count: 10 (pad)
  +      CNSP interval: 10, PSNP interval: 2
  +      LAN Priority: 64, is not DIS
  +    IP Prefix(es):
  +      192.168.5.1/26
  +    IPv6 Link-Locals:
  +      fe80::XXXX:XXXX:XXXX:XXXX/64
  +    IPv6 Prefixes:
  +      fc00:0:0:5::1/64
  +
  +  Interface: r1-eth6, State: Up, Active, Circuit Id: 0xXX
  +    Type: lan, Level: L2, SNPA: XXXX.XXXX.XXXX
  +    Level-2 Information:
  +      Metric: 10, Active neighbors: 0
  +      Hello interval: 3, Holddown count: 10 (pad)
  +      CNSP interval: 10, PSNP interval: 2
  +      LAN Priority: 64, is not DIS
  +    IP Prefix(es):
  +      192.168.6.1/26
  +    IPv6 Link-Locals:
  +      fe80::XXXX:XXXX:XXXX:XXXX/64
  +    IPv6 Prefixes:
  +      fc00:0:0:6::1/64
assert 1 == 0
  -1
  +0
r1 failed MPLS LDP Interface status Check:
--- actual MPLS LDP interface status
+++ expected MPLS LDP interface status
@@ -1,3 +1,3 @@
 AF   Interface   State  Uptime   Hello Timers  ac
-ipv4 r1-eth9     DOWN   xx:xx:xx 5/15           0
+ipv4 r1-eth9     ACTIVE xx:xx:xx 5/15           0
 ipv6 r1-eth9     ACTIVE xx:xx:xx 5/15           0
2020-03-11 17:02:57,052 ERROR: assert failed at "test_all_protocol_startup/test_mpls_interfaces": MPLS LDP Interface status failed for router r1:
  --- actual MPLS LDP interface status
  +++ expected MPLS LDP interface status
  @@ -1,3 +1,3 @@
   AF   Interface   State  Uptime   Hello Timers  ac
  -ipv4 r1-eth9     DOWN   xx:xx:xx 5/15           0
  +ipv4 r1-eth9     ACTIVE xx:xx:xx 5/15           0
   ipv6 r1-eth9     ACTIVE xx:xx:xx 5/15           0
assert 1 == 0
  -1
  +0
2020-03-11 17:03:34,402 ERROR: 'router_json_cmp' failed after 26.42 seconds
2020-03-11 17:03:34,409 ERROR: assert failed at "test_bfd_bgp_cbit_topo3/test_protocols_convergence": "r1" JSON output mismatches
assert expected key(s) [u'2001:db8:4::/64', u'2001:db8:6::/64', u'2001:db8:7::/64', u'2001:db8:1::/64'] in json (have [u'fe80::/64']):
  --- Expected value
  +++ Current value
  @@ -2 +2 @@
  -    "2001:db8:1::/64": [
  +    "fe80::/64": [
  @@ -4 +3,0 @@
  -            "destSelected": true, 
  @@ -5,0 +5,5 @@
  +            "installed": true, 
  +            "internalFlags": 0, 
  +            "internalNextHopActiveNum": 1, 
  +            "internalNextHopNum": 1, 
  +            "internalStatus": 16, 
  @@ -12,0 +17 @@
  +                    "interfaceIndex": 2, 
  @@ -16 +21 @@
  -            "prefix": "2001:db8:1::/64", 
  +            "prefix": "fe80::/64", 
  @@ -18,4 +23,3 @@
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:4::/64": [
  +            "table": 254, 
  +            "uptime": "00:00:30"
  +        }, 
  @@ -24 +28,6 @@
  -            "distance": 1, 
  +            "distance": 0, 
  +            "installed": true, 
  +            "internalFlags": 8, 
  +            "internalNextHopActiveNum": 1, 
  +            "internalNextHopNum": 1, 
  +            "internalStatus": 16, 
  @@ -29 +38 @@
  -                    "afi": "ipv6", 
  +                    "directlyConnected": true, 
  @@ -32 +41,2 @@
  -                    "interfaceName": "r1-eth0"
  +                    "interfaceIndex": 1, 
  +                    "interfaceName": "lo"
  @@ -35,51 +45,5 @@
  -            "prefix": "2001:db8:4::/64", 
  -            "protocol": "static", 
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:6::/64": [
  -        {
  -            "destSelected": true, 
  -            "distance": 20, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "afi": "ipv6", 
  -                    "ip": "2001:db8:4::1", 
  -                    "recursive": true
  -                }, 
  -                {
  -                    "afi": "ipv6", 
  -                    "fib": true, 
  -                    "interfaceName": "r1-eth0", 
  -                    "ip": "2001:db8:1::2"
  -                }
  -            ], 
  -            "prefix": "2001:db8:6::/64", 
  -            "protocol": "bgp", 
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:7::/64": [
  -        {
  -            "destSelected": true, 
  -            "distance": 20, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "afi": "ipv6", 
  -                    "ip": "2001:db8:4::1", 
  -                    "recursive": true
  -                }, 
  -                {
  -                    "afi": "ipv6", 
  -                    "fib": true, 
  -                    "interfaceName": "r1-eth0", 
  -                    "ip": "2001:db8:1::2"
  -                }
  -            ], 
  -            "prefix": "2001:db8:7::/64", 
  -            "protocol": "bgp", 
  -            "selected": true
  +            "prefix": "fe80::/64", 
  +            "protocol": "connected", 
  +            "selected": true, 
  +            "table": 254, 
  +            "uptime": "00:00:31"
2020-03-11 17:03:39,885 ERROR: 'router_json_cmp' failed after 5.27 seconds
2020-03-11 17:03:39,887 ERROR: assert failed at "test_bfd_bgp_cbit_topo3/test_bfd_comes_back_again": "r1" JSON output mismatches
assert json too few items (have 0, expected 1:
   --- Expected value
  +++ Current value
  @@ -1,16 +1 @@
  -[
  -    {
  -        "diagnostic": "ok", 
  -        "echo-interval": 0, 
  -        "local": "2001:db8:1::1", 
  -        "multihop": true, 
  -        "peer": "2001:db8:4::1", 
  -        "receive-interval": 300, 
  -        "remote-diagnostic": "ok", 
  -        "remote-echo-interval": 50, 
  -        "remote-receive-interval": 300, 
  -        "remote-transmit-interval": 300, 
  -        "status": "up", 
  -        "transmit-interval": 300
  -    }
  -]
  +[])
2020-03-11 17:03:55,721 ERROR: 'router_json_cmp' failed after 5.27 seconds
2020-03-11 17:03:55,726 ERROR: assert failed at "test_bfd_topo1/test_bfd_connection": "r4" JSON output mismatches
assert json value is different (
  --- Expected value
  +++ Current value
  @@ -2,0 +3,6 @@
  +        "detect-multiplier": 3, 
  +        "diagnostic": "ok", 
  +        "downtime": 11, 
  +        "echo-interval": 0, 
  +        "id": 2887157787, 
  +        "multihop": false, 
  @@ -4 +10,10 @@
  -        "status": "up"
  +        "receive-interval": 2000, 
  +        "remote-detect-multiplier": 3, 
  +        "remote-diagnostic": "ok", 
  +        "remote-echo-interval": 0, 
  +        "remote-id": 0, 
  +        "remote-receive-interval": 1000, 
  +        "remote-transmit-interval": 1000, 
  +        "status": "down", 
  +        "transmit-interval": 2000, 
  +        "vrf": "default")
2020-03-11 17:05:54,267 ERROR: 'router_json_cmp' failed after 105.85 seconds
2020-03-11 17:05:54,273 ERROR: assert failed at "test_bfd_topo2/test_protocols_convergence": "r4" JSON output mismatches
assert expected key(s) [u'10.254.254.4/32'] in json (have []):
  --- Expected value
  +++ Current value
  @@ -1,24 +1 @@
  -{
  -    "10.254.254.4/32": [
  -        {
  -            "distance": 0, 
  -            "installed": true, 
  -            "internalFlags": 8, 
  -            "internalStatus": 16, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "directlyConnected": true, 
  -                    "fib": true, 
  -                    "flags": 3, 
  -                    "interfaceIndex": 1, 
  -                    "interfaceName": "lo"
  -                }
  -            ], 
  -            "prefix": "10.254.254.4/32", 
  -            "protocol": "connected", 
  -            "selected": true
  -        }
  -    ]
  -}
  +{}
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
2020-03-11 17:06:11,487 ERROR: 'router_json_cmp' failed after 5.33 seconds
2020-03-11 17:06:11,491 ERROR: assert failed at "test_bfd_vrf_topo1/test_bfd_connection": "r4" JSON output mismatches
assert json value is different (
  --- Expected value
  +++ Current value
  @@ -2,0 +3,6 @@
  +        "detect-multiplier": 3, 
  +        "diagnostic": "ok", 
  +        "downtime": 12, 
  +        "echo-interval": 0, 
  +        "id": 2747070065, 
  +        "multihop": false, 
  @@ -4 +10,10 @@
  -        "status": "up"
  +        "receive-interval": 2000, 
  +        "remote-detect-multiplier": 3, 
  +        "remote-diagnostic": "ok", 
  +        "remote-echo-interval": 0, 
  +        "remote-id": 0, 
  +        "remote-receive-interval": 1000, 
  +        "remote-transmit-interval": 1000, 
  +        "status": "down", 
  +        "transmit-interval": 2000, 
  +        "vrf": "r4-cust1")
2020-03-11 17:07:20,518 ERROR: '_output_summary_cmp' failed after 40.56 seconds
2020-03-11 17:07:20,523 ERROR: assert failed at "test_bgp_ecmp_topo1/test_bgp_convergence": BGP router network did not converge
assert json["ipv4Unicast"]["peers"]["10.0.2.107"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.107"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.118"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.118"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.103"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.103"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.102"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.102"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.101"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.101"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.111"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.111"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.105"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.105"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.104"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.104"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.119"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.119"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.112"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.112"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.110"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.110"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.108"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.108"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.109"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.109"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.113"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.113"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.106"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.106"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.115"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.115"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.120"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.120"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.116"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.116"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.114"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.114"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.117"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.117"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
*** defaultIntf: warning: r1 has no interfaces
2020-03-11 17:08:59,138 ERROR: '_bgp_converge' failed after 19.96 seconds
2020-03-11 17:08:59,141 ERROR: assert failed at "test_bgp_aggregate-address_origin/test_bgp_aggregate_address_origin": Failed to see bgp convergence in "TopoGear<name="r2",links=["r2-eth0"<->"s1-eth1"]> TopoRouter<>"
assert json["192.168.255.1"]["bgpState"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["192.168.255.1"]["addressFamilyInfo"]["ipv4Unicast"]["acceptedPrefixCounter"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -3
  +0)
2020-03-11 17:09:24,522 ERROR: '_bgp_converge' failed after 19.54 seconds
2020-03-11 17:09:24,525 ERROR: assert failed at "test_bgp_aggregate-address_route-map/test_bgp_maximum_prefix_invalid": Failed to see bgp convergence in "TopoGear<name="r2",links=["r2-eth0"<->"s1-eth1"]> TopoRouter<>"
assert json["192.168.255.1"]["bgpState"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["192.168.255.1"]["addressFamilyInfo"]["ipv4Unicast"]["acceptedPrefixCounter"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -3
  +0)

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-11094/artifact/TOPOI386/ErrorLog/log_topotests.txt

Successful on other platforms/tests

Debian 10 deb pkg check
Ubuntu 16.04 deb pkg check
Ubuntu 12.04 deb pkg check
Fedora 29 rpm pkg check
Debian 8 deb pkg check
Debian 9 deb pkg check
Ubuntu 14.04 deb pkg check
Static analyzer (clang)

NetDEF-CI · 2020-03-12T05:52:49Z

Continuous Integration Result: FAILED

Test incomplete. See below for issues.
CI System Testrun URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-11094/

This is a comment from an automated CI system.
For questions and feedback in regards to this CI system, please feel free to email
Martin Winter - mwinter (at) opensourcerouting.org.

Get source / Pull Request: Successful

Building Stage: Successful

Basic Tests: Incomplete

CentOS 7 rpm pkg check: Failed (click for details)

CentOS 7 rpm pkg check: Unknown Log URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-11094/artifact/CENTOS7RPM/ErrorLog/log_package_start.txt CentOS 7 rpm pkg check: No useful log found

Topology tests on Ubuntu 18.04 amd64: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOU1804-11094/test

Topology Tests failed for Topology tests on Ubuntu 18.04 amd64:

Failed check for StdErr Output on daemons:
r1 OSPF6d StdErr Output:
% Configuration failed: validation error.

Please check the logs for more details.
r1 ISISd StdErr Output:

% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.r%s Zebra StdErr Output:
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.

Known issue - IGNORING. See https://github.com/FRRouting/frr/issues/349
r1 failed IP Routing table check:
--- Actual IP Routing Table
+++ Expected IP RoutingTable
@@ -1,9 +1,23 @@
+C>* 192.168.0.0/24 is directly connected, r1-eth0, XX:XX:XX
+C>* 192.168.1.0/26 is directly connected, r1-eth1, XX:XX:XX
+C>* 192.168.2.0/26 is directly connected, r1-eth2, XX:XX:XX
+C>* 192.168.3.0/26 is directly connected, r1-eth3, XX:XX:XX
+C>* 192.168.4.0/26 is directly connected, r1-eth4, XX:XX:XX
+C>* 192.168.5.0/26 is directly connected, r1-eth5, XX:XX:XX
+C>* 192.168.6.0/26 is directly connected, r1-eth6, XX:XX:XX
+C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX
+C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX
+C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX
+O   192.168.0.0/24 [110/10] is directly connected, r1-eth0, XX:XX:XX
+O   192.168.3.0/26 [110/10] is directly connected, r1-eth3, XX:XX:XX
 S>* 1.1.1.1/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
 S>* 1.1.1.2/32 [1/0] is directly connected, r1-eth1, XX:XX:XX
-S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0 onlink, XX:XX:XX
+S>* 4.5.6.10/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
+S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
 S>* 4.5.6.12/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
 S>* 4.5.6.13/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.14/32 [1/0] unreachable (blackhole), XX:XX:XX
+S   4.5.6.15/32 [255/0] via 192.168.0.2, r1-eth0, XX:XX:XX
 S>* 4.5.6.7/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.8/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.9/32 [1/0] unreachable (ICMP unreachable), XX:XX:XX
2020-03-12 03:20:25,185 ERROR: assert failed at "test_all_protocol_startup/test_converge_protocols": IP Routing table failed for r1
  --- Actual IP Routing Table
  +++ Expected IP RoutingTable
  @@ -1,9 +1,23 @@
  +C>* 192.168.0.0/24 is directly connected, r1-eth0, XX:XX:XX
  +C>* 192.168.1.0/26 is directly connected, r1-eth1, XX:XX:XX
  +C>* 192.168.2.0/26 is directly connected, r1-eth2, XX:XX:XX
  +C>* 192.168.3.0/26 is directly connected, r1-eth3, XX:XX:XX
  +C>* 192.168.4.0/26 is directly connected, r1-eth4, XX:XX:XX
  +C>* 192.168.5.0/26 is directly connected, r1-eth5, XX:XX:XX
  +C>* 192.168.6.0/26 is directly connected, r1-eth6, XX:XX:XX
  +C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX
  +C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX
  +C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX
  +O   192.168.0.0/24 [110/10] is directly connected, r1-eth0, XX:XX:XX
  +O   192.168.3.0/26 [110/10] is directly connected, r1-eth3, XX:XX:XX
   S>* 1.1.1.1/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
   S>* 1.1.1.2/32 [1/0] is directly connected, r1-eth1, XX:XX:XX
  -S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0 onlink, XX:XX:XX
  +S>* 4.5.6.10/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
  +S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
   S>* 4.5.6.12/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
   S>* 4.5.6.13/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.14/32 [1/0] unreachable (blackhole), XX:XX:XX
  +S   4.5.6.15/32 [255/0] via 192.168.0.2, r1-eth0, XX:XX:XX
   S>* 4.5.6.7/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.8/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.9/32 [1/0] unreachable (ICMP unreachable), XX:XX:XX
assert 1 == 0
  -1
  +0
r1 failed IP RIP status check:
--- actual IP RIP status
+++ expected IP RIP status
@@ -7,6 +7,7 @@
   Redistributing:
   Default version control: send version 2, receive version 2 
     Interface        Send  Recv   Key-chain
+    r1-eth1          2     2      
   Routing for Networks:
     192.168.1.0/26
   Routing Information Sources:
2020-03-12 03:20:25,886 ERROR: assert failed at "test_all_protocol_startup/test_rip_status": IP RIP status failed for router r1:
  --- actual IP RIP status
  +++ expected IP RIP status
  @@ -7,6 +7,7 @@
     Redistributing:
     Default version control: send version 2, receive version 2 
       Interface        Send  Recv   Key-chain
  +    r1-eth1          2     2      
     Routing for Networks:
       192.168.1.0/26
     Routing Information Sources:
assert 1 == 0
  -1
  +0
r1 failed IPv6 RIPng status check:
--- actual IPv6 RIPng status
+++ expected IPv6 RIPng status
@@ -7,6 +7,7 @@
   Redistributing:
   Default version control: send version 1, receive version 1 
     Interface        Send  Recv
+    r1-eth2          1     1  
   Routing for Networks:
     fc00:0:0:2::/64
   Routing Information Sources:
2020-03-12 03:20:26,030 ERROR: assert failed at "test_all_protocol_startup/test_ripng_status": IPv6 RIPng status failed for router r1:
  --- actual IPv6 RIPng status
  +++ expected IPv6 RIPng status
  @@ -7,6 +7,7 @@
     Redistributing:
     Default version control: send version 1, receive version 1 
       Interface        Send  Recv
  +    r1-eth2          1     1  
     Routing for Networks:
       fc00:0:0:2::/64
     Routing Information Sources:
assert 1 == 0
  -1
  +0
r1 failed SHOW IP OSPF INTERFACE check:
--- actual SHOW IP OSPF INTERFACE
+++ expected SHOW IP OSPF INTERFACE
@@ -1 +1,22 @@
-
+r1-eth0 is up
+  ifindex X, MTU 1500 bytes, BW XX Mbit <UP,BROADCAST,RUNNING,MULTICAST>
+  Internet Address 192.168.0.1/24, Broadcast 192.168.0.255, Area 0.0.0.0
+  MTU mismatch detection: enabled
+  Router ID 192.168.0.1, Network Type BROADCAST, Cost: 10
+  Transmit Delay is 1 sec, State DR, Priority 1
+  No backup designated router on this network
+  Multicast group memberships: OSPFAllRouters OSPFDesignatedRouters
+  Timer intervals configured, Hello 10s, Dead 40s, Wait 40s, Retransmit 5
+    Hello due in XX.XXXs
+  Neighbor Count is 0, Adjacent neighbor count is 0
+r1-eth3 is up
+  ifindex X, MTU 1500 bytes, BW XX Mbit <UP,BROADCAST,RUNNING,MULTICAST>
+  Internet Address 192.168.3.1/26, Broadcast 192.168.3.63, Area 0.0.0.0
+  MTU mismatch detection: enabled
+  Router ID 192.168.0.1, Network Type BROADCAST, Cost: 10
+  Transmit Delay is 1 sec, State DR, Priority 1
+  No backup designated router on this network
+  Multicast group memberships: OSPFAllRouters OSPFDesignatedRouters
+  Timer intervals configured, Hello 10s, Dead 40s, Wait 40s, Retransmit 5
+    Hello due in XX.XXXs
+  Neighbor Count is 0, Adjacent neighbor count is 0
Known issue - IGNORING. See https://github.com/FRRouting/frr/issues/348
r1 failed SHOW ISIS INTERFACE DETAIL check:
--- actual SHOW ISIS INTERFACE DETAIL
+++ expected SHOW ISIS OSPF6 INTERFACE DETAIL
@@ -1 +1,28 @@
 Area test:
+  Interface: r1-eth5, State: Up, Active, Circuit Id: 0xXX
+    Type: lan, Level: L1, SNPA: XXXX.XXXX.XXXX
+    Level-1 Information:
+      Metric: 10, Active neighbors: 0
+      Hello interval: 3, Holddown count: 10 (pad)
+      CNSP interval: 10, PSNP interval: 2
+      LAN Priority: 64, is not DIS
+    IP Prefix(es):
+      192.168.5.1/26
+    IPv6 Link-Locals:
+      fe80::XXXX:XXXX:XXXX:XXXX/64
+    IPv6 Prefixes:
+      fc00:0:0:5::1/64
+
+  Interface: r1-eth6, State: Up, Active, Circuit Id: 0xXX
+    Type: lan, Level: L2, SNPA: XXXX.XXXX.XXXX
+    Level-2 Information:
+      Metric: 10, Active neighbors: 0
+      Hello interval: 3, Holddown count: 10 (pad)
+      CNSP interval: 10, PSNP interval: 2
+      LAN Priority: 64, is not DIS
+    IP Prefix(es):
+      192.168.6.1/26
+    IPv6 Link-Locals:
+      fe80::XXXX:XXXX:XXXX:XXXX/64
+    IPv6 Prefixes:
+      fc00:0:0:6::1/64
2020-03-12 03:20:26,255 ERROR: assert failed at "test_all_protocol_startup/test_isis_interfaces": SHOW ISIS INTERFACE DETAIL failed for router r1:
  --- actual SHOW ISIS INTERFACE DETAIL
  +++ expected SHOW ISIS OSPF6 INTERFACE DETAIL
  @@ -1 +1,28 @@
   Area test:
  +  Interface: r1-eth5, State: Up, Active, Circuit Id: 0xXX
  +    Type: lan, Level: L1, SNPA: XXXX.XXXX.XXXX
  +    Level-1 Information:
  +      Metric: 10, Active neighbors: 0
  +      Hello interval: 3, Holddown count: 10 (pad)
  +      CNSP interval: 10, PSNP interval: 2
  +      LAN Priority: 64, is not DIS
  +    IP Prefix(es):
  +      192.168.5.1/26
  +    IPv6 Link-Locals:
  +      fe80::XXXX:XXXX:XXXX:XXXX/64
  +    IPv6 Prefixes:
  +      fc00:0:0:5::1/64
  +
  +  Interface: r1-eth6, State: Up, Active, Circuit Id: 0xXX
  +    Type: lan, Level: L2, SNPA: XXXX.XXXX.XXXX
  +    Level-2 Information:
  +      Metric: 10, Active neighbors: 0
  +      Hello interval: 3, Holddown count: 10 (pad)
  +      CNSP interval: 10, PSNP interval: 2
  +      LAN Priority: 64, is not DIS
  +    IP Prefix(es):
  +      192.168.6.1/26
  +    IPv6 Link-Locals:
  +      fe80::XXXX:XXXX:XXXX:XXXX/64
  +    IPv6 Prefixes:
  +      fc00:0:0:6::1/64
assert 1 == 0
  -1
  +0
r1 failed MPLS LDP Interface status Check:
--- actual MPLS LDP interface status
+++ expected MPLS LDP interface status
@@ -1,3 +1,3 @@
 AF   Interface   State  Uptime   Hello Timers  ac
-ipv4 r1-eth9     DOWN   xx:xx:xx 5/15           0
+ipv4 r1-eth9     ACTIVE xx:xx:xx 5/15           0
 ipv6 r1-eth9     ACTIVE xx:xx:xx 5/15           0
2020-03-12 03:20:27,924 ERROR: assert failed at "test_all_protocol_startup/test_mpls_interfaces": MPLS LDP Interface status failed for router r1:
  --- actual MPLS LDP interface status
  +++ expected MPLS LDP interface status
  @@ -1,3 +1,3 @@
   AF   Interface   State  Uptime   Hello Timers  ac
  -ipv4 r1-eth9     DOWN   xx:xx:xx 5/15           0
  +ipv4 r1-eth9     ACTIVE xx:xx:xx 5/15           0
   ipv6 r1-eth9     ACTIVE xx:xx:xx 5/15           0
assert 1 == 0
  -1
  +0
2020-03-12 03:21:02,788 ERROR: 'router_json_cmp' failed after 25.51 seconds
2020-03-12 03:21:02,791 ERROR: assert failed at "test_bfd_bgp_cbit_topo3/test_protocols_convergence": "r1" JSON output mismatches
assert expected key(s) [u'2001:db8:4::/64', u'2001:db8:6::/64', u'2001:db8:7::/64', u'2001:db8:1::/64'] in json (have [u'fe80::/64']):
  --- Expected value
  +++ Current value
  @@ -2 +2 @@
  -    "2001:db8:1::/64": [
  +    "fe80::/64": [
  @@ -4 +3,0 @@
  -            "destSelected": true, 
  @@ -5,0 +5,5 @@
  +            "installed": true, 
  +            "internalFlags": 0, 
  +            "internalNextHopActiveNum": 1, 
  +            "internalNextHopNum": 1, 
  +            "internalStatus": 16, 
  @@ -12,0 +17 @@
  +                    "interfaceIndex": 2, 
  @@ -16 +21 @@
  -            "prefix": "2001:db8:1::/64", 
  +            "prefix": "fe80::/64", 
  @@ -18,4 +23,3 @@
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:4::/64": [
  +            "table": 254, 
  +            "uptime": "00:00:28"
  +        }, 
  @@ -24 +28,6 @@
  -            "distance": 1, 
  +            "distance": 0, 
  +            "installed": true, 
  +            "internalFlags": 8, 
  +            "internalNextHopActiveNum": 1, 
  +            "internalNextHopNum": 1, 
  +            "internalStatus": 16, 
  @@ -29 +38 @@
  -                    "afi": "ipv6", 
  +                    "directlyConnected": true, 
  @@ -32 +41,2 @@
  -                    "interfaceName": "r1-eth0"
  +                    "interfaceIndex": 1, 
  +                    "interfaceName": "lo"
  @@ -35,51 +45,5 @@
  -            "prefix": "2001:db8:4::/64", 
  -            "protocol": "static", 
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:6::/64": [
  -        {
  -            "destSelected": true, 
  -            "distance": 20, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "afi": "ipv6", 
  -                    "ip": "2001:db8:4::1", 
  -                    "recursive": true
  -                }, 
  -                {
  -                    "afi": "ipv6", 
  -                    "fib": true, 
  -                    "interfaceName": "r1-eth0", 
  -                    "ip": "2001:db8:1::2"
  -                }
  -            ], 
  -            "prefix": "2001:db8:6::/64", 
  -            "protocol": "bgp", 
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:7::/64": [
  -        {
  -            "destSelected": true, 
  -            "distance": 20, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "afi": "ipv6", 
  -                    "ip": "2001:db8:4::1", 
  -                    "recursive": true
  -                }, 
  -                {
  -                    "afi": "ipv6", 
  -                    "fib": true, 
  -                    "interfaceName": "r1-eth0", 
  -                    "ip": "2001:db8:1::2"
  -                }
  -            ], 
  -            "prefix": "2001:db8:7::/64", 
  -            "protocol": "bgp", 
  -            "selected": true
  +            "prefix": "fe80::/64", 
  +            "protocol": "connected", 
  +            "selected": true, 
  +            "table": 254, 
  +            "uptime": "00:00:29"
2020-03-12 03:21:08,075 ERROR: 'router_json_cmp' failed after 5.12 seconds
2020-03-12 03:21:08,077 ERROR: assert failed at "test_bfd_bgp_cbit_topo3/test_bfd_comes_back_again": "r1" JSON output mismatches
assert json too few items (have 0, expected 1:
   --- Expected value
  +++ Current value
  @@ -1,16 +1 @@
  -[
  -    {
  -        "diagnostic": "ok", 
  -        "echo-interval": 0, 
  -        "local": "2001:db8:1::1", 
  -        "multihop": true, 
  -        "peer": "2001:db8:4::1", 
  -        "receive-interval": 300, 
  -        "remote-diagnostic": "ok", 
  -        "remote-echo-interval": 50, 
  -        "remote-receive-interval": 300, 
  -        "remote-transmit-interval": 300, 
  -        "status": "up", 
  -        "transmit-interval": 300
  -    }
  -]
  +[])
2020-03-12 03:21:22,981 ERROR: 'router_json_cmp' failed after 5.07 seconds
2020-03-12 03:21:22,983 ERROR: assert failed at "test_bfd_topo1/test_bfd_connection": "r4" JSON output mismatches
assert json value is different (
  --- Expected value
  +++ Current value
  @@ -2,0 +3,6 @@
  +        "detect-multiplier": 3, 
  +        "diagnostic": "ok", 
  +        "downtime": 10, 
  +        "echo-interval": 0, 
  +        "id": 3704691462, 
  +        "multihop": false, 
  @@ -4 +10,10 @@
  -        "status": "up"
  +        "receive-interval": 2000, 
  +        "remote-detect-multiplier": 3, 
  +        "remote-diagnostic": "ok", 
  +        "remote-echo-interval": 0, 
  +        "remote-id": 0, 
  +        "remote-receive-interval": 1000, 
  +        "remote-transmit-interval": 1000, 
  +        "status": "down", 
  +        "transmit-interval": 2000, 
  +        "vrf": "default")
2020-03-12 03:23:16,991 ERROR: 'router_json_cmp' failed after 102.37 seconds
2020-03-12 03:23:16,993 ERROR: assert failed at "test_bfd_topo2/test_protocols_convergence": "r4" JSON output mismatches
assert expected key(s) [u'10.254.254.4/32'] in json (have []):
  --- Expected value
  +++ Current value
  @@ -1,24 +1 @@
  -{
  -    "10.254.254.4/32": [
  -        {
  -            "distance": 0, 
  -            "installed": true, 
  -            "internalFlags": 8, 
  -            "internalStatus": 16, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "directlyConnected": true, 
  -                    "fib": true, 
  -                    "flags": 3, 
  -                    "interfaceIndex": 1, 
  -                    "interfaceName": "lo"
  -                }
  -            ], 
  -            "prefix": "10.254.254.4/32", 
  -            "protocol": "connected", 
  -            "selected": true
  -        }
  -    ]
  -}
  +{}
2020-03-12 03:23:32,836 ERROR: 'router_json_cmp' failed after 5.03 seconds
2020-03-12 03:23:32,838 ERROR: assert failed at "test_bfd_vrf_topo1/test_bfd_connection": "r4" JSON output mismatches
assert json value is different (
  --- Expected value
  +++ Current value
  @@ -2,0 +3,6 @@
  +        "detect-multiplier": 3, 
  +        "diagnostic": "ok", 
  +        "downtime": 10, 
  +        "echo-interval": 0, 
  +        "id": 2746785824, 
  +        "multihop": false, 
  @@ -4 +10,10 @@
  -        "status": "up"
  +        "receive-interval": 2000, 
  +        "remote-detect-multiplier": 3, 
  +        "remote-diagnostic": "ok", 
  +        "remote-echo-interval": 0, 
  +        "remote-id": 0, 
  +        "remote-receive-interval": 1000, 
  +        "remote-transmit-interval": 1000, 
  +        "status": "down", 
  +        "transmit-interval": 2000, 
  +        "vrf": "r4-cust1")
2020-03-12 03:24:36,928 ERROR: '_output_summary_cmp' failed after 38.47 seconds
2020-03-12 03:24:36,932 ERROR: assert failed at "test_bgp_ecmp_topo1/test_bgp_convergence": BGP router network did not converge
assert json["ipv4Unicast"]["peers"]["10.0.2.107"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.107"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.118"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.118"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.103"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.103"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.102"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.102"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.101"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.101"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.111"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.111"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.105"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.105"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.104"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.104"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.119"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.119"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.112"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.112"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.110"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.110"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.108"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.108"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.109"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.109"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.113"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.113"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.106"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.106"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.115"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.115"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.120"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.120"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.116"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.116"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.114"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.114"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.117"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.117"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
*** defaultIntf: warning: r1 has no interfaces
2020-03-12 03:26:05,978 ERROR: '_bgp_converge' failed after 19.30 seconds
2020-03-12 03:26:05,980 ERROR: assert failed at "test_bgp_aggregate-address_origin/test_bgp_aggregate_address_origin": Failed to see bgp convergence in "TopoGear<name="r2",links=["r2-eth0"<->"s1-eth1"]> TopoRouter<>"
assert json["192.168.255.1"]["bgpState"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["192.168.255.1"]["addressFamilyInfo"]["ipv4Unicast"]["acceptedPrefixCounter"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -3
  +0)
2020-03-12 03:26:30,682 ERROR: '_bgp_converge' failed after 19.38 seconds
2020-03-12 03:26:30,684 ERROR: assert failed at "test_bgp_aggregate-address_route-map/test_bgp_maximum_prefix_invalid": Failed to see bgp convergence in "TopoGear<name="r2",links=["r2-eth0"<->"s1-eth1"]> TopoRouter<>"
assert json["192.168.255.1"]["bgpState"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["192.168.255.1"]["addressFamilyInfo"]["ipv4Unicast"]["acceptedPrefixCounter"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -3
  +0)

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-11094/artifact/TOPOU1804/ErrorLog/log_topotests.txt

IPv6 protocols on Ubuntu 14.04: Failed (click for details)

CentOS 7 rpm pkg check: Failed (click for details)

CentOS 7 rpm pkg check: Unknown Log URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-11094/artifact/CENTOS7RPM/ErrorLog/log_package_start.txt CentOS 7 rpm pkg check: No useful log found

Topology tests on Ubuntu 18.04 amd64: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOU1804-11094/test

Topology Tests failed for Topology tests on Ubuntu 18.04 amd64:

Failed check for StdErr Output on daemons:
r1 OSPF6d StdErr Output:
% Configuration failed: validation error.

Please check the logs for more details.
r1 ISISd StdErr Output:

% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.r%s Zebra StdErr Output:
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.

Known issue - IGNORING. See https://github.com/FRRouting/frr/issues/349
r1 failed IP Routing table check:
--- Actual IP Routing Table
+++ Expected IP RoutingTable
@@ -1,9 +1,23 @@
+C>* 192.168.0.0/24 is directly connected, r1-eth0, XX:XX:XX
+C>* 192.168.1.0/26 is directly connected, r1-eth1, XX:XX:XX
+C>* 192.168.2.0/26 is directly connected, r1-eth2, XX:XX:XX
+C>* 192.168.3.0/26 is directly connected, r1-eth3, XX:XX:XX
+C>* 192.168.4.0/26 is directly connected, r1-eth4, XX:XX:XX
+C>* 192.168.5.0/26 is directly connected, r1-eth5, XX:XX:XX
+C>* 192.168.6.0/26 is directly connected, r1-eth6, XX:XX:XX
+C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX
+C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX
+C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX
+O   192.168.0.0/24 [110/10] is directly connected, r1-eth0, XX:XX:XX
+O   192.168.3.0/26 [110/10] is directly connected, r1-eth3, XX:XX:XX
 S>* 1.1.1.1/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
 S>* 1.1.1.2/32 [1/0] is directly connected, r1-eth1, XX:XX:XX
-S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0 onlink, XX:XX:XX
+S>* 4.5.6.10/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
+S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
 S>* 4.5.6.12/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
 S>* 4.5.6.13/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.14/32 [1/0] unreachable (blackhole), XX:XX:XX
+S   4.5.6.15/32 [255/0] via 192.168.0.2, r1-eth0, XX:XX:XX
 S>* 4.5.6.7/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.8/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.9/32 [1/0] unreachable (ICMP unreachable), XX:XX:XX
2020-03-12 03:20:25,185 ERROR: assert failed at "test_all_protocol_startup/test_converge_protocols": IP Routing table failed for r1
  --- Actual IP Routing Table
  +++ Expected IP RoutingTable
  @@ -1,9 +1,23 @@
  +C>* 192.168.0.0/24 is directly connected, r1-eth0, XX:XX:XX
  +C>* 192.168.1.0/26 is directly connected, r1-eth1, XX:XX:XX
  +C>* 192.168.2.0/26 is directly connected, r1-eth2, XX:XX:XX
  +C>* 192.168.3.0/26 is directly connected, r1-eth3, XX:XX:XX
  +C>* 192.168.4.0/26 is directly connected, r1-eth4, XX:XX:XX
  +C>* 192.168.5.0/26 is directly connected, r1-eth5, XX:XX:XX
  +C>* 192.168.6.0/26 is directly connected, r1-eth6, XX:XX:XX
  +C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX
  +C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX
  +C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX
  +O   192.168.0.0/24 [110/10] is directly connected, r1-eth0, XX:XX:XX
  +O   192.168.3.0/26 [110/10] is directly connected, r1-eth3, XX:XX:XX
   S>* 1.1.1.1/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
   S>* 1.1.1.2/32 [1/0] is directly connected, r1-eth1, XX:XX:XX
  -S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0 onlink, XX:XX:XX
  +S>* 4.5.6.10/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
  +S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
   S>* 4.5.6.12/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
   S>* 4.5.6.13/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.14/32 [1/0] unreachable (blackhole), XX:XX:XX
  +S   4.5.6.15/32 [255/0] via 192.168.0.2, r1-eth0, XX:XX:XX
   S>* 4.5.6.7/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.8/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.9/32 [1/0] unreachable (ICMP unreachable), XX:XX:XX
assert 1 == 0
  -1
  +0
r1 failed IP RIP status check:
--- actual IP RIP status
+++ expected IP RIP status
@@ -7,6 +7,7 @@
   Redistributing:
   Default version control: send version 2, receive version 2 
     Interface        Send  Recv   Key-chain
+    r1-eth1          2     2      
   Routing for Networks:
     192.168.1.0/26
   Routing Information Sources:
2020-03-12 03:20:25,886 ERROR: assert failed at "test_all_protocol_startup/test_rip_status": IP RIP status failed for router r1:
  --- actual IP RIP status
  +++ expected IP RIP status
  @@ -7,6 +7,7 @@
     Redistributing:
     Default version control: send version 2, receive version 2 
       Interface        Send  Recv   Key-chain
  +    r1-eth1          2     2      
     Routing for Networks:
       192.168.1.0/26
     Routing Information Sources:
assert 1 == 0
  -1
  +0
r1 failed IPv6 RIPng status check:
--- actual IPv6 RIPng status
+++ expected IPv6 RIPng status
@@ -7,6 +7,7 @@
   Redistributing:
   Default version control: send version 1, receive version 1 
     Interface        Send  Recv
+    r1-eth2          1     1  
   Routing for Networks:
     fc00:0:0:2::/64
   Routing Information Sources:
2020-03-12 03:20:26,030 ERROR: assert failed at "test_all_protocol_startup/test_ripng_status": IPv6 RIPng status failed for router r1:
  --- actual IPv6 RIPng status
  +++ expected IPv6 RIPng status
  @@ -7,6 +7,7 @@
     Redistributing:
     Default version control: send version 1, receive version 1 
       Interface        Send  Recv
  +    r1-eth2          1     1  
     Routing for Networks:
       fc00:0:0:2::/64
     Routing Information Sources:
assert 1 == 0
  -1
  +0
r1 failed SHOW IP OSPF INTERFACE check:
--- actual SHOW IP OSPF INTERFACE
+++ expected SHOW IP OSPF INTERFACE
@@ -1 +1,22 @@
-
+r1-eth0 is up
+  ifindex X, MTU 1500 bytes, BW XX Mbit <UP,BROADCAST,RUNNING,MULTICAST>
+  Internet Address 192.168.0.1/24, Broadcast 192.168.0.255, Area 0.0.0.0
+  MTU mismatch detection: enabled
+  Router ID 192.168.0.1, Network Type BROADCAST, Cost: 10
+  Transmit Delay is 1 sec, State DR, Priority 1
+  No backup designated router on this network
+  Multicast group memberships: OSPFAllRouters OSPFDesignatedRouters
+  Timer intervals configured, Hello 10s, Dead 40s, Wait 40s, Retransmit 5
+    Hello due in XX.XXXs
+  Neighbor Count is 0, Adjacent neighbor count is 0
+r1-eth3 is up
+  ifindex X, MTU 1500 bytes, BW XX Mbit <UP,BROADCAST,RUNNING,MULTICAST>
+  Internet Address 192.168.3.1/26, Broadcast 192.168.3.63, Area 0.0.0.0
+  MTU mismatch detection: enabled
+  Router ID 192.168.0.1, Network Type BROADCAST, Cost: 10
+  Transmit Delay is 1 sec, State DR, Priority 1
+  No backup designated router on this network
+  Multicast group memberships: OSPFAllRouters OSPFDesignatedRouters
+  Timer intervals configured, Hello 10s, Dead 40s, Wait 40s, Retransmit 5
+    Hello due in XX.XXXs
+  Neighbor Count is 0, Adjacent neighbor count is 0
Known issue - IGNORING. See https://github.com/FRRouting/frr/issues/348
r1 failed SHOW ISIS INTERFACE DETAIL check:
--- actual SHOW ISIS INTERFACE DETAIL
+++ expected SHOW ISIS OSPF6 INTERFACE DETAIL
@@ -1 +1,28 @@
 Area test:
+  Interface: r1-eth5, State: Up, Active, Circuit Id: 0xXX
+    Type: lan, Level: L1, SNPA: XXXX.XXXX.XXXX
+    Level-1 Information:
+      Metric: 10, Active neighbors: 0
+      Hello interval: 3, Holddown count: 10 (pad)
+      CNSP interval: 10, PSNP interval: 2
+      LAN Priority: 64, is not DIS
+    IP Prefix(es):
+      192.168.5.1/26
+    IPv6 Link-Locals:
+      fe80::XXXX:XXXX:XXXX:XXXX/64
+    IPv6 Prefixes:
+      fc00:0:0:5::1/64
+
+  Interface: r1-eth6, State: Up, Active, Circuit Id: 0xXX
+    Type: lan, Level: L2, SNPA: XXXX.XXXX.XXXX
+    Level-2 Information:
+      Metric: 10, Active neighbors: 0
+      Hello interval: 3, Holddown count: 10 (pad)
+      CNSP interval: 10, PSNP interval: 2
+      LAN Priority: 64, is not DIS
+    IP Prefix(es):
+      192.168.6.1/26
+    IPv6 Link-Locals:
+      fe80::XXXX:XXXX:XXXX:XXXX/64
+    IPv6 Prefixes:
+      fc00:0:0:6::1/64
2020-03-12 03:20:26,255 ERROR: assert failed at "test_all_protocol_startup/test_isis_interfaces": SHOW ISIS INTERFACE DETAIL failed for router r1:
  --- actual SHOW ISIS INTERFACE DETAIL
  +++ expected SHOW ISIS OSPF6 INTERFACE DETAIL
  @@ -1 +1,28 @@
   Area test:
  +  Interface: r1-eth5, State: Up, Active, Circuit Id: 0xXX
  +    Type: lan, Level: L1, SNPA: XXXX.XXXX.XXXX
  +    Level-1 Information:
  +      Metric: 10, Active neighbors: 0
  +      Hello interval: 3, Holddown count: 10 (pad)
  +      CNSP interval: 10, PSNP interval: 2
  +      LAN Priority: 64, is not DIS
  +    IP Prefix(es):
  +      192.168.5.1/26
  +    IPv6 Link-Locals:
  +      fe80::XXXX:XXXX:XXXX:XXXX/64
  +    IPv6 Prefixes:
  +      fc00:0:0:5::1/64
  +
  +  Interface: r1-eth6, State: Up, Active, Circuit Id: 0xXX
  +    Type: lan, Level: L2, SNPA: XXXX.XXXX.XXXX
  +    Level-2 Information:
  +      Metric: 10, Active neighbors: 0
  +      Hello interval: 3, Holddown count: 10 (pad)
  +      CNSP interval: 10, PSNP interval: 2
  +      LAN Priority: 64, is not DIS
  +    IP Prefix(es):
  +      192.168.6.1/26
  +    IPv6 Link-Locals:
  +      fe80::XXXX:XXXX:XXXX:XXXX/64
  +    IPv6 Prefixes:
  +      fc00:0:0:6::1/64
assert 1 == 0
  -1
  +0
r1 failed MPLS LDP Interface status Check:
--- actual MPLS LDP interface status
+++ expected MPLS LDP interface status
@@ -1,3 +1,3 @@
 AF   Interface   State  Uptime   Hello Timers  ac
-ipv4 r1-eth9     DOWN   xx:xx:xx 5/15           0
+ipv4 r1-eth9     ACTIVE xx:xx:xx 5/15           0
 ipv6 r1-eth9     ACTIVE xx:xx:xx 5/15           0
2020-03-12 03:20:27,924 ERROR: assert failed at "test_all_protocol_startup/test_mpls_interfaces": MPLS LDP Interface status failed for router r1:
  --- actual MPLS LDP interface status
  +++ expected MPLS LDP interface status
  @@ -1,3 +1,3 @@
   AF   Interface   State  Uptime   Hello Timers  ac
  -ipv4 r1-eth9     DOWN   xx:xx:xx 5/15           0
  +ipv4 r1-eth9     ACTIVE xx:xx:xx 5/15           0
   ipv6 r1-eth9     ACTIVE xx:xx:xx 5/15           0
assert 1 == 0
  -1
  +0
2020-03-12 03:21:02,788 ERROR: 'router_json_cmp' failed after 25.51 seconds
2020-03-12 03:21:02,791 ERROR: assert failed at "test_bfd_bgp_cbit_topo3/test_protocols_convergence": "r1" JSON output mismatches
assert expected key(s) [u'2001:db8:4::/64', u'2001:db8:6::/64', u'2001:db8:7::/64', u'2001:db8:1::/64'] in json (have [u'fe80::/64']):
  --- Expected value
  +++ Current value
  @@ -2 +2 @@
  -    "2001:db8:1::/64": [
  +    "fe80::/64": [
  @@ -4 +3,0 @@
  -            "destSelected": true, 
  @@ -5,0 +5,5 @@
  +            "installed": true, 
  +            "internalFlags": 0, 
  +            "internalNextHopActiveNum": 1, 
  +            "internalNextHopNum": 1, 
  +            "internalStatus": 16, 
  @@ -12,0 +17 @@
  +                    "interfaceIndex": 2, 
  @@ -16 +21 @@
  -            "prefix": "2001:db8:1::/64", 
  +            "prefix": "fe80::/64", 
  @@ -18,4 +23,3 @@
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:4::/64": [
  +            "table": 254, 
  +            "uptime": "00:00:28"
  +        }, 
  @@ -24 +28,6 @@
  -            "distance": 1, 
  +            "distance": 0, 
  +            "installed": true, 
  +            "internalFlags": 8, 
  +            "internalNextHopActiveNum": 1, 
  +            "internalNextHopNum": 1, 
  +            "internalStatus": 16, 
  @@ -29 +38 @@
  -                    "afi": "ipv6", 
  +                    "directlyConnected": true, 
  @@ -32 +41,2 @@
  -                    "interfaceName": "r1-eth0"
  +                    "interfaceIndex": 1, 
  +                    "interfaceName": "lo"
  @@ -35,51 +45,5 @@
  -            "prefix": "2001:db8:4::/64", 
  -            "protocol": "static", 
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:6::/64": [
  -        {
  -            "destSelected": true, 
  -            "distance": 20, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "afi": "ipv6", 
  -                    "ip": "2001:db8:4::1", 
  -                    "recursive": true
  -                }, 
  -                {
  -                    "afi": "ipv6", 
  -                    "fib": true, 
  -                    "interfaceName": "r1-eth0", 
  -                    "ip": "2001:db8:1::2"
  -                }
  -            ], 
  -            "prefix": "2001:db8:6::/64", 
  -            "protocol": "bgp", 
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:7::/64": [
  -        {
  -            "destSelected": true, 
  -            "distance": 20, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "afi": "ipv6", 
  -                    "ip": "2001:db8:4::1", 
  -                    "recursive": true
  -                }, 
  -                {
  -                    "afi": "ipv6", 
  -                    "fib": true, 
  -                    "interfaceName": "r1-eth0", 
  -                    "ip": "2001:db8:1::2"
  -                }
  -            ], 
  -            "prefix": "2001:db8:7::/64", 
  -            "protocol": "bgp", 
  -            "selected": true
  +            "prefix": "fe80::/64", 
  +            "protocol": "connected", 
  +            "selected": true, 
  +            "table": 254, 
  +            "uptime": "00:00:29"
2020-03-12 03:21:08,075 ERROR: 'router_json_cmp' failed after 5.12 seconds
2020-03-12 03:21:08,077 ERROR: assert failed at "test_bfd_bgp_cbit_topo3/test_bfd_comes_back_again": "r1" JSON output mismatches
assert json too few items (have 0, expected 1:
   --- Expected value
  +++ Current value
  @@ -1,16 +1 @@
  -[
  -    {
  -        "diagnostic": "ok", 
  -        "echo-interval": 0, 
  -        "local": "2001:db8:1::1", 
  -        "multihop": true, 
  -        "peer": "2001:db8:4::1", 
  -        "receive-interval": 300, 
  -        "remote-diagnostic": "ok", 
  -        "remote-echo-interval": 50, 
  -        "remote-receive-interval": 300, 
  -        "remote-transmit-interval": 300, 
  -        "status": "up", 
  -        "transmit-interval": 300
  -    }
  -]
  +[])
2020-03-12 03:21:22,981 ERROR: 'router_json_cmp' failed after 5.07 seconds
2020-03-12 03:21:22,983 ERROR: assert failed at "test_bfd_topo1/test_bfd_connection": "r4" JSON output mismatches
assert json value is different (
  --- Expected value
  +++ Current value
  @@ -2,0 +3,6 @@
  +        "detect-multiplier": 3, 
  +        "diagnostic": "ok", 
  +        "downtime": 10, 
  +        "echo-interval": 0, 
  +        "id": 3704691462, 
  +        "multihop": false, 
  @@ -4 +10,10 @@
  -        "status": "up"
  +        "receive-interval": 2000, 
  +        "remote-detect-multiplier": 3, 
  +        "remote-diagnostic": "ok", 
  +        "remote-echo-interval": 0, 
  +        "remote-id": 0, 
  +        "remote-receive-interval": 1000, 
  +        "remote-transmit-interval": 1000, 
  +        "status": "down", 
  +        "transmit-interval": 2000, 
  +        "vrf": "default")
2020-03-12 03:23:16,991 ERROR: 'router_json_cmp' failed after 102.37 seconds
2020-03-12 03:23:16,993 ERROR: assert failed at "test_bfd_topo2/test_protocols_convergence": "r4" JSON output mismatches
assert expected key(s) [u'10.254.254.4/32'] in json (have []):
  --- Expected value
  +++ Current value
  @@ -1,24 +1 @@
  -{
  -    "10.254.254.4/32": [
  -        {
  -            "distance": 0, 
  -            "installed": true, 
  -            "internalFlags": 8, 
  -            "internalStatus": 16, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "directlyConnected": true, 
  -                    "fib": true, 
  -                    "flags": 3, 
  -                    "interfaceIndex": 1, 
  -                    "interfaceName": "lo"
  -                }
  -            ], 
  -            "prefix": "10.254.254.4/32", 
  -            "protocol": "connected", 
  -            "selected": true
  -        }
  -    ]
  -}
  +{}
2020-03-12 03:23:32,836 ERROR: 'router_json_cmp' failed after 5.03 seconds
2020-03-12 03:23:32,838 ERROR: assert failed at "test_bfd_vrf_topo1/test_bfd_connection": "r4" JSON output mismatches
assert json value is different (
  --- Expected value
  +++ Current value
  @@ -2,0 +3,6 @@
  +        "detect-multiplier": 3, 
  +        "diagnostic": "ok", 
  +        "downtime": 10, 
  +        "echo-interval": 0, 
  +        "id": 2746785824, 
  +        "multihop": false, 
  @@ -4 +10,10 @@
  -        "status": "up"
  +        "receive-interval": 2000, 
  +        "remote-detect-multiplier": 3, 
  +        "remote-diagnostic": "ok", 
  +        "remote-echo-interval": 0, 
  +        "remote-id": 0, 
  +        "remote-receive-interval": 1000, 
  +        "remote-transmit-interval": 1000, 
  +        "status": "down", 
  +        "transmit-interval": 2000, 
  +        "vrf": "r4-cust1")
2020-03-12 03:24:36,928 ERROR: '_output_summary_cmp' failed after 38.47 seconds
2020-03-12 03:24:36,932 ERROR: assert failed at "test_bgp_ecmp_topo1/test_bgp_convergence": BGP router network did not converge
assert json["ipv4Unicast"]["peers"]["10.0.2.107"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.107"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.118"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.118"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.103"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.103"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.102"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.102"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.101"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.101"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.111"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.111"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.105"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.105"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.104"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.104"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.119"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.119"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.112"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.112"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.110"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.110"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.108"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.108"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.109"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.109"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.113"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.113"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.106"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.106"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.115"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.115"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.120"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.120"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.116"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.116"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.114"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.114"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.117"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.117"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
*** defaultIntf: warning: r1 has no interfaces
2020-03-12 03:26:05,978 ERROR: '_bgp_converge' failed after 19.30 seconds
2020-03-12 03:26:05,980 ERROR: assert failed at "test_bgp_aggregate-address_origin/test_bgp_aggregate_address_origin": Failed to see bgp convergence in "TopoGear<name="r2",links=["r2-eth0"<->"s1-eth1"]> TopoRouter<>"
assert json["192.168.255.1"]["bgpState"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["192.168.255.1"]["addressFamilyInfo"]["ipv4Unicast"]["acceptedPrefixCounter"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -3
  +0)
2020-03-12 03:26:30,682 ERROR: '_bgp_converge' failed after 19.38 seconds
2020-03-12 03:26:30,684 ERROR: assert failed at "test_bgp_aggregate-address_route-map/test_bgp_maximum_prefix_invalid": Failed to see bgp convergence in "TopoGear<name="r2",links=["r2-eth0"<->"s1-eth1"]> TopoRouter<>"
assert json["192.168.255.1"]["bgpState"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["192.168.255.1"]["addressFamilyInfo"]["ipv4Unicast"]["acceptedPrefixCounter"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -3
  +0)

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-11094/artifact/TOPOU1804/ErrorLog/log_topotests.txt

IPv6 protocols on Ubuntu 14.04: Failed (click for details)

Addresssanitizer topotest: Incomplete

(check logs for details)

Topology tests on Ubuntu 16.04 amd64: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOU1604-11094/test

Topology Tests failed for Topology tests on Ubuntu 16.04 amd64:

Failed check for StdErr Output on daemons:
r1 OSPF6d StdErr Output:
% Configuration failed: validation error.

Please check the logs for more details.
r1 ISISd StdErr Output:

% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.r%s Zebra StdErr Output:
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.

Known issue - IGNORING. See https://github.com/FRRouting/frr/issues/349
r1 failed IP Routing table check:
--- Actual IP Routing Table
+++ Expected IP RoutingTable
@@ -1,9 +1,23 @@
+C>* 192.168.0.0/24 is directly connected, r1-eth0, XX:XX:XX
+C>* 192.168.1.0/26 is directly connected, r1-eth1, XX:XX:XX
+C>* 192.168.2.0/26 is directly connected, r1-eth2, XX:XX:XX
+C>* 192.168.3.0/26 is directly connected, r1-eth3, XX:XX:XX
+C>* 192.168.4.0/26 is directly connected, r1-eth4, XX:XX:XX
+C>* 192.168.5.0/26 is directly connected, r1-eth5, XX:XX:XX
+C>* 192.168.6.0/26 is directly connected, r1-eth6, XX:XX:XX
+C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX
+C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX
+C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX
+O   192.168.0.0/24 [110/10] is directly connected, r1-eth0, XX:XX:XX
+O   192.168.3.0/26 [110/10] is directly connected, r1-eth3, XX:XX:XX
 S>* 1.1.1.1/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
 S>* 1.1.1.2/32 [1/0] is directly connected, r1-eth1, XX:XX:XX
-S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0 onlink, XX:XX:XX
+S>* 4.5.6.10/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
+S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
 S>* 4.5.6.12/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
 S>* 4.5.6.13/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.14/32 [1/0] unreachable (blackhole), XX:XX:XX
+S   4.5.6.15/32 [255/0] via 192.168.0.2, r1-eth0, XX:XX:XX
 S>* 4.5.6.7/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.8/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.9/32 [1/0] unreachable (ICMP unreachable), XX:XX:XX
2020-03-12 04:19:51,678 ERROR: assert failed at "test_all_protocol_startup/test_converge_protocols": IP Routing table failed for r1
  --- Actual IP Routing Table
  +++ Expected IP RoutingTable
  @@ -1,9 +1,23 @@
  +C>* 192.168.0.0/24 is directly connected, r1-eth0, XX:XX:XX
  +C>* 192.168.1.0/26 is directly connected, r1-eth1, XX:XX:XX
  +C>* 192.168.2.0/26 is directly connected, r1-eth2, XX:XX:XX
  +C>* 192.168.3.0/26 is directly connected, r1-eth3, XX:XX:XX
  +C>* 192.168.4.0/26 is directly connected, r1-eth4, XX:XX:XX
  +C>* 192.168.5.0/26 is directly connected, r1-eth5, XX:XX:XX
  +C>* 192.168.6.0/26 is directly connected, r1-eth6, XX:XX:XX
  +C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX
  +C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX
  +C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX
  +O   192.168.0.0/24 [110/10] is directly connected, r1-eth0, XX:XX:XX
  +O   192.168.3.0/26 [110/10] is directly connected, r1-eth3, XX:XX:XX
   S>* 1.1.1.1/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
   S>* 1.1.1.2/32 [1/0] is directly connected, r1-eth1, XX:XX:XX
  -S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0 onlink, XX:XX:XX
  +S>* 4.5.6.10/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
  +S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
   S>* 4.5.6.12/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
   S>* 4.5.6.13/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.14/32 [1/0] unreachable (blackhole), XX:XX:XX
  +S   4.5.6.15/32 [255/0] via 192.168.0.2, r1-eth0, XX:XX:XX
   S>* 4.5.6.7/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.8/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.9/32 [1/0] unreachable (ICMP unreachable), XX:XX:XX
assert 1 == 0
  -1
  +0
r1 failed IP RIP status check:
--- actual IP RIP status
+++ expected IP RIP status
@@ -7,6 +7,7 @@
   Redistributing:
   Default version control: send version 2, receive version 2 
     Interface        Send  Recv   Key-chain
+    r1-eth1          2     2      
   Routing for Networks:
     192.168.1.0/26
   Routing Information Sources:
2020-03-12 04:19:52,347 ERROR: assert failed at "test_all_protocol_startup/test_rip_status": IP RIP status failed for router r1:
  --- actual IP RIP status
  +++ expected IP RIP status
  @@ -7,6 +7,7 @@
     Redistributing:
     Default version control: send version 2, receive version 2 
       Interface        Send  Recv   Key-chain
  +    r1-eth1          2     2      
     Routing for Networks:
       192.168.1.0/26
     Routing Information Sources:
assert 1 == 0
  -1
  +0
r1 failed IPv6 RIPng status check:
--- actual IPv6 RIPng status
+++ expected IPv6 RIPng status
@@ -7,6 +7,7 @@
   Redistributing:
   Default version control: send version 1, receive version 1 
     Interface        Send  Recv
+    r1-eth2          1     1  
   Routing for Networks:
     fc00:0:0:2::/64
   Routing Information Sources:
2020-03-12 04:19:52,494 ERROR: assert failed at "test_all_protocol_startup/test_ripng_status": IPv6 RIPng status failed for router r1:
  --- actual IPv6 RIPng status
  +++ expected IPv6 RIPng status
  @@ -7,6 +7,7 @@
     Redistributing:
     Default version control: send version 1, receive version 1 
       Interface        Send  Recv
  +    r1-eth2          1     1  
     Routing for Networks:
       fc00:0:0:2::/64
     Routing Information Sources:
assert 1 == 0
  -1
  +0
r1 failed SHOW IP OSPF INTERFACE check:
--- actual SHOW IP OSPF INTERFACE
+++ expected SHOW IP OSPF INTERFACE
@@ -1 +1,22 @@
-
+r1-eth0 is up
+  ifindex X, MTU 1500 bytes, BW XX Mbit <UP,BROADCAST,RUNNING,MULTICAST>
+  Internet Address 192.168.0.1/24, Broadcast 192.168.0.255, Area 0.0.0.0
+  MTU mismatch detection: enabled
+  Router ID 192.168.0.1, Network Type BROADCAST, Cost: 10
+  Transmit Delay is 1 sec, State DR, Priority 1
+  No backup designated router on this network
+  Multicast group memberships: OSPFAllRouters OSPFDesignatedRouters
+  Timer intervals configured, Hello 10s, Dead 40s, Wait 40s, Retransmit 5
+    Hello due in XX.XXXs
+  Neighbor Count is 0, Adjacent neighbor count is 0
+r1-eth3 is up
+  ifindex X, MTU 1500 bytes, BW XX Mbit <UP,BROADCAST,RUNNING,MULTICAST>
+  Internet Address 192.168.3.1/26, Broadcast 192.168.3.63, Area 0.0.0.0
+  MTU mismatch detection: enabled
+  Router ID 192.168.0.1, Network Type BROADCAST, Cost: 10
+  Transmit Delay is 1 sec, State DR, Priority 1
+  No backup designated router on this network
+  Multicast group memberships: OSPFAllRouters OSPFDesignatedRouters
+  Timer intervals configured, Hello 10s, Dead 40s, Wait 40s, Retransmit 5
+    Hello due in XX.XXXs
+  Neighbor Count is 0, Adjacent neighbor count is 0
Known issue - IGNORING. See https://github.com/FRRouting/frr/issues/348
r1 failed SHOW ISIS INTERFACE DETAIL check:
--- actual SHOW ISIS INTERFACE DETAIL
+++ expected SHOW ISIS OSPF6 INTERFACE DETAIL
@@ -1 +1,28 @@
 Area test:
+  Interface: r1-eth5, State: Up, Active, Circuit Id: 0xXX
+    Type: lan, Level: L1, SNPA: XXXX.XXXX.XXXX
+    Level-1 Information:
+      Metric: 10, Active neighbors: 0
+      Hello interval: 3, Holddown count: 10 (pad)
+      CNSP interval: 10, PSNP interval: 2
+      LAN Priority: 64, is not DIS
+    IP Prefix(es):
+      192.168.5.1/26
+    IPv6 Link-Locals:
+      fe80::XXXX:XXXX:XXXX:XXXX/64
+    IPv6 Prefixes:
+      fc00:0:0:5::1/64
+
+  Interface: r1-eth6, State: Up, Active, Circuit Id: 0xXX
+    Type: lan, Level: L2, SNPA: XXXX.XXXX.XXXX
+    Level-2 Information:
+      Metric: 10, Active neighbors: 0
+      Hello interval: 3, Holddown count: 10 (pad)
+      CNSP interval: 10, PSNP interval: 2
+      LAN Priority: 64, is not DIS
+    IP Prefix(es):
+      192.168.6.1/26
+    IPv6 Link-Locals:
+      fe80::XXXX:XXXX:XXXX:XXXX/64
+    IPv6 Prefixes:
+      fc00:0:0:6::1/64
2020-03-12 04:19:52,767 ERROR: assert failed at "test_all_protocol_startup/test_isis_interfaces": SHOW ISIS INTERFACE DETAIL failed for router r1:
  --- actual SHOW ISIS INTERFACE DETAIL
  +++ expected SHOW ISIS OSPF6 INTERFACE DETAIL
  @@ -1 +1,28 @@
   Area test:
  +  Interface: r1-eth5, State: Up, Active, Circuit Id: 0xXX
  +    Type: lan, Level: L1, SNPA: XXXX.XXXX.XXXX
  +    Level-1 Information:
  +      Metric: 10, Active neighbors: 0
  +      Hello interval: 3, Holddown count: 10 (pad)
  +      CNSP interval: 10, PSNP interval: 2
  +      LAN Priority: 64, is not DIS
  +    IP Prefix(es):
  +      192.168.5.1/26
  +    IPv6 Link-Locals:
  +      fe80::XXXX:XXXX:XXXX:XXXX/64
  +    IPv6 Prefixes:
  +      fc00:0:0:5::1/64
  +
  +  Interface: r1-eth6, State: Up, Active, Circuit Id: 0xXX
  +    Type: lan, Level: L2, SNPA: XXXX.XXXX.XXXX
  +    Level-2 Information:
  +      Metric: 10, Active neighbors: 0
  +      Hello interval: 3, Holddown count: 10 (pad)
  +      CNSP interval: 10, PSNP interval: 2
  +      LAN Priority: 64, is not DIS
  +    IP Prefix(es):
  +      192.168.6.1/26
  +    IPv6 Link-Locals:
  +      fe80::XXXX:XXXX:XXXX:XXXX/64
  +    IPv6 Prefixes:
  +      fc00:0:0:6::1/64
assert 1 == 0
  -1
  +0
r1 failed MPLS LDP Interface status Check:
--- actual MPLS LDP interface status
+++ expected MPLS LDP interface status
@@ -1,3 +1,3 @@
 AF   Interface   State  Uptime   Hello Timers  ac
-ipv4 r1-eth9     DOWN   xx:xx:xx 5/15           0
+ipv4 r1-eth9     ACTIVE xx:xx:xx 5/15           0
 ipv6 r1-eth9     ACTIVE xx:xx:xx 5/15           0
2020-03-12 04:19:54,458 ERROR: assert failed at "test_all_protocol_startup/test_mpls_interfaces": MPLS LDP Interface status failed for router r1:
  --- actual MPLS LDP interface status
  +++ expected MPLS LDP interface status
  @@ -1,3 +1,3 @@
   AF   Interface   State  Uptime   Hello Timers  ac
  -ipv4 r1-eth9     DOWN   xx:xx:xx 5/15           0
  +ipv4 r1-eth9     ACTIVE xx:xx:xx 5/15           0
   ipv6 r1-eth9     ACTIVE xx:xx:xx 5/15           0
assert 1 == 0
  -1
  +0
2020-03-12 04:20:29,167 ERROR: 'router_json_cmp' failed after 25.08 seconds
2020-03-12 04:20:29,169 ERROR: assert failed at "test_bfd_bgp_cbit_topo3/test_protocols_convergence": "r1" JSON output mismatches
assert expected key(s) [u'2001:db8:4::/64', u'2001:db8:6::/64', u'2001:db8:7::/64', u'2001:db8:1::/64'] in json (have [u'fe80::/64']):
  --- Expected value
  +++ Current value
  @@ -2 +2 @@
  -    "2001:db8:1::/64": [
  +    "fe80::/64": [
  @@ -4 +3,0 @@
  -            "destSelected": true, 
  @@ -5,0 +5,5 @@
  +            "installed": true, 
  +            "internalFlags": 0, 
  +            "internalNextHopActiveNum": 1, 
  +            "internalNextHopNum": 1, 
  +            "internalStatus": 16, 
  @@ -12,0 +17 @@
  +                    "interfaceIndex": 2, 
  @@ -16 +21 @@
  -            "prefix": "2001:db8:1::/64", 
  +            "prefix": "fe80::/64", 
  @@ -18,4 +23,3 @@
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:4::/64": [
  +            "table": 254, 
  +            "uptime": "00:00:27"
  +        }, 
  @@ -24 +28,6 @@
  -            "distance": 1, 
  +            "distance": 0, 
  +            "installed": true, 
  +            "internalFlags": 8, 
  +            "internalNextHopActiveNum": 1, 
  +            "internalNextHopNum": 1, 
  +            "internalStatus": 16, 
  @@ -29 +38 @@
  -                    "afi": "ipv6", 
  +                    "directlyConnected": true, 
  @@ -32 +41,2 @@
  -                    "interfaceName": "r1-eth0"
  +                    "interfaceIndex": 1, 
  +                    "interfaceName": "lo"
  @@ -35,51 +45,5 @@
  -            "prefix": "2001:db8:4::/64", 
  -            "protocol": "static", 
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:6::/64": [
  -        {
  -            "destSelected": true, 
  -            "distance": 20, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "afi": "ipv6", 
  -                    "ip": "2001:db8:4::1", 
  -                    "recursive": true
  -                }, 
  -                {
  -                    "afi": "ipv6", 
  -                    "fib": true, 
  -                    "interfaceName": "r1-eth0", 
  -                    "ip": "2001:db8:1::2"
  -                }
  -            ], 
  -            "prefix": "2001:db8:6::/64", 
  -            "protocol": "bgp", 
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:7::/64": [
  -        {
  -            "destSelected": true, 
  -            "distance": 20, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "afi": "ipv6", 
  -                    "ip": "2001:db8:4::1", 
  -                    "recursive": true
  -                }, 
  -                {
  -                    "afi": "ipv6", 
  -                    "fib": true, 
  -                    "interfaceName": "r1-eth0", 
  -                    "ip": "2001:db8:1::2"
  -                }
  -            ], 
  -            "prefix": "2001:db8:7::/64", 
  -            "protocol": "bgp", 
  -            "selected": true
  +            "prefix": "fe80::/64", 
  +            "protocol": "connected", 
  +            "selected": true, 
  +            "table": 254, 
  +            "uptime": "00:00:29"
2020-03-12 04:20:34,368 ERROR: 'router_json_cmp' failed after 5.07 seconds
2020-03-12 04:20:34,369 ERROR: assert failed at "test_bfd_bgp_cbit_topo3/test_bfd_comes_back_again": "r1" JSON output mismatches
assert json too few items (have 0, expected 1:
   --- Expected value
  +++ Current value
  @@ -1,16 +1 @@
  -[
  -    {
  -        "diagnostic": "ok", 
  -        "echo-interval": 0, 
  -        "local": "2001:db8:1::1", 
  -        "multihop": true, 
  -        "peer": "2001:db8:4::1", 
  -        "receive-interval": 300, 
  -        "remote-diagnostic": "ok", 
  -        "remote-echo-interval": 50, 
  -        "remote-receive-interval": 300, 
  -        "remote-transmit-interval": 300, 
  -        "status": "up", 
  -        "transmit-interval": 300
  -    }
  -]
  +[])
2020-03-12 04:20:48,365 ERROR: 'router_json_cmp' failed after 4.95 seconds
2020-03-12 04:20:48,366 ERROR: assert failed at "test_bfd_topo1/test_bfd_connection": "r4" JSON output mismatches
assert json value is different (
  --- Expected value
  +++ Current value
  @@ -2,0 +3,6 @@
  +        "detect-multiplier": 3, 
  +        "diagnostic": "ok", 
  +        "downtime": 10, 
  +        "echo-interval": 0, 
  +        "id": 423642906, 
  +        "multihop": false, 
  @@ -4 +10,10 @@
  -        "status": "up"
  +        "receive-interval": 2000, 
  +        "remote-detect-multiplier": 3, 
  +        "remote-diagnostic": "ok", 
  +        "remote-echo-interval": 0, 
  +        "remote-id": 0, 
  +        "remote-receive-interval": 1000, 
  +        "remote-transmit-interval": 1000, 
  +        "status": "down", 
  +        "transmit-interval": 2000, 
  +        "vrf": "default")
2020-03-12 04:22:38,979 ERROR: 'router_json_cmp' failed after 100.00 seconds
2020-03-12 04:22:38,981 ERROR: assert failed at "test_bfd_topo2/test_protocols_convergence": "r4" JSON output mismatches
assert expected key(s) [u'10.254.254.4/32'] in json (have []):
  --- Expected value
  +++ Current value
  @@ -1,24 +1 @@
  -{
  -    "10.254.254.4/32": [
  -        {
  -            "distance": 0, 
  -            "installed": true, 
  -            "internalFlags": 8, 
  -            "internalStatus": 16, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "directlyConnected": true, 
  -                    "fib": true, 
  -                    "flags": 3, 
  -                    "interfaceIndex": 1, 
  -                    "interfaceName": "lo"
  -                }
  -            ], 
  -            "prefix": "10.254.254.4/32", 
  -            "protocol": "connected", 
  -            "selected": true
  -        }
  -    ]
  -}
  +{}
2020-03-12 04:22:53,405 ERROR: 'router_json_cmp' failed after 4.97 seconds
2020-03-12 04:22:53,407 ERROR: assert failed at "test_bfd_vrf_topo1/test_bfd_connection": "r4" JSON output mismatches
assert json value is different (
  --- Expected value
  +++ Current value
  @@ -2,0 +3,6 @@
  +        "detect-multiplier": 3, 
  +        "diagnostic": "ok", 
  +        "downtime": 10, 
  +        "echo-interval": 0, 
  +        "id": 3268838170, 
  +        "multihop": false, 
  @@ -4 +10,10 @@
  -        "status": "up"
  +        "receive-interval": 2000, 
  +        "remote-detect-multiplier": 3, 
  +        "remote-diagnostic": "ok", 
  +        "remote-echo-interval": 0, 
  +        "remote-id": 0, 
  +        "remote-receive-interval": 1000, 
  +        "remote-transmit-interval": 1000, 
  +        "status": "down", 
  +        "transmit-interval": 2000, 
  +        "vrf": "r4-cust1")
2020-03-12 04:23:56,712 ERROR: '_output_summary_cmp' failed after 37.70 seconds
2020-03-12 04:23:56,715 ERROR: assert failed at "test_bgp_ecmp_topo1/test_bgp_convergence": BGP router network did not converge
assert json["ipv4Unicast"]["peers"]["10.0.2.107"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.107"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.118"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.118"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.103"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.103"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.102"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.102"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.101"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.101"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.111"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.111"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.105"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.105"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.104"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.104"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.119"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.119"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.112"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.112"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.110"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.110"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.108"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.108"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.109"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.109"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.113"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.113"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.106"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.106"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.115"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.115"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.120"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.120"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.116"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.116"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.114"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.114"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.117"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.117"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
*** defaultIntf: warning: r1 has no interfaces
2020-03-12 04:25:23,047 ERROR: '_bgp_converge' failed after 19.01 seconds
2020-03-12 04:25:23,048 ERROR: assert failed at "test_bgp_aggregate-address_origin/test_bgp_aggregate_address_origin": Failed to see bgp convergence in "TopoGear<name="r2",links=["r2-eth0"<->"s1-eth1"]> TopoRouter<>"
assert json["192.168.255.1"]["bgpState"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["192.168.255.1"]["addressFamilyInfo"]["ipv4Unicast"]["acceptedPrefixCounter"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -3
  +0)
2020-03-12 04:25:47,374 ERROR: '_bgp_converge' failed after 19.08 seconds
2020-03-12 04:25:47,376 ERROR: assert failed at "test_bgp_aggregate-address_route-map/test_bgp_maximum_prefix_invalid": Failed to see bgp convergence in "TopoGear<name="r2",links=["r2-eth0"<->"s1-eth1"]> TopoRouter<>"
assert json["192.168.255.1"]["bgpState"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["192.168.255.1"]["addressFamilyInfo"]["ipv4Unicast"]["acceptedPrefixCounter"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -3
  +0)

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-11094/artifact/TOPOU1604/ErrorLog/log_topotests.txt

IPv4 protocols on Ubuntu 14.04: Failed (click for details)

IPv4 ldp protocol on Ubuntu 16.04: Failed (click for details)

Topotest tests on Ubuntu 16.04 i386: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOI386-11094/test

Topology Tests failed for Topotest tests on Ubuntu 16.04 i386:

Failed check for StdErr Output on daemons:
r1 OSPF6d StdErr Output:
% Configuration failed: validation error.

Please check the logs for more details.
r1 ISISd StdErr Output:

% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.r%s Zebra StdErr Output:
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.
% Configuration failed: validation error.

Please check the logs for more details.

Known issue - IGNORING. See https://github.com/FRRouting/frr/issues/349
r1 failed IP Routing table check:
--- Actual IP Routing Table
+++ Expected IP RoutingTable
@@ -1,9 +1,23 @@
+C>* 192.168.0.0/24 is directly connected, r1-eth0, XX:XX:XX
+C>* 192.168.1.0/26 is directly connected, r1-eth1, XX:XX:XX
+C>* 192.168.2.0/26 is directly connected, r1-eth2, XX:XX:XX
+C>* 192.168.3.0/26 is directly connected, r1-eth3, XX:XX:XX
+C>* 192.168.4.0/26 is directly connected, r1-eth4, XX:XX:XX
+C>* 192.168.5.0/26 is directly connected, r1-eth5, XX:XX:XX
+C>* 192.168.6.0/26 is directly connected, r1-eth6, XX:XX:XX
+C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX
+C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX
+C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX
+O   192.168.0.0/24 [110/10] is directly connected, r1-eth0, XX:XX:XX
+O   192.168.3.0/26 [110/10] is directly connected, r1-eth3, XX:XX:XX
 S>* 1.1.1.1/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
 S>* 1.1.1.2/32 [1/0] is directly connected, r1-eth1, XX:XX:XX
-S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0 onlink, XX:XX:XX
+S>* 4.5.6.10/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
+S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
 S>* 4.5.6.12/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
 S>* 4.5.6.13/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.14/32 [1/0] unreachable (blackhole), XX:XX:XX
+S   4.5.6.15/32 [255/0] via 192.168.0.2, r1-eth0, XX:XX:XX
 S>* 4.5.6.7/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.8/32 [1/0] unreachable (blackhole), XX:XX:XX
 S>* 4.5.6.9/32 [1/0] unreachable (ICMP unreachable), XX:XX:XX
2020-03-11 20:19:57,257 ERROR: assert failed at "test_all_protocol_startup/test_converge_protocols": IP Routing table failed for r1
  --- Actual IP Routing Table
  +++ Expected IP RoutingTable
  @@ -1,9 +1,23 @@
  +C>* 192.168.0.0/24 is directly connected, r1-eth0, XX:XX:XX
  +C>* 192.168.1.0/26 is directly connected, r1-eth1, XX:XX:XX
  +C>* 192.168.2.0/26 is directly connected, r1-eth2, XX:XX:XX
  +C>* 192.168.3.0/26 is directly connected, r1-eth3, XX:XX:XX
  +C>* 192.168.4.0/26 is directly connected, r1-eth4, XX:XX:XX
  +C>* 192.168.5.0/26 is directly connected, r1-eth5, XX:XX:XX
  +C>* 192.168.6.0/26 is directly connected, r1-eth6, XX:XX:XX
  +C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX
  +C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX
  +C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX
  +O   192.168.0.0/24 [110/10] is directly connected, r1-eth0, XX:XX:XX
  +O   192.168.3.0/26 [110/10] is directly connected, r1-eth3, XX:XX:XX
   S>* 1.1.1.1/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
   S>* 1.1.1.2/32 [1/0] is directly connected, r1-eth1, XX:XX:XX
  -S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0 onlink, XX:XX:XX
  +S>* 4.5.6.10/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
  +S>* 4.5.6.11/32 [1/0] via 192.168.0.2, r1-eth0, XX:XX:XX
   S>* 4.5.6.12/32 [1/0] is directly connected, r1-eth0, XX:XX:XX
   S>* 4.5.6.13/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.14/32 [1/0] unreachable (blackhole), XX:XX:XX
  +S   4.5.6.15/32 [255/0] via 192.168.0.2, r1-eth0, XX:XX:XX
   S>* 4.5.6.7/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.8/32 [1/0] unreachable (blackhole), XX:XX:XX
   S>* 4.5.6.9/32 [1/0] unreachable (ICMP unreachable), XX:XX:XX
assert 1 == 0
  -1
  +0
r1 failed IP RIP status check:
--- actual IP RIP status
+++ expected IP RIP status
@@ -7,6 +7,7 @@
   Redistributing:
   Default version control: send version 2, receive version 2 
     Interface        Send  Recv   Key-chain
+    r1-eth1          2     2      
   Routing for Networks:
     192.168.1.0/26
   Routing Information Sources:
2020-03-11 20:19:58,103 ERROR: assert failed at "test_all_protocol_startup/test_rip_status": IP RIP status failed for router r1:
  --- actual IP RIP status
  +++ expected IP RIP status
  @@ -7,6 +7,7 @@
     Redistributing:
     Default version control: send version 2, receive version 2 
       Interface        Send  Recv   Key-chain
  +    r1-eth1          2     2      
     Routing for Networks:
       192.168.1.0/26
     Routing Information Sources:
assert 1 == 0
  -1
  +0
r1 failed IPv6 RIPng status check:
--- actual IPv6 RIPng status
+++ expected IPv6 RIPng status
@@ -7,6 +7,7 @@
   Redistributing:
   Default version control: send version 1, receive version 1 
     Interface        Send  Recv
+    r1-eth2          1     1  
   Routing for Networks:
     fc00:0:0:2::/64
   Routing Information Sources:
2020-03-11 20:19:58,282 ERROR: assert failed at "test_all_protocol_startup/test_ripng_status": IPv6 RIPng status failed for router r1:
  --- actual IPv6 RIPng status
  +++ expected IPv6 RIPng status
  @@ -7,6 +7,7 @@
     Redistributing:
     Default version control: send version 1, receive version 1 
       Interface        Send  Recv
  +    r1-eth2          1     1  
     Routing for Networks:
       fc00:0:0:2::/64
     Routing Information Sources:
assert 1 == 0
  -1
  +0
r1 failed SHOW IP OSPF INTERFACE check:
--- actual SHOW IP OSPF INTERFACE
+++ expected SHOW IP OSPF INTERFACE
@@ -1 +1,22 @@
-
+r1-eth0 is up
+  ifindex X, MTU 1500 bytes, BW XX Mbit <UP,BROADCAST,RUNNING,MULTICAST>
+  Internet Address 192.168.0.1/24, Broadcast 192.168.0.255, Area 0.0.0.0
+  MTU mismatch detection: enabled
+  Router ID 192.168.0.1, Network Type BROADCAST, Cost: 10
+  Transmit Delay is 1 sec, State DR, Priority 1
+  No backup designated router on this network
+  Multicast group memberships: OSPFAllRouters OSPFDesignatedRouters
+  Timer intervals configured, Hello 10s, Dead 40s, Wait 40s, Retransmit 5
+    Hello due in XX.XXXs
+  Neighbor Count is 0, Adjacent neighbor count is 0
+r1-eth3 is up
+  ifindex X, MTU 1500 bytes, BW XX Mbit <UP,BROADCAST,RUNNING,MULTICAST>
+  Internet Address 192.168.3.1/26, Broadcast 192.168.3.63, Area 0.0.0.0
+  MTU mismatch detection: enabled
+  Router ID 192.168.0.1, Network Type BROADCAST, Cost: 10
+  Transmit Delay is 1 sec, State DR, Priority 1
+  No backup designated router on this network
+  Multicast group memberships: OSPFAllRouters OSPFDesignatedRouters
+  Timer intervals configured, Hello 10s, Dead 40s, Wait 40s, Retransmit 5
+    Hello due in XX.XXXs
+  Neighbor Count is 0, Adjacent neighbor count is 0
Known issue - IGNORING. See https://github.com/FRRouting/frr/issues/348
r1 failed SHOW ISIS INTERFACE DETAIL check:
--- actual SHOW ISIS INTERFACE DETAIL
+++ expected SHOW ISIS OSPF6 INTERFACE DETAIL
@@ -1 +1,28 @@
 Area test:
+  Interface: r1-eth5, State: Up, Active, Circuit Id: 0xXX
+    Type: lan, Level: L1, SNPA: XXXX.XXXX.XXXX
+    Level-1 Information:
+      Metric: 10, Active neighbors: 0
+      Hello interval: 3, Holddown count: 10 (pad)
+      CNSP interval: 10, PSNP interval: 2
+      LAN Priority: 64, is not DIS
+    IP Prefix(es):
+      192.168.5.1/26
+    IPv6 Link-Locals:
+      fe80::XXXX:XXXX:XXXX:XXXX/64
+    IPv6 Prefixes:
+      fc00:0:0:5::1/64
+
+  Interface: r1-eth6, State: Up, Active, Circuit Id: 0xXX
+    Type: lan, Level: L2, SNPA: XXXX.XXXX.XXXX
+    Level-2 Information:
+      Metric: 10, Active neighbors: 0
+      Hello interval: 3, Holddown count: 10 (pad)
+      CNSP interval: 10, PSNP interval: 2
+      LAN Priority: 64, is not DIS
+    IP Prefix(es):
+      192.168.6.1/26
+    IPv6 Link-Locals:
+      fe80::XXXX:XXXX:XXXX:XXXX/64
+    IPv6 Prefixes:
+      fc00:0:0:6::1/64
2020-03-11 20:19:58,623 ERROR: assert failed at "test_all_protocol_startup/test_isis_interfaces": SHOW ISIS INTERFACE DETAIL failed for router r1:
  --- actual SHOW ISIS INTERFACE DETAIL
  +++ expected SHOW ISIS OSPF6 INTERFACE DETAIL
  @@ -1 +1,28 @@
   Area test:
  +  Interface: r1-eth5, State: Up, Active, Circuit Id: 0xXX
  +    Type: lan, Level: L1, SNPA: XXXX.XXXX.XXXX
  +    Level-1 Information:
  +      Metric: 10, Active neighbors: 0
  +      Hello interval: 3, Holddown count: 10 (pad)
  +      CNSP interval: 10, PSNP interval: 2
  +      LAN Priority: 64, is not DIS
  +    IP Prefix(es):
  +      192.168.5.1/26
  +    IPv6 Link-Locals:
  +      fe80::XXXX:XXXX:XXXX:XXXX/64
  +    IPv6 Prefixes:
  +      fc00:0:0:5::1/64
  +
  +  Interface: r1-eth6, State: Up, Active, Circuit Id: 0xXX
  +    Type: lan, Level: L2, SNPA: XXXX.XXXX.XXXX
  +    Level-2 Information:
  +      Metric: 10, Active neighbors: 0
  +      Hello interval: 3, Holddown count: 10 (pad)
  +      CNSP interval: 10, PSNP interval: 2
  +      LAN Priority: 64, is not DIS
  +    IP Prefix(es):
  +      192.168.6.1/26
  +    IPv6 Link-Locals:
  +      fe80::XXXX:XXXX:XXXX:XXXX/64
  +    IPv6 Prefixes:
  +      fc00:0:0:6::1/64
assert 1 == 0
  -1
  +0
r1 failed MPLS LDP Interface status Check:
--- actual MPLS LDP interface status
+++ expected MPLS LDP interface status
@@ -1,3 +1,3 @@
 AF   Interface   State  Uptime   Hello Timers  ac
-ipv4 r1-eth9     DOWN   xx:xx:xx 5/15           0
+ipv4 r1-eth9     ACTIVE xx:xx:xx 5/15           0
 ipv6 r1-eth9     ACTIVE xx:xx:xx 5/15           0
2020-03-11 20:20:00,541 ERROR: assert failed at "test_all_protocol_startup/test_mpls_interfaces": MPLS LDP Interface status failed for router r1:
  --- actual MPLS LDP interface status
  +++ expected MPLS LDP interface status
  @@ -1,3 +1,3 @@
   AF   Interface   State  Uptime   Hello Timers  ac
  -ipv4 r1-eth9     DOWN   xx:xx:xx 5/15           0
  +ipv4 r1-eth9     ACTIVE xx:xx:xx 5/15           0
   ipv6 r1-eth9     ACTIVE xx:xx:xx 5/15           0
assert 1 == 0
  -1
  +0
2020-03-11 20:20:37,763 ERROR: 'router_json_cmp' failed after 26.73 seconds
2020-03-11 20:20:37,768 ERROR: assert failed at "test_bfd_bgp_cbit_topo3/test_protocols_convergence": "r1" JSON output mismatches
assert expected key(s) [u'2001:db8:4::/64', u'2001:db8:6::/64', u'2001:db8:7::/64', u'2001:db8:1::/64'] in json (have [u'fe80::/64']):
  --- Expected value
  +++ Current value
  @@ -2 +2 @@
  -    "2001:db8:1::/64": [
  +    "fe80::/64": [
  @@ -4 +3,0 @@
  -            "destSelected": true, 
  @@ -5,0 +5,5 @@
  +            "installed": true, 
  +            "internalFlags": 0, 
  +            "internalNextHopActiveNum": 1, 
  +            "internalNextHopNum": 1, 
  +            "internalStatus": 16, 
  @@ -12,0 +17 @@
  +                    "interfaceIndex": 2, 
  @@ -16 +21 @@
  -            "prefix": "2001:db8:1::/64", 
  +            "prefix": "fe80::/64", 
  @@ -18,4 +23,3 @@
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:4::/64": [
  +            "table": 254, 
  +            "uptime": "00:00:30"
  +        }, 
  @@ -24 +28,6 @@
  -            "distance": 1, 
  +            "distance": 0, 
  +            "installed": true, 
  +            "internalFlags": 8, 
  +            "internalNextHopActiveNum": 1, 
  +            "internalNextHopNum": 1, 
  +            "internalStatus": 16, 
  @@ -29 +38 @@
  -                    "afi": "ipv6", 
  +                    "directlyConnected": true, 
  @@ -32 +41,2 @@
  -                    "interfaceName": "r1-eth0"
  +                    "interfaceIndex": 1, 
  +                    "interfaceName": "lo"
  @@ -35,51 +45,5 @@
  -            "prefix": "2001:db8:4::/64", 
  -            "protocol": "static", 
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:6::/64": [
  -        {
  -            "destSelected": true, 
  -            "distance": 20, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "afi": "ipv6", 
  -                    "ip": "2001:db8:4::1", 
  -                    "recursive": true
  -                }, 
  -                {
  -                    "afi": "ipv6", 
  -                    "fib": true, 
  -                    "interfaceName": "r1-eth0", 
  -                    "ip": "2001:db8:1::2"
  -                }
  -            ], 
  -            "prefix": "2001:db8:6::/64", 
  -            "protocol": "bgp", 
  -            "selected": true
  -        }
  -    ], 
  -    "2001:db8:7::/64": [
  -        {
  -            "destSelected": true, 
  -            "distance": 20, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "afi": "ipv6", 
  -                    "ip": "2001:db8:4::1", 
  -                    "recursive": true
  -                }, 
  -                {
  -                    "afi": "ipv6", 
  -                    "fib": true, 
  -                    "interfaceName": "r1-eth0", 
  -                    "ip": "2001:db8:1::2"
  -                }
  -            ], 
  -            "prefix": "2001:db8:7::/64", 
  -            "protocol": "bgp", 
  -            "selected": true
  +            "prefix": "fe80::/64", 
  +            "protocol": "connected", 
  +            "selected": true, 
  +            "table": 254, 
  +            "uptime": "00:00:31"
2020-03-11 20:20:43,187 ERROR: 'router_json_cmp' failed after 5.24 seconds
2020-03-11 20:20:43,190 ERROR: assert failed at "test_bfd_bgp_cbit_topo3/test_bfd_comes_back_again": "r1" JSON output mismatches
assert json too few items (have 0, expected 1:
   --- Expected value
  +++ Current value
  @@ -1,16 +1 @@
  -[
  -    {
  -        "diagnostic": "ok", 
  -        "echo-interval": 0, 
  -        "local": "2001:db8:1::1", 
  -        "multihop": true, 
  -        "peer": "2001:db8:4::1", 
  -        "receive-interval": 300, 
  -        "remote-diagnostic": "ok", 
  -        "remote-echo-interval": 50, 
  -        "remote-receive-interval": 300, 
  -        "remote-transmit-interval": 300, 
  -        "status": "up", 
  -        "transmit-interval": 300
  -    }
  -]
  +[])
2020-03-11 20:20:59,498 ERROR: 'router_json_cmp' failed after 5.30 seconds
2020-03-11 20:20:59,500 ERROR: assert failed at "test_bfd_topo1/test_bfd_connection": "r4" JSON output mismatches
assert json value is different (
  --- Expected value
  +++ Current value
  @@ -2,0 +3,6 @@
  +        "detect-multiplier": 3, 
  +        "diagnostic": "ok", 
  +        "downtime": 12, 
  +        "echo-interval": 0, 
  +        "id": 2408515198, 
  +        "multihop": false, 
  @@ -4 +10,10 @@
  -        "status": "up"
  +        "receive-interval": 2000, 
  +        "remote-detect-multiplier": 3, 
  +        "remote-diagnostic": "ok", 
  +        "remote-echo-interval": 0, 
  +        "remote-id": 0, 
  +        "remote-receive-interval": 1000, 
  +        "remote-transmit-interval": 1000, 
  +        "status": "down", 
  +        "transmit-interval": 2000, 
  +        "vrf": "default")
2020-03-11 20:22:58,722 ERROR: 'router_json_cmp' failed after 106.22 seconds
2020-03-11 20:22:58,727 ERROR: assert failed at "test_bfd_topo2/test_protocols_convergence": "r4" JSON output mismatches
assert expected key(s) [u'10.254.254.4/32'] in json (have []):
  --- Expected value
  +++ Current value
  @@ -1,24 +1 @@
  -{
  -    "10.254.254.4/32": [
  -        {
  -            "distance": 0, 
  -            "installed": true, 
  -            "internalFlags": 8, 
  -            "internalStatus": 16, 
  -            "metric": 0, 
  -            "nexthops": [
  -                {
  -                    "active": true, 
  -                    "directlyConnected": true, 
  -                    "fib": true, 
  -                    "flags": 3, 
  -                    "interfaceIndex": 1, 
  -                    "interfaceName": "lo"
  -                }
  -            ], 
  -            "prefix": "10.254.254.4/32", 
  -            "protocol": "connected", 
  -            "selected": true
  -        }
  -    ]
  -}
  +{}
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
2020-03-11 20:23:16,508 ERROR: 'router_json_cmp' failed after 5.35 seconds
2020-03-11 20:23:16,512 ERROR: assert failed at "test_bfd_vrf_topo1/test_bfd_connection": "r4" JSON output mismatches
assert json value is different (
  --- Expected value
  +++ Current value
  @@ -2,0 +3,6 @@
  +        "detect-multiplier": 3, 
  +        "diagnostic": "ok", 
  +        "downtime": 12, 
  +        "echo-interval": 0, 
  +        "id": 1749479622, 
  +        "multihop": false, 
  @@ -4 +10,10 @@
  -        "status": "up"
  +        "receive-interval": 2000, 
  +        "remote-detect-multiplier": 3, 
  +        "remote-diagnostic": "ok", 
  +        "remote-echo-interval": 0, 
  +        "remote-id": 0, 
  +        "remote-receive-interval": 1000, 
  +        "remote-transmit-interval": 1000, 
  +        "status": "down", 
  +        "transmit-interval": 2000, 
  +        "vrf": "r4-cust1")
2020-03-11 20:24:26,074 ERROR: '_output_summary_cmp' failed after 40.27 seconds
2020-03-11 20:24:26,080 ERROR: assert failed at "test_bgp_ecmp_topo1/test_bgp_convergence": BGP router network did not converge
assert json["ipv4Unicast"]["peers"]["10.0.2.107"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.107"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.118"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.118"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.103"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.103"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.102"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.102"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.101"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.101"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.111"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.111"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.105"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.105"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.1.104"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.1.104"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.119"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.119"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.112"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.112"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.110"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.110"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.108"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.108"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.109"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.109"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.113"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.113"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.2.106"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.2.106"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.115"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.115"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.120"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.120"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.116"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.116"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.3.114"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.3.114"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
  json["ipv4Unicast"]["peers"]["10.0.4.117"]["state"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["ipv4Unicast"]["peers"]["10.0.4.117"]["prefixReceivedCount"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -42
  +0)
*** defaultIntf: warning: r1 has no interfaces
2020-03-11 20:26:04,548 ERROR: '_bgp_converge' failed after 19.98 seconds
2020-03-11 20:26:04,557 ERROR: assert failed at "test_bgp_aggregate-address_origin/test_bgp_aggregate_address_origin": Failed to see bgp convergence in "TopoGear<name="r2",links=["r2-eth0"<->"s1-eth1"]> TopoRouter<>"
assert json["192.168.255.1"]["bgpState"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["192.168.255.1"]["addressFamilyInfo"]["ipv4Unicast"]["acceptedPrefixCounter"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -3
  +0)
2020-03-11 20:26:30,582 ERROR: '_bgp_converge' failed after 19.93 seconds
2020-03-11 20:26:30,586 ERROR: assert failed at "test_bgp_aggregate-address_route-map/test_bgp_maximum_prefix_invalid": Failed to see bgp convergence in "TopoGear<name="r2",links=["r2-eth0"<->"s1-eth1"]> TopoRouter<>"
assert json["192.168.255.1"]["bgpState"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -"Established"
  +"Active")
  json["192.168.255.1"]["addressFamilyInfo"]["ipv4Unicast"]["acceptedPrefixCounter"] value is different (
  --- Expected value
  +++ Current value
  @@ -1 +1 @@
  -3
  +0)

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-11094/artifact/TOPOI386/ErrorLog/log_topotests.txt

Successful on other platforms/tests

Debian 10 deb pkg check
Ubuntu 16.04 deb pkg check
Ubuntu 12.04 deb pkg check
Fedora 29 rpm pkg check
Debian 8 deb pkg check
Debian 9 deb pkg check
Ubuntu 14.04 deb pkg check
Static analyzer (clang)

chiragshah6 and others added 30 commits December 9, 2019 14:20

yang: add vrf model

0693b0d

module: frr-vrf +--rw lib +--rw vrf* [name] +--rw name string +--ro id? uint32 +--ro active? boolean <false> +--rw netns {netns}? +--rw name? string Signed-off-by: Chirag Shah <chirag@cumulusnetworks.com>

*: add frr-vrf yang module in makefile

e095f16

lib: Adding frr-vrf yang module to common place so it can be accessed from all frr modules. Signed-off-by: Chirag Shah <chirag@cumulusnetworks.com>

Merge pull request FRRouting#5501 from chiragshah6/yang_nb1

7d75ef8

yang: add vrf model

yang: add vrf model

cf93250

module: frr-vrf +--rw lib +--rw vrf* [name] +--rw name string +--ro id? uint32 +--ro active? boolean <false> +--rw netns {netns}? +--rw name? string Signed-off-by: Chirag Shah <chirag@cumulusnetworks.com>

*: add frr-vrf yang module in makefile

245daf0

lib: Adding frr-vrf yang module to common place so it can be accessed from all frr modules. Signed-off-by: Chirag Shah <chirag@cumulusnetworks.com>

Merge branch 'nb_conversions' of https://github.com/FRRouting/frr int…

2d2d0ee

…o nb_conversions

yang: add vrf ref to interface model

87ee53f

module: frr-interface +--rw lib +--rw interface* [name vrf] +--rw name string +--rw vrf frr-vrf:vrf-ref +--rw description? string Signed-off-by: Chirag Shah <chirag@cumulusnetworks.com>

Merge pull request FRRouting#5751 from chiragshah6/yang_nb1

5dd164b

yang: add vrf ref to interface model

staticd: yang defination

95f1804

Yang files for staticd to use northbound APIs Co-authored-by: Santosh P K <sapk@vmware.com> Co-authored-by: vishaldhingra <vdhingra@vmware.com> Signed-off-by: vishaldhingra <vdhingra@vmware.com>

lib: yang defination for basic frr-routing

f5319ff

Yang files for basic frr-routing used by other daemons like staticd and pim Co-authored-by: Santosh P K <sapk@vmware.com> Co-authored-by: vishaldhingra <vdhingra@vmware.com> Signed-off-by: vishaldhingra <vdhingra@vmware.com>

lib: FRR next-hop yang data model.

a530bfe

A common nexthop and group nexthop yang data model for all protocols in FRR. Co-authored-by: Santosh P K <sapk@vmware.com> Co-authored-by: Vishaldhingra <vdhingra@vmware.com> Signed-off-by: Santosh P K <sapk@vmware.com>

Merge pull request FRRouting#5578 from Spantik/working_nb

db727fe

lib: FRR next-hop yang data model.

Merge pull request FRRouting#5460 from vishaldhingra/static_nb

2a9ca11

staticd: yang definition

Merge pull request FRRouting#5530 from vishaldhingra/common_nb

aa9935c

lib: yang defination for basic routing frr-routing

yang: add vrf model

6514ce8

module: frr-vrf +--rw lib +--rw vrf* [name] +--rw name string +--ro id? uint32 +--ro active? boolean <false> +--rw netns {netns}? +--rw name? string Signed-off-by: Chirag Shah <chirag@cumulusnetworks.com>

*: add frr-vrf yang module in makefile

5b15a51

lib: Adding frr-vrf yang module to common place so it can be accessed from all frr modules. Signed-off-by: Chirag Shah <chirag@cumulusnetworks.com>

yang: add vrf ref to interface model

ee8ac97

module: frr-interface +--rw lib +--rw interface* [name vrf] +--rw name string +--rw vrf frr-vrf:vrf-ref +--rw description? string Signed-off-by: Chirag Shah <chirag@cumulusnetworks.com>

lib: FRR next-hop yang data model.

97928ec

A common nexthop and group nexthop yang data model for all protocols in FRR. Co-authored-by: Santosh P K <sapk@vmware.com> Co-authored-by: Vishaldhingra <vdhingra@vmware.com> Signed-off-by: Santosh P K <sapk@vmware.com>

staticd: yang defination

8f8cac6

Yang files for staticd to use northbound APIs Co-authored-by: Santosh P K <sapk@vmware.com> Co-authored-by: vishaldhingra <vdhingra@vmware.com> Signed-off-by: vishaldhingra <vdhingra@vmware.com>

lib: yang defination for basic frr-routing

2aa6fcc

Yang files for basic frr-routing used by other daemons like staticd and pim Co-authored-by: Santosh P K <sapk@vmware.com> Co-authored-by: vishaldhingra <vdhingra@vmware.com> Signed-off-by: vishaldhingra <vdhingra@vmware.com>

Merge branch 'nb_conversions' of https://github.com/FRRouting/frr int…

3e31357

…o nb_conversions

yang: add vrf model

c590694

module: frr-vrf +--rw lib +--rw vrf* [name] +--rw name string +--ro id? uint32 +--ro active? boolean <false> +--rw netns {netns}? +--rw name? string Signed-off-by: Chirag Shah <chirag@cumulusnetworks.com>

*: add frr-vrf yang module in makefile

2884b53

lib: Adding frr-vrf yang module to common place so it can be accessed from all frr modules. Signed-off-by: Chirag Shah <chirag@cumulusnetworks.com>

yang: add vrf ref to interface model

745d694

module: frr-interface +--rw lib +--rw interface* [name vrf] +--rw name string +--rw vrf frr-vrf:vrf-ref +--rw description? string Signed-off-by: Chirag Shah <chirag@cumulusnetworks.com>

lib: FRR next-hop yang data model.

1dc094d

A common nexthop and group nexthop yang data model for all protocols in FRR. Co-authored-by: Santosh P K <sapk@vmware.com> Co-authored-by: Vishaldhingra <vdhingra@vmware.com> Signed-off-by: Santosh P K <sapk@vmware.com>

staticd: yang defination

3cd3efe

Yang files for staticd to use northbound APIs Co-authored-by: Santosh P K <sapk@vmware.com> Co-authored-by: vishaldhingra <vdhingra@vmware.com> Signed-off-by: vishaldhingra <vdhingra@vmware.com>

lib: yang defination for basic frr-routing

30144e1

Yang files for basic frr-routing used by other daemons like staticd and pim Co-authored-by: Santosh P K <sapk@vmware.com> Co-authored-by: vishaldhingra <vdhingra@vmware.com> Signed-off-by: vishaldhingra <vdhingra@vmware.com>

Merge branch 'nb_conversions' of https://github.com/FRRouting/frr int…

84b5d31

…o nb_conversions

*: include vrf northbound module in init

096409c

Signed-off-by: Chirag Shah <chirag@cumulusnetworks.com>

lib: vrf northbound callbacks

4495296

Signed-off-by: Chirag Shah <chirag@cumulusnetworks.com>

polychaeta added libfrr staticd yang labels Mar 11, 2020

polychaeta reviewed Mar 11, 2020

View reviewed changes

chiragshah6 closed this Mar 12, 2020

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

*: vrf northbound callbacks #5987

*: vrf northbound callbacks #5987

chiragshah6 commented Mar 11, 2020

polychaeta left a comment

LabN-CI commented Mar 12, 2020

NetDEF-CI commented Mar 12, 2020

NetDEF-CI commented Mar 12, 2020

*: vrf northbound callbacks #5987

*: vrf northbound callbacks #5987

Conversation

chiragshah6 commented Mar 11, 2020

polychaeta left a comment

Choose a reason for hiding this comment

LabN-CI commented Mar 12, 2020

💚 Basic BGPD CI results: SUCCESS, 0 tests failed

NetDEF-CI commented Mar 12, 2020

Continuous Integration Result: FAILED

Get source / Pull Request: Successful

Building Stage: Successful

Basic Tests: Incomplete

NetDEF-CI commented Mar 12, 2020

Continuous Integration Result: FAILED

Get source / Pull Request: Successful

Building Stage: Successful

Basic Tests: Incomplete