FreeRangeRouting Github Pull Request Testing

Build: #6936 failed Custom build by Github Hook with revision master

Build result summary

Details

Completed
Duration
122 minutes
Flags
Custom revisionCustom build
Labels
version=frr-7_1-dev-511-g2d657fec1git=https_//github_com/frrouting/frr_gitbuildurl=https_//ci1_netdef_org/browse/frr-frrpullreq-6936branch=master
Revision
master master
Total tests
5697
Fixed in
#6937 (Custom build by Github Hook with revision master)

Custom variables

Custom revision
master master
Name Value
github_base_sha 50b9931b0aca6d5198761065306bfca625c50b12
github_pullreq 3945
github_branch master
github_repo FRRouting/frr
github_merge_sha 2d657fec105f777d5197e0e1a7db31ba366a833c

Comments

  1. Github Hook

    GitHub Merge Request 3945
    for GitHub Repo FRRouting/frr, branch master

    Request to merge from donaldsharp/frr
    Merge Git Commit ID 2d657fec105f777d5197e0e1a7db31ba366a833c on top of base Git Commit ID 50b9931b0aca6d5198761065306bfca625c50b12

Code commits

Author Commit Message Commit date
David Lamparter David Lamparter 50b9931b0aca6d5198761065306bfca625c50b12 50b9931b0aca6d5198761065306bfca625c50b12 Merge pull request #3936 from donaldsharp/ospf_1000_club
ospfd: When converting to ms divide by 1000

Tests

New test failures 111
Status Test View job Duration
Collapse Failed test_all_protocol_startup test_converge_protocols History
Topology Tests on Ubuntu 16.04 amd64 1 min
AssertionError: IP Routing table failed for r1   --- Actual IP Routing Table   +++ Expected IP RoutingTable   @@ -8,5 +8,5 @@    C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX    C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX    C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX   -O>r 192.168.0.1/32 [110/10] via 0.0.0.0, r1-eth0 onlink, XX:XX:XX   -O>r 192.168.3.1/32 [110/10] via 0.0.0.0, r1-eth3 onlink, XX:XX:XX   +O   192.168.0.0/24 [110/10] is directly connected, r1-eth0, XX:XX:XX   +O   192.168.3.0/26 [110/10] is directly connected, r1-eth3, XX:XX:XX assert 1 == 0   -1   +0
E   AssertionError: IP Routing table failed for r1
      --- Actual IP Routing Table
      +++ Expected IP RoutingTable
      @@ -8,5 +8,5 @@
       C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX
       C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX
       C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX
(7 more lines...)
Collapse Failed test_all_protocol_startup test_isis_interfaces History
Topology Tests on Ubuntu 16.04 amd64 < 1 sec
AssertionError: SHOW ISIS INTERFACE DETAIL failed for router r1:   --- actual SHOW ISIS INTERFACE DETAIL   +++ expected SHOW ISIS OSPF6 INTERFACE DETAIL   @@ -7,7 +7,7 @@          CNSP interval: 10, PSNP interval: 2          LAN Priority: 64, is not DIS        IP Prefix(es):   -      192.168.5.1/32   +      192.168.5.1/26        IPv6 Link-Locals:          fe80::XXXX:XXXX:XXXX:XXXX/64        IPv6 Prefixes:   @@ -21,7 +21,7 @@          CNSP interval: 10, PSNP interval: 2          LAN Priority: 64, is not DIS        IP Prefix(es):   -      192.168.6.1/32   +      192.168.6.1/26        IPv6 Link-Locals:          fe80::XXXX:XXXX:XXXX:XXXX/64        IPv6 Prefixes: assert 1 == 0   -1   +0
E   AssertionError: SHOW ISIS INTERFACE DETAIL failed for router r1:
      --- actual SHOW ISIS INTERFACE DETAIL
      +++ expected SHOW ISIS OSPF6 INTERFACE DETAIL
      @@ -7,7 +7,7 @@
             CNSP interval: 10, PSNP interval: 2
             LAN Priority: 64, is not DIS
           IP Prefix(es):
(17 more lines...)
Collapse Failed test_all_protocol_startup test_converge_protocols History
Topology Tests on Ubuntu 18.04 amd64 1 min
AssertionError: IP Routing table failed for r1   --- Actual IP Routing Table   +++ Expected IP RoutingTable   @@ -8,5 +8,5 @@    C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX    C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX    C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX   -O>r 192.168.0.1/32 [110/10] via 0.0.0.0, r1-eth0 onlink, XX:XX:XX   -O>r 192.168.3.1/32 [110/10] via 0.0.0.0, r1-eth3 onlink, XX:XX:XX   +O   192.168.0.0/24 [110/10] is directly connected, r1-eth0, XX:XX:XX   +O   192.168.3.0/26 [110/10] is directly connected, r1-eth3, XX:XX:XX assert 1 == 0   -1   +0
E   AssertionError: IP Routing table failed for r1
      --- Actual IP Routing Table
      +++ Expected IP RoutingTable
      @@ -8,5 +8,5 @@
       C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX
       C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX
       C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX
(7 more lines...)
Collapse Failed test_all_protocol_startup test_isis_interfaces History
Topology Tests on Ubuntu 18.04 amd64 < 1 sec
AssertionError: SHOW ISIS INTERFACE DETAIL failed for router r1:   --- actual SHOW ISIS INTERFACE DETAIL   +++ expected SHOW ISIS OSPF6 INTERFACE DETAIL   @@ -7,7 +7,7 @@          CNSP interval: 10, PSNP interval: 2          LAN Priority: 64, is not DIS        IP Prefix(es):   -      192.168.5.1/32   +      192.168.5.1/26        IPv6 Link-Locals:          fe80::XXXX:XXXX:XXXX:XXXX/64        IPv6 Prefixes:   @@ -21,7 +21,7 @@          CNSP interval: 10, PSNP interval: 2          LAN Priority: 64, is not DIS        IP Prefix(es):   -      192.168.6.1/32   +      192.168.6.1/26        IPv6 Link-Locals:          fe80::XXXX:XXXX:XXXX:XXXX/64        IPv6 Prefixes: assert 1 == 0   -1   +0
E   AssertionError: SHOW ISIS INTERFACE DETAIL failed for router r1:
      --- actual SHOW ISIS INTERFACE DETAIL
      +++ expected SHOW ISIS OSPF6 INTERFACE DETAIL
      @@ -7,7 +7,7 @@
             CNSP interval: 10, PSNP interval: 2
             LAN Priority: 64, is not DIS
           IP Prefix(es):
(17 more lines...)
Collapse Failed test_all_protocol_startup test_converge_protocols History
TopoTest Tests on Ubuntu 16.04 i386 1 min
AssertionError: IP Routing table failed for r1   --- Actual IP Routing Table   +++ Expected IP RoutingTable   @@ -8,5 +8,5 @@    C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX    C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX    C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX   -O>r 192.168.0.1/32 [110/10] via 0.0.0.0, r1-eth0 onlink, XX:XX:XX   -O>r 192.168.3.1/32 [110/10] via 0.0.0.0, r1-eth3 onlink, XX:XX:XX   +O   192.168.0.0/24 [110/10] is directly connected, r1-eth0, XX:XX:XX   +O   192.168.3.0/26 [110/10] is directly connected, r1-eth3, XX:XX:XX assert 1 == 0   -1   +0
E   AssertionError: IP Routing table failed for r1
      --- Actual IP Routing Table
      +++ Expected IP RoutingTable
      @@ -8,5 +8,5 @@
       C>* 192.168.7.0/26 is directly connected, r1-eth7, XX:XX:XX
       C>* 192.168.8.0/26 is directly connected, r1-eth8, XX:XX:XX
       C>* 192.168.9.0/26 is directly connected, r1-eth9, XX:XX:XX
(7 more lines...)
Collapse Failed test_all_protocol_startup test_isis_interfaces History
TopoTest Tests on Ubuntu 16.04 i386 < 1 sec
AssertionError: SHOW ISIS INTERFACE DETAIL failed for router r1:   --- actual SHOW ISIS INTERFACE DETAIL   +++ expected SHOW ISIS OSPF6 INTERFACE DETAIL   @@ -7,7 +7,7 @@          CNSP interval: 10, PSNP interval: 2          LAN Priority: 64, is not DIS        IP Prefix(es):   -      192.168.5.1/32   +      192.168.5.1/26        IPv6 Link-Locals:          fe80::XXXX:XXXX:XXXX:XXXX/64        IPv6 Prefixes:   @@ -21,7 +21,7 @@          CNSP interval: 10, PSNP interval: 2          LAN Priority: 64, is not DIS        IP Prefix(es):   -      192.168.6.1/32   +      192.168.6.1/26        IPv6 Link-Locals:          fe80::XXXX:XXXX:XXXX:XXXX/64        IPv6 Prefixes: assert 1 == 0   -1   +0
E   AssertionError: SHOW ISIS INTERFACE DETAIL failed for router r1:
      --- actual SHOW ISIS INTERFACE DETAIL
      +++ expected SHOW ISIS OSPF6 INTERFACE DETAIL
      @@ -7,7 +7,7 @@
             CNSP interval: 10, PSNP interval: 2
             LAN Priority: 64, is not DIS
           IP Prefix(es):
(17 more lines...)
Collapse Failed test_bfd_topo2 test_protocols_convergence History
Topology Tests on Ubuntu 16.04 amd64 1 min
AssertionError: "r2" JSON output mismatches assert expected key(s) [u'10.254.254.3/32'] in json (have [u'10.0.3.2/32', u'10.0.3.0/24', u'10.254.254.2/32', u'10.254.254.1/32']):   --- Expected value   +++ Current value   @@ -4,17 +4 @@   -            "distance": 110,    -            "internalFlags": 0,    -            "internalStatus": 2,    -            "metric": 10,    -            "nexthops": [   -                {   -                    "active": true,    -                    "directlyConnected": true,    -                    "flags": 1,    -                    "interfaceIndex": 3,    -                    "interfaceName": "r2-eth1"   -                }   -            ],    -            "prefix": "10.0.3.0/24",    -            "protocol": "ospf"   -        },    -        {   +            "destSelected": true,    @@ -38 +22,27 @@   -            "selected": true   +            "selected": true,    +            "uptime": "00:01:50"   +        }   +    ],    +    "10.0.3.2/32": [   +        {   +            "destSelected": true,    +            "distance": 110,    +            "failed": true,    +            "internalFlags": 8,    +            "internalStatus": 66,    +            "metric": 10,    +            "nexthops": [   +                {   +                    "active": true,    +                    "afi": "ipv4",    +                    "flags": 9,    +                    "interfaceIndex": 3,    +                    "interfaceName": "r2-eth1",    +                    "ip": "0.0.0.0",    +                    "onLink": true   +                }   +            ],    +            "prefix": "10.0.3.2/32",    +            "protocol": "ospf",    +            "selected": true,    +            "uptime": "00:01:49"   @@ -42,0 +53 @@   +            "destSelected": true,    @@ -55 +66,2 @@   -                    "interfaceName": "r2-eth0"   +                    "interfaceName": "r2-eth0",    +                    "ip": "fe80::d461:13ff:fe8d:808d"   @@ -60 +72,2 @@   -            "selected": true   +            "selected": true,    +            "uptime": "00:01:45"   @@ -64,0 +78 @@   +            "destSelected": true,    @@ -82,24 +96,2 @@   -            "selected": true   -        }   -    ],    -    "10.254.254.3/32": [   -        {   -            "distance": 110,    -            "installed": true,    -            "internalFlags": 8,    -            "internalStatus": 34,    -            "metric": 20,    -            "nexthops": [   -                {   -                    "active": true,    -                    "afi": "ipv4",    -                    "fib": true,    -                    "flags": 3,    -                    "interfaceIndex": 3,    -                    "interfaceName": "r2-eth1",    -                    "ip": "10.0.3.1"   -                }   -            ],    -            "prefix": "10.254.254.3/32",    -            "protocol": "ospf",    -            "selected": true   +            "selected": true,    +            "uptime": "00:01:50"   json too few items (have 1, expected 2:    --- Expected value   +++ Current value   @@ -3,17 +3 @@   -        "distance": 110,    -        "internalFlags": 0,    -        "internalStatus": 2,    -        "metric": 10,    -        "nexthops": [   -            {   -                "active": true,    -                "directlyConnected": true,    -                "flags": 1,    -                "interfaceIndex": 3,    -                "interfaceName": "r2-eth1"   -            }   -        ],    -        "prefix": "10.0.3.0/24",    -        "protocol": "ospf"   -    },    -    {   +        "destSelected": true,    @@ -37 +21,2 @@   -        "selected": true   +        "selected": true,    +        "uptime": "00:01:50")
E   AssertionError: "r2" JSON output mismatches
    assert expected key(s) [u'10.254.254.3/32'] in json (have [u'10.0.3.2/32', u'10.0.3.0/24', u'10.254.254.2/32', u'10.254.254.1/32']):
      --- Expected value
      +++ Current value
      @@ -4,17 +4 @@
      -            "distance": 110, 
      -            "internalFlags": 0, 
(110 more lines...)
Collapse Failed test_bfd_topo2 test_bfd_connection History
Topology Tests on Ubuntu 16.04 amd64 6 secs
AssertionError: "r2" JSON output mismatches assert json too few items (have 2, expected 3:    --- Expected value   +++ Current value   @@ -5 +5,3 @@   -        "interface": "r2-eth0",    +        "id": 3447310732,    +        "interface": "r2-eth2",    +        "local": "fe80::48c3:15ff:febb:689a",    @@ -6,0 +9 @@   +        "peer": "fe80::2094:64ff:fedf:11e4",    @@ -9,0 +13 @@   +        "remote-id": 1379148085,    @@ -13 +17,2 @@   -        "transmit-interval": 300   +        "transmit-interval": 300,    +        "uptime": 102   @@ -18 +23,3 @@   -        "interface": "r2-eth2",    +        "id": 1275447625,    +        "interface": "r2-eth0",    +        "local": "fe80::4003:37ff:fedb:916",    @@ -19,0 +27 @@   +        "peer": "fe80::d461:13ff:fe8d:808d",    @@ -22,0 +31 @@   +        "remote-id": 3372621557,    @@ -26,15 +35,2 @@   -        "transmit-interval": 300   -    },    -    {   -        "diagnostic": "ok",    -        "echo-interval": 0,    -        "interface": "r2-eth1",    -        "multihop": false,    -        "peer": "10.0.3.1",    -        "receive-interval": 300,    -        "remote-diagnostic": "ok",    -        "remote-echo-interval": 50,    -        "remote-receive-interval": 300,    -        "remote-transmit-interval": 300,    -        "status": "up",    -        "transmit-interval": 300   +        "transmit-interval": 300,    +        "uptime": 112)
E   AssertionError: "r2" JSON output mismatches
    assert json too few items (have 2, expected 3:
       --- Expected value
      +++ Current value
      @@ -5 +5,3 @@
      -        "interface": "r2-eth0", 
      +        "id": 3447310732, 
(37 more lines...)
Collapse Failed test_bfd_topo2 test_bfd_connection History
Topology Tests on Ubuntu 18.04 amd64 5 secs
AssertionError: "r2" JSON output mismatches assert json too few items (have 2, expected 3:    --- Expected value   +++ Current value   @@ -5 +5,3 @@   -        "interface": "r2-eth0",    +        "id": 177167282,    +        "interface": "r2-eth2",    +        "local": "fe80::b4c0:35ff:fe85:45dd",    @@ -6,0 +9 @@   +        "peer": "fe80::d86d:d5ff:fe6d:6eaa",    @@ -9,0 +13 @@   +        "remote-id": 2391228368,    @@ -13 +17,2 @@   -        "transmit-interval": 300   +        "transmit-interval": 300,    +        "uptime": 97   @@ -18 +23,3 @@   -        "interface": "r2-eth2",    +        "id": 3668894412,    +        "interface": "r2-eth0",    +        "local": "fe80::681d:31ff:fec1:9e04",    @@ -19,0 +27 @@   +        "peer": "fe80::441c:10ff:fe25:4065",    @@ -22,0 +31 @@   +        "remote-id": 528647411,    @@ -26,15 +35,2 @@   -        "transmit-interval": 300   -    },    -    {   -        "diagnostic": "ok",    -        "echo-interval": 0,    -        "interface": "r2-eth1",    -        "multihop": false,    -        "peer": "10.0.3.1",    -        "receive-interval": 300,    -        "remote-diagnostic": "ok",    -        "remote-echo-interval": 50,    -        "remote-receive-interval": 300,    -        "remote-transmit-interval": 300,    -        "status": "up",    -        "transmit-interval": 300   +        "transmit-interval": 300,    +        "uptime": 106)
E   AssertionError: "r2" JSON output mismatches
    assert json too few items (have 2, expected 3:
       --- Expected value
      +++ Current value
      @@ -5 +5,3 @@
      -        "interface": "r2-eth0", 
      +        "id": 177167282, 
(37 more lines...)
Collapse Failed test_bfd_topo2 test_protocols_convergence History
Topology Tests on Ubuntu 18.04 amd64 1 min
AssertionError: "r2" JSON output mismatches assert expected key(s) [u'10.254.254.3/32'] in json (have [u'10.0.3.2/32', u'10.0.3.0/24', u'10.254.254.2/32', u'10.254.254.1/32']):   --- Expected value   +++ Current value   @@ -4,17 +4 @@   -            "distance": 110,    -            "internalFlags": 0,    -            "internalStatus": 2,    -            "metric": 10,    -            "nexthops": [   -                {   -                    "active": true,    -                    "directlyConnected": true,    -                    "flags": 1,    -                    "interfaceIndex": 3,    -                    "interfaceName": "r2-eth1"   -                }   -            ],    -            "prefix": "10.0.3.0/24",    -            "protocol": "ospf"   -        },    -        {   +            "destSelected": true,    @@ -38 +22,27 @@   -            "selected": true   +            "selected": true,    +            "uptime": "00:01:45"   +        }   +    ],    +    "10.0.3.2/32": [   +        {   +            "destSelected": true,    +            "distance": 110,    +            "failed": true,    +            "internalFlags": 8,    +            "internalStatus": 66,    +            "metric": 10,    +            "nexthops": [   +                {   +                    "active": true,    +                    "afi": "ipv4",    +                    "flags": 9,    +                    "interfaceIndex": 3,    +                    "interfaceName": "r2-eth1",    +                    "ip": "0.0.0.0",    +                    "onLink": true   +                }   +            ],    +            "prefix": "10.0.3.2/32",    +            "protocol": "ospf",    +            "selected": true,    +            "uptime": "00:01:44"   @@ -42,0 +53 @@   +            "destSelected": true,    @@ -55 +66,2 @@   -                    "interfaceName": "r2-eth0"   +                    "interfaceName": "r2-eth0",    +                    "ip": "fe80::441c:10ff:fe25:4065"   @@ -60 +72,2 @@   -            "selected": true   +            "selected": true,    +            "uptime": "00:01:41"   @@ -64,0 +78 @@   +            "destSelected": true,    @@ -82,24 +96,2 @@   -            "selected": true   -        }   -    ],    -    "10.254.254.3/32": [   -        {   -            "distance": 110,    -            "installed": true,    -            "internalFlags": 8,    -            "internalStatus": 34,    -            "metric": 20,    -            "nexthops": [   -                {   -                    "active": true,    -                    "afi": "ipv4",    -                    "fib": true,    -                    "flags": 3,    -                    "interfaceIndex": 3,    -                    "interfaceName": "r2-eth1",    -                    "ip": "10.0.3.1"   -                }   -            ],    -            "prefix": "10.254.254.3/32",    -            "protocol": "ospf",    -            "selected": true   +            "selected": true,    +            "uptime": "00:01:45"   json too few items (have 1, expected 2:    --- Expected value   +++ Current value   @@ -3,17 +3 @@   -        "distance": 110,    -        "internalFlags": 0,    -        "internalStatus": 2,    -        "metric": 10,    -        "nexthops": [   -            {   -                "active": true,    -                "directlyConnected": true,    -                "flags": 1,    -                "interfaceIndex": 3,    -                "interfaceName": "r2-eth1"   -            }   -        ],    -        "prefix": "10.0.3.0/24",    -        "protocol": "ospf"   -    },    -    {   +        "destSelected": true,    @@ -37 +21,2 @@   -        "selected": true   +        "selected": true,    +        "uptime": "00:01:45")
E   AssertionError: "r2" JSON output mismatches
    assert expected key(s) [u'10.254.254.3/32'] in json (have [u'10.0.3.2/32', u'10.0.3.0/24', u'10.254.254.2/32', u'10.254.254.1/32']):
      --- Expected value
      +++ Current value
      @@ -4,17 +4 @@
      -            "distance": 110, 
      -            "internalFlags": 0, 
(110 more lines...)
Collapse Failed test_bfd_topo2 test_protocols_convergence History
TopoTest Tests on Ubuntu 16.04 i386 1 min
AssertionError: "r2" JSON output mismatches assert expected key(s) [u'10.254.254.3/32'] in json (have [u'10.0.3.2/32', u'10.0.3.0/24', u'10.254.254.2/32', u'10.254.254.1/32']):   --- Expected value   +++ Current value   @@ -4,17 +4 @@   -            "distance": 110,    -            "internalFlags": 0,    -            "internalStatus": 2,    -            "metric": 10,    -            "nexthops": [   -                {   -                    "active": true,    -                    "directlyConnected": true,    -                    "flags": 1,    -                    "interfaceIndex": 3,    -                    "interfaceName": "r2-eth1"   -                }   -            ],    -            "prefix": "10.0.3.0/24",    -            "protocol": "ospf"   -        },    -        {   +            "destSelected": true,    @@ -38 +22,27 @@   -            "selected": true   +            "selected": true,    +            "uptime": "00:01:48"   +        }   +    ],    +    "10.0.3.2/32": [   +        {   +            "destSelected": true,    +            "distance": 110,    +            "failed": true,    +            "internalFlags": 8,    +            "internalStatus": 66,    +            "metric": 10,    +            "nexthops": [   +                {   +                    "active": true,    +                    "afi": "ipv4",    +                    "flags": 9,    +                    "interfaceIndex": 3,    +                    "interfaceName": "r2-eth1",    +                    "ip": "0.0.0.0",    +                    "onLink": true   +                }   +            ],    +            "prefix": "10.0.3.2/32",    +            "protocol": "ospf",    +            "selected": true,    +            "uptime": "00:01:47"   @@ -42,0 +53 @@   +            "destSelected": true,    @@ -55 +66,2 @@   -                    "interfaceName": "r2-eth0"   +                    "interfaceName": "r2-eth0",    +                    "ip": "fe80::e8d5:c3ff:fe99:a21"   @@ -60 +72,2 @@   -            "selected": true   +            "selected": true,    +            "uptime": "00:01:45"   @@ -64,0 +78 @@   +            "destSelected": true,    @@ -82,24 +96,2 @@   -            "selected": true   -        }   -    ],    -    "10.254.254.3/32": [   -        {   -            "distance": 110,    -            "installed": true,    -            "internalFlags": 8,    -            "internalStatus": 34,    -            "metric": 20,    -            "nexthops": [   -                {   -                    "active": true,    -                    "afi": "ipv4",    -                    "fib": true,    -                    "flags": 3,    -                    "interfaceIndex": 3,    -                    "interfaceName": "r2-eth1",    -                    "ip": "10.0.3.1"   -                }   -            ],    -            "prefix": "10.254.254.3/32",    -            "protocol": "ospf",    -            "selected": true   +            "selected": true,    +            "uptime": "00:01:48"   json too few items (have 1, expected 2:    --- Expected value   +++ Current value   @@ -3,17 +3 @@   -        "distance": 110,    -        "internalFlags": 0,    -        "internalStatus": 2,    -        "metric": 10,    -        "nexthops": [   -            {   -                "active": true,    -                "directlyConnected": true,    -                "flags": 1,    -                "interfaceIndex": 3,    -                "interfaceName": "r2-eth1"   -            }   -        ],    -        "prefix": "10.0.3.0/24",    -        "protocol": "ospf"   -    },    -    {   +        "destSelected": true,    @@ -37 +21,2 @@   -        "selected": true   +        "selected": true,    +        "uptime": "00:01:48")
E   AssertionError: "r2" JSON output mismatches
    assert expected key(s) [u'10.254.254.3/32'] in json (have [u'10.0.3.2/32', u'10.0.3.0/24', u'10.254.254.2/32', u'10.254.254.1/32']):
      --- Expected value
      +++ Current value
      @@ -4,17 +4 @@
      -            "distance": 110, 
      -            "internalFlags": 0, 
(110 more lines...)
Collapse Failed test_bfd_topo2 test_bfd_connection History
TopoTest Tests on Ubuntu 16.04 i386 6 secs
AssertionError: "r2" JSON output mismatches assert json too few items (have 2, expected 3:    --- Expected value   +++ Current value   @@ -5 +5,3 @@   -        "interface": "r2-eth0",    +        "id": 4162228473,    +        "interface": "r2-eth2",    +        "local": "fe80::ae:71ff:fe98:ead0",    @@ -6,0 +9 @@   +        "peer": "fe80::5837:37ff:fe65:7c84",    @@ -9,0 +13 @@   +        "remote-id": 1829969035,    @@ -13 +17,2 @@   -        "transmit-interval": 300   +        "transmit-interval": 300,    +        "uptime": 100   @@ -18 +23,3 @@   -        "interface": "r2-eth2",    +        "id": 993728925,    +        "interface": "r2-eth0",    +        "local": "fe80::700c:95ff:fe4e:7c57",    @@ -19,0 +27 @@   +        "peer": "fe80::e8d5:c3ff:fe99:a21",    @@ -22,0 +31 @@   +        "remote-id": 3231217232,    @@ -26,15 +35,2 @@   -        "transmit-interval": 300   -    },    -    {   -        "diagnostic": "ok",    -        "echo-interval": 0,    -        "interface": "r2-eth1",    -        "multihop": false,    -        "peer": "10.0.3.1",    -        "receive-interval": 300,    -        "remote-diagnostic": "ok",    -        "remote-echo-interval": 50,    -        "remote-receive-interval": 300,    -        "remote-transmit-interval": 300,    -        "status": "up",    -        "transmit-interval": 300   +        "transmit-interval": 300,    +        "uptime": 110)
E   AssertionError: "r2" JSON output mismatches
    assert json too few items (have 2, expected 3:
       --- Expected value
      +++ Current value
      @@ -5 +5,3 @@
      -        "interface": "r2-eth0", 
      +        "id": 4162228473, 
(37 more lines...)
Collapse Failed test_bgp_l3vpn_to_bgp_direct test_adjacencies History
Topology Tests on Ubuntu 16.04 amd64 3 mins
AssertionError: 10 tests failed
E   AssertionError: 10 tests failed
Collapse Failed test_bgp_l3vpn_to_bgp_direct test_adjacencies History
Topology Tests on Ubuntu 18.04 amd64 3 mins
AssertionError: 10 tests failed
E   AssertionError: 10 tests failed
Collapse Failed test_bgp_l3vpn_to_bgp_direct test_adjacencies History
TopoTest Tests on Ubuntu 16.04 i386 3 mins
AssertionError: 10 tests failed
E   AssertionError: 10 tests failed
Collapse Failed test_bgp_l3vpn_to_bgp_vrf test_adjacencies History
Topology Tests on Ubuntu 16.04 amd64 8 mins
AssertionError: 13 tests failed
E   AssertionError: 13 tests failed
Collapse Failed test_bgp_l3vpn_to_bgp_vrf test_adjacencies History
Topology Tests on Ubuntu 18.04 amd64 8 mins
AssertionError: 13 tests failed
E   AssertionError: 13 tests failed
Collapse Failed test_bgp_l3vpn_to_bgp_vrf test_adjacencies History
TopoTest Tests on Ubuntu 16.04 i386 8 mins
AssertionError: 13 tests failed
E   AssertionError: 13 tests failed
Collapse Failed test_bgp_rfapi_basic_sanity_config2 test_adjacencies History
Topology Tests on Ubuntu 16.04 amd64 3 mins
AssertionError: 9 tests failed
E   AssertionError: 9 tests failed
Collapse Failed test_bgp_rfapi_basic_sanity_config2 test_adjacencies History
Topology Tests on Ubuntu 18.04 amd64 3 mins
AssertionError: 9 tests failed
E   AssertionError: 9 tests failed
Collapse Failed test_bgp_rfapi_basic_sanity_config2 test_adjacencies History
TopoTest Tests on Ubuntu 16.04 i386 3 mins
AssertionError: 9 tests failed
E   AssertionError: 9 tests failed
Collapse Failed test_bgp_rfapi_basic_sanity test_adjacencies History
Topology Tests on Ubuntu 16.04 amd64 3 mins
AssertionError: 9 tests failed
E   AssertionError: 9 tests failed
Collapse Failed test_bgp_rfapi_basic_sanity test_adjacencies History
Topology Tests on Ubuntu 18.04 amd64 3 mins
AssertionError: 9 tests failed
E   AssertionError: 9 tests failed
Collapse Failed test_bgp_rfapi_basic_sanity test_adjacencies History
TopoTest Tests on Ubuntu 16.04 i386 3 mins
AssertionError: 9 tests failed
E   AssertionError: 9 tests failed
Collapse Failed test_eigrp_topo1 test_eigrp_routes History
Topology Tests on Ubuntu 16.04 amd64 < 1 sec
AssertionError: "show ip eigrp topo" mismatches on r1 assert expected key(s) [u'192.168.1.0/24', u'192.168.3.0/24', u'193.1.1.0/26', u'193.1.2.0/24'] in json["P"] (have ['193.1.1.1/32', '192.168.1.1/32']):   --- Expected value   +++ Current value   @@ -2 +2 @@   -    "192.168.1.0/24": {   +    "192.168.1.1/32": {   @@ -9,8 +9 @@   -    "192.168.3.0/24": {   -        "fd": "33280",    -        "interface": " r1-eth1",    -        "serno": "0",    -        "successors": "1",    -        "via": "193.1.1.2 (33280/30720)"   -    },    -    "193.1.1.0/26": {   +    "193.1.1.1/32": {   @@ -22,7 +14,0 @@   -    },    -    "193.1.2.0/24": {   -        "fd": "30720",    -        "interface": " r1-eth1",    -        "serno": "0",    -        "successors": "1",    -        "via": "193.1.1.2 (30720/28160)"
E   AssertionError: "show ip eigrp topo" mismatches on r1
    assert expected key(s) [u'192.168.1.0/24', u'192.168.3.0/24', u'193.1.1.0/26', u'193.1.2.0/24'] in json["P"] (have ['193.1.1.1/32', '192.168.1.1/32']):
      --- Expected value
      +++ Current value
      @@ -2 +2 @@
      -    "192.168.1.0/24": {
      +    "192.168.1.1/32": {
(18 more lines...)
Collapse Failed test_eigrp_topo1 test_zebra_ipv4_routingTable History
Topology Tests on Ubuntu 16.04 amd64 < 1 sec
AssertionError: Zebra IPv4 Routing Table verification failed for router r1 assert expected key(s) [u'192.168.3.0/24', u'193.1.2.0/24'] in json (have [u'193.1.1.1/32', u'192.168.1.0/24', u'192.168.1.1/32', u'193.1.1.0/26']):   --- Expected value   +++ Current value   @@ -3,0 +4,29 @@   +            "destSelected": true,    +            "distance": 0,    +            "installed": true,    +            "internalFlags": 8,    +            "internalStatus": 32,    +            "metric": 0,    +            "nexthops": [   +                {   +                    "active": true,    +                    "directlyConnected": true,    +                    "fib": true,    +                    "flags": 3,    +                    "interfaceIndex": 2,    +                    "interfaceName": "r1-eth0"   +                }   +            ],    +            "prefix": "192.168.1.0/24",    +            "protocol": "connected",    +            "selected": true,    +            "uptime": "00:00:11"   +        }   +    ],    +    "192.168.1.1/32": [   +        {   +            "destSelected": true,    +            "distance": 90,    +            "installed": true,    +            "internalFlags": 8,    +            "internalStatus": 34,    @@ -8,0 +38,3 @@   +                    "fib": true,    +                    "flags": 3,    +                    "interfaceIndex": 2,    @@ -12,3 +44,7 @@   -            "prefix": "192.168.1.0/24",    -            "protocol": "eigrp"   -        },    +            "prefix": "192.168.1.1/32",    +            "protocol": "eigrp",    +            "selected": true,    +            "uptime": "00:00:10"   +        }   +    ],    +    "193.1.1.0/26": [   @@ -15,0 +52,6 @@   +            "destSelected": true,    +            "distance": 0,    +            "installed": true,    +            "internalFlags": 8,    +            "internalStatus": 32,    +            "metric": 0,    @@ -21 +63,3 @@   -                    "interfaceName": "r1-eth0"   +                    "flags": 3,    +                    "interfaceIndex": 3,    +                    "interfaceName": "r1-eth1"   @@ -24 +68 @@   -            "prefix": "192.168.1.0/24",    +            "prefix": "193.1.1.0/26",    @@ -26 +70,2 @@   -            "selected": true   +            "selected": true,    +            "uptime": "00:00:11"   @@ -29 +74 @@   -    "192.168.3.0/24": [   +    "193.1.1.1/32": [   @@ -31,17 +76,5 @@   -            "metric": 33280,    -            "nexthops": [   -                {   -                    "active": true,    -                    "afi": "ipv4",    -                    "fib": true,    -                    "interfaceName": "r1-eth1",    -                    "ip": "193.1.1.2"   -                }   -            ],    -            "prefix": "192.168.3.0/24",    -            "protocol": "eigrp",    -            "selected": true   -        }   -    ],    -    "193.1.1.0/26": [   -        {   +            "destSelected": true,    +            "distance": 90,    +            "installed": true,    +            "internalFlags": 8,    +            "internalStatus": 34,    @@ -52,0 +86,3 @@   +                    "fib": true,    +                    "flags": 3,    +                    "interfaceIndex": 3,    @@ -56,30 +92 @@   -            "prefix": "193.1.1.0/26",    -            "protocol": "eigrp"   -        },    -        {   -            "nexthops": [   -                {   -                    "active": true,    -                    "directlyConnected": true,    -                    "fib": true,    -                    "interfaceName": "r1-eth1"   -                }   -            ],    -            "prefix": "193.1.1.0/26",    -            "protocol": "connected",    -            "selected": true   -        }   -    ],    -    "193.1.2.0/24": [   -        {   -            "metric": 30720,    -            "nexthops": [   -                {   -                    "active": true,    -                    "afi": "ipv4",    -                    "fib": true,    -                    "interfaceName": "r1-eth1",    -                    "ip": "193.1.1.2"   -                }   -            ],    -            "prefix": "193.1.2.0/24",    +            "prefix": "193.1.1.1/32",    @@ -87 +94,2 @@   -            "selected": true   +            "selected": true,    +            "uptime": "00:00:10"   json too few items (have 1, expected 2:    --- Expected value   +++ Current value   @@ -3,12 +3,6 @@   -        "metric": 28160,    -        "nexthops": [   -            {   -                "active": true,    -                "directlyConnected": true,    -                "interfaceName": "r1-eth0"   -            }   -        ],    -        "prefix": "192.168.1.0/24",    -        "protocol": "eigrp"   -    },    -    {   +        "destSelected": true,    +        "distance": 0,    +        "installed": true,    +        "internalFlags": 8,    +        "internalStatus": 32,    +        "metric": 0,    @@ -19,0 +14,2 @@   +                "flags": 3,    +                "interfaceIndex": 2,    @@ -25 +21,2 @@   -        "selected": true   +        "selected": true,    +        "uptime": "00:00:11")   json too few items (have 1, expected 2:    --- Expected value   +++ Current value   @@ -3,12 +3,6 @@   -        "metric": 28160,    -        "nexthops": [   -            {   -                "active": true,    -                "directlyConnected": true,    -                "interfaceName": "r1-eth1"   -            }   -        ],    -        "prefix": "193.1.1.0/26",    -        "protocol": "eigrp"   -    },    -    {   +        "destSelected": true,    +        "distance": 0,    +        "installed": true,    +        "internalFlags": 8,    +        "internalStatus": 32,    +        "metric": 0,    @@ -19,0 +14,2 @@   +                "flags": 3,    +                "interfaceIndex": 3,    @@ -25 +21,2 @@   -        "selected": true   +        "selected": true,    +        "uptime": "00:00:11")
E   AssertionError: Zebra IPv4 Routing Table verification failed for router r1
    assert expected key(s) [u'192.168.3.0/24', u'193.1.2.0/24'] in json (have [u'193.1.1.1/32', u'192.168.1.0/24', u'192.168.1.1/32', u'193.1.1.0/26']):
      --- Expected value
      +++ Current value
      @@ -3,0 +4,29 @@
      +            "destSelected": true, 
      +            "distance": 0, 
(185 more lines...)
Collapse Failed test_eigrp_topo1 test_zebra_ipv4_routingTable History
Topology Tests on Ubuntu 18.04 amd64 < 1 sec
AssertionError: Zebra IPv4 Routing Table verification failed for router r1 assert expected key(s) [u'192.168.3.0/24', u'193.1.2.0/24'] in json (have [u'193.1.1.1/32', u'192.168.1.0/24', u'192.168.1.1/32', u'193.1.1.0/26']):   --- Expected value   +++ Current value   @@ -3,0 +4,29 @@   +            "destSelected": true,    +            "distance": 0,    +            "installed": true,    +            "internalFlags": 8,    +            "internalStatus": 32,    +            "metric": 0,    +            "nexthops": [   +                {   +                    "active": true,    +                    "directlyConnected": true,    +                    "fib": true,    +                    "flags": 3,    +                    "interfaceIndex": 2,    +                    "interfaceName": "r1-eth0"   +                }   +            ],    +            "prefix": "192.168.1.0/24",    +            "protocol": "connected",    +            "selected": true,    +            "uptime": "00:00:11"   +        }   +    ],    +    "192.168.1.1/32": [   +        {   +            "destSelected": true,    +            "distance": 90,    +            "installed": true,    +            "internalFlags": 8,    +            "internalStatus": 34,    @@ -8,0 +38,3 @@   +                    "fib": true,    +                    "flags": 3,    +                    "interfaceIndex": 2,    @@ -12,3 +44,7 @@   -            "prefix": "192.168.1.0/24",    -            "protocol": "eigrp"   -        },    +            "prefix": "192.168.1.1/32",    +            "protocol": "eigrp",    +            "selected": true,    +            "uptime": "00:00:10"   +        }   +    ],    +    "193.1.1.0/26": [   @@ -15,0 +52,6 @@   +            "destSelected": true,    +            "distance": 0,    +            "installed": true,    +            "internalFlags": 8,    +            "internalStatus": 32,    +            "metric": 0,    @@ -21 +63,3 @@   -                    "interfaceName": "r1-eth0"   +                    "flags": 3,    +                    "interfaceIndex": 3,    +                    "interfaceName": "r1-eth1"   @@ -24 +68 @@   -            "prefix": "192.168.1.0/24",    +            "prefix": "193.1.1.0/26",    @@ -26 +70,2 @@   -            "selected": true   +            "selected": true,    +            "uptime": "00:00:11"   @@ -29 +74 @@   -    "192.168.3.0/24": [   +    "193.1.1.1/32": [   @@ -31,17 +76,5 @@   -            "metric": 33280,    -            "nexthops": [   -                {   -                    "active": true,    -                    "afi": "ipv4",    -                    "fib": true,    -                    "interfaceName": "r1-eth1",    -                    "ip": "193.1.1.2"   -                }   -            ],    -            "prefix": "192.168.3.0/24",    -            "protocol": "eigrp",    -            "selected": true   -        }   -    ],    -    "193.1.1.0/26": [   -        {   +            "destSelected": true,    +            "distance": 90,    +            "installed": true,    +            "internalFlags": 8,    +            "internalStatus": 34,    @@ -52,0 +86,3 @@   +                    "fib": true,    +                    "flags": 3,    +                    "interfaceIndex": 3,    @@ -56,30 +92 @@   -            "prefix": "193.1.1.0/26",    -            "protocol": "eigrp"   -        },    -        {   -            "nexthops": [   -                {   -                    "active": true,    -                    "directlyConnected": true,    -                    "fib": true,    -                    "interfaceName": "r1-eth1"   -                }   -            ],    -            "prefix": "193.1.1.0/26",    -            "protocol": "connected",    -            "selected": true   -        }   -    ],    -    "193.1.2.0/24": [   -        {   -            "metric": 30720,    -            "nexthops": [   -                {   -                    "active": true,    -                    "afi": "ipv4",    -                    "fib": true,    -                    "interfaceName": "r1-eth1",    -                    "ip": "193.1.1.2"   -                }   -            ],    -            "prefix": "193.1.2.0/24",    +            "prefix": "193.1.1.1/32",    @@ -87 +94,2 @@   -            "selected": true   +            "selected": true,    +            "uptime": "00:00:10"   json too few items (have 1, expected 2:    --- Expected value   +++ Current value   @@ -3,12 +3,6 @@   -        "metric": 28160,    -        "nexthops": [   -            {   -                "active": true,    -                "directlyConnected": true,    -                "interfaceName": "r1-eth0"   -            }   -        ],    -        "prefix": "192.168.1.0/24",    -        "protocol": "eigrp"   -    },    -    {   +        "destSelected": true,    +        "distance": 0,    +        "installed": true,    +        "internalFlags": 8,    +        "internalStatus": 32,    +        "metric": 0,    @@ -19,0 +14,2 @@   +                "flags": 3,    +                "interfaceIndex": 2,    @@ -25 +21,2 @@   -        "selected": true   +        "selected": true,    +        "uptime": "00:00:11")   json too few items (have 1, expected 2:    --- Expected value   +++ Current value   @@ -3,12 +3,6 @@   -        "metric": 28160,    -        "nexthops": [   -            {   -                "active": true,    -                "directlyConnected": true,    -                "interfaceName": "r1-eth1"   -            }   -        ],    -        "prefix": "193.1.1.0/26",    -        "protocol": "eigrp"   -    },    -    {   +        "destSelected": true,    +        "distance": 0,    +        "installed": true,    +        "internalFlags": 8,    +        "internalStatus": 32,    +        "metric": 0,    @@ -19,0 +14,2 @@   +                "flags": 3,    +                "interfaceIndex": 3,    @@ -25 +21,2 @@   -        "selected": true   +        "selected": true,    +        "uptime": "00:00:11")
E   AssertionError: Zebra IPv4 Routing Table verification failed for router r1
    assert expected key(s) [u'192.168.3.0/24', u'193.1.2.0/24'] in json (have [u'193.1.1.1/32', u'192.168.1.0/24', u'192.168.1.1/32', u'193.1.1.0/26']):
      --- Expected value
      +++ Current value
      @@ -3,0 +4,29 @@
      +            "destSelected": true, 
      +            "distance": 0, 
(185 more lines...)
Collapse Failed test_eigrp_topo1 test_eigrp_routes History
Topology Tests on Ubuntu 18.04 amd64 < 1 sec
AssertionError: "show ip eigrp topo" mismatches on r1 assert expected key(s) [u'192.168.1.0/24', u'192.168.3.0/24', u'193.1.1.0/26', u'193.1.2.0/24'] in json["P"] (have ['193.1.1.1/32', '192.168.1.1/32']):   --- Expected value   +++ Current value   @@ -2 +2 @@   -    "192.168.1.0/24": {   +    "192.168.1.1/32": {   @@ -9,8 +9 @@   -    "192.168.3.0/24": {   -        "fd": "33280",    -        "interface": " r1-eth1",    -        "serno": "0",    -        "successors": "1",    -        "via": "193.1.1.2 (33280/30720)"   -    },    -    "193.1.1.0/26": {   +    "193.1.1.1/32": {   @@ -22,7 +14,0 @@   -    },    -    "193.1.2.0/24": {   -        "fd": "30720",    -        "interface": " r1-eth1",    -        "serno": "0",    -        "successors": "1",    -        "via": "193.1.1.2 (30720/28160)"
E   AssertionError: "show ip eigrp topo" mismatches on r1
    assert expected key(s) [u'192.168.1.0/24', u'192.168.3.0/24', u'193.1.1.0/26', u'193.1.2.0/24'] in json["P"] (have ['193.1.1.1/32', '192.168.1.1/32']):
      --- Expected value
      +++ Current value
      @@ -2 +2 @@
      -    "192.168.1.0/24": {
      +    "192.168.1.1/32": {
(18 more lines...)
Collapse Failed test_eigrp_topo1 test_zebra_ipv4_routingTable History
TopoTest Tests on Ubuntu 16.04 i386 < 1 sec
AssertionError: Zebra IPv4 Routing Table verification failed for router r1 assert expected key(s) [u'192.168.3.0/24', u'193.1.2.0/24'] in json (have [u'193.1.1.1/32', u'192.168.1.0/24', u'192.168.1.1/32', u'193.1.1.0/26']):   --- Expected value   +++ Current value   @@ -3,0 +4,29 @@   +            "destSelected": true,    +            "distance": 0,    +            "installed": true,    +            "internalFlags": 8,    +            "internalStatus": 32,    +            "metric": 0,    +            "nexthops": [   +                {   +                    "active": true,    +                    "directlyConnected": true,    +                    "fib": true,    +                    "flags": 3,    +                    "interfaceIndex": 2,    +                    "interfaceName": "r1-eth0"   +                }   +            ],    +            "prefix": "192.168.1.0/24",    +            "protocol": "connected",    +            "selected": true,    +            "uptime": "00:00:11"   +        }   +    ],    +    "192.168.1.1/32": [   +        {   +            "destSelected": true,    +            "distance": 90,    +            "installed": true,    +            "internalFlags": 8,    +            "internalStatus": 34,    @@ -8,0 +38,3 @@   +                    "fib": true,    +                    "flags": 3,    +                    "interfaceIndex": 2,    @@ -12,3 +44,7 @@   -            "prefix": "192.168.1.0/24",    -            "protocol": "eigrp"   -        },    +            "prefix": "192.168.1.1/32",    +            "protocol": "eigrp",    +            "selected": true,    +            "uptime": "00:00:10"   +        }   +    ],    +    "193.1.1.0/26": [   @@ -15,0 +52,6 @@   +            "destSelected": true,    +            "distance": 0,    +            "installed": true,    +            "internalFlags": 8,    +            "internalStatus": 32,    +            "metric": 0,    @@ -21 +63,3 @@   -                    "interfaceName": "r1-eth0"   +                    "flags": 3,    +                    "interfaceIndex": 3,    +                    "interfaceName": "r1-eth1"   @@ -24 +68 @@   -            "prefix": "192.168.1.0/24",    +            "prefix": "193.1.1.0/26",    @@ -26 +70,2 @@   -            "selected": true   +            "selected": true,    +            "uptime": "00:00:11"   @@ -29 +74 @@   -    "192.168.3.0/24": [   +    "193.1.1.1/32": [   @@ -31,17 +76,5 @@   -            "metric": 33280,    -            "nexthops": [   -                {   -                    "active": true,    -                    "afi": "ipv4",    -                    "fib": true,    -                    "interfaceName": "r1-eth1",    -                    "ip": "193.1.1.2"   -                }   -            ],    -            "prefix": "192.168.3.0/24",    -            "protocol": "eigrp",    -            "selected": true   -        }   -    ],    -    "193.1.1.0/26": [   -        {   +            "destSelected": true,    +            "distance": 90,    +            "installed": true,    +            "internalFlags": 8,    +            "internalStatus": 34,    @@ -52,0 +86,3 @@   +                    "fib": true,    +                    "flags": 3,    +                    "interfaceIndex": 3,    @@ -56,30 +92 @@   -            "prefix": "193.1.1.0/26",    -            "protocol": "eigrp"   -        },    -        {   -            "nexthops": [   -                {   -                    "active": true,    -                    "directlyConnected": true,    -                    "fib": true,    -                    "interfaceName": "r1-eth1"   -                }   -            ],    -            "prefix": "193.1.1.0/26",    -            "protocol": "connected",    -            "selected": true   -        }   -    ],    -    "193.1.2.0/24": [   -        {   -            "metric": 30720,    -            "nexthops": [   -                {   -                    "active": true,    -                    "afi": "ipv4",    -                    "fib": true,    -                    "interfaceName": "r1-eth1",    -                    "ip": "193.1.1.2"   -                }   -            ],    -            "prefix": "193.1.2.0/24",    +            "prefix": "193.1.1.1/32",    @@ -87 +94,2 @@   -            "selected": true   +            "selected": true,    +            "uptime": "00:00:10"   json too few items (have 1, expected 2:    --- Expected value   +++ Current value   @@ -3,12 +3,6 @@   -        "metric": 28160,    -        "nexthops": [   -            {   -                "active": true,    -                "directlyConnected": true,    -                "interfaceName": "r1-eth0"   -            }   -        ],    -        "prefix": "192.168.1.0/24",    -        "protocol": "eigrp"   -    },    -    {   +        "destSelected": true,    +        "distance": 0,    +        "installed": true,    +        "internalFlags": 8,    +        "internalStatus": 32,    +        "metric": 0,    @@ -19,0 +14,2 @@   +                "flags": 3,    +                "interfaceIndex": 2,    @@ -25 +21,2 @@   -        "selected": true   +        "selected": true,    +        "uptime": "00:00:11")   json too few items (have 1, expected 2:    --- Expected value   +++ Current value   @@ -3,12 +3,6 @@   -        "metric": 28160,    -        "nexthops": [   -            {   -                "active": true,    -                "directlyConnected": true,    -                "interfaceName": "r1-eth1"   -            }   -        ],    -        "prefix": "193.1.1.0/26",    -        "protocol": "eigrp"   -    },    -    {   +        "destSelected": true,    +        "distance": 0,    +        "installed": true,    +        "internalFlags": 8,    +        "internalStatus": 32,    +        "metric": 0,    @@ -19,0 +14,2 @@   +                "flags": 3,    +                "interfaceIndex": 3,    @@ -25 +21,2 @@   -        "selected": true   +        "selected": true,    +        "uptime": "00:00:11")
E   AssertionError: Zebra IPv4 Routing Table verification failed for router r1
    assert expected key(s) [u'192.168.3.0/24', u'193.1.2.0/24'] in json (have [u'193.1.1.1/32', u'192.168.1.0/24', u'192.168.1.1/32', u'193.1.1.0/26']):
      --- Expected value
      +++ Current value
      @@ -3,0 +4,29 @@
      +            "destSelected": true, 
      +            "distance": 0, 
(185 more lines...)
Collapse Failed test_eigrp_topo1 test_eigrp_routes History
TopoTest Tests on Ubuntu 16.04 i386 < 1 sec
AssertionError: "show ip eigrp topo" mismatches on r1 assert expected key(s) [u'192.168.1.0/24', u'192.168.3.0/24', u'193.1.1.0/26', u'193.1.2.0/24'] in json["P"] (have ['193.1.1.1/32', '192.168.1.1/32']):   --- Expected value   +++ Current value   @@ -2 +2 @@   -    "192.168.1.0/24": {   +    "192.168.1.1/32": {   @@ -9,8 +9 @@   -    "192.168.3.0/24": {   -        "fd": "33280",    -        "interface": " r1-eth1",    -        "serno": "0",    -        "successors": "1",    -        "via": "193.1.1.2 (33280/30720)"   -    },    -    "193.1.1.0/26": {   +    "193.1.1.1/32": {   @@ -22,7 +14,0 @@   -    },    -    "193.1.2.0/24": {   -        "fd": "30720",    -        "interface": " r1-eth1",    -        "serno": "0",    -        "successors": "1",    -        "via": "193.1.1.2 (30720/28160)"
E   AssertionError: "show ip eigrp topo" mismatches on r1
    assert expected key(s) [u'192.168.1.0/24', u'192.168.3.0/24', u'193.1.1.0/26', u'193.1.2.0/24'] in json["P"] (have ['193.1.1.1/32', '192.168.1.1/32']):
      --- Expected value
      +++ Current value
      @@ -2 +2 @@
      -    "192.168.1.0/24": {
      +    "192.168.1.1/32": {
(18 more lines...)
Collapse Failed test_isis_topo1 test_isis_convergence History
Topology Tests on Ubuntu 16.04 amd64 1 min
AssertionError: ISIS did not converge on r4:   json["1"]["level-2"] value is different (   --- Expected value   +++ Current value   @@ -9 +9 @@   -        "vertex": "10.0.21.0/24"   +        "vertex": "10.0.21.1/32"   @@ -33,0 +34,8 @@   +    },    +    {   +        "interface": "r2",    +        "metric": "TE",    +        "next-hop": "20",    +        "parent": "r4-eth0",    +        "type": "IP",    +        "vertex": "10.0.21.2/32")   json["1"]["level-1"] value is different (   --- Expected value   +++ Current value   @@ -9 +9 @@   -        "vertex": "10.0.11.0/24"   +        "vertex": "10.0.11.2/32"   @@ -46,0 +47,17 @@   +        "parent": "r5(4)",    +        "type": "pseudo_TE-IS",    +        "vertex": "r3"   +    },    +    {   +        "interface": "r4-eth1",    +        "metric": "20",    +        "next-hop": "r5",    +        "parent": "r5(4)",    +        "type": "pseudo_TE-IS",    +        "vertex": "r5"   +    },    +    {   +        "interface": "r4-eth1",    +        "metric": "20",    +        "next-hop": "r5",    +        "parent": "r3(2)",    @@ -48,0 +66,16 @@   +    },    +    {   +        "interface": "r5",    +        "metric": "TE",    +        "next-hop": "20",    +        "parent": "r4-eth1",    +        "type": "IP",    +        "vertex": "10.0.10.1/32"   +    },    +    {   +        "interface": "r5",    +        "metric": "TE",    +        "next-hop": "20",    +        "parent": "r4-eth1",    +        "type": "IP",    +        "vertex": "10.0.11.1/32"   @@ -64,0 +98,16 @@   +    },    +    {   +        "interface": "r5",    +        "metric": "TE",    +        "next-hop": "30",    +        "parent": "r4-eth1",    +        "type": "IP",    +        "vertex": "10.0.20.1/32"   +    },    +    {   +        "interface": "r5",    +        "metric": "TE",    +        "next-hop": "30",    +        "parent": "r4-eth1",    +        "type": "IP",    +        "vertex": "10.0.10.2/32") assert False
E   AssertionError: ISIS did not converge on r4:
      json["1"]["level-2"] value is different (
      --- Expected value
      +++ Current value
      @@ -9 +9 @@
      -        "vertex": "10.0.21.0/24"
      +        "vertex": "10.0.21.1/32"
(68 more lines...)
Collapse Failed test_isis_topo1 test_isis_convergence History
Topology Tests on Ubuntu 18.04 amd64 1 min
AssertionError: ISIS did not converge on r4:   json["1"]["level-2"] value is different (   --- Expected value   +++ Current value   @@ -9 +9 @@   -        "vertex": "10.0.21.0/24"   +        "vertex": "10.0.21.1/32"   @@ -33,0 +34,8 @@   +    },    +    {   +        "interface": "r2",    +        "metric": "TE",    +        "next-hop": "20",    +        "parent": "r4-eth0",    +        "type": "IP",    +        "vertex": "10.0.21.2/32")   json["1"]["level-1"] value is different (   --- Expected value   +++ Current value   @@ -9 +9 @@   -        "vertex": "10.0.11.0/24"   +        "vertex": "10.0.11.2/32"   @@ -46,0 +47,17 @@   +        "parent": "r5(4)",    +        "type": "pseudo_TE-IS",    +        "vertex": "r3"   +    },    +    {   +        "interface": "r4-eth1",    +        "metric": "20",    +        "next-hop": "r5",    +        "parent": "r5(4)",    +        "type": "pseudo_TE-IS",    +        "vertex": "r5"   +    },    +    {   +        "interface": "r4-eth1",    +        "metric": "20",    +        "next-hop": "r5",    +        "parent": "r3(2)",    @@ -48,0 +66,16 @@   +    },    +    {   +        "interface": "r5",    +        "metric": "TE",    +        "next-hop": "20",    +        "parent": "r4-eth1",    +        "type": "IP",    +        "vertex": "10.0.10.1/32"   +    },    +    {   +        "interface": "r5",    +        "metric": "TE",    +        "next-hop": "20",    +        "parent": "r4-eth1",    +        "type": "IP",    +        "vertex": "10.0.11.1/32"   @@ -64,0 +98,16 @@   +    },    +    {   +        "interface": "r5",    +        "metric": "TE",    +        "next-hop": "30",    +        "parent": "r4-eth1",    +        "type": "IP",    +        "vertex": "10.0.20.1/32"   +    },    +    {   +        "interface": "r5",    +        "metric": "TE",    +        "next-hop": "30",    +        "parent": "r4-eth1",    +        "type": "IP",    +        "vertex": "10.0.10.2/32") assert False
E   AssertionError: ISIS did not converge on r4:
      json["1"]["level-2"] value is different (
      --- Expected value
      +++ Current value
      @@ -9 +9 @@
      -        "vertex": "10.0.21.0/24"
      +        "vertex": "10.0.21.1/32"
(68 more lines...)
Collapse Failed test_isis_topo1 test_isis_convergence History
TopoTest Tests on Ubuntu 16.04 i386 1 min
AssertionError: ISIS did not converge on r4:   json["1"]["level-2"] value is different (   --- Expected value   +++ Current value   @@ -9 +9 @@   -        "vertex": "10.0.21.0/24"   +        "vertex": "10.0.21.1/32"   @@ -33,0 +34,8 @@   +    },    +    {   +        "interface": "r2",    +        "metric": "TE",    +        "next-hop": "20",    +        "parent": "r4-eth0",    +        "type": "IP",    +        "vertex": "10.0.21.2/32")   json["1"]["level-1"] value is different (   --- Expected value   +++ Current value   @@ -9 +9 @@   -        "vertex": "10.0.11.0/24"   +        "vertex": "10.0.11.2/32"   @@ -46,0 +47,17 @@   +        "parent": "r5(4)",    +        "type": "pseudo_TE-IS",    +        "vertex": "r3"   +    },    +    {   +        "interface": "r4-eth1",    +        "metric": "20",    +        "next-hop": "r5",    +        "parent": "r5(4)",    +        "type": "pseudo_TE-IS",    +        "vertex": "r5"   +    },    +    {   +        "interface": "r4-eth1",    +        "metric": "20",    +        "next-hop": "r5",    +        "parent": "r3(2)",    @@ -48,0 +66,16 @@   +    },    +    {   +        "interface": "r5",    +        "metric": "TE",    +        "next-hop": "20",    +        "parent": "r4-eth1",    +        "type": "IP",    +        "vertex": "10.0.10.1/32"   +    },    +    {   +        "interface": "r5",    +        "metric": "TE",    +        "next-hop": "20",    +        "parent": "r4-eth1",    +        "type": "IP",    +        "vertex": "10.0.11.1/32"   @@ -64,0 +98,16 @@   +    },    +    {   +        "interface": "r5",    +        "metric": "TE",    +        "next-hop": "30",    +        "parent": "r4-eth1",    +        "type": "IP",    +        "vertex": "10.0.20.1/32"   +    },    +    {   +        "interface": "r5",    +        "metric": "TE",    +        "next-hop": "30",    +        "parent": "r4-eth1",    +        "type": "IP",    +        "vertex": "10.0.10.2/32") assert False
E   AssertionError: ISIS did not converge on r4:
      json["1"]["level-2"] value is different (
      --- Expected value
      +++ Current value
      @@ -9 +9 @@
      -        "vertex": "10.0.21.0/24"
      +        "vertex": "10.0.21.1/32"
(68 more lines...)
Collapse Failed test_ldp_topo1 test_mpls_ldp_neighbor_establish History
Topology Tests on Ubuntu 16.04 amd64 1 min
NameError: global name 'ospfStatus' is not defined
E   NameError: global name 'ospfStatus' is not defined
Collapse Failed test_ldp_topo1 test_mpls_ldp_neighbor_establish History
Topology Tests on Ubuntu 18.04 amd64 1 min
NameError: global name 'ospfStatus' is not defined
E   NameError: global name 'ospfStatus' is not defined
Collapse Failed test_ldp_topo1 test_mpls_ldp_neighbor_establish History
TopoTest Tests on Ubuntu 16.04 i386 1 min
NameError: global name 'ospfStatus' is not defined
E   NameError: global name 'ospfStatus' is not defined
Collapse Failed test_ldp_vpls_topo1 test_ldp_bindings History
Topology Tests on Ubuntu 16.04 amd64 1 min
AssertionError: "r1" JSON output mismatches the expected result assert json too few items (have 1, expected 6:    --- Expected value   +++ Current value   @@ -6 +6 @@   -        "neighborId": "2.2.2.2",    +        "neighborId": "0.0.0.0",    @@ -8,41 +8 @@   -        "remoteLabel": "17"   -    },    -    {   -        "addressFamily": "ipv4",    -        "inUse": 0,    -        "localLabel": "imp-null",    -        "neighborId": "3.3.3.3",    -        "prefix": "1.1.1.1/32",    -        "remoteLabel": "16"   -    },    -    {   -        "addressFamily": "ipv4",    -        "inUse": 1,    -        "localLabel": "17",    -        "neighborId": "2.2.2.2",    -        "prefix": "2.2.2.2/32",    -        "remoteLabel": "imp-null"   -    },    -    {   -        "addressFamily": "ipv4",    -        "inUse": 0,    -        "localLabel": "17",    -        "neighborId": "3.3.3.3",    -        "prefix": "2.2.2.2/32",    -        "remoteLabel": "17"   -    },    -    {   -        "addressFamily": "ipv4",    -        "inUse": 0,    -        "localLabel": "18",    -        "neighborId": "2.2.2.2",    -        "prefix": "3.3.3.3/32",    -        "remoteLabel": "18"   -    },    -    {   -        "addressFamily": "ipv4",    -        "inUse": 1,    -        "localLabel": "18",    -        "neighborId": "3.3.3.3",    -        "prefix": "3.3.3.3/32",    -        "remoteLabel": "imp-null"   +        "remoteLabel": "-")
E   AssertionError: "r1" JSON output mismatches the expected result
    assert json too few items (have 1, expected 6:
       --- Expected value
      +++ Current value
      @@ -6 +6 @@
      -        "neighborId": "2.2.2.2", 
      +        "neighborId": "0.0.0.0", 
(43 more lines...)
Collapse Failed test_ldp_vpls_topo1 test_ospf_convergence History
Topology Tests on Ubuntu 16.04 amd64 1 min
AssertionError: "r1" JSON output mismatches the expected result assert expected key(s) [u'2.2.2.2', u'3.3.3.3'] in json["neighbors"] (have []):   --- Expected value   +++ Current value   @@ -1,24 +1 @@   -{   -    "2.2.2.2": [   -        {   -            "address": "10.0.1.2",    -            "dbSummaryCounter": 0,    -            "ifaceName": "r1-eth1:10.0.1.1",    -            "priority": 1,    -            "requestCounter": 0,    -            "retransmitCounter": 0,    -            "state": "Full/DR"   -        }   -    ],    -    "3.3.3.3": [   -        {   -            "address": "10.0.2.3",    -            "dbSummaryCounter": 0,    -            "ifaceName": "r1-eth2:10.0.2.1",    -            "priority": 1,    -            "requestCounter": 0,    -            "retransmitCounter": 0,    -            "state": "Full/DR"   -        }   -    ]   -}   +{}
E   AssertionError: "r1" JSON output mismatches the expected result
    assert expected key(s) [u'2.2.2.2', u'3.3.3.3'] in json["neighbors"] (have []):
      --- Expected value
      +++ Current value
      @@ -1,24 +1 @@
      -{
      -    "2.2.2.2": [
(23 more lines...)
Collapse Failed test_ldp_vpls_topo1 test_ldp_pseudowires_after_link_down History
Topology Tests on Ubuntu 16.04 amd64 1 min
AssertionError: "r1" JSON output mismatches the expected result assert json["r1-mpw0"]["status"] value is different (   --- Expected value   +++ Current value   @@ -1 +1 @@   -"up"   +"down")
E   AssertionError: "r1" JSON output mismatches the expected result
    assert json["r1-mpw0"]["status"] value is different (
      --- Expected value
      +++ Current value
      @@ -1 +1 @@
      -"up"
      +"down")
Collapse Failed test_ldp_vpls_topo1 test_ldp_adjacencies History
Topology Tests on Ubuntu 16.04 amd64 1 min
AssertionError: "r1" JSON output mismatches the expected result assert json too few items (have 2, expected 3:    --- Expected value   +++ Current value   @@ -11,7 +10,0 @@   -        "helloHoldtime": 45,    -        "neighborId": "2.2.2.2",    -        "peer": "2.2.2.2",    -        "type": "targeted"   -    },    -    {   -        "addressFamily": "ipv4", )
E   AssertionError: "r1" JSON output mismatches the expected result
    assert json too few items (have 2, expected 3:
       --- Expected value
      +++ Current value
      @@ -11,7 +10,0 @@
      -        "helloHoldtime": 45, 
      -        "neighborId": "2.2.2.2", 
(5 more lines...)
Collapse Failed test_ldp_vpls_topo1 test_ldp_pwid_bindings History
Topology Tests on Ubuntu 16.04 amd64 1 min
AssertionError: "r1" JSON output mismatches the expected result assert expected key(s) [u'remoteGroupID', u'remoteControlWord', u'remoteIfMtu', u'remoteVcType'] in json["2.2.2.2: 100"] (have [u'localIfMtu', u'destination', u'remoteLabel', u'localVcType', u'localGroupID', u'localLabel', u'localControlWord', u'vcId']):   --- Expected value   +++ Current value   @@ -8,5 +8 @@   -    "remoteControlWord": 1,    -    "remoteGroupID": 0,    -    "remoteIfMtu": 1500,    -    "remoteLabel": 16,    -    "remoteVcType": "Ethernet",    +    "remoteLabel": "unassigned",    json["2.2.2.2: 100"]["remoteLabel"] value is different (   --- Expected value   +++ Current value   @@ -1 +1 @@   -16   +"unassigned")
E   AssertionError: "r1" JSON output mismatches the expected result
    assert expected key(s) [u'remoteGroupID', u'remoteControlWord', u'remoteIfMtu', u'remoteVcType'] in json["2.2.2.2: 100"] (have [u'localIfMtu', u'destination', u'remoteLabel', u'localVcType', u'localGroupID', u'localLabel', u'localControlWord', u'vcId']):
      --- Expected value
      +++ Current value
      @@ -8,5 +8 @@
      -    "remoteControlWord": 1, 
      -    "remoteGroupID": 0, 
(10 more lines...)
Collapse Failed test_ldp_vpls_topo1 test_ldp_pseudowires History
Topology Tests on Ubuntu 16.04 amd64 1 min
AssertionError: "r1" JSON output mismatches the expected result assert json["r1-mpw0"]["status"] value is different (   --- Expected value   +++ Current value   @@ -1 +1 @@   -"up"   +"down")
E   AssertionError: "r1" JSON output mismatches the expected result
    assert json["r1-mpw0"]["status"] value is different (
      --- Expected value
      +++ Current value
      @@ -1 +1 @@
      -"up"
      +"down")
Collapse Failed test_ldp_vpls_topo1 test_ldp_neighbors History
Topology Tests on Ubuntu 16.04 amd64 1 min
AssertionError: "r1" JSON output mismatches the expected result assert expected key(s) [u'neighbors'] in json (have []):   --- Expected value   +++ Current value   @@ -1,16 +1 @@   -{   -    "neighbors": [   -        {   -            "addressFamily": "ipv4",    -            "neighborId": "2.2.2.2",    -            "state": "OPERATIONAL",    -            "transportAddress": "2.2.2.2"   -        },    -        {   -            "addressFamily": "ipv4",    -            "neighborId": "3.3.3.3",    -            "state": "OPERATIONAL",    -            "transportAddress": "3.3.3.3"   -        }   -    ]   -}   +{}
E   AssertionError: "r1" JSON output mismatches the expected result
    assert expected key(s) [u'neighbors'] in json (have []):
      --- Expected value
      +++ Current value
      @@ -1,16 +1 @@
      -{
      -    "neighbors": [
(15 more lines...)
Collapse Failed test_ldp_vpls_topo1 test_rib History
Topology Tests on Ubuntu 16.04 amd64 1 min
AssertionError: "r1" JSON output mismatches the expected result assert expected key(s) [u'2.2.2.2/32', u'3.3.3.3/32', u'10.0.3.0/24'] in json (have [u'1.1.1.1/32', u'10.0.1.0/24', u'10.0.2.0/24', u'10.0.1.1/32', u'10.0.2.1/32']):   --- Expected value   +++ Current value   @@ -4,0 +5,2 @@   +            "internalFlags": 0,    +            "internalStatus": 0,    @@ -9,0 +12 @@   +                    "flags": 1,    @@ -15 +18,2 @@   -            "protocol": "ospf"   +            "protocol": "ospf",    +            "uptime": "00:03:41"   @@ -17,0 +22,6 @@   +            "destSelected": true,    +            "distance": 0,    +            "installed": true,    +            "internalFlags": 8,    +            "internalStatus": 32,    +            "metric": 0,    @@ -22,0 +33 @@   +                    "flags": 3,    @@ -29 +40,2 @@   -            "selected": true   +            "selected": true,    +            "uptime": "00:03:42"   @@ -34,14 +46,6 @@   -            "distance": 110,    -            "metric": 10,    -            "nexthops": [   -                {   -                    "active": true,    -                    "directlyConnected": true,    -                    "interfaceIndex": 3,    -                    "interfaceName": "r1-eth1"   -                }   -            ],    -            "prefix": "10.0.1.0/24",    -            "protocol": "ospf"   -        },    -        {   +            "destSelected": true,    +            "distance": 0,    +            "installed": true,    +            "internalFlags": 8,    +            "internalStatus": 32,    +            "metric": 0,    @@ -52,0 +57 @@   +                    "flags": 3,    @@ -59 +64,27 @@   -            "selected": true   +            "selected": true,    +            "uptime": "00:03:42"   +        }   +    ],    +    "10.0.1.1/32": [   +        {   +            "destSelected": true,    +            "distance": 110,    +            "failed": true,    +            "internalFlags": 8,    +            "internalStatus": 66,    +            "metric": 10,    +            "nexthops": [   +                {   +                    "active": true,    +                    "afi": "ipv4",    +                    "flags": 9,    +                    "interfaceIndex": 3,    +                    "interfaceName": "r1-eth1",    +                    "ip": "0.0.0.0",    +                    "onLink": true   +                }   +            ],    +            "prefix": "10.0.1.1/32",    +            "protocol": "ospf",    +            "selected": true,    +            "uptime": "00:03:41"   @@ -64,14 +95,6 @@   -            "distance": 110,    -            "metric": 10,    -            "nexthops": [   -                {   -                    "active": true,    -                    "directlyConnected": true,    -                    "interfaceIndex": 4,    -                    "interfaceName": "r1-eth2"   -                }   -            ],    -            "prefix": "10.0.2.0/24",    -            "protocol": "ospf"   -        },    -        {   +            "destSelected": true,    +            "distance": 0,    +            "installed": true,    +            "internalFlags": 8,    +            "internalStatus": 32,    +            "metric": 0,    @@ -82,0 +106 @@   +                    "flags": 3,    @@ -89 +113,2 @@   -            "selected": true   +            "selected": true,    +            "uptime": "00:03:42"   @@ -92 +117 @@   -    "10.0.3.0/24": [   +    "10.0.2.1/32": [   @@ -93,0 +119 @@   +            "destSelected": true,    @@ -95,27 +121,3 @@   -            "metric": 20,    -            "nexthops": [   -                {   -                    "active": true,    -                    "afi": "ipv4",    -                    "fib": true,    -                    "interfaceIndex": 3,    -                    "interfaceName": "r1-eth1",    -                    "ip": "10.0.1.2"   -                },    -                {   -                    "active": true,    -                    "afi": "ipv4",    -                    "fib": true,    -                    "interfaceIndex": 4,    -                    "interfaceName": "r1-eth2",    -                    "ip": "10.0.2.3"   -                }   -            ],    -            "prefix": "10.0.3.0/24",    -            "protocol": "ospf",    -            "selected": true   -        }   -    ],    -    "2.2.2.2/32": [   -        {   -            "distance": 110,    +            "failed": true,    +            "internalFlags": 8,    +            "internalStatus": 66,    @@ -127,4 +129,5 @@   -                    "fib": true,    -                    "interfaceIndex": 3,    -                    "interfaceName": "r1-eth1",    -                    "ip": "10.0.1.2"   +                    "flags": 9,    +                    "interfaceIndex": 4,    +                    "interfaceName": "r1-eth2",    +                    "ip": "0.0.0.0",    +                    "onLink": true   @@ -133 +136 @@   -            "prefix": "2.2.2.2/32",    +            "prefix": "10.0.2.1/32",    @@ -135,20 +138,2 @@   -            "selected": true   -        }   -    ],    -    "3.3.3.3/32": [   -        {   -            "distance": 110,    -            "metric": 10,    -            "nexthops": [   -                {   -                    "active": true,    -                    "afi": "ipv4",    -                    "fib": true,    -                    "interfaceIndex": 4,    -                    "interfaceName": "r1-eth2",    -                    "ip": "10.0.2.3"   -                }   -            ],    -            "prefix": "3.3.3.3/32",    -            "protocol": "ospf",    -            "selected": true   +            "selected": true,    +            "uptime": "00:03:41"   json too few items (have 1, expected 2:    --- Expected value   +++ Current value   @@ -3,14 +3,6 @@   -        "distance": 110,    -        "metric": 10,    -        "nexthops": [   -            {   -                "active": true,    -                "directlyConnected": true,    -                "interfaceIndex": 3,    -                "interfaceName": "r1-eth1"   -            }   -        ],    -        "prefix": "10.0.1.0/24",    -        "protocol": "ospf"   -    },    -    {   +        "destSelected": true,    +        "distance": 0,    +        "installed": true,    +        "internalFlags": 8,    +        "internalStatus": 32,    +        "metric": 0,    @@ -21,0 +14 @@   +                "flags": 3,    @@ -28 +21,2 @@   -        "selected": true   +        "selected": true,    +        "uptime": "00:03:42")   json too few items (have 1, expected 2:    --- Expected value   +++ Current value   @@ -3,14 +3,6 @@   -        "distance": 110,    -        "metric": 10,    -        "nexthops": [   -            {   -                "active": true,    -                "directlyConnected": true,    -                "interfaceIndex": 4,    -                "interfaceName": "r1-eth2"   -            }   -        ],    -        "prefix": "10.0.2.0/24",    -        "protocol": "ospf"   -    },    -    {   +        "destSelected": true,    +        "distance": 0,    +        "installed": true,    +        "internalFlags": 8,    +        "internalStatus": 32,    +        "metric": 0,    @@ -21,0 +14 @@   +                "flags": 3,    @@ -28 +21,2 @@   -        "selected": true   +        "selected": true,    +        "uptime": "00:03:42")
E   AssertionError: "r1" JSON output mismatches the expected result
    assert expected key(s) [u'2.2.2.2/32', u'3.3.3.3/32', u'10.0.3.0/24'] in json (have [u'1.1.1.1/32', u'10.0.1.0/24', u'10.0.2.0/24', u'10.0.1.1/32', u'10.0.2.1/32']):
      --- Expected value
      +++ Current value
      @@ -4,0 +5,2 @@
      +            "internalFlags": 0, 
      +            "internalStatus": 0, 
(230 more lines...)
Collapse Failed test_ldp_vpls_topo1 test_ldp_bindings History
Topology Tests on Ubuntu 18.04 amd64 1 min
AssertionError: "r1" JSON output mismatches the expected result assert json too few items (have 1, expected 6:    --- Expected value   +++ Current value   @@ -6 +6 @@   -        "neighborId": "2.2.2.2",    +        "neighborId": "0.0.0.0",    @@ -8,41 +8 @@   -        "remoteLabel": "17"   -    },    -    {   -        "addressFamily": "ipv4",    -        "inUse": 0,    -        "localLabel": "imp-null",    -        "neighborId": "3.3.3.3",    -        "prefix": "1.1.1.1/32",    -        "remoteLabel": "16"   -    },    -    {   -        "addressFamily": "ipv4",    -        "inUse": 1,    -        "localLabel": "17",    -        "neighborId": "2.2.2.2",    -        "prefix": "2.2.2.2/32",    -        "remoteLabel": "imp-null"   -    },    -    {   -        "addressFamily": "ipv4",    -        "inUse": 0,    -        "localLabel": "17",    -        "neighborId": "3.3.3.3",    -        "prefix": "2.2.2.2/32",    -        "remoteLabel": "17"   -    },    -    {   -        "addressFamily": "ipv4",    -        "inUse": 0,    -        "localLabel": "18",    -        "neighborId": "2.2.2.2",    -        "prefix": "3.3.3.3/32",    -        "remoteLabel": "18"   -    },    -    {   -        "addressFamily": "ipv4",    -        "inUse": 1,    -        "localLabel": "18",    -        "neighborId": "3.3.3.3",    -        "prefix": "3.3.3.3/32",    -        "remoteLabel": "imp-null"   +        "remoteLabel": "-")
E   AssertionError: "r1" JSON output mismatches the expected result
    assert json too few items (have 1, expected 6:
       --- Expected value
      +++ Current value
      @@ -6 +6 @@
      -        "neighborId": "2.2.2.2", 
      +        "neighborId": "0.0.0.0", 
(43 more lines...)
Collapse Failed test_ldp_vpls_topo1 test_rib History
Topology Tests on Ubuntu 18.04 amd64 1 min
AssertionError: "r1" JSON output mismatches the expected result assert expected key(s) [u'2.2.2.2/32', u'3.3.3.3/32', u'10.0.3.0/24'] in json (have [u'1.1.1.1/32', u'10.0.1.0/24', u'10.0.2.0/24', u'10.0.1.1/32', u'10.0.2.1/32']):   --- Expected value   +++ Current value   @@ -4,0 +5,2 @@   +            "internalFlags": 0,    +            "internalStatus": 0,    @@ -9,0 +12 @@   +                    "flags": 1,    @@ -15 +18,2 @@   -            "protocol": "ospf"   +            "protocol": "ospf",    +            "uptime": "00:03:32"   @@ -17,0 +22,6 @@   +            "destSelected": true,    +            "distance": 0,    +            "installed": true,    +            "internalFlags": 8,    +            "internalStatus": 32,    +            "metric": 0,    @@ -22,0 +33 @@   +                    "flags": 3,    @@ -29 +40,2 @@   -            "selected": true   +            "selected": true,    +            "uptime": "00:03:33"   @@ -34,14 +46,6 @@   -            "distance": 110,    -            "metric": 10,    -            "nexthops": [   -                {   -                    "active": true,    -                    "directlyConnected": true,    -                    "interfaceIndex": 3,    -                    "interfaceName": "r1-eth1"   -                }   -            ],    -            "prefix": "10.0.1.0/24",    -            "protocol": "ospf"   -        },    -        {   +            "destSelected": true,    +            "distance": 0,    +            "installed": true,    +            "internalFlags": 8,    +            "internalStatus": 32,    +            "metric": 0,    @@ -52,0 +57 @@   +                    "flags": 3,    @@ -59 +64,27 @@   -            "selected": true   +            "selected": true,    +            "uptime": "00:03:33"   +        }   +    ],    +    "10.0.1.1/32": [   +        {   +            "destSelected": true,    +            "distance": 110,    +            "failed": true,    +            "internalFlags": 8,    +            "internalStatus": 66,    +            "metric": 10,    +            "nexthops": [   +                {   +                    "active": true,    +                    "afi": "ipv4",    +                    "flags": 9,    +                    "interfaceIndex": 3,    +                    "interfaceName": "r1-eth1",    +                    "ip": "0.0.0.0",    +                    "onLink": true   +                }   +            ],    +            "prefix": "10.0.1.1/32",    +            "protocol": "ospf",    +            "selected": true,    +            "uptime": "00:03:32"   @@ -64,14 +95,6 @@   -            "distance": 110,    -            "metric": 10,    -            "nexthops": [   -                {   -                    "active": true,    -                    "directlyConnected": true,    -                    "interfaceIndex": 4,    -                    "interfaceName": "r1-eth2"   -                }   -            ],    -            "prefix": "10.0.2.0/24",    -            "protocol": "ospf"   -        },    -        {   +            "destSelected": true,    +            "distance": 0,    +            "installed": true,    +            "internalFlags": 8,    +            "internalStatus": 32,    +            "metric": 0,    @@ -82,0 +106 @@   +                    "flags": 3,    @@ -89 +113,2 @@   -            "selected": true   +            "selected": true,    +            "uptime": "00:03:33"   @@ -92 +117 @@   -    "10.0.3.0/24": [   +    "10.0.2.1/32": [   @@ -93,0 +119 @@   +            "destSelected": true,    @@ -95,27 +121,3 @@   -            "metric": 20,    -            "nexthops": [   -                {   -                    "active": true,    -                    "afi": "ipv4",    -                    "fib": true,    -                    "interfaceIndex": 3,    -                    "interfaceName": "r1-eth1",    -                    "ip": "10.0.1.2"   -                },    -                {   -                    "active": true,    -                    "afi": "ipv4",    -                    "fib": true,    -                    "interfaceIndex": 4,    -                    "interfaceName": "r1-eth2",    -                    "ip": "10.0.2.3"   -                }   -            ],    -            "prefix": "10.0.3.0/24",    -            "protocol": "ospf",    -            "selected": true   -        }   -    ],    -    "2.2.2.2/32": [   -        {   -            "distance": 110,    +            "failed": true,    +            "internalFlags": 8,    +            "internalStatus": 66,    @@ -127,4 +129,5 @@   -                    "fib": true,    -                    "interfaceIndex": 3,    -                    "interfaceName": "r1-eth1",    -                    "ip": "10.0.1.2"   +                    "flags": 9,    +                    "interfaceIndex": 4,    +                    "interfaceName": "r1-eth2",    +                    "ip": "0.0.0.0",    +                    "onLink": true   @@ -133 +136 @@   -            "prefix": "2.2.2.2/32",    +            "prefix": "10.0.2.1/32",    @@ -135,20 +138,2 @@   -            "selected": true   -        }   -    ],    -    "3.3.3.3/32": [   -        {   -            "distance": 110,    -            "metric": 10,    -            "nexthops": [   -                {   -                    "active": true,    -                    "afi": "ipv4",    -                    "fib": true,    -                    "interfaceIndex": 4,    -                    "interfaceName": "r1-eth2",    -                    "ip": "10.0.2.3"   -                }   -            ],    -            "prefix": "3.3.3.3/32",    -            "protocol": "ospf",    -            "selected": true   +            "selected": true,    +            "uptime": "00:03:32"   json too few items (have 1, expected 2:    --- Expected value   +++ Current value   @@ -3,14 +3,6 @@   -        "distance": 110,    -        "metric": 10,    -        "nexthops": [   -            {   -                "active": true,    -                "directlyConnected": true,    -                "interfaceIndex": 3,    -                "interfaceName": "r1-eth1"   -            }   -        ],    -        "prefix": "10.0.1.0/24",    -        "protocol": "ospf"   -    },    -    {   +        "destSelected": true,    +        "distance": 0,    +        "installed": true,    +        "internalFlags": 8,    +        "internalStatus": 32,    +        "metric": 0,    @@ -21,0 +14 @@   +                "flags": 3,    @@ -28 +21,2 @@   -        "selected": true   +        "selected": true,    +        "uptime": "00:03:33")   json too few items (have 1, expected 2:    --- Expected value   +++ Current value   @@ -3,14 +3,6 @@   -        "distance": 110,    -        "metric": 10,    -        "nexthops": [   -            {   -                "active": true,    -                "directlyConnected": true,    -                "interfaceIndex": 4,    -                "interfaceName": "r1-eth2"   -            }   -        ],    -        "prefix": "10.0.2.0/24",    -        "protocol": "ospf"   -    },    -    {   +        "destSelected": true,    +        "distance": 0,    +        "installed": true,    +        "internalFlags": 8,    +        "internalStatus": 32,    +        "metric": 0,    @@ -21,0 +14 @@   +                "flags": 3,    @@ -28 +21,2 @@   -        "selected": true   +        "selected": true,    +        "uptime": "00:03:33")
E   AssertionError: "r1" JSON output mismatches the expected result
    assert expected key(s) [u'2.2.2.2/32', u'3.3.3.3/32', u'10.0.3.0/24'] in json (have [u'1.1.1.1/32', u'10.0.1.0/24', u'10.0.2.0/24', u'10.0.1.1/32', u'10.0.2.1/32']):
      --- Expected value
      +++ Current value
      @@ -4,0 +5,2 @@
      +            "internalFlags": 0, 
      +            "internalStatus": 0, 
(230 more lines...)
Collapse Failed test_ldp_vpls_topo1 test_ldp_pseudowires_after_link_down History
Topology Tests on Ubuntu 18.04 amd64 1 min
AssertionError: "r1" JSON output mismatches the expected result assert json["r1-mpw0"]["status"] value is different (   --- Expected value   +++ Current value   @@ -1 +1 @@   -"up"   +"down")
E   AssertionError: "r1" JSON output mismatches the expected result
    assert json["r1-mpw0"]["status"] value is different (
      --- Expected value
      +++ Current value
      @@ -1 +1 @@
      -"up"
      +"down")
Collapse Failed test_ldp_vpls_topo1 test_ospf_convergence History
Topology Tests on Ubuntu 18.04 amd64 1 min
AssertionError: "r1" JSON output mismatches the expected result assert expected key(s) [u'2.2.2.2', u'3.3.3.3'] in json["neighbors"] (have []):   --- Expected value   +++ Current value   @@ -1,24 +1 @@   -{   -    "2.2.2.2": [   -        {   -            "address": "10.0.1.2",    -            "dbSummaryCounter": 0,    -            "ifaceName": "r1-eth1:10.0.1.1",    -            "priority": 1,    -            "requestCounter": 0,    -            "retransmitCounter": 0,    -            "state": "Full/DR"   -        }   -    ],    -    "3.3.3.3": [   -        {   -            "address": "10.0.2.3",    -            "dbSummaryCounter": 0,    -            "ifaceName": "r1-eth2:10.0.2.1",    -            "priority": 1,    -            "requestCounter": 0,    -            "retransmitCounter": 0,    -            "state": "Full/DR"   -        }   -    ]   -}   +{}
E   AssertionError: "r1" JSON output mismatches the expected result
    assert expected key(s) [u'2.2.2.2', u'3.3.3.3'] in json["neighbors"] (have []):
      --- Expected value
      +++ Current value
      @@ -1,24 +1 @@
      -{
      -    "2.2.2.2": [
(23 more lines...)
Collapse Failed test_ldp_vpls_topo1 test_ldp_pwid_bindings History
Topology Tests on Ubuntu 18.04 amd64 1 min
AssertionError: "r1" JSON output mismatches the expected result assert expected key(s) [u'remoteGroupID', u'remoteControlWord', u'remoteIfMtu', u'remoteVcType'] in json["2.2.2.2: 100"] (have [u'localIfMtu', u'destination', u'remoteLabel', u'localVcType', u'localGroupID', u'localLabel', u'localControlWord', u'vcId']):   --- Expected value   +++ Current value   @@ -8,5 +8 @@   -    "remoteControlWord": 1,    -    "remoteGroupID": 0,    -    "remoteIfMtu": 1500,    -    "remoteLabel": 16,    -    "remoteVcType": "Ethernet",    +    "remoteLabel": "unassigned",    json["2.2.2.2: 100"]["remoteLabel"] value is different (   --- Expected value   +++ Current value   @@ -1 +1 @@   -16   +"unassigned")
E   AssertionError: "r1" JSON output mismatches the expected result
    assert expected key(s) [u'remoteGroupID', u'remoteControlWord', u'remoteIfMtu', u'remoteVcType'] in json["2.2.2.2: 100"] (have [u'localIfMtu', u'destination', u'remoteLabel', u'localVcType', u'localGroupID', u'localLabel', u'localControlWord', u'vcId']):
      --- Expected value
      +++ Current value
      @@ -8,5 +8 @@
      -    "remoteControlWord": 1, 
      -    "remoteGroupID": 0, 
(10 more lines...)
Collapse Failed test_ldp_vpls_topo1 test_ldp_adjacencies History
Topology Tests on Ubuntu 18.04 amd64 1 min
AssertionError: "r1" JSON output mismatches the expected result assert json too few items (have 2, expected 3:    --- Expected value   +++ Current value   @@ -11,7 +10,0 @@   -        "helloHoldtime": 45,    -        "neighborId": "2.2.2.2",    -        "peer": "2.2.2.2",    -        "type": "targeted"   -    },    -    {   -        "addressFamily": "ipv4", )
E   AssertionError: "r1" JSON output mismatches the expected result
    assert json too few items (have 2, expected 3:
       --- Expected value
      +++ Current value
      @@ -11,7 +10,0 @@
      -        "helloHoldtime": 45, 
      -        "neighborId": "2.2.2.2", 
(5 more lines...)