Testing PullReq against Topology Tests

Build: #390 failed Custom build by Github Hook with revision master

Test results

  • 1,270 tests in total
  • 11 tests failed
  • 11 failures are new
  • 215 tests were quarantined / skipped
  • 225 minutes taken in total.
New test failures 11
Status Test View job Duration
Collapse Failed test_bgp_l3vpn_to_bgp_direct test_adjacencies History
TopoTest Master arm7 1 min
AssertionError: 3 tests failed
E   AssertionError: 3 tests failed
Collapse Failed test_bgp_rfapi_basic_sanity_config2 test_adjacencies History
TopoTest Master arm7 1 min
AssertionError: 3 tests failed
E   AssertionError: 3 tests failed
Collapse Failed test_bgp_rfapi_basic_sanity test_adjacencies History
TopoTest Master arm7 1 min
AssertionError: 3 tests failed
E   AssertionError: 3 tests failed
Collapse Failed test_ldp_topo1 test_zebra_ipv4_routingTable History
TopoTest Master arm7 1 sec
AssertionError: IPv4 Zebra Routing Table verification failed for router r2:   --- actual IPv4 zebra routing table   +++ expected IPv4 zebra routing table   @@ -1,6 +1,6 @@    O>* 1.1.1.1/32 [110/10] via 10.0.1.1, r2-eth0, label implicit-null    O   2.2.2.2/32 [110/0] is directly connected, lo   -O>  3.3.3.3/32 [110/10] via 10.0.2.3, r2-eth1   +O>* 3.3.3.3/32 [110/10] via 10.0.2.3, r2-eth1, label implicit-null    O>* 4.4.4.4/32 [110/10] via 10.0.2.4, r2-eth1, label implicit-null    O   10.0.1.0/24 [110/10] is directly connected, r2-eth0    O   10.0.2.0/24 [110/10] is directly connected, r2-eth1 assert 1 == 0
E   AssertionError: IPv4 Zebra Routing Table verification failed for router r2:
      --- actual IPv4 zebra routing table
      +++ expected IPv4 zebra routing table
      @@ -1,6 +1,6 @@
       O>* 1.1.1.1/32 [110/10] via 10.0.1.1, r2-eth0, label implicit-null
       O   2.2.2.2/32 [110/0] is directly connected, lo
      -O>  3.3.3.3/32 [110/10] via 10.0.2.3, r2-eth1
(5 more lines...)
Collapse Failed test_ldp_topo1 test_mpls_table History
TopoTest Master arm7 2 secs
AssertionError: MPLS table output for router r2:   --- actual MPLS table output   +++ expected MPLS table output   @@ -2,5 +2,6 @@       Label     Type          Nexthop     Label    --------  -------  ---------------  --------          XX      LDP         10.0.1.1  implicit-null   +      XX      LDP         10.0.2.3  implicit-null          XX      LDP         10.0.2.4  implicit-null          XX      LDP         10.0.3.3  implicit-null assert 1 == 0
E   AssertionError: MPLS table output for router r2:
      --- actual MPLS table output
      +++ expected MPLS table output
      @@ -2,5 +2,6 @@
          Label     Type          Nexthop     Label
       --------  -------  ---------------  --------
             XX      LDP         10.0.1.1  implicit-null
(4 more lines...)
Collapse Failed test_ldp_topo1 test_linux_mpls_routes History
TopoTest Master arm7 < 1 sec
AssertionError: Linux Kernel MPLS route output for router r2:   --- actual Linux Kernel MPLS route   +++ expected Linux Kernel MPLS route   @@ -1,3 +1,3 @@   +xx proto xx nexthopvia inet 10.0.2.3 dev r2-eth1 nexthopvia inet 10.0.3.3 dev r2-eth2    xx via inet 10.0.1.1 dev r2-eth0 proto xx    xx via inet 10.0.2.4 dev r2-eth1 proto xx   -xx via inet 10.0.3.3 dev r2-eth2 proto xx assert 1 == 0
E   AssertionError: Linux Kernel MPLS route output for router r2:
      --- actual Linux Kernel MPLS route
      +++ expected Linux Kernel MPLS route
      @@ -1,3 +1,3 @@
      +xx proto xx nexthopvia inet 10.0.2.3 dev r2-eth1 nexthopvia inet 10.0.3.3 dev r2-eth2
       xx via inet 10.0.1.1 dev r2-eth0 proto xx
       xx via inet 10.0.2.4 dev r2-eth1 proto xx
(2 more lines...)
Collapse Failed test_ldp_topo1 test_mpls_ldp_binding History
TopoTest Master arm7 1 sec
AssertionError: MPLS LDP Interface binding output for router r2:   --- actual MPLS LDP binding output   +++ expected MPLS LDP binding output   @@ -1,5 +1,6 @@    AF   Destination          Nexthop         Local Label Remote Label  In Use    ipv4 1.1.1.1/32           1.1.1.1         xxx         imp-null         yes   +ipv4 1.1.1.1/32           3.3.3.3         xxx         xxx               no    ipv4 1.1.1.1/32           4.4.4.4         xxx         xxx               no    ipv4 2.2.2.2/32           1.1.1.1         imp-null    xxx               no    ipv4 2.2.2.2/32           3.3.3.3         imp-null    xxx               no assert 1 == 0
E   AssertionError: MPLS LDP Interface binding output for router r2:
      --- actual MPLS LDP binding output
      +++ expected MPLS LDP binding output
      @@ -1,5 +1,6 @@
       AF   Destination          Nexthop         Local Label Remote Label  In Use
       ipv4 1.1.1.1/32           1.1.1.1         xxx         imp-null         yes
      +ipv4 1.1.1.1/32           3.3.3.3         xxx         xxx               no
(4 more lines...)
Collapse Failed test_ldp_vpls_topo1 test_rib History
TopoTest Master arm7 3 mins
AssertionError: "r1" JSON output mismatches the expected result assert json value is different (   --- Expected value   +++ Current value   @@ -3,0 +4,2 @@   +        "internalFlags": 16,    +        "internalStatus": 2,    @@ -9 +11 @@   -                "fib": true,    +                "flags": 1,    @@ -17 +19 @@   -                "fib": true,    +                "flags": 1,    @@ -25 +27,2 @@   -        "selected": true   +        "selected": true,    +        "uptime": "00:04:05")
E   AssertionError: "r1" JSON output mismatches the expected result
    assert json value is different (
      --- Expected value
      +++ Current value
      @@ -3,0 +4,2 @@
      +        "internalFlags": 16, 
      +        "internalStatus": 2, 
(10 more lines...)
Collapse Failed test_pim test_pim_igmp_report History
TopoTest 3.0 Branch < 1 sec
KeyError: '229.1.1.2'
E   KeyError: '229.1.1.2'
Collapse Failed test_pim test_pim_igmp_report History
TopoTest Master arm7 1 sec
KeyError: '229.1.1.2'
E   KeyError: '229.1.1.2'
Collapse Failed test_pim test_pim_send_mcast_stream History
TopoTest Master arm7 16 secs
KeyError: '229.1.1.1'
E   KeyError: '229.1.1.1'
Skipped tests 100
Status Test Failing since View job
Skipped test_all_protocol_startup test_shutdown_check_stderr History
AddressSanitizer
Skipped test_all_protocol_startup test_mpls_interfaces History
TopoTest Master arm8
Skipped test_bfd_topo1 test_bfd_connection History
TopoTest 2.0 Branch
Skipped test_bfd_topo1 test_bfd_fast_convergence History
TopoTest 2.0 Branch
Skipped test_bfd_topo1 test_bgp_fast_reconvergence History
TopoTest 2.0 Branch
Skipped test_bfd_topo1 test_memory_leak History
TopoTest 2.0 Branch
Skipped test_bfd_topo1 test_bgp_convergence History
TopoTest 2.0 Branch
Skipped test_bfd_topo1 test_bgp_fast_convergence History
TopoTest 2.0 Branch
Skipped test_bfd_topo1 test_bfd_connection History
TopoTest 3.0 Branch
Skipped test_bfd_topo1 test_memory_leak History
TopoTest 3.0 Branch
Skipped test_bfd_topo1 test_bgp_fast_reconvergence History
TopoTest 3.0 Branch
Skipped test_bfd_topo1 test_bgp_convergence History
TopoTest 3.0 Branch
Skipped test_bfd_topo1 test_bfd_fast_convergence History
TopoTest 3.0 Branch
Skipped test_bfd_topo1 test_bgp_fast_convergence History
TopoTest 3.0 Branch
Skipped test_bfd_topo1 test_bgp_fast_convergence History
TopoTest 4.0 Branch
Skipped test_bfd_topo1 test_bfd_fast_convergence History
TopoTest 4.0 Branch
Skipped test_bfd_topo1 test_bgp_fast_reconvergence History
TopoTest 4.0 Branch
Skipped test_bfd_topo1 test_bfd_connection History
TopoTest 4.0 Branch
Skipped test_bfd_topo1 test_bgp_convergence History
TopoTest 4.0 Branch
Skipped test_bfd_topo1 test_memory_leak History
TopoTest 4.0 Branch
Skipped test_bfd_topo1 test_bgp_fast_reconvergence History
TopoTest 5.0 Branch
Skipped test_bfd_topo1 test_bgp_fast_convergence History
TopoTest 5.0 Branch
Skipped test_bfd_topo1 test_memory_leak History
TopoTest 5.0 Branch
Skipped test_bfd_topo1 test_bfd_connection History
TopoTest 5.0 Branch
Skipped test_bfd_topo1 test_bgp_convergence History
TopoTest 5.0 Branch
Skipped test_bfd_topo1 test_bfd_fast_convergence History
TopoTest 5.0 Branch
Skipped test_bgp_l3vpn_to_bgp_direct test_add_routes History
TopoTest 2.0 Branch
Skipped test_bgp_l3vpn_to_bgp_direct test_cleanup_all History
TopoTest 2.0 Branch
Skipped test_bgp_l3vpn_to_bgp_direct test_adjacencies History
TopoTest 2.0 Branch
Skipped test_bgp_l3vpn_to_bgp_direct test_check_routes History
TopoTest 2.0 Branch
Skipped test_bgp_l3vpn_to_bgp_direct test_check_routes History
TopoTest 3.0 Branch
Skipped test_bgp_l3vpn_to_bgp_direct test_add_routes History
TopoTest 3.0 Branch
Skipped test_bgp_l3vpn_to_bgp_direct test_adjacencies History
TopoTest 3.0 Branch
Skipped test_bgp_l3vpn_to_bgp_direct test_cleanup_all History
TopoTest 3.0 Branch
Skipped test_bgp_l3vpn_to_bgp_direct test_cleanup_all History
TopoTest Master arm7
Skipped test_bgp_l3vpn_to_bgp_direct test_add_routes History
TopoTest Master arm7
Skipped test_bgp_l3vpn_to_bgp_direct test_check_routes History
TopoTest Master arm7
Skipped test_bgp_l3vpn_to_bgp_direct test_add_routes History
TopoTest Master arm8
Skipped test_bgp_l3vpn_to_bgp_direct test_cleanup_all History
TopoTest Master arm8
Skipped test_bgp_l3vpn_to_bgp_direct test_memory_leak History
TopoTest Master arm8
Skipped test_bgp_l3vpn_to_bgp_direct test_check_routes History
TopoTest Master arm8
Skipped test_bgp_l3vpn_to_bgp_direct test_adjacencies History
TopoTest Master arm8
Skipped test_bgp_l3vpn_to_bgp_vrf test_check_linux_vrf History
AddressSanitizer
Skipped test_bgp_l3vpn_to_bgp_vrf test_check_linux_mpls History
AddressSanitizer
Skipped test_bgp_l3vpn_to_bgp_vrf test_check_routes History
TopoTest 2.0 Branch
Skipped test_bgp_l3vpn_to_bgp_vrf test_check_linux_mpls History
TopoTest 2.0 Branch
Skipped test_bgp_l3vpn_to_bgp_vrf test_check_linux_vrf History
TopoTest 2.0 Branch
Skipped test_bgp_l3vpn_to_bgp_vrf test_adjacencies History
TopoTest 2.0 Branch
Skipped test_bgp_l3vpn_to_bgp_vrf test_adjacencies History
TopoTest 3.0 Branch
Skipped test_bgp_l3vpn_to_bgp_vrf test_check_linux_vrf History
TopoTest 3.0 Branch
Skipped test_bgp_l3vpn_to_bgp_vrf test_check_linux_mpls History
TopoTest 3.0 Branch
Skipped test_bgp_l3vpn_to_bgp_vrf test_check_routes History
TopoTest 3.0 Branch
Skipped test_bgp_l3vpn_to_bgp_vrf test_check_linux_vrf History
TopoTest 4.0 Branch
Skipped test_bgp_l3vpn_to_bgp_vrf test_check_routes History
TopoTest 4.0 Branch
Skipped test_bgp_l3vpn_to_bgp_vrf test_check_linux_mpls History
TopoTest 4.0 Branch
Skipped test_bgp_l3vpn_to_bgp_vrf test_adjacencies History
TopoTest 4.0 Branch
Skipped test_bgp_l3vpn_to_bgp_vrf test_check_linux_vrf History
TopoTest 5.0 Branch
Skipped test_bgp_l3vpn_to_bgp_vrf test_check_linux_mpls History
TopoTest 5.0 Branch
Skipped test_bgp_l3vpn_to_bgp_vrf test_check_linux_mpls History
TopoTest 6.0 Branch
Skipped test_bgp_l3vpn_to_bgp_vrf test_check_linux_vrf History
TopoTest 6.0 Branch
Skipped test_bgp_l3vpn_to_bgp_vrf test_check_linux_vrf History
TopoTest Master amd64
Skipped test_bgp_l3vpn_to_bgp_vrf test_check_linux_mpls History
TopoTest Master amd64
Skipped test_bgp_l3vpn_to_bgp_vrf test_check_linux_vrf History
TopoTest Master i386
Skipped test_bgp_l3vpn_to_bgp_vrf test_check_linux_mpls History
TopoTest Master i386
Skipped test_bgp_multiview_topo1 test_shutdown_check_stderr History
AddressSanitizer
Skipped test_bgp_rfapi_basic_sanity_config2 test_cleanup_all History
TopoTest 2.0 Branch
Skipped test_bgp_rfapi_basic_sanity_config2 test_check_timeout History
TopoTest 2.0 Branch
Skipped test_bgp_rfapi_basic_sanity_config2 test_check_close History
TopoTest 2.0 Branch
Skipped test_bgp_rfapi_basic_sanity_config2 test_check_routes History
TopoTest 2.0 Branch
Skipped test_bgp_rfapi_basic_sanity_config2 test_adjacencies History
TopoTest 2.0 Branch
Skipped test_bgp_rfapi_basic_sanity_config2 test_add_routes History
TopoTest 2.0 Branch
Skipped test_bgp_rfapi_basic_sanity_config2 test_check_routes History
TopoTest 3.0 Branch
Skipped test_bgp_rfapi_basic_sanity_config2 test_check_close History
TopoTest 3.0 Branch
Skipped test_bgp_rfapi_basic_sanity_config2 test_adjacencies History
TopoTest 3.0 Branch
Skipped test_bgp_rfapi_basic_sanity_config2 test_check_timeout History
TopoTest 3.0 Branch
Skipped test_bgp_rfapi_basic_sanity_config2 test_cleanup_all History
TopoTest 3.0 Branch
Skipped test_bgp_rfapi_basic_sanity_config2 test_add_routes History
TopoTest 3.0 Branch
Skipped test_bgp_rfapi_basic_sanity_config2 test_check_timeout History
TopoTest Master arm7
Skipped test_bgp_rfapi_basic_sanity_config2 test_check_routes History
TopoTest Master arm7
Skipped test_bgp_rfapi_basic_sanity_config2 test_cleanup_all History
TopoTest Master arm7
Skipped test_bgp_rfapi_basic_sanity_config2 test_check_close History
TopoTest Master arm7
Skipped test_bgp_rfapi_basic_sanity_config2 test_adjacencies History
TopoTest Master arm8
Skipped test_bgp_rfapi_basic_sanity_config2 test_cleanup_all History
TopoTest Master arm8
Skipped test_bgp_rfapi_basic_sanity_config2 test_add_routes History
TopoTest Master arm8
Skipped test_bgp_rfapi_basic_sanity_config2 test_check_timeout History
TopoTest Master arm8
Skipped test_bgp_rfapi_basic_sanity_config2 test_check_routes History
TopoTest Master arm8
Skipped test_bgp_rfapi_basic_sanity_config2 test_check_close History
TopoTest Master arm8
Skipped test_bgp_rfapi_basic_sanity test_check_timeout History
TopoTest 2.0 Branch
Skipped test_bgp_rfapi_basic_sanity test_add_routes History
TopoTest 2.0 Branch
Skipped test_bgp_rfapi_basic_sanity test_check_routes History
TopoTest 2.0 Branch
Skipped test_bgp_rfapi_basic_sanity test_check_close History
TopoTest 2.0 Branch
Skipped test_bgp_rfapi_basic_sanity test_adjacencies History
TopoTest 2.0 Branch
Skipped test_bgp_rfapi_basic_sanity test_cleanup_all History
TopoTest 2.0 Branch
Skipped test_bgp_rfapi_basic_sanity test_check_timeout History
TopoTest 3.0 Branch
Skipped test_bgp_rfapi_basic_sanity test_check_routes History
TopoTest 3.0 Branch
Skipped test_bgp_rfapi_basic_sanity test_add_routes History
TopoTest 3.0 Branch
Skipped test_bgp_rfapi_basic_sanity test_cleanup_all History
TopoTest 3.0 Branch
Skipped test_bgp_rfapi_basic_sanity test_adjacencies History
TopoTest 3.0 Branch
Skipped test_bgp_rfapi_basic_sanity test_check_close History
TopoTest 3.0 Branch
Skipped test_bgp_rfapi_basic_sanity test_check_close History
TopoTest Master arm7