Testing PullReq against Topology Tests

Build: #390 failed Custom build by Github Hook with revision master

Build result summary

Details

Completed
Duration
53 minutes
Flags
Custom revisionCustom build
Labels
version=frr-6_1-dev-892-g98d8359fegit=https_//github_com/frrouting/topotests_gitbuildurl=https_//ci1_netdef_org/browse/frr-topopr-cf-390branch=master
Revisions
FRR - Topotests
master master
FRR - FreeRangeRouting
98d8359fe710f08753a337911b04612da5218b2b 98d8359fe710f08753a337911b04612da5218b2b
Total tests
1270
Failing since
#381 (Custom build by Github Hook with revision master)
Fixed in
#391 (Custom build by Github Hook with revision master)

Custom variables

Custom revision
master master
Name Value
github_base_sha 512010d4e54e38189ca553a20e088614516a70ec
github_pullreq 133
github_branch master
github_repo FRRouting/topotests
github_merge_sha b3f6a1d9af1cf1690e058600c60d02141e33a00b

Comments

  1. Github Hook

    GitHub Merge Request 133
    for GitHub Repo FRRouting/topotests, branch master

    Request to merge from donaldsharp/topotests
    Merge Git Commit ID b3f6a1d9af1cf1690e058600c60d02141e33a00b on top of base Git Commit ID 512010d4e54e38189ca553a20e088614516a70ec

Code commits

FRR - Topotests
Author Commit Message Commit date
Martin Winter Martin Winter 512010d4e54e38189ca553a20e088614516a70ec 512010d4e54e38189ca553a20e088614516a70ec Merge pull request #143 from opensourcerouting/bgp-ecmp-default-fix
bgp-ecmp-topo1: fix and improve topology test
FRR - FreeRangeRouting
Author Commit Message Commit date
Russ White <russ@riw.us> Russ White <russ@riw.us> 98d8359fe710f08753a337911b04612da5218b2b 98d8359fe710f08753a337911b04612da5218b2b Merge pull request #3351 from chiragshah6/ospfv3_dev
ospf6d: abr summary advertise best route
Russ White <russ@riw.us> Russ White <russ@riw.us> ae4bb7ba6e3ed494c705065c31abd6053498e446 ae4bb7ba6e3ed494c705065c31abd6053498e446 Merge pull request #3356 from opensourcerouting/router-id-loopbacks
zebra: improve identification of loopback interfaces in the router-id code
Russ White <russ@riw.us> Russ White <russ@riw.us> 0c9503eb4e71edddd57ae86d2574fd37c46ad4d0 0c9503eb4e71edddd57ae86d2574fd37c46ad4d0 Merge pull request #3361 from opensourcerouting/yang-embed-models
yang: embed models into binaries
Russ White <russ@riw.us> Russ White <russ@riw.us> 32bdc40ec460ac78fcfb245e7bba61da2e3d125f 32bdc40ec460ac78fcfb245e7bba61da2e3d125f Merge pull request #3362 from pacovn/Coverity_1475469_null_check
bgpd: null check (Coverity 1475469)

Tests

New test failures 11
Status Test View job Duration
Collapse Failed test_bgp_l3vpn_to_bgp_direct test_adjacencies History
TopoTest Master arm7 1 min
AssertionError: 3 tests failed
E   AssertionError: 3 tests failed
Collapse Failed test_bgp_rfapi_basic_sanity_config2 test_adjacencies History
TopoTest Master arm7 1 min
AssertionError: 3 tests failed
E   AssertionError: 3 tests failed
Collapse Failed test_bgp_rfapi_basic_sanity test_adjacencies History
TopoTest Master arm7 1 min
AssertionError: 3 tests failed
E   AssertionError: 3 tests failed
Collapse Failed test_ldp_topo1 test_linux_mpls_routes History
TopoTest Master arm7 < 1 sec
AssertionError: Linux Kernel MPLS route output for router r2:   --- actual Linux Kernel MPLS route   +++ expected Linux Kernel MPLS route   @@ -1,3 +1,3 @@   +xx proto xx nexthopvia inet 10.0.2.3 dev r2-eth1 nexthopvia inet 10.0.3.3 dev r2-eth2    xx via inet 10.0.1.1 dev r2-eth0 proto xx    xx via inet 10.0.2.4 dev r2-eth1 proto xx   -xx via inet 10.0.3.3 dev r2-eth2 proto xx assert 1 == 0
E   AssertionError: Linux Kernel MPLS route output for router r2:
      --- actual Linux Kernel MPLS route
      +++ expected Linux Kernel MPLS route
      @@ -1,3 +1,3 @@
      +xx proto xx nexthopvia inet 10.0.2.3 dev r2-eth1 nexthopvia inet 10.0.3.3 dev r2-eth2
       xx via inet 10.0.1.1 dev r2-eth0 proto xx
       xx via inet 10.0.2.4 dev r2-eth1 proto xx
(2 more lines...)
Collapse Failed test_ldp_topo1 test_mpls_table History
TopoTest Master arm7 2 secs
AssertionError: MPLS table output for router r2:   --- actual MPLS table output   +++ expected MPLS table output   @@ -2,5 +2,6 @@       Label     Type          Nexthop     Label    --------  -------  ---------------  --------          XX      LDP         10.0.1.1  implicit-null   +      XX      LDP         10.0.2.3  implicit-null          XX      LDP         10.0.2.4  implicit-null          XX      LDP         10.0.3.3  implicit-null assert 1 == 0
E   AssertionError: MPLS table output for router r2:
      --- actual MPLS table output
      +++ expected MPLS table output
      @@ -2,5 +2,6 @@
          Label     Type          Nexthop     Label
       --------  -------  ---------------  --------
             XX      LDP         10.0.1.1  implicit-null
(4 more lines...)
Collapse Failed test_ldp_topo1 test_mpls_ldp_binding History
TopoTest Master arm7 1 sec
AssertionError: MPLS LDP Interface binding output for router r2:   --- actual MPLS LDP binding output   +++ expected MPLS LDP binding output   @@ -1,5 +1,6 @@    AF   Destination          Nexthop         Local Label Remote Label  In Use    ipv4 1.1.1.1/32           1.1.1.1         xxx         imp-null         yes   +ipv4 1.1.1.1/32           3.3.3.3         xxx         xxx               no    ipv4 1.1.1.1/32           4.4.4.4         xxx         xxx               no    ipv4 2.2.2.2/32           1.1.1.1         imp-null    xxx               no    ipv4 2.2.2.2/32           3.3.3.3         imp-null    xxx               no assert 1 == 0
E   AssertionError: MPLS LDP Interface binding output for router r2:
      --- actual MPLS LDP binding output
      +++ expected MPLS LDP binding output
      @@ -1,5 +1,6 @@
       AF   Destination          Nexthop         Local Label Remote Label  In Use
       ipv4 1.1.1.1/32           1.1.1.1         xxx         imp-null         yes
      +ipv4 1.1.1.1/32           3.3.3.3         xxx         xxx               no
(4 more lines...)
Collapse Failed test_ldp_topo1 test_zebra_ipv4_routingTable History
TopoTest Master arm7 1 sec
AssertionError: IPv4 Zebra Routing Table verification failed for router r2:   --- actual IPv4 zebra routing table   +++ expected IPv4 zebra routing table   @@ -1,6 +1,6 @@    O>* 1.1.1.1/32 [110/10] via 10.0.1.1, r2-eth0, label implicit-null    O   2.2.2.2/32 [110/0] is directly connected, lo   -O>  3.3.3.3/32 [110/10] via 10.0.2.3, r2-eth1   +O>* 3.3.3.3/32 [110/10] via 10.0.2.3, r2-eth1, label implicit-null    O>* 4.4.4.4/32 [110/10] via 10.0.2.4, r2-eth1, label implicit-null    O   10.0.1.0/24 [110/10] is directly connected, r2-eth0    O   10.0.2.0/24 [110/10] is directly connected, r2-eth1 assert 1 == 0
E   AssertionError: IPv4 Zebra Routing Table verification failed for router r2:
      --- actual IPv4 zebra routing table
      +++ expected IPv4 zebra routing table
      @@ -1,6 +1,6 @@
       O>* 1.1.1.1/32 [110/10] via 10.0.1.1, r2-eth0, label implicit-null
       O   2.2.2.2/32 [110/0] is directly connected, lo
      -O>  3.3.3.3/32 [110/10] via 10.0.2.3, r2-eth1
(5 more lines...)
Collapse Failed test_ldp_vpls_topo1 test_rib History
TopoTest Master arm7 3 mins
AssertionError: "r1" JSON output mismatches the expected result assert json value is different (   --- Expected value   +++ Current value   @@ -3,0 +4,2 @@   +        "internalFlags": 16,    +        "internalStatus": 2,    @@ -9 +11 @@   -                "fib": true,    +                "flags": 1,    @@ -17 +19 @@   -                "fib": true,    +                "flags": 1,    @@ -25 +27,2 @@   -        "selected": true   +        "selected": true,    +        "uptime": "00:04:05")
E   AssertionError: "r1" JSON output mismatches the expected result
    assert json value is different (
      --- Expected value
      +++ Current value
      @@ -3,0 +4,2 @@
      +        "internalFlags": 16, 
      +        "internalStatus": 2, 
(10 more lines...)
Collapse Failed test_pim test_pim_igmp_report History
TopoTest 3.0 Branch < 1 sec
KeyError: '229.1.1.2'
E   KeyError: '229.1.1.2'
Collapse Failed test_pim test_pim_igmp_report History
TopoTest Master arm7 1 sec
KeyError: '229.1.1.2'
E   KeyError: '229.1.1.2'
Collapse Failed test_pim test_pim_send_mcast_stream History
TopoTest Master arm7 16 secs
KeyError: '229.1.1.1'
E   KeyError: '229.1.1.1'

Shared artifacts

Artifact File size
VersionInfo 784 bytes
SourceCode 4 MB
topotests 538 KB