Configuring Mellanox ONYX OS uplink ports to Cisco 5000 switches

Prev Next

In this configuration

  • 8 uplink ports on VAST Mellanox ONYX OS switches

  • 4 on each VAST Mellanox ONYX OS switch

  • These 4 links are divided into to groups, each with 2 links

  • Two groups are connected to two different Cisco Nexus switches

  • Fully redundant uplink connection between VAST Mellanox to Cisco switches

Instructions

Cisco Nexus 5696 Chassis (“Nexus 5696 Supervisor”)
 Intel(R) Xeon(R) CPU @ 1.80 with 16511892 kB of memory.
 Processor Board ID FOC20433Q96
Software
 BIOS: version 2.1.0

make sure vpc and lacp are enabled

feature lacp
feature vpc

For example

Cisco configure VLAN 515 and port channel 41 on their switch for uplink ports, we need to configure port channel 41 to be access mode and vpc 41 should be configured on both Cisco switches so 8 uplinks are treated as a single channel, to match our MLAG across all 8 uplink ports on our Mellanox switches

 

> show running-config interface port-channel41
 
interface port-channel41
  switchport access vlan 515
  vpc 41

Verify the VPC status

> show vpc 41
 
 vPC status
 
---------------------------------------------------------------------------
id     Port        Status Consistency Reason       Active vlans vPC+ Attrib
--     ----------  ------ ----------- ------       ------------ -----------
41     Po41        up     success     success      515          DF: Partial,
    FP MAC:
   512.0.0 

Two uplinks to the first Mellanox switch:

> show running-config interface Ethernet4/1-2
 
interface Ethernet4/1
  description "VAST MLX1-ETH1"
  switchport access vlan 515
  channel-group 41 mode active
interface Ethernet4/2
  description "VAST MLX2-ETH1"
  switchport access vlan 515
  channel-group 41 mode active

Two uplinks on the same Nexus switch to 2nd Mellanox switch:

> show running-config interface Ethernet6/5-6
 
interface Ethernet6/5
  description "VAST MLX1-ETH3"
  switchport access vlan 515
  channel-group 41 mode active
interface Ethernet6/6
  description "VAST MLX2-ETH3"
  switchport access vlan 515
  channel-group 41 mode active

 

Use exactly the same configuration on 2nd Nexus switch to provide full mesh connectivity to two Mellanox switches.