⚠️ Warning
Networking is configured on a per-CNode basis, it is possible for a cluster to have CNodes with differing configurations. If you are unsure of the configuration of a particular CNode, please contact VAST Support for assistance.
SMC Gen5 Genoa CBox with single CX7 NIC in InfiniBand Mode
SMC Gen5 Genoa CBox | ||||
|---|---|---|---|---|
Number | Name | Port Location | Function | PCIe B:D.F |
1 | PSU 1 | |||
2 | PSU 2 | |||
3 | ib1 | Right Card – Left Port | Unified | 81:00.1 |
4 | ib0 | Right Card – Right Port | Unified | 81:00.0 |
5 | enp65s0f0 | 1 GbE Port 1 (Left) | MGMT/IPMI | |
6 | enp65s0f1 | 1 GbE Port 2 | (*MGMT) | |
7 | enp65s0f3 | 1 GbE Port 4 (Right) | TECH | |
8 | BMC | Dedicated BMC port | (*IPMI) | |
*In B2B IPMI configuration, the MGMT port is moved to 1GbE port 2 (enp65s0f1) and Port 1 (enp65s0f0) connected to the Dedicated BMC Port of the Peer Node
SMC Gen5 Genoa CBox with Dual CX7 NIC in InfiniBand + InfiniBand mode
SMC Gen5 Genoa CBox | ||||
|---|---|---|---|---|
Number | Name | Port Location | Function | PCIe B:D.F |
1 | PSU 1 | |||
2 | PSU 2 | |||
3 | ib1 | Right Card – Left Port | Internal | 81:00.1 |
4 | ib0 | Right Card – Right Port | Internal | 81:00.0 |
5 | ib3 | Left Card – Left Port | Northbound/Split | |
6 | ib2 | Left Card – Right Port | Northbound/Split | |
7 | BMC | Dedicated BMC port | (*IPMI) | |
8 | enp65s0f0 | 1 GbE Port 1 (Left) | MGMT/IPMI | |
9 | enp65s0f1 | 1 GbE Port 2 | (*MGMT) | |
10 | enp65s0f3 | 1 GbE Port 4 (Right) | TECH | |
*In B2B IPMI configuration, the MGMT port is moved to 1GbE port 2 (enp65s0f1) and Port 1 (enp65s0f0) connected to the Dedicated BMC Port of the Peer Node
SMC Gen5 Genoa CBox with dual CX7 NIC in InfiniBand Mode with “Skip NIC - External” enabled
⚠️ Warning
Since this is a per-CNode setting, it is possible for a cluster to have CNodes with differing configurations. If you are unsure of the configuration of a CNode, please contact VAST Support for assistance.
When this flag is used, VAST instructs the auto-ports feature to disable the NIC that is typically designated for northbound traffic. This means that if you use this flag on a node with two NICs, the NIC designated for internal traffic will handle both internal and external (aka Unified) network traffic. This means the network interfaces that would typically be solely used for northbound connections are effectively disabled. This flag is not valid on a single NIC CNode.
SMC Gen5 Genoa CBox | ||||
|---|---|---|---|---|
Number | Name | Port Location | Function | PCIe B:D.F |
1 | PSU 1 | |||
2 | PSU 2 | |||
3 | ib1 | Right Card – Left Port | Unified | 81:00.1 |
4 | ib0 | Right Card – Right Port | Unified | 81:00.0 |
5 | ib3 | Left Card – Left Port | Disabled | 01:00.1 |
6 | ib2 | Left Card – Right Port | Disabled | 01:00.0 |
7 | BMC | Dedicated BMC port | (*IPMI) | |
8 | enp65s0f0 | 1 GbE Port 1 (Left) | MGMT/IPMI | |
9 | enp65s0f1 | 1 GbE Port 2 | (*MGMT) | |
10 | enp65s0f3 | 1 GbE Port 4 (Right) | TECH | |
*In B2B IPMI configuration, the MGMT port is moved to 1GbE port 2 (enp65s0f1) and Port 1 (enp65s0f0) connected to the Dedicated BMC Port of the Peer Node
ℹ️ Note
The SMC Gen5 Genoa Platform does not support the Reverse NICs option.