CL Port Diagrams - InfiniBand

ℹ️ Info

The Green Port - the leftmost RJ45 on the Cascade Lake CNode (The Green Port) is “reserved” and is not used in a VAST Deployment.

⚠️ Warning

Networking is configured on a per-CNode basis, it is possible for a chassis to have CNodes with differing configurations. If you are unsure of the configuration of a particular CNode, please contact VAST Support for assistance.

Cascade Lake CBox with single CX5 NIC in InfiniBand Mode

*in B2B IPMI configuration the MGMT port is moved to 1GbE port 2 (eno2) and the TECH port is moved to 1GbE port 1 (eno1).

Cascade Lake CBox with Dual CX5 or CX5+CX6 NIC in IB + IB mode

*in B2B IPMI configuration the MGMT port is moved to 1GbE port 2 (eno2) and the TECH port is moved to 1GbE port 1 (eno1).

Cascade Lake CBox with Dual CX5 or CX5+CX6 NIC in IB mode with “Skip NIC - External” enabled

ℹ️ Info

The “Skip NIC - External” flag is a setting that can be set either in the VAST GUI Installer or via the command line configure_network.py tool.  This flag is set on a per-CNode basis.

⚠️ Warning

Since this is a per-CNode setting, it is possible for a chassis to have CNodes with differing configurations. If you are unsure of the configuration of a CNode, please contact VAST Support for assistance.

When this flag is used, VAST instructs the auto-ports feature to disable the NIC that is typically designated for northbound traffic.  This means that if you use this flag on a node with two NICs, the NIC designated for internal traffic will handle both internal and external (aka Unified) network traffic. This means the network interfaces that would typically be solely used for northbound connections are effectively disabled. This flag is not valid on a single NIC CNode.

*in B2B IPMI configuration the MGMT port is moved to 1GbE port 2 (eno2) and the TECH port is moved to 1GbE port 1 (eno1).

Cascade Lake CBox with CX5+CX6 NIC in IB mode with “Skip NIC - Internal” enabled

ℹ️ Info

The “Skip NIC - Internal” flag is a setting that can be set either in the VAST GUI Installer or via the command line configure_network.py tool.  This flag is set on a per-CNode basis.

⚠️ Warning

Since this is a per-CNode setting, it is possible for a chassis to have CNodes with differing configurations. If you are unsure of the configuration of a CNode, please contact VAST Support for assistance.

When this flag is used, VAST instructs the auto-ports feature to disable the NIC that is typically designated for internal traffic.  This means that if you use this flag on a node with two NICs, the NIC designated for northbound traffic will handle both internal and external (aka Unified) network traffic. This means the network interfaces that would typically be solely used for internal connections are effectively disabled. This flag is not valid on a single NIC CNode.

*in B2B IPMI configuration the MGMT port is moved to 1GbE port 2 (eno2) and the TECH port is moved to 1GbE port 1 (eno1).

Cascade Lake CBox with CX5+CX6 NIC in IB + IB mode with “Reverse NICs” enabled

ℹ️ Info

The “Reverse NICs” flag is a setting that can be set either in the VAST GUI Installer or via the command line configure_network.py tool. This flag is set on a per-CNode basis.

⚠️ Warning

Since this is a per-CNode setting, it is possible for a chassis to have CNodes with differing configurations. If you are unsure of the configuration of a CNode, please contact VAST Support for assistance.

The “Reverse NICs” flag refers to a specific configuration that swaps the roles between the NIC intended for northband traffic and the NIC intended for internal traffic. This is primarily used in scenarios where the physical cabling or hardware layout necessitates a reversal of these roles.

*in B2B IPMI configuration the MGMT port is moved to 1GbE port 2 (eno2) and the TECH port is moved to 1GbE port 1 (eno1).

ℹ️ Note

Using the Skip NIC and Reverse NIC functionality together is supported, but has extremely limited use cases.  Thus it is not documented here.