Dell IL Port Diagrams - InfiniBand

Prev Next

ℹ️ Info

The Green Port - the leftmost RJ45 on the Dell IceLake CNode (The Green Port) is “reserved” and is not used in a VAST Deployment.

⚠️ Warning

Networking is configured on a per-CNode basis, it is possible for a chassis to have CNodes with differing configurations. If you are unsure of the configuration of a particular CNode, please contact VAST Support for assistance.

Dell IceLake CBox with Single CX6 NIC in InfiniBand Mode

Dell IceLake CBox with Single CX6 NIC in InfiniBand Mode

Dell IceLake CBox

Number

Name

Port Location

Function

PCIe B:D.F

1

CNode 1

2

CNode 2

3

CNode 3

4

CNode 4

5

PSU 1

6

PSU 2

7

ib1

Right Card – Left Port

Unified

31:00.1

8

ib0

Right Card – Right Port

Unified

31:00.0

9

em2

1 GbE Port 1 (Left)

MGMT/IPMI

10

em3

1 GbE Port 2

 (*MGMT)

11

em5

1 GbE Port 4 (Right)

TECH

*in B2B IPMI configuration the MGMT port is moved to 1GbE port 2 (eno2) and the TECH port is moved to 1GbE port 1 (em3).


Dell IceLake CBox with Dual CX6 NIC in IB + IB mode

Dell IceLake CBox with Dual CX6 NIC in IB + IB mode

Dell IceLake CBox

Number

Name

Port Location

Function

PCIe B:D.F

1

CNode 1

2

CNode 2

3

CNode 3

4

CNode 4

5

PSU 1

6

PSU 2

7

ib3

Right Card – Left Port

Internal

31:00.1

8

ib2

Right Card – Right Port

Internal

31:00.0

9

ib1

Left Card – Left Port

Northbound / Split

17:00.1

10

ib0

Left Card – Right Port

Northbound / Split

17:00.0

11

em2

1 GbE Port 1 (Left)

MGMT/IPMI

12

em3

1 GbE Port 2

 (*MGMT)

13

em5

1 GbE Port 4 (Right)

TECH

*in B2B IPMI configuration the MGMT port is moved to 1GbE port 2 (eno2) and the TECH port is moved to 1GbE port 1 (em3).


Dell IceLake CBox with Dual CX6 NIC in IB mode with “Skip NIC - External” enabled

ℹ️ Info

The “Skip NIC - External” flag is a setting that can be set either in the VAST GUI Installer or via the command line configure_network.py tool.  This flag is set on a per-CNode basis.

⚠️ Warning

Since this is a per-CNode setting, it is possible for a chassis to have CNodes with differing configurations. If you are unsure of the configuration of a CNode, please contact VAST Support for assistance.

When this flag is used, VAST instructs the auto-ports feature to disable the NIC that is typically designated for northbound traffic.  This means that if you use this flag on a node with two NICs, the NIC designated for internal traffic will handle both internal and external (aka Unified) network traffic. This means the network interfaces that would typically be solely used for northbound connections are effectively disabled. This flag is not valid on a single NIC CNode.

Dell IceLake CBox with Dual CX6 NIC in IB mode

Dell IceLake CBox

Number

Name

Port Location

Function

PCIe B:D.F

1

CNode 1

2

CNode 2

3

CNode 3

4

CNode 4

5

PSU 1

6

PSU 2

7

ib3

Right Card – Left Port

Unified

31:00.1

8

ib2

Right Card – Right Port

Unified

31:00.0

9

ib1

Left Card – Left Port

Disabled

17:00.1

10

ib0

Left Card – Right Port

Disabled

17:00.0

11

em2

1 GbE Port 1 (Left)

MGMT/IPMI

12

em3

1 GbE Port 2

 (*MGMT)

13

em5

1 GbE Port 4 (Right)

TECH

*in B2B IPMI configuration the MGMT port is moved to 1GbE port 2 (eno2) and the TECH port is moved to 1GbE port 1 (em3).


ℹ️ Note

The Dell IceLake Platform supports the Skip NIC - Internal option, but it has limited use cases and is not documented here.

ℹ️ Note

The Dell IceLake Platform supports the Reverse NICs option, but it has limited use cases and is not documented here.