HPE IL Port Diagrams - InfiniBand

Prev Next

ℹ️ Info

The HPE IceLake platform “flips” the left side (facing rear of unit) nodes.  VAST maps the locations of the High Speed ports in our software. Please pay careful attention to the management ports as they are mirrored left to right.

⚠️ Warning

Networking is configured on a per-CNode basis, it is possible for a chassis to have CNodes with differing configurations. If you are unsure of the configuration of a particular CNode, please contact VAST Support for assistance.

HPE IceLake CBox with single CX6 NIC in IB Mode

HPE IceLake CBox with single CX6

HPE IceLake CBox

Number

Name

Port Location

Function

PCIe B:D.F

1

CNode 1

2

CNode 2

3

CNode 3

4

CNode 4

5

PSU 1

6

PSU 2

7

ib1

Nodes 1+2 (Right Side) Left Card – Left Port

Unified

63:00.1

8

ib0

Nodes 1+2 (Right Side) Left Card – Right Port

Unified

63:00.0

9

ib0

Nodes 3+4 (Left Side) Right Card – Left Port

Unified

63:00.0

10

ib1

Nodes 3+4 (Left Side) Right Card – Right Port

Unified

63:00.1

11

ens8f0

1GbE Port 1 (Closest to PSU)

MGMT/IPMI

12

ens8f1

1GbE Port 2

(*MGMT)

13

ens8f4

1GbE Port 4 (Outermost)

TECH

*in B2B IPMI configuration the MGMT port is moved to 1GbE port 2 (ens8f1).


HPE IceLake CBox with Dual CX6 or CX6+CX7 NIC in IB + IB mode

HPE IceLake CBox with Dual CX6 or CX6+CX7

HPE IceLake CBox

Number

Name

Port Location

Function

PCIe B:D.F

1

CNode 1

2

CNode 2

3

CNode 3

4

CNode 4

5

PSU 1

6

PSU 2

7

ib1

Nodes 1+2 (Right Side) Left Card – Left Port

Northbound/Split

63:00.1

8

ib0

Nodes 1+2 (Right Side) Left Card – Right Port

Northbound/Split

63:00.0

9

ib0

Nodes 3+4 (Left Side) Right Card – Left Port

Internal

63:00.0

10

ib1

Nodes 3+4 (Left Side) Right Card – Right Port

Internal

63:00.1

11

ib2

Nodes 1+2 (Right Side) Right Card – Left Port

Internal

84:00.0

12

ib3

Nodes 1+2 (Right Side) Right Card – Right Port

Internal

84:00.1

13

ib3

Nodes 3+4 (Left Side) Left Card – Left Port

Northbound/Split

84:00.1

14

ib2

Nodes 3+4 (Left Side) Left Card – Right Port

Northbound/Split

84:00.0

15

ens8f0

1GbE Port 1 (Closest to PSU)

MGMT/IPMI

16

ens8f1

1GbE Port 2

(*MGMT)

17

ens8f4

1GbE Port 4 (Outermost)

TECH

*in B2B IPMI configuration the MGMT port is moved to 1GbE port 2 (ens8f1).


HPE IceLake CBox with dual CX6 or CX6 + CX7 NIC in IB Mode with “Skip NIC - External” enabled

⚠️ Warning

Since this is a per-CNode setting, it is possible for a chassis to have CNodes with differing configurations. If you are unsure of the configuration of a CNode, please contact VAST Support for assistance.

When this flag is used, VAST instructs the auto-ports feature to disable the NIC that is typically designated for northbound traffic.  This means that if you use this flag on a node with two NICs, the NIC designated for internal traffic will handle both internal and external (aka Unified) network traffic. This means the network interfaces that would typically be solely used for northbound connections are effectively disabled. This flag is not valid on a single NIC CNode.

HPE IceLake CBox with dual CX6 or CX6 + CX7 NIC in IB Mode

HPE IceLake CBox

Number

Name

Port Location

Function

PCIe B:D.F

1

CNode 1

2

CNode 2

3

CNode 3

4

CNode 4

5

PSU 1

6

PSU 2

7

ib1

Nodes 1+2 (Right Side) Left Card – Left Port

Disabled

63:00.1

8

ib0

Nodes 1+2 (Right Side) Left Card – Right Port

Disabled

63:00.0

9

ib0

Nodes 3+4 (Left Side) Right Card – Left Port

Unified

63:00.0

10

ib1

Nodes 3+4 (Left Side) Right Card – Right Port

Unified

63:00.1

11

ib2

Nodes 1+2 (Right Side) Right Card – Left Port

Unified

84:00.0

12

ib3

Nodes 1+2 (Right Side) Right Card – Right Port

Unified

84:00.1

13

ib3

Nodes 3+4 (Left Side) Left Card – Left Port

Disabled

84:00.1

14

ib2

Nodes 3+4 (Left Side) Left Card – Right Port

Disabled

84:00.0

15

ens8f0

1GbE Port 1 (Closest to PSU)

MGMT/IPMI

16

ens8f1

1GbE Port 2

(*MGMT)

17

ens8f4

1GbE Port 4 (Outermost)

TECH

*in B2B IPMI configuration the MGMT port is moved to 1GbE port 2 (ens8f1).


HPE IceLake CBox with CX6 + CX7 NIC in IB Mode with “Skip NIC - Internal” enabled

⚠️ Warning

Since this is a per-CNode setting, it is possible for a chassis to have CNodes with differing configurations. If you are unsure of the configuration of a CNode, please contact VAST Support for assistance.

When this flag is used, VAST instructs the auto-ports feature to disable the NIC that is typically designated for northbound traffic.  This means that if you use this flag on a node with two NICs, the NIC designated for internal traffic will handle both internal and external (aka Unified) network traffic. This means the network interfaces that would typically be solely used for northbound connections are effectively disabled. This flag is not valid on a single NIC CNode.

HPE IceLake CBox with CX6 + CX7 NIC in IB Mode

HPE IceLake CBox

Number

Name

Port Location

Function

PCIe B:D.F

1

CNode 1

2

CNode 2

3

CNode 3

4

CNode 4

5

PSU 1

6

PSU 2

7

ib1

Nodes 1+2 (Right Side) Left Card – Left Port

Unified

63:00.1

8

ib0

Nodes 1+2 (Right Side) Left Card – Right Port

Unified

63:00.0

9

ib0

Nodes 3+4 (Left Side) Right Card – Left Port

Disabled

63:00.0

10

ib1

Nodes 3+4 (Left Side) Right Card – Right Port

Disabled

63:00.1

11

ib2

Nodes 1+2 (Right Side) Right Card – Left Port

Disabled

84:00.0

12

ib3

Nodes 1+2 (Right Side) Right Card – Right Port

Disabled

84:00.1

13

ib2

Nodes 3+4 (Left Side) Left Card – Left Port

Unified

84:00.1

14

ib3

Nodes 3+4 (Left Side) Left Card – Right Port

Unified

84:00.0

15

ens8f0

1GbE Port 1 (Closest to PSU)

MGMT/IPMI

16

ens8f1

1GbE Port 2

(*MGMT)

17

ens8f4

1GbE Port 4 (Outermost)

TECH

*in B2B IPMI configuration the MGMT port is moved to 1GbE port 2 (ens8f1).


ℹ️ Note

The HPE IceLake Platform does not support the Reverse NICs option.