HPE Gen5 Genoa Port Diagrams - InfiniBand

Prev Next

⚠️ Warning

Networking is configured on a per-CNode basis, it is possible for a cluster to have CNodes with differing configurations. If you are unsure of the configuration of a particular CNode, please contact VAST Support for assistance.

HPE Gen5 Genoa CBox with single CX7 NIC in InfiniBand Mode

bd20f348-12d2-49fa-bcc6-dc08a2758bba.png

HPE Gen5 Genoa CBox

Number

Name

Port Location

Function

PCIe B:D.F

1

PSU 1

2

PSU 2

3

ib0

Right Card – Left Port

Unified

07:00.0

4

ib1

Right Card – Right Port

Unified

07:00.1

5

enp200s0f0

1 GbE Port 1 (Left)

MGMT/IPMI

c8:00.0

6

enp200s0f1

1 GbE Port 2

 (*MGMT)

c8:00.1

7

enp200s0f3

1 GbE Port 4 (Right)

TECH

c8:00.3

8

BMC

Dedicated BMC port

(*IPMI)

*In B2B IPMI configuration, the MGMT port is moved to 1GbE port 2 (enp200s0f1,), and port 1 (enp200s0f0) is connected  to the Dedicated BMC Port of the Peer Node


HPE Gen5 Genoa CBox with Dual CX7 NIC in InfiniBand + InfiniBand mode

dbc97d8e-5ada-45ae-9eaa-842607812c04.png

HPE Gen5 Genoa CBox

Number

Name

Port Location

Function

PCIe B:D.F

1

PSU 1

2

PSU 2

3

ib2

Right Card – Left Port

Internal

07:00.0

4

ib3

Right Card – Right Port

Internal

07:00.1

5

ib0

Left Card – Left Port

Northbound/Split

86:00.0

6

ib1

Left Card – Right Port

Northbound/Split

86:00.1

7

BMC

Dedicated BMC port

(*IPMI)

8

enp200s0f0

1 GbE Port 1 (Left)

MGMT/IPMI

c8:00.0

9

enp200s0f1

1 GbE Port 2

 (*MGMT)

c8:00.1

10

enp200s0f3

1 GbE Port 4 (Right)

TECH

c8:00.3

*In B2B IPMI configuration, the MGMT port is moved to 1GbE port 2 (enp200s0f1), and port 1 (enp200s0f0) is connected  to the Dedicated BMC Port of the Peer Node


HPE Gen5 Genoa CBox with dual CX7 NIC in InfiniBand Mode with “Skip NIC - External” enabled

⚠️ Warning

Since this is a per-CNode setting, it is possible for a cluster to have CNodes with differing configurations. If you are unsure of the configuration of a CNode, please contact VAST Support for assistance.

When this flag is used, VAST instructs the auto-ports feature to disable the NIC that is typically designated for northbound traffic.  This means that if you use this flag on a node with two NICs, the NIC designated for internal traffic will handle both internal and external (aka Unified) network traffic. This means the network interfaces that would typically be solely used for northbound connections are effectively disabled. This flag is not valid on a single NIC CNode.

42c84536-99be-4c14-ab55-31a0c54168c1.png

HPE Gen5 Genoa CBox

Number

Name

Port Location

Function

PCIe B:D.F

1

PSU 1

2

PSU 2

3

ib2

Right Card – Left Port

Unified

07:00.0

4

ib3

Right Card – Right Port

Unified

07:00.1

5

ib0

Left Card – Left Port

Disabled

86:00.0

6

ib1

Left Card – Right Port

Disabled

86:00.1

7

BMC

Dedicated BMC port

(*IPMI)

8

enp200s0f0

1 GbE Port 1 (Left)

MGMT/IPMI

c8:00.0

9

enp200s0f1

1 GbE Port 2

 (*MGMT)

c8:00.1

10

enp200s0f3

1 GbE Port 4 (Right)

TECH

c8:00.3

*In B2B IPMI configuration, the MGMT port is moved to 1GbE port 2 (enp200s0f1), and port 1 (enp200s0f0) is connected  to the Dedicated BMC Port of the Peer Node


ℹ️ Note

The HPE Gen5 Genoa Platform does not support the Reverse NICs option.