This document guides users on how to set up the Ethernet network for InfiniBox services. Three types of services are supported over Ethernet: NAS, iSCSI and replication. Normally, each service can use two or more ports per node, providing high availability and increased throughput.
Introduction
Scope of document
This document provides guidelines and instructions for setting up InfiniBox services. The document is built upon past releases of Best Practices and Deployment Considerations documents that are still available on the Infinidat Support website. If you are running an InfiniBox version older that 4.0, this document complements but does not entirely replace past documentation.
Obsolete documentation
- Deployment consideration for setting up services - User documentation for InfiniBox v4.0 and former InfiniBox releases, includes an article named "Deployment Considerations for Setting up Services". This article is now obsolete. The instructions provided in the article have been merged into this document
Deploying InfiniBox Services
InfiniBox Services
InfiniBox supports three types of services over Ethernet networks: NAS, iSCSI and replication. Normally, each service can use one, two or more ports per node, which providing high availability and increased throughput.
NAS and replication services can easily share the ports (in pairs) and this is a common configuration. It is neither customary nor recommended to share ports between iSCSI and other services due to the differing nature of the relevant protocols:
- The iSCSI protocol has a built-in mechanism to ensure high-availability and high-performance using multipathing. This is the standard option for iSCSI deployment and is the recommended configuration for using iSCSI with InfiniBox.
- NAS and replication services do not have such built-in support, so LACP (link aggregation) is recommended to provide high-availability and increased performance.
The following table summarizes the different aspects of iSCSI vs. NAS and replication services:
Recommended | iSCSI | NAS and/or Replication |
---|---|---|
Number of Network Spaces | 2 | 1 per service |
Number of port groups | 2 | 1 |
Number of ports in each port group | 1 | 2 |
Switch configuration | 2 separate switches | LACP across chassis (VPC), or stacked switches |
Selecting Ethernet Ports for the Services
Ports should be grouped into pairs so they can be allocated to services. For example, assign ETH1 and ETH2 as one pair, with ETH3 and ETH4 as another pair. Analyze which services are required, and whether is there a need for physical separation between them. Consider the recommendation to isolate iSCSI and the fact that there are a limited number of pairs (depending on InfiniBox model).
Switch requirements
It is also recommended to set the ports connected to InfiniBox to account for changes using a spanning-tree algorithm. For many network vendor implementations, this will be called “portfast”, “edge” or “edge-port” in the switch configuration semantics.
InfiniBox Fx1xx
InfiniBox Fx1xx models have two Ethernet data ports per node (total of 6 ports per system).
Use the following table to decide which port groups you need to create, and how many Ethernet ports to place in each port group:
Is iSCSI required? | Is NAS and/or Replication required? | Recommended Configuration | Example Port Groups |
---|---|---|---|
Not required | Required | 1 port group with 2 ports | PG3 (ETH1, ETH2) for NAS and replication |
Required | Not required | 2 port groups, each with 1 port |
|
Required | Required | 1 port group with 2 ports
| PG3 (ETH1, ETH2) for all services |
InfiniBox Fx2xx: four Ethernet Data Ports Per Node
InfiniBox Fx2xx models have four Ethernet data ports per node (total of 12 ports per system).
On F42xx with SMB nodes ports ETH1 - ETH2 (marked 9 - 10 in the patch panel) are used for back-end connectivity.
Do NOT use these Ethernet ports for any other service.
The management ports (marked MGMT in the patch panel) and the Support Appliance port (marked SA in the patch panel) support 1GbE, 100MbE and 10MbE, and will auto-negotiate the network speed according to the network switch.
Use the following table to decide which port groups you need to create, and how many Ethernet ports to place in each port group:
Is iSCSI required? | Is NAS and/or Replication required? | Recommended Configuration | Example Port Groups |
---|---|---|---|
Not required | Required | 1-2 port groups, each with 2 ports
|
|
Required | Not required | 2 port groups, each with 1 port |
|
Required | Required | iSCSI - 2 port groups, each with 1 port NAS / Replication - 1 port group with 2 ports
|
|
InfiniBox Fx3xx
InfiniBox Fx3xx models have six Ethernet data ports per node (total of 18 ports per system).
In Fx3xx systems using fiber-optic Ethernet connectivity, ports ETH1 - ETH4 (marked 9 - 12 in the patch panel) are 25GbE-ready. We recommend not mixing these ports with ETH5 - ETH6 (marked 13 - 14 in the patch panel) in the same port group.
The management ports (marked MGMT in the patch panel) support 1GbE only.
The Support Appliance port (marked SA in the patch panel) supports 1GbE, 100MbE and 10MbE, and will auto-negotiate the network speed according to the network switch.
Use the following table to decide which port groups you need to create, and how many Ethernet ports to place in each port group:
Is iSCSI required? | Is NAS and/or Replication required? | Recommended Configuration | Example Port Groups |
---|---|---|---|
Not required | Required | 1-3 port groups, each with 2 ports |
|
Required | Not required | 2 port groups, each with 1 port |
|
Required | Required | iSCSI - 2 port groups, each with 1 port NAS - 1 port group with 2 ports Replication - 1 port group with 2 ports |
|
Connecting the Switch to the InfiniBox Patch Panel
iSCSI deployment
- Connect ports to the switches.
Select one port from each node (ETH1 in the above example), and connect it to iSCSI Switch A
Select one port from each node (ETH2 in the above example), and connect it to iSCSI Switch B
The following steps highlight the relevant configuration for iSCSI. For more details, see: Creating an iSCSI service in this document.
Create a network space and call it iSCSI-A:
- Create a new Port Group with ETH1 port from every node
- Provide 6 IP addresses for the Network Space iSCSI-A
- Create a network space and call it iSCSI-B:
- Create a new Port Group with ETH2 port from every node
- Provide 6 IP addresses for the Network Space iSCSI-B
NAS and/or Replication Deployment
Use two switches that support creating LACP LAGs that spread across the switches.
Typically, stacked switches support such a configuration.
Some switch chassis also support this (e.g. Cisco Nexus Virtual PortChannel).
- Select one port from each node (ETH3 in the above example), and connect it to switch module 1
- Select one port from each node (ETH4 in the above example), and connect it to switch module 2
- Configure a LAG for each couple of ports, as indicated above.
The following steps highlight the relevant configuration for NAS and Replication. For more details, see: Creating a NAS Service
Create a network space:
- Create a new Port Group with ETH3 and ETH4 ports from every node
- Provide IP addresses for the Network Space:
- For NAS service, 6 IPs are required
- For replication service, more than 6 IP addresses are required (see IP addresses in the section InfiniBox Best Practices Guide for Setting Up the Replication Service)
- If you need to run both NAS and replication on the same Port Group, create another Network Space using the same Port Group.
Performance and Redundancy
Performance
Specific details about the performance of NAS can be found in InfiniBox Best Practices Guide for Setting Up a NAS Service.
Specific details about the performance of replication can be found in InfiniBox Best Practices Guide for Setting up the Replication Service.
Ensuring Redundancy
"Good Path" ensures redundancy to all virtual IPs (NAS/Replication).
For iSCSI 6 IPs are also virtually applied - however each connection is independently managed with MPIO on the client.
Ensuring Redundancy in the Case of a Failed NIC
1 Failed NIC maintains access to all Virtual IPs although one controller has limited maximum bandwidth.
Ensuring Redundancy in the Case of a Failed Node
Access to all IPs is maintained as IPs are redistributed across the remaining controllers. Bandwidth is limited to the aggregate maximum bandwidth of the remaining controller ports.
Ensuring Redundancy in the Case of a Failed Switch
Access to all virtual IPs is maintained although maximum aggregate performance is reduced to 50%. Typically this has a low performance impact as clients generally do not utilize all of the available bandwidth.
This document guides users on how to set up the Ethernet network for InfiniBox services. Three types of services are supported over Ethernet: NAS, iSCSI and replication. Normally, each service can use two or more ports per node, providing high availability and increased throughput.
Introduction
Scope of document
This document provides guidelines and instructions for setting up InfiniBox services. The document is built upon past releases of Best Practices and Deployment Considerations documents that are still available on the Infinidat Support website. If you are running an InfiniBox version older that 4.0, this document complements but does not entirely replace past documentation.
Obsolete documentation
- Deployment consideration for setting up services - User documentation for InfiniBox v4.0 and former InfiniBox releases, includes an article named "Deployment Considerations for Setting up Services". This article is now obsolete. The instructions provided in the article have been merged into this document
Deploying InfiniBox Services
InfiniBox Services
InfiniBox supports three types of services over Ethernet networks: NAS, iSCSI and replication. Normally, each service can use one, two or more ports per node, which providing high availability and increased throughput.
NAS and replication services can easily share the ports (in pairs) and this is a common configuration. It is neither customary nor recommended to share ports between iSCSI and other services due to the differing nature of the relevant protocols:
- The iSCSI protocol has a built-in mechanism to ensure high-availability and high-performance using multipathing. This is the standard option for iSCSI deployment and is the recommended configuration for using iSCSI with InfiniBox.
- NAS and replication services do not have such built-in support, so LACP (link aggregation) is recommended to provide high-availability and increased performance.
The following table summarizes the different aspects of iSCSI vs. NAS and replication services:
Recommended | iSCSI | NAS and/or Replication |
---|---|---|
Number of Network Spaces | 2 | 1 per service |
Number of port groups | 2 | 1 |
Number of ports in each port group | 1 | 2 |
Switch configuration | 2 separate switches | LACP across chassis (VPC), or stacked switches |
Selecting Ethernet Ports for the Services
Ports should be grouped into pairs so they can be allocated to services. For example, assign ETH1 and ETH2 as one pair, with ETH3 and ETH4 as another pair. Analyze which services are required, and whether is there a need for physical separation between them. Consider the recommendation to isolate iSCSI and the fact that there are a limited number of pairs (depending on InfiniBox model).
Switch requirements
It is also recommended to set the ports connected to InfiniBox to account for changes using a spanning-tree algorithm. For many network vendor implementations, this will be called “portfast”, “edge” or “edge-port” in the switch configuration semantics.
InfiniBox Fx1xx
InfiniBox Fx1xx models have two Ethernet data ports per node (total of 6 ports per system).
Use the following table to decide which port groups you need to create, and how many Ethernet ports to place in each port group:
Is iSCSI required? | Is NAS and/or Replication required? | Recommended Configuration | Example Port Groups |
---|---|---|---|
Not required | Required | 1 port group with 2 ports | PG3 (ETH1, ETH2) for NAS and replication |
Required | Not required | 2 port groups, each with 1 port |
|
Required | Required | 1 port group with 2 ports
| PG3 (ETH1, ETH2) for all services |
InfiniBox Fx2xx: four Ethernet Data Ports Per Node
InfiniBox Fx2xx models have four Ethernet data ports per node (total of 12 ports per system).
On F42xx with SMB nodes ports ETH1 - ETH2 (marked 9 - 10 in the patch panel) are used for back-end connectivity.
Do NOT use these Ethernet ports for any other service.
The management ports (marked MGMT in the patch panel) and the Support Appliance port (marked SA in the patch panel) support 1GbE, 100MbE and 10MbE, and will auto-negotiate the network speed according to the network switch.
Use the following table to decide which port groups you need to create, and how many Ethernet ports to place in each port group:
Is iSCSI required? | Is NAS and/or Replication required? | Recommended Configuration | Example Port Groups |
---|---|---|---|
Not required | Required | 1-2 port groups, each with 2 ports
|
|
Required | Not required | 2 port groups, each with 1 port |
|
Required | Required | iSCSI - 2 port groups, each with 1 port NAS / Replication - 1 port group with 2 ports
|
|
InfiniBox Fx3xx
InfiniBox Fx3xx models have six Ethernet data ports per node (total of 18 ports per system).
In Fx3xx systems using fiber-optic Ethernet connectivity, ports ETH1 - ETH4 (marked 9 - 12 in the patch panel) are 25GbE-ready. We recommend not mixing these ports with ETH5 - ETH6 (marked 13 - 14 in the patch panel) in the same port group.
The management ports (marked MGMT in the patch panel) support 1GbE only.
The Support Appliance port (marked SA in the patch panel) supports 1GbE, 100MbE and 10MbE, and will auto-negotiate the network speed according to the network switch.
Use the following table to decide which port groups you need to create, and how many Ethernet ports to place in each port group:
Is iSCSI required? | Is NAS and/or Replication required? | Recommended Configuration | Example Port Groups |
---|---|---|---|
Not required | Required | 1-3 port groups, each with 2 ports |
|
Required | Not required | 2 port groups, each with 1 port |
|
Required | Required | iSCSI - 2 port groups, each with 1 port NAS - 1 port group with 2 ports Replication - 1 port group with 2 ports |
|
Connecting the Switch to the InfiniBox Patch Panel
iSCSI deployment
- Connect ports to the switches.
Select one port from each node (ETH1 in the above example), and connect it to iSCSI Switch A
Select one port from each node (ETH2 in the above example), and connect it to iSCSI Switch B
The following steps highlight the relevant configuration for iSCSI. For more details, see: Creating an iSCSI service in this document.
Create a network space and call it iSCSI-A:
- Create a new Port Group with ETH1 port from every node
- Provide 6 IP addresses for the Network Space iSCSI-A
- Create a network space and call it iSCSI-B:
- Create a new Port Group with ETH2 port from every node
- Provide 6 IP addresses for the Network Space iSCSI-B
NAS and/or Replication Deployment
Use two switches that support creating LACP LAGs that spread across the switches.
Typically, stacked switches support such a configuration.
Some switch chassis also support this (e.g. Cisco Nexus Virtual PortChannel).
- Select one port from each node (ETH3 in the above example), and connect it to switch module 1
- Select one port from each node (ETH4 in the above example), and connect it to switch module 2
- Configure a LAG for each couple of ports, as indicated above.
The following steps highlight the relevant configuration for NAS and Replication. For more details, see: Creating a NAS Service
Create a network space:
- Create a new Port Group with ETH3 and ETH4 ports from every node
- Provide IP addresses for the Network Space:
- For NAS service, 6 IPs are required
- For replication service, more than 6 IP addresses are required (see IP addresses in the section InfiniBox Best Practices Guide for Setting Up the Replication Service)
- If you need to run both NAS and replication on the same Port Group, create another Network Space using the same Port Group.
Performance and Redundancy
Performance
Specific details about the performance of NAS can be found in InfiniBox Best Practices Guide for Setting Up a NAS Service.
Specific details about the performance of replication can be found in InfiniBox Best Practices Guide for Setting up the Replication Service.
Ensuring Redundancy
"Good Path" ensures redundancy to all virtual IPs (NAS/Replication).
For iSCSI 6 IPs are also virtually applied - however each connection is independently managed with MPIO on the client.
Ensuring Redundancy in the Case of a Failed NIC
1 Failed NIC maintains access to all Virtual IPs although one controller has limited maximum bandwidth.
Ensuring Redundancy in the Case of a Failed Node
Access to all IPs is maintained as IPs are redistributed across the remaining controllers. Bandwidth is limited to the aggregate maximum bandwidth of the remaining controller ports.
Ensuring Redundancy in the Case of a Failed Switch
Access to all virtual IPs is maintained although maximum aggregate performance is reduced to 50%. Typically this has a low performance impact as clients generally do not utilize all of the available bandwidth.
This document guides users on how to set up the Ethernet network for InfiniBox services. Three types of services are supported over Ethernet: NAS, iSCSI and replication. Normally, each service can use two or more ports per node, providing high availability and increased throughput.
Introduction
Scope of document
This document provides guidelines and instructions for setting up InfiniBox services. The document is built upon past releases of Best Practices and Deployment Considerations documents that are still available on the Infinidat Support website. If you are running an InfiniBox version older that 4.0, this document complements but does not entirely replace past documentation.
Obsolete documentation
- Deployment consideration for setting up services - User documentation for InfiniBox v4.0 and former InfiniBox releases, includes an article named "Deployment Considerations for Setting up Services". This article is now obsolete. The instructions provided in the article have been merged into this document
Deploying InfiniBox Services
InfiniBox Services
InfiniBox supports three types of services over Ethernet networks: NAS, iSCSI and replication. Normally, each service can use one, two or more ports per node, which providing high availability and increased throughput.
NAS and replication services can easily share the ports (in pairs) and this is a common configuration. It is neither customary nor recommended to share ports between iSCSI and other services due to the differing nature of the relevant protocols:
- The iSCSI protocol has a built-in mechanism to ensure high-availability and high-performance using multipathing. This is the standard option for iSCSI deployment and is the recommended configuration for using iSCSI with InfiniBox.
- NAS and replication services do not have such built-in support, so LACP (link aggregation) is recommended to provide high-availability and increased performance.
The following table summarizes the different aspects of iSCSI vs. NAS and replication services:
Recommended | iSCSI | NAS and/or Replication |
---|---|---|
Number of Network Spaces | 2 | 1 per service |
Number of port groups | 2 | 1 |
Number of ports in each port group | 1 | 2 |
Switch configuration | 2 separate switches | LACP across chassis (VPC), or stacked switches |
Selecting Ethernet Ports for the Services
Ports should be grouped into pairs so they can be allocated to services. For example, assign ETH1 and ETH2 as one pair, with ETH3 and ETH4 as another pair. Analyze which services are required, and whether is there a need for physical separation between them. Consider the recommendation to isolate iSCSI and the fact that there are a limited number of pairs (depending on InfiniBox model).
Switch requirements
It is also recommended to set the ports connected to InfiniBox to account for changes using a spanning-tree algorithm. For many network vendor implementations, this will be called “portfast”, “edge” or “edge-port” in the switch configuration semantics.
InfiniBox Fx1xx
InfiniBox Fx1xx models have two Ethernet data ports per node (total of 6 ports per system).
Use the following table to decide which port groups you need to create, and how many Ethernet ports to place in each port group:
Is iSCSI required? | Is NAS and/or Replication required? | Recommended Configuration | Example Port Groups |
---|---|---|---|
Not required | Required | 1 port group with 2 ports | PG3 (ETH1, ETH2) for NAS and replication |
Required | Not required | 2 port groups, each with 1 port |
|
Required | Required | 1 port group with 2 ports
| PG3 (ETH1, ETH2) for all services |
InfiniBox Fx2xx: four Ethernet Data Ports Per Node
InfiniBox Fx2xx models have four Ethernet data ports per node (total of 12 ports per system).
On F42xx with SMB nodes ports ETH1 - ETH2 (marked 9 - 10 in the patch panel) are used for back-end connectivity.
Do NOT use these Ethernet ports for any other service.
The management ports (marked MGMT in the patch panel) and the Support Appliance port (marked SA in the patch panel) support 1GbE, 100MbE and 10MbE, and will auto-negotiate the network speed according to the network switch.
Use the following table to decide which port groups you need to create, and how many Ethernet ports to place in each port group:
Is iSCSI required? | Is NAS and/or Replication required? | Recommended Configuration | Example Port Groups |
---|---|---|---|
Not required | Required | 1-2 port groups, each with 2 ports
|
|
Required | Not required | 2 port groups, each with 1 port |
|
Required | Required | iSCSI - 2 port groups, each with 1 port NAS / Replication - 1 port group with 2 ports
|
|
InfiniBox Fx3xx
InfiniBox Fx3xx models have six Ethernet data ports per node (total of 18 ports per system).
In Fx3xx systems using fiber-optic Ethernet connectivity, ports ETH1 - ETH4 (marked 9 - 12 in the patch panel) are 25GbE-ready. We recommend not mixing these ports with ETH5 - ETH6 (marked 13 - 14 in the patch panel) in the same port group.
The management ports (marked MGMT in the patch panel) support 1GbE only.
The Support Appliance port (marked SA in the patch panel) supports 1GbE, 100MbE and 10MbE, and will auto-negotiate the network speed according to the network switch.
Use the following table to decide which port groups you need to create, and how many Ethernet ports to place in each port group:
Is iSCSI required? | Is NAS and/or Replication required? | Recommended Configuration | Example Port Groups |
---|---|---|---|
Not required | Required | 1-3 port groups, each with 2 ports |
|
Required | Not required | 2 port groups, each with 1 port |
|
Required | Required | iSCSI - 2 port groups, each with 1 port NAS - 1 port group with 2 ports Replication - 1 port group with 2 ports |
|
Connecting the Switch to the InfiniBox Patch Panel
iSCSI deployment
- Connect ports to the switches.
Select one port from each node (ETH1 in the above example), and connect it to iSCSI Switch A
Select one port from each node (ETH2 in the above example), and connect it to iSCSI Switch B
The following steps highlight the relevant configuration for iSCSI. For more details, see: Creating an iSCSI service in this document.
Create a network space and call it iSCSI-A:
- Create a new Port Group with ETH1 port from every node
- Provide 6 IP addresses for the Network Space iSCSI-A
- Create a network space and call it iSCSI-B:
- Create a new Port Group with ETH2 port from every node
- Provide 6 IP addresses for the Network Space iSCSI-B
NAS and/or Replication Deployment
Use two switches that support creating LACP LAGs that spread across the switches.
Typically, stacked switches support such a configuration.
Some switch chassis also support this (e.g. Cisco Nexus Virtual PortChannel).
- Select one port from each node (ETH3 in the above example), and connect it to switch module 1
- Select one port from each node (ETH4 in the above example), and connect it to switch module 2
- Configure a LAG for each couple of ports, as indicated above.
The following steps highlight the relevant configuration for NAS and Replication. For more details, see: Creating a NAS Service
Create a network space:
- Create a new Port Group with ETH3 and ETH4 ports from every node
- Provide IP addresses for the Network Space:
- For NAS service, 6 IPs are required
- For replication service, more than 6 IP addresses are required (see IP addresses in the section InfiniBox Best Practices Guide for Setting Up the Replication Service)
- If you need to run both NAS and replication on the same Port Group, create another Network Space using the same Port Group.
Performance and Redundancy
Performance
Specific details about the performance of NAS can be found in InfiniBox Best Practices Guide for Setting Up a NAS Service.
Specific details about the performance of replication can be found in InfiniBox Best Practices Guide for Setting up the Replication Service.
Ensuring Redundancy
"Good Path" ensures redundancy to all virtual IPs (NAS/Replication).
For iSCSI 6 IPs are also virtually applied - however each connection is independently managed with MPIO on the client.
Ensuring Redundancy in the Case of a Failed NIC
1 Failed NIC maintains access to all Virtual IPs although one controller has limited maximum bandwidth.
Ensuring Redundancy in the Case of a Failed Node
Access to all IPs is maintained as IPs are redistributed across the remaining controllers. Bandwidth is limited to the aggregate maximum bandwidth of the remaining controller ports.
Ensuring Redundancy in the Case of a Failed Switch
Access to all virtual IPs is maintained although maximum aggregate performance is reduced to 50%. Typically this has a low performance impact as clients generally do not utilize all of the available bandwidth.
This document guides users on how to set up the Ethernet network for InfiniBox services. Three types of services are supported over Ethernet: NAS, iSCSI and replication. Normally, each service can use two or more ports per node, providing high availability and increased throughput.
Introduction
Scope of document
This document provides guidelines and instructions for setting up InfiniBox services. The document is built upon past releases of Best Practices and Deployment Considerations documents that are still available on the Infinidat Support website. If you are running an InfiniBox version older that 4.0, this document complements but does not entirely replace past documentation.
Obsolete documentation
- Deployment consideration for setting up services - User documentation for InfiniBox v4.0 and former InfiniBox releases, includes an article named "Deployment Considerations for Setting up Services". This article is now obsolete. The instructions provided in the article have been merged into this document
Deploying InfiniBox Services
InfiniBox Services
InfiniBox supports three types of services over Ethernet networks: NAS, iSCSI and replication. Normally, each service can use one, two or more ports per node, which providing high availability and increased throughput.
NAS and replication services can easily share the ports (in pairs) and this is a common configuration. It is neither customary nor recommended to share ports between iSCSI and other services due to the differing nature of the relevant protocols:
- The iSCSI protocol has a built-in mechanism to ensure high-availability and high-performance using multipathing. This is the standard option for iSCSI deployment and is the recommended configuration for using iSCSI with InfiniBox.
- NAS and replication services do not have such built-in support, so LACP (link aggregation) is recommended to provide high-availability and increased performance.
The following table summarizes the different aspects of iSCSI vs. NAS and replication services:
Recommended | iSCSI | NAS and/or Replication |
---|---|---|
Number of Network Spaces | 2 | 1 per service |
Number of port groups | 2 | 1 |
Number of ports in each port group | 1 | 2 |
Switch configuration | 2 separate switches | LACP across chassis (VPC), or stacked switches |
Selecting Ethernet Ports for the Services
Ports should be grouped into pairs so they can be allocated to services. For example, assign ETH1 and ETH2 as one pair, with ETH3 and ETH4 as another pair. Analyze which services are required, and whether is there a need for physical separation between them. Consider the recommendation to isolate iSCSI and the fact that there are a limited number of pairs (depending on InfiniBox model).
Switch requirements
It is also recommended to set the ports connected to InfiniBox to account for changes using a spanning-tree algorithm. For many network vendor implementations, this will be called “portfast”, “edge” or “edge-port” in the switch configuration semantics.
InfiniBox Fx1xx
InfiniBox Fx1xx models have two Ethernet data ports per node (total of 6 ports per system).
Use the following table to decide which port groups you need to create, and how many Ethernet ports to place in each port group:
Is iSCSI required? | Is NAS and/or Replication required? | Recommended Configuration | Example Port Groups |
---|---|---|---|
Not required | Required | 1 port group with 2 ports | PG3 (ETH1, ETH2) for NAS and replication |
Required | Not required | 2 port groups, each with 1 port |
|
Required | Required | 1 port group with 2 ports
| PG3 (ETH1, ETH2) for all services |
InfiniBox Fx2xx: four Ethernet Data Ports Per Node
InfiniBox Fx2xx models have four Ethernet data ports per node (total of 12 ports per system).
On F42xx with SMB nodes ports ETH1 - ETH2 (marked 9 - 10 in the patch panel) are used for back-end connectivity.
Do NOT use these Ethernet ports for any other service.
The management ports (marked MGMT in the patch panel) and the Support Appliance port (marked SA in the patch panel) support 1GbE, 100MbE and 10MbE, and will auto-negotiate the network speed according to the network switch.
Use the following table to decide which port groups you need to create, and how many Ethernet ports to place in each port group:
Is iSCSI required? | Is NAS and/or Replication required? | Recommended Configuration | Example Port Groups |
---|---|---|---|
Not required | Required | 1-2 port groups, each with 2 ports
|
|
Required | Not required | 2 port groups, each with 1 port |
|
Required | Required | iSCSI - 2 port groups, each with 1 port NAS / Replication - 1 port group with 2 ports
|
|
InfiniBox Fx3xx
InfiniBox Fx3xx models have six Ethernet data ports per node (total of 18 ports per system).
In Fx3xx systems using fiber-optic Ethernet connectivity, ports ETH1 - ETH4 (marked 9 - 12 in the patch panel) are 25GbE-ready. We recommend not mixing these ports with ETH5 - ETH6 (marked 13 - 14 in the patch panel) in the same port group.
The management ports (marked MGMT in the patch panel) support 1GbE only.
The Support Appliance port (marked SA in the patch panel) supports 1GbE, 100MbE and 10MbE, and will auto-negotiate the network speed according to the network switch.
Use the following table to decide which port groups you need to create, and how many Ethernet ports to place in each port group:
Is iSCSI required? | Is NAS and/or Replication required? | Recommended Configuration | Example Port Groups |
---|---|---|---|
Not required | Required | 1-3 port groups, each with 2 ports |
|
Required | Not required | 2 port groups, each with 1 port |
|
Required | Required | iSCSI - 2 port groups, each with 1 port NAS - 1 port group with 2 ports Replication - 1 port group with 2 ports |
|
Connecting the Switch to the InfiniBox Patch Panel
iSCSI deployment
- Connect ports to the switches.
Select one port from each node (ETH1 in the above example), and connect it to iSCSI Switch A
Select one port from each node (ETH2 in the above example), and connect it to iSCSI Switch B
The following steps highlight the relevant configuration for iSCSI. For more details, see: Creating an iSCSI service in this document.
Create a network space and call it iSCSI-A:
- Create a new Port Group with ETH1 port from every node
- Provide 6 IP addresses for the Network Space iSCSI-A
- Create a network space and call it iSCSI-B:
- Create a new Port Group with ETH2 port from every node
- Provide 6 IP addresses for the Network Space iSCSI-B
NAS and/or Replication Deployment
Use two switches that support creating LACP LAGs that spread across the switches.
Typically, stacked switches support such a configuration.
Some switch chassis also support this (e.g. Cisco Nexus Virtual PortChannel).
- Select one port from each node (ETH3 in the above example), and connect it to switch module 1
- Select one port from each node (ETH4 in the above example), and connect it to switch module 2
- Configure a LAG for each couple of ports, as indicated above.
The following steps highlight the relevant configuration for NAS and Replication. For more details, see: Creating a NAS Service
Create a network space:
- Create a new Port Group with ETH3 and ETH4 ports from every node
- Provide IP addresses for the Network Space:
- For NAS service, 6 IPs are required
- For replication service, more than 6 IP addresses are required (see IP addresses in the section InfiniBox Best Practices Guide for Setting Up the Replication Service)
- If you need to run both NAS and replication on the same Port Group, create another Network Space using the same Port Group.
Performance and Redundancy
Performance
Specific details about the performance of NAS can be found in InfiniBox Best Practices Guide for Setting Up a NAS Service.
Specific details about the performance of replication can be found in InfiniBox Best Practices Guide for Setting up the Replication Service.
Ensuring Redundancy
"Good Path" ensures redundancy to all virtual IPs (NAS/Replication).
For iSCSI 6 IPs are also virtually applied - however each connection is independently managed with MPIO on the client.
Ensuring Redundancy in the Case of a Failed NIC
1 Failed NIC maintains access to all Virtual IPs although one controller has limited maximum bandwidth.
Ensuring Redundancy in the Case of a Failed Node
Access to all IPs is maintained as IPs are redistributed across the remaining controllers. Bandwidth is limited to the aggregate maximum bandwidth of the remaining controller ports.
Ensuring Redundancy in the Case of a Failed Switch
Access to all virtual IPs is maintained although maximum aggregate performance is reduced to 50%. Typically this has a low performance impact as clients generally do not utilize all of the available bandwidth.
Comments