This is a production configuration I have used with 1GbE and 10GbE Extreme Networks switches for iSCSI storage, specifically a Nimble Storage CS260G with 1GbE management interfaces and 10GbE iSCSI data interfaces.
10GbE iSCSI is on one stacked pair of Extreme x670’s and the 1GbE management interfaces are on an x460 stack.
This is the ExtremeOS configuration I have for both networks.
#iSCSI data ports (10GbE) Extreme Networks x670 (stacked pair)
configure ports 1:1, 1:2, 2:1, 2:2 display-string “Nimble01-Prod-iSCSI”
enable flow-control tx-pause ports 1:1, 1:2, 2:1, 2:2
enable flow-control rx-pause ports 1:1, 1:2, 2:1, 2:2
configure vlan “iSCSI_Data” tag 140
configure vlan “iSCSI_Data” ipaddress 10.190.201.250 255.255.255.0
configure vlan “iSCSI_Data” add ports 1:1,1:2,2:1,2:2
#Mgmt ports (1GbE) Extreme Networks x460 (stacked pair)
configure ports 1:1,1:2,2:1,2:2 display-string “Nimble01-Prod-Mgmt”
configure vlan “Storage_Mgmt” tag 130
configure vlan “Storage_Mgmt” ipaddress 10.201.201.1 255.255.255.0
enable ipforwarding vlan “Storage_Mgmt”
configure vlan “Storage_Mgmt” add ports 1:1,1:2,2:1,2:2
I have no spanning tree or rate-limiting (also known as broadcast storm control) configured on any iSCSI or management ports. These are not recommended for iSCSI performance reasons.
The important architectural points are:
- iSCSI and management have dedicated VLAN’s for isolation, performance and security/policy etc .
- The switch ports carrying iSCSI data have send/receive flow control enabled, for performance consistency.
- Switches carrying management and iSCSI data are stacked for redundancy.