|

Network Appliance - Toasters

10 Gbps curiosity

View: New views

10 Messages — Rating Filter: Alert me

	10 Gbps curiosity by Jedan58 :: Rate this Message: \| View Threaded \| Show Only this Message Some parts of this message have been removed. Learn more about Nabble's security policy. Hi all Reading on superior results reached in certaing environment (NetApp NFS with Oracle ad example) I’m looking for some direct experience and informations about performances, benchmarks, infrastructure used - I mean also exactly model and brand of switches J - and so on. So that, more on the relatively new world of 10 Gbps networks. Does anyone direct experience? Are you using it in your site? Thanks in advance
	RE: 10 Gbps curiosity by Page, Jeremy :: Rate this Message: \| View Threaded \| Show Only this Message Some parts of this message have been removed. Learn more about Nabble's security policy. I have just (generating some traffic here in doing so) added a pair of stacked Cisco 3750-E switches with redundant 10g connections. Right now they are just using etherchannel with default MTU. Once everything else is running properly I’ll try LACP and probably an MTU of ~7500. The only problem I see is it’s VERY easy to burn the CPU when doing large writes because I have the TOE cards in a VIF…which disables the TOE functionality. --- From: owner-toasters@... [mailto:owner-toasters@...] On Behalf Of Milazzo Giacomo Sent: Wednesday, May 21, 2008 11:11 AM To: toasters@... Subject: 10 Gbps curiosity Hi all Reading on superior results reached in certaing environment (NetApp NFS with Oracle ad example) I’m looking for some direct experience and informations about performances, benchmarks, infrastructure used - I mean also exactly model and brand of switches J - and so on. So that, more on the relatively new world of 10 Gbps networks. Does anyone direct experience? Are you using it in your site? Thanks in advance This message (including any attachments) contains confidential and/or proprietary information intended only for the addressee. Any unauthorized disclosure, copying, distribution or reliance on the contents of this information is strictly prohibited and may constitute a violation of law. If you are not the intended recipient, please notify the sender immediately by responding to this e-mail, and delete the message from your system. If you have any questions about this e-mail please notify the sender immediately.
	RE: 10 Gbps curiosity by Willeke, Jochen :: Rate this Message: \| View Threaded \| Show Only this Message Some parts of this message have been removed. Learn more about Nabble's security policy. Hello, we use FAS6070 with 2x10Gbps and Oracle DB's over NFS for nearly 2 years now. Our switches are Nortell 8000 series, so we use a technique called SMLT which allows us to use both links while they are connected to different switches. The databases run quite well over NFS. Sadly only the filers are using 10Gbps, the servers don't have 10Gbps. Nevertheless we see good roundtrip times and throughput, but as always there are some people who argue that SAN would be faster. Sadly we have no global benchmark tests, only results while investigating problems. One thing we came along is when using a vif with two PCI-X-10Gbps-NICs we see a strange performance slump for 32k frames, but only on one interface. Right now we are searching together with netapp for the root of this problem. Regards Jochen From: owner-toasters@... [mailto:owner-toasters@...] On Behalf Of Milazzo Giacomo Sent: Wednesday, May 21, 2008 5:11 PM To: toasters@... Subject: 10 Gbps curiosity Hi all Reading on superior results reached in certaing environment (NetApp NFS with Oracle ad example) I’m looking for some direct experience and informations about performances, benchmarks, infrastructure used - I mean also exactly model and brand of switches J - and so on. So that, more on the relatively new world of 10 Gbps networks. Does anyone direct experience? Are you using it in your site? Thanks in advance Wincor Nixdorf International GmbH Sitz der Gesellschaft: Paderborn Registergericht Paderborn HRB 3507 Geschäftsführer: Eckard Heidloff (Vorsitzender), Stefan Auerbach, Dr. Jürgen Wunram Vorsitzender des Aufsichtsrats: Karl-Heinz Stiller Steuernummer: 339/5884/0020 - Ust-ID Nr.: DE812927716 - WEEE-Reg.-Nr. DE44477193 Diese E-Mail enthält vertrauliche Informationen. Wenn Sie nicht der richtige Adressat sind oder diese E-Mail irrtümlich erhalten haben, informieren Sie bitte sofort den Absender und vernichten Sie diese E-Mail. Das unerlaubte Kopieren sowie die unbefugte Weitergabe dieser E-Mail ist nicht gestattet. This e-mail may contain confidential information. If you are not the intended recipient (or have received this e-mail in error) please notify the sender immediately and destroy this e-mail. Any unauthorised copying, disclosure or distribution of the material in this e-mail is strictly forbidden.
	RE: 10 Gbps curiosity by Jean-Noel Filippi :: Rate this Message: \| View Threaded \| Show Only this Message Some parts of this message have been removed. Learn more about Nabble's security policy. We use 2 x FAS6080 with redundant 10GE in a VIF single mode. They are connected to Force10 C300 switches. We generated up to 4Gbit of CIFS traffic and everything works well. From: owner-toasters@... [mailto:owner-toasters@...] On Behalf Of Milazzo Giacomo Sent: Wednesday, May 21, 2008 8:11 AM To: toasters@... Subject: 10 Gbps curiosity Hi all Reading on superior results reached in certaing environment (NetApp NFS with Oracle ad example) I’m looking for some direct experience and informations about performances, benchmarks, infrastructure used - I mean also exactly model and brand of switches J - and so on. So that, more on the relatively new world of 10 Gbps networks. Does anyone direct experience? Are you using it in your site? Thanks in advance
	RE: 10 Gbps curiosity by Glenn Walker :: Rate this Message: \| View Threaded \| Show Only this Message Some parts of this message have been removed. Learn more about Nabble's security policy. LACP isn’t supported on the 10GbE cards either, FYI. Glenn From: owner-toasters@... [mailto:owner-toasters@...] On Behalf Of Page, Jeremy Sent: Wednesday, May 21, 2008 11:54 AM To: toasters@... Subject: RE: 10 Gbps curiosity I have just (generating some traffic here in doing so) added a pair of stacked Cisco 3750-E switches with redundant 10g connections. Right now they are just using etherchannel with default MTU. Once everything else is running properly I’ll try LACP and probably an MTU of ~7500. The only problem I see is it’s VERY easy to burn the CPU when doing large writes because I have the TOE cards in a VIF…which disables the TOE functionality. --- From: owner-toasters@... [mailto:owner-toasters@...] On Behalf Of Milazzo Giacomo Sent: Wednesday, May 21, 2008 11:11 AM To: toasters@... Subject: 10 Gbps curiosity Hi all Reading on superior results reached in certaing environment (NetApp NFS with Oracle ad example) I’m looking for some direct experience and informations about performances, benchmarks, infrastructure used - I mean also exactly model and brand of switches J - and so on. So that, more on the relatively new world of 10 Gbps networks. Does anyone direct experience? Are you using it in your site? Thanks in advance This message (including any attachments) contains confidential and/or proprietary information intended only for the addressee. Any unauthorized disclosure, copying, distribution or reliance on the contents of this information is strictly prohibited and may constitute a violation of law. If you are not the intended recipient, please notify the sender immediately by responding to this e-mail, and delete the message from your system. If you have any questions about this e-mail please notify the sender immediately.
	RE: 10 Gbps curiosity by Glenn Walker :: Rate this Message: \| View Threaded \| Show Only this Message Some parts of this message have been removed. Learn more about Nabble's security policy. We’re deploying FAS6070s with 2 x Active\ 2 x Passive 10GbE Single Mode, multi-level VIFs (Etherchannel) per head for VMWare over NFS. Looks good so far, so I’ll let the group know how this turns out… FWIW, I have the same concerns over CPU, but I’m hedging my bets that the FAS6070s are such beasts that they won’t really care. From: owner-toasters@... [mailto:owner-toasters@...] On Behalf Of Jean-Noel Filippi Sent: Wednesday, May 21, 2008 2:18 PM To: Milazzo Giacomo; toasters@... Subject: RE: 10 Gbps curiosity We use 2 x FAS6080 with redundant 10GE in a VIF single mode. They are connected to Force10 C300 switches. We generated up to 4Gbit of CIFS traffic and everything works well. From: owner-toasters@... [mailto:owner-toasters@...] On Behalf Of Milazzo Giacomo Sent: Wednesday, May 21, 2008 8:11 AM To: toasters@... Subject: 10 Gbps curiosity Hi all Reading on superior results reached in certaing environment (NetApp NFS with Oracle ad example) I’m looking for some direct experience and informations about performances, benchmarks, infrastructure used - I mean also exactly model and brand of switches J - and so on. So that, more on the relatively new world of 10 Gbps networks. Does anyone direct experience? Are you using it in your site? Thanks in advance
	RE: 10 Gbps curiosity by Glenn Walker :: Rate this Message: \| View Threaded \| Show Only this Message Some parts of this message have been removed. Learn more about Nabble's security policy. Crap L NetApp – when are you going to enable ToE and EtherChannel together? This bombs my plans pretty quickly. Maybe I can change it now before it’s too late. From: Myles Uyema [mailto:mlists@...] Sent: Wednesday, May 21, 2008 10:21 PM To: Glenn Walker Cc: Jean-Noel Filippi; Milazzo Giacomo; <toasters@...> Subject: Re: 10 Gbps curiosity With TOE disabled we maxxed out a 6070 head at 375MBytes per second on 7.2.4. NFS only. Network domain pegged at 100%. With TOE enabled on 7.3RC1 we saw 815MBytes per second. 60% network domain. PCI-X single port TOE, 100 clients reading sequentially. </phone> On May 21, 2008, at 2:58 PM, "Glenn Walker" <ggwalker@...> wrote: We’re deploying FAS6070s with 2 x Active\ 2 x Passive 10GbE Single Mode, multi-level VIFs (Etherchannel) per head for VMWare over NFS. Looks good so far, so I’ll let the group know how this turns out… FWIW, I have the same concerns over CPU, but I’m hedging my bets that the FAS6070s are such beasts that they won’t really care. From: owner-toasters@... [owner-toasters@...] On Behalf Of Jean-Noel Filippi Sent: Wednesday, May 21, 2008 2:18 PM To: Milazzo Giacomo; toasters@...toasters@... Subject: RE: 10 Gbps curiosity We use 2 x FAS6080 with redundant 10GE in a VIF single mode. They are connected to Force10 C300 switches. We generated up to 4Gbit of CIFS traffic and everything works well. From: owner-toasters@... [owner-toasters@...] On Behalf Of Milazzo Giacomo Sent: Wednesday, May 21, 2008 8:11 AM To: toasters@...toasters@... Subject: 10 Gbps curiosity Hi all Reading on superior results reached in certaing environment (NetApp NFS with Oracle ad example) I’m looking for some direct experience and informations about performances, benchmarks, infrastructure used - I mean also exactly model and brand of switches J - and so on. So that, more on the relatively new world of 10 Gbps networks. Does anyone direct experience? Are you using it in your site? Thanks in advance
	RE: 10 Gbps curiosity by Glenn Walker :: Rate this Message: \| View Threaded \| Show Only this Message Some parts of this message have been removed. Learn more about Nabble's security policy. FWIW, the documentation states that ToE with 10GbE is disabled when part of a VIF. I originally thought this meant ‘etherchannel’ given that LACP wasn’t supported with 10GbE, but re-reading it appears to imply _any_ VIF, even single-mode (it wasn’t specified, so I have to assume any VIF). This is less than stellar – what good is having an interface that is a SPOF? Unless this documentation is incorrect, I have no choice but to remain without ToE L From: owner-toasters@... [mailto:owner-toasters@...] On Behalf Of Glenn Walker Sent: Wednesday, May 21, 2008 11:05 PM To: Myles Uyema Cc: Jean-Noel Filippi; Milazzo Giacomo; toasters@... Subject: RE: 10 Gbps curiosity Crap L NetApp – when are you going to enable ToE and EtherChannel together? This bombs my plans pretty quickly. Maybe I can change it now before it’s too late. From: Myles Uyema [mailto:mlists@...] Sent: Wednesday, May 21, 2008 10:21 PM To: Glenn Walker Cc: Jean-Noel Filippi; Milazzo Giacomo; <toasters@...> Subject: Re: 10 Gbps curiosity With TOE disabled we maxxed out a 6070 head at 375MBytes per second on 7.2.4. NFS only. Network domain pegged at 100%. With TOE enabled on 7.3RC1 we saw 815MBytes per second. 60% network domain. PCI-X single port TOE, 100 clients reading sequentially. </phone> On May 21, 2008, at 2:58 PM, "Glenn Walker" <ggwalker@...> wrote: We’re deploying FAS6070s with 2 x Active\ 2 x Passive 10GbE Single Mode, multi-level VIFs (Etherchannel) per head for VMWare over NFS. Looks good so far, so I’ll let the group know how this turns out… FWIW, I have the same concerns over CPU, but I’m hedging my bets that the FAS6070s are such beasts that they won’t really care. From: owner-toasters@... [owner-toasters@...] On Behalf Of Jean-Noel Filippi Sent: Wednesday, May 21, 2008 2:18 PM To: Milazzo Giacomo; toasters@...toasters@... Subject: RE: 10 Gbps curiosity We use 2 x FAS6080 with redundant 10GE in a VIF single mode. They are connected to Force10 C300 switches. We generated up to 4Gbit of CIFS traffic and everything works well. From: owner-toasters@... [owner-toasters@...] On Behalf Of Milazzo Giacomo Sent: Wednesday, May 21, 2008 8:11 AM To: toasters@...toasters@... Subject: 10 Gbps curiosity Hi all Reading on superior results reached in certaing environment (NetApp NFS with Oracle ad example) I’m looking for some direct experience and informations about performances, benchmarks, infrastructure used - I mean also exactly model and brand of switches J - and so on. So that, more on the relatively new world of 10 Gbps networks. Does anyone direct experience? Are you using it in your site? Thanks in advance
	RE: 10 Gbps curiosity by Pascal Dukers :: Rate this Message: \| View Threaded \| Show Only this Message Glenn Walker wrote: FWIW, the documentation states that ToE with 10GbE is disabled when part of a VIF. I originally thought this meant 'etherchannel' given that LACP wasn't supported with 10GbE, but re-reading it appears to imply _any_ VIF, even single-mode (it wasn't specified, so I have to assume any VIF). I can confirm that TOE gets disabled even with a single vif. The filer showed the following message while creating a single vif with 2 10 Gb ports: "The system-wide TCP Offload Engine (TOE) functionality was changed to off due to vif on TOE restriction." And I looks even worse considering it turns it off system wide, meaning you can't have TOE on a non-vif 10 Gb port next to a 10 Gb vif! I hope they will enable TOE with vifs in the near future.
	RE: 10 Gbps curiosity by Glenn Walker :: Rate this Message: \| View Threaded \| Show Only this Message Yeah - I noticed the 'system-wide' part myself. ToE and VIFs go together like peanut butter and jelly - time to make it happen, guys! :) -----Original Message----- From: owner-toasters@... [mailto:owner-toasters@...] On Behalf Of Pascal Dukers Sent: Thursday, May 22, 2008 1:57 AM To: toasters@... Subject: RE: 10 Gbps curiosity Glenn Walker wrote: > > FWIW, the documentation states that ToE with 10GbE is disabled when part > of a VIF. I originally thought this meant 'etherchannel' given that > LACP wasn't supported with 10GbE, but re-reading it appears to imply > _any_ VIF, even single-mode (it wasn't specified, so I have to assume > any VIF). > I can confirm that TOE gets disabled even with a single vif. The filer showed the following message while creating a single vif with 2 10 Gb ports: "The system-wide TCP Offload Engine (TOE) functionality was changed to off due to vif on TOE restriction." And I looks even worse considering it turns it off system wide, meaning you can't have TOE on a non-vif 10 Gb port next to a 10 Gb vif! I hope they will enable TOE with vifs in the near future. -- View this message in context: http://www.nabble.com/10-Gbps-curiosity-tp17371975p17397848.html Sent from the Network Appliance - Toasters mailing list archive at Nabble.com.