Low Network Throughput between HVM Guests

View: New views
9 Messages — Rating Filter:   Alert me  

Low Network Throughput between HVM Guests

by Mr. Teo En Ming (Zhang Enming)-2 :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

Hi,

Is it possible to increase network throughput between HVM virtual machines? It is very slow.

--
Mr. Teo En Ming (Zhang Enming) Dip(Mechatronics) BEng(Hons)(Mechanical Engineering)
Alma Maters:
(1) Singapore Polytechnic
(2) National University of Singapore
My Primary Blog: http://teo-en-ming-aka-zhang-enming.blogspot.com
My Secondary Blog: http://enmingteo.wordpress.com
My Youtube videos: http://www.youtube.com/user/enmingteo
Email: space.time.universe@...
Mobile Phone (Starhub Prepaid): +65-8369-2618
Street: Bedok Reservoir Road
Country: Singapore

_______________________________________________
Xen-devel mailing list
Xen-devel@...
http://lists.xensource.com/xen-devel

Re: Low Network Throughput between HVM Guests

by Mr. Teo En Ming (Zhang Enming)-2 :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

Hi All,

Please refer to the following thread:

http://lists.sdsc.edu/pipermail/npaci-rocks-discussion/2009-November/043597.html

--
Mr. Teo En Ming (Zhang Enming) Dip(Mechatronics) BEng(Hons)(Mechanical Engineering)
Alma Maters:
(1) Singapore Polytechnic
(2) National University of Singapore
My Primary Blog: http://teo-en-ming-aka-zhang-enming.blogspot.com
My Secondary Blog: http://enmingteo.wordpress.com
My Youtube videos: http://www.youtube.com/user/enmingteo
Email: space.time.universe@...
Mobile Phone (Starhub Prepaid): +65-8369-2618
Street: Bedok Reservoir Road
Country: Singapore

On Sat, Nov 7, 2009 at 1:10 PM, Mr. Teo En Ming (Zhang Enming) <space.time.universe@...> wrote:
Hi,

Is it possible to increase network throughput between HVM virtual machines? It is very slow.

--
Mr. Teo En Ming (Zhang Enming) Dip(Mechatronics) BEng(Hons)(Mechanical Engineering)
Alma Maters:
(1) Singapore Polytechnic
(2) National University of Singapore
My Primary Blog: http://teo-en-ming-aka-zhang-enming.blogspot.com
My Secondary Blog: http://enmingteo.wordpress.com
My Youtube videos: http://www.youtube.com/user/enmingteo
Email: space.time.universe@...
Mobile Phone (Starhub Prepaid): +65-8369-2618
Street: Bedok Reservoir Road
Country: Singapore





_______________________________________________
Xen-devel mailing list
Xen-devel@...
http://lists.xensource.com/xen-devel

Re: Low Network Throughput between HVM Guests

by Pasi Kärkkäinen :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

On Sat, Nov 07, 2009 at 01:10:56PM +0800, Mr. Teo En Ming (Zhang Enming) wrote:
>    Hi,
>
>    Is it possible to increase network throughput between HVM virtual
>    machines? It is very slow.
>

Do you have PV drivers installed in the HVM guests? if not, use e1000 NIC.

-- Pasi


_______________________________________________
Xen-devel mailing list
Xen-devel@...
http://lists.xensource.com/xen-devel

Re: Low Network Throughput between HVM Guests

by Mr. Teo En Ming (Zhang Enming)-2 :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

Hi Pasi,

I am not sure whether I can install PV drivers in Rocks HPC Cluster software 5.1 x86-64 (based on CentOS) HVM virtual machines. When I tried to install Rocks 5.1 x86-64 as a PV guest, it complains "invalid kernel" and something about the ELF kernel image. So I guess PV is out for Rocks.

To set e1000 (virtualized Intel Gigabit NIC), I have to use the model parameter in vif in HVM config? Will I get gigabit speeds instead of the Fast Ethernet 100Mb/s speed with virtual Realtek NICs?

Thank you.

--
Mr. Teo En Ming (Zhang Enming) Dip(Mechatronics) BEng(Hons)(Mechanical Engineering)
Alma Maters:
(1) Singapore Polytechnic
(2) National University of Singapore
My Primary Blog: http://teo-en-ming-aka-zhang-enming.blogspot.com
My Secondary Blog: http://enmingteo.wordpress.com
My Youtube videos: http://www.youtube.com/user/enmingteo
Email: space.time.universe@...
Mobile Phone (Starhub Prepaid): +65-8369-2618
Street: Bedok Reservoir Road
Country: Singapore

On Sat, Nov 7, 2009 at 7:17 PM, Pasi Kärkkäinen <pasik@...> wrote:
On Sat, Nov 07, 2009 at 01:10:56PM +0800, Mr. Teo En Ming (Zhang Enming) wrote:
>    Hi,
>
>    Is it possible to increase network throughput between HVM virtual
>    machines? It is very slow.
>

Do you have PV drivers installed in the HVM guests? if not, use e1000 NIC.

-- Pasi





_______________________________________________
Xen-devel mailing list
Xen-devel@...
http://lists.xensource.com/xen-devel

Re: Low Network Throughput between HVM Guests

by Mr. Teo En Ming (Zhang Enming)-2 :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

Hi Pasi,

With reference to http://download.oracle.com/docs/cd/E11081_01/doc/doc.21/e10898/templates.htm#BABGBGHA ,

vif = [ 'type=ioemu, mac=00:16:3e:09:bb:c6, bridge=xenbr2, model=e1000']

Can I omit type=ioemu?
--
Mr. Teo En Ming (Zhang Enming) Dip(Mechatronics) BEng(Hons)(Mechanical Engineering)
Alma Maters:
(1) Singapore Polytechnic
(2) National University of Singapore
My Primary Blog: http://teo-en-ming-aka-zhang-enming.blogspot.com
My Secondary Blog: http://enmingteo.wordpress.com
My Youtube videos: http://www.youtube.com/user/enmingteo
Email: space.time.universe@...
Mobile Phone (Starhub Prepaid): +65-8369-2618
Street: Bedok Reservoir Road
Country: Singapore

On Sat, Nov 7, 2009 at 7:23 PM, Mr. Teo En Ming (Zhang Enming) <space.time.universe@...> wrote:
Hi Pasi,

I am not sure whether I can install PV drivers in Rocks HPC Cluster software 5.1 x86-64 (based on CentOS) HVM virtual machines. When I tried to install Rocks 5.1 x86-64 as a PV guest, it complains "invalid kernel" and something about the ELF kernel image. So I guess PV is out for Rocks.

To set e1000 (virtualized Intel Gigabit NIC), I have to use the model parameter in vif in HVM config? Will I get gigabit speeds instead of the Fast Ethernet 100Mb/s speed with virtual Realtek NICs?

Thank you.


--
Mr. Teo En Ming (Zhang Enming) Dip(Mechatronics) BEng(Hons)(Mechanical Engineering)
Alma Maters:
(1) Singapore Polytechnic
(2) National University of Singapore
My Primary Blog: http://teo-en-ming-aka-zhang-enming.blogspot.com
My Secondary Blog: http://enmingteo.wordpress.com
My Youtube videos: http://www.youtube.com/user/enmingteo
Email: space.time.universe@...
Mobile Phone (Starhub Prepaid): +65-8369-2618
Street: Bedok Reservoir Road
Country: Singapore

On Sat, Nov 7, 2009 at 7:17 PM, Pasi Kärkkäinen <pasik@...> wrote:
On Sat, Nov 07, 2009 at 01:10:56PM +0800, Mr. Teo En Ming (Zhang Enming) wrote:
>    Hi,
>
>    Is it possible to increase network throughput between HVM virtual
>    machines? It is very slow.
>

Do you have PV drivers installed in the HVM guests? if not, use e1000 NIC.

-- Pasi









_______________________________________________
Xen-devel mailing list
Xen-devel@...
http://lists.xensource.com/xen-devel

Re: Low Network Throughput between HVM Guests

by Pasi Kärkkäinen :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

On Sat, Nov 07, 2009 at 07:23:48PM +0800, Mr. Teo En Ming (Zhang Enming) wrote:
>    Hi Pasi,
>
>    I am not sure whether I can install PV drivers in Rocks HPC Cluster
>    software 5.1 x86-64 (based on CentOS) HVM virtual machines. When I tried
>    to install Rocks 5.1 x86-64 as a PV guest, it complains "invalid kernel"
>    and something about the ELF kernel image. So I guess PV is out for Rocks.
>

What complains about invalid kernel?

I think redhat does ship pv-on-hvm drivers with rhel/centos, so you
could enable those and get paravirtualized disk and network for the HVM
guest.

>    To set e1000 (virtualized Intel Gigabit NIC), I have to use the model
>    parameter in vif in HVM config? Will I get gigabit speeds instead of the
>    Fast Ethernet 100Mb/s speed with virtual Realtek NICs?
>

In a virtual guest those reported speeds don't mean much.. so even when the
realtek nic reports 100 Mbit/sec speed, it can go faster.

But yeah, model=e1000 and it will be reported as 1Gbit/sec.

Qemu e1000 emulation is faster than realtek emulation.. so that should be better.

-- Pasi


_______________________________________________
Xen-devel mailing list
Xen-devel@...
http://lists.xensource.com/xen-devel

Re: Low Network Throughput between HVM Guests

by Mr. Teo En Ming (Zhang Enming)-2 :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

Hi Pasi,

I have added 'type=ioemu' and 'model=e1000' to vif in my HVM configuration files. Now the Rocks HPC Cluster 5.1 x86-64 Frontend node detected two Intel 82540 Gigabit Ethernet controllers. Hopefully this will speed up my compute node installation with the upgraded gigabit speed.

--
Mr. Teo En Ming (Zhang Enming) Dip(Mechatronics) BEng(Hons)(Mechanical Engineering)
Alma Maters:
(1) Singapore Polytechnic
(2) National University of Singapore
My Primary Blog: http://teo-en-ming-aka-zhang-enming.blogspot.com
My Secondary Blog: http://enmingteo.wordpress.com
My Youtube videos: http://www.youtube.com/user/enmingteo
Email: space.time.universe@...
Mobile Phone (Starhub Prepaid): +65-8369-2618
Street: Bedok Reservoir Road
Country: Singapore

On Sat, Nov 7, 2009 at 9:15 PM, Pasi Kärkkäinen <pasik@...> wrote:
On Sat, Nov 07, 2009 at 07:23:48PM +0800, Mr. Teo En Ming (Zhang Enming) wrote:
>    Hi Pasi,
>
>    I am not sure whether I can install PV drivers in Rocks HPC Cluster
>    software 5.1 x86-64 (based on CentOS) HVM virtual machines. When I tried
>    to install Rocks 5.1 x86-64 as a PV guest, it complains "invalid kernel"
>    and something about the ELF kernel image. So I guess PV is out for Rocks.
>

What complains about invalid kernel?

I think redhat does ship pv-on-hvm drivers with rhel/centos, so you
could enable those and get paravirtualized disk and network for the HVM
guest.

>    To set e1000 (virtualized Intel Gigabit NIC), I have to use the model
>    parameter in vif in HVM config? Will I get gigabit speeds instead of the
>    Fast Ethernet 100Mb/s speed with virtual Realtek NICs?
>

In a virtual guest those reported speeds don't mean much.. so even when the
realtek nic reports 100 Mbit/sec speed, it can go faster.

But yeah, model=e1000 and it will be reported as 1Gbit/sec.

Qemu e1000 emulation is faster than realtek emulation.. so that should be better.

-- Pasi






_______________________________________________
Xen-devel mailing list
Xen-devel@...
http://lists.xensource.com/xen-devel

Re: Low Network Throughput between HVM Guests

by Mr. Teo En Ming (Zhang Enming)-2 :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

Hi Pasi,

Yay!!!! My Rocks HPC Cluster 5.1 x86-64 first compute node is finally installing!!! The emulated Realtek Fast Ethernet 100 Mb/s network card is really wasting a lot of my time. Thanks for pointing me to e1000!!! Now I get upgraded Gigabit network card speed!

Thanks so much Pasi!!!

--
Mr. Teo En Ming (Zhang Enming) Dip(Mechatronics) BEng(Hons)(Mechanical Engineering)
Alma Maters:
(1) Singapore Polytechnic
(2) National University of Singapore
My Primary Blog: http://teo-en-ming-aka-zhang-enming.blogspot.com
My Secondary Blog: http://enmingteo.wordpress.com
My Youtube videos: http://www.youtube.com/user/enmingteo
Email: space.time.universe@...
Mobile Phone (Starhub Prepaid): +65-8369-2618
Street: Bedok Reservoir Road
Country: Singapore

On Sat, Nov 7, 2009 at 11:30 PM, Mr. Teo En Ming (Zhang Enming) <space.time.universe@...> wrote:
Hi Pasi,

I have added 'type=ioemu' and 'model=e1000' to vif in my HVM configuration files. Now the Rocks HPC Cluster 5.1 x86-64 Frontend node detected two Intel 82540 Gigabit Ethernet controllers. Hopefully this will speed up my compute node installation with the upgraded gigabit speed.


--
Mr. Teo En Ming (Zhang Enming) Dip(Mechatronics) BEng(Hons)(Mechanical Engineering)
Alma Maters:
(1) Singapore Polytechnic
(2) National University of Singapore
My Primary Blog: http://teo-en-ming-aka-zhang-enming.blogspot.com
My Secondary Blog: http://enmingteo.wordpress.com
My Youtube videos: http://www.youtube.com/user/enmingteo
Email: space.time.universe@...
Mobile Phone (Starhub Prepaid): +65-8369-2618
Street: Bedok Reservoir Road
Country: Singapore

On Sat, Nov 7, 2009 at 9:15 PM, Pasi Kärkkäinen <pasik@...> wrote:
On Sat, Nov 07, 2009 at 07:23:48PM +0800, Mr. Teo En Ming (Zhang Enming) wrote:
>    Hi Pasi,
>
>    I am not sure whether I can install PV drivers in Rocks HPC Cluster
>    software 5.1 x86-64 (based on CentOS) HVM virtual machines. When I tried
>    to install Rocks 5.1 x86-64 as a PV guest, it complains "invalid kernel"
>    and something about the ELF kernel image. So I guess PV is out for Rocks.
>

What complains about invalid kernel?

I think redhat does ship pv-on-hvm drivers with rhel/centos, so you
could enable those and get paravirtualized disk and network for the HVM
guest.

>    To set e1000 (virtualized Intel Gigabit NIC), I have to use the model
>    parameter in vif in HVM config? Will I get gigabit speeds instead of the
>    Fast Ethernet 100Mb/s speed with virtual Realtek NICs?
>

In a virtual guest those reported speeds don't mean much.. so even when the
realtek nic reports 100 Mbit/sec speed, it can go faster.

But yeah, model=e1000 and it will be reported as 1Gbit/sec.

Qemu e1000 emulation is faster than realtek emulation.. so that should be better.

-- Pasi










_______________________________________________
Xen-devel mailing list
Xen-devel@...
http://lists.xensource.com/xen-devel

Re: Low Network Throughput between HVM Guests

by Mr. Teo En Ming (Zhang Enming)-2 :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

C.1 e100 And e1000 Network Device Emulators

You can use the network device emulators for the Intel 8255x 10/100 Mbps Ethernet controller (the e100 controller) and the Intel 82540EM Gigabit Ethernet controller (the e1000 controller) for hardware virtualized guests. The e1000 controller is a Gigabit Ethernet controller and increases the network throughput when compared to the default Ethernet controller.

To use these network device emulators, install the network device driver on the guest, then modify the guest configuration file to specify the controller model type: either e100; or e1000. For example, to use the e1000 controller, set model=e1000 in the vif entry in the guest configuration file:

vif = [ 'type=ioemu, mac=00:16:3e:09:bb:c6, bridge=xenbr2, model=e1000']

Create the guest again using the xm create command. The guest now uses the faster e1000 controller.

*****************************************************************************

Previously I thought QEMU only supports emulated Realtek Fast Ethernet 100 Mb/s controllers.

--
Mr. Teo En Ming (Zhang Enming) Dip(Mechatronics) BEng(Hons)(Mechanical Engineering)
Alma Maters:
(1) Singapore Polytechnic
(2) National University of Singapore
My Primary Blog: http://teo-en-ming-aka-zhang-enming.blogspot.com
My Secondary Blog: http://enmingteo.wordpress.com
My Youtube videos: http://www.youtube.com/user/enmingteo
Email: space.time.universe@...
Mobile Phone (Starhub Prepaid): +65-8369-2618
Street: Bedok Reservoir Road
Country: Singapore



On Sat, Nov 7, 2009 at 11:40 PM, Mr. Teo En Ming (Zhang Enming) <space.time.universe@...> wrote:
Hi Pasi,

Yay!!!! My Rocks HPC Cluster 5.1 x86-64 first compute node is finally installing!!! The emulated Realtek Fast Ethernet 100 Mb/s network card is really wasting a lot of my time. Thanks for pointing me to e1000!!! Now I get upgraded Gigabit network card speed!

Thanks so much Pasi!!!


--
Mr. Teo En Ming (Zhang Enming) Dip(Mechatronics) BEng(Hons)(Mechanical Engineering)
Alma Maters:
(1) Singapore Polytechnic
(2) National University of Singapore
My Primary Blog: http://teo-en-ming-aka-zhang-enming.blogspot.com
My Secondary Blog: http://enmingteo.wordpress.com
My Youtube videos: http://www.youtube.com/user/enmingteo
Email: space.time.universe@...
Mobile Phone (Starhub Prepaid): +65-8369-2618
Street: Bedok Reservoir Road
Country: Singapore

On Sat, Nov 7, 2009 at 11:30 PM, Mr. Teo En Ming (Zhang Enming) <space.time.universe@...> wrote:
Hi Pasi,

I have added 'type=ioemu' and 'model=e1000' to vif in my HVM configuration files. Now the Rocks HPC Cluster 5.1 x86-64 Frontend node detected two Intel 82540 Gigabit Ethernet controllers. Hopefully this will speed up my compute node installation with the upgraded gigabit speed.


--
Mr. Teo En Ming (Zhang Enming) Dip(Mechatronics) BEng(Hons)(Mechanical Engineering)
Alma Maters:
(1) Singapore Polytechnic
(2) National University of Singapore
My Primary Blog: http://teo-en-ming-aka-zhang-enming.blogspot.com
My Secondary Blog: http://enmingteo.wordpress.com
My Youtube videos: http://www.youtube.com/user/enmingteo
Email: space.time.universe@...
Mobile Phone (Starhub Prepaid): +65-8369-2618
Street: Bedok Reservoir Road
Country: Singapore

On Sat, Nov 7, 2009 at 9:15 PM, Pasi Kärkkäinen <pasik@...> wrote:
On Sat, Nov 07, 2009 at 07:23:48PM +0800, Mr. Teo En Ming (Zhang Enming) wrote:
>    Hi Pasi,
>
>    I am not sure whether I can install PV drivers in Rocks HPC Cluster
>    software 5.1 x86-64 (based on CentOS) HVM virtual machines. When I tried
>    to install Rocks 5.1 x86-64 as a PV guest, it complains "invalid kernel"
>    and something about the ELF kernel image. So I guess PV is out for Rocks.
>

What complains about invalid kernel?

I think redhat does ship pv-on-hvm drivers with rhel/centos, so you
could enable those and get paravirtualized disk and network for the HVM
guest.

>    To set e1000 (virtualized Intel Gigabit NIC), I have to use the model
>    parameter in vif in HVM config? Will I get gigabit speeds instead of the
>    Fast Ethernet 100Mb/s speed with virtual Realtek NICs?
>

In a virtual guest those reported speeds don't mean much.. so even when the
realtek nic reports 100 Mbit/sec speed, it can go faster.

But yeah, model=e1000 and it will be reported as 1Gbit/sec.

Qemu e1000 emulation is faster than realtek emulation.. so that should be better.

-- Pasi














_______________________________________________
Xen-devel mailing list
Xen-devel@...
http://lists.xensource.com/xen-devel