Are there any current, in play plans, to multi-thread rsync?

[Michael Brian - IL]

I am looking for an enhancement to multi-thread or parallelize rsync.

Are there any plans that would allow one to set a parameter, like 'number_of_threads' and

rsync will ship multiple files at the same time?

 

Sincerely,

 

	Brian P Michael
	Technical Management Consultant Rolta TUSC, Inc.
	michaelb@...
	630-960-2909 x1181
	http://www.tusc.com

 

The information contained in this transmission is privileged and confidential information intended for the use of the individual or entity named above.  If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited.  If you have received this transmission in error, do not read it.  Please immediately reply to the sender that you have received this communication in error and then delete it.  Thank you.

 

--
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

[Wayne Davison-2]

On Fri, Oct 16, 2009 at 8:32 PM, Michael Brian - IL <MICHAELB@...> wrote:

I am looking for an enhancement to multi-thread or parallelize rsync.

Are there any plans that would allow one to set a parameter, like 'number_of_threads' and rsync will ship multiple files at the same time?

Not at present.  That would be a pretty big protocol change, and is probably something that would be best left to a new-protocol rewrite.  It would be quite interesting to have separate connections for the hierarchy traversal code versus one or more file transfer connections that were controlled by the traversal process, but that is not something that I'm working on, nor have I heard about anyone else doing that.

..wayne..
 

--
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

[Michael Brian - IL]

Thanks for the update.

 

We are using rsync to sync up the Oracle archived transaction logs to our standby databases.

We would like to control the number of files that could be transfered in parallel.

 

Thanks for the update.

 

 

Brian

 

----------------------

Brian P Michael

Technical Management Consultant

Rolta TUSC, Inc.

michaelb@...

630-960-2909 x1181

http://www.tusc.com

 

The information contained in this transmission is privileged and confidential information intended for the use of the individual or entity named above.  If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited.  If you have received this transmission in error, do not read it.  Please immediately reply to the sender that you have received this communication in error and then delete it.  Thank you.

 

---

From: 4wayned@... [mailto:4wayned@...] On Behalf Of Wayne Davison
Sent: Saturday, October 17, 2009 2:30 AM
To: Michael Brian - IL
Cc: rsync@...
Subject: Re: Are there any current, in play plans, to multi-thread rsync?

On Fri, Oct 16, 2009 at 8:32 PM, Michael Brian - IL <MICHAELB@...> wrote:

I am looking for an enhancement to multi-thread or parallelize rsync.

Are there any plans that would allow one to set a parameter, like 'number_of_threads' and rsync will ship multiple files at the same time?

Not at present.  That would be a pretty big protocol change, and is probably something that would be best left to a new-protocol rewrite.  It would be quite interesting to have separate connections for the hierarchy traversal code versus one or more file transfer connections that were controlled by the traversal process, but that is not something that I'm working on, nor have I heard about anyone else doing that.

..wayne..
 

--
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html