<div dir="ltr">On Thu, Aug 21, 2008 at 4:10 PM, Dan Ritter <span dir="ltr"><<a href="mailto:dsr-myth@tao.merseine.nu">dsr-myth@tao.merseine.nu</a>></span> wrote:<br><div class="gmail_quote"><blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">
On Thu, Aug 21, 2008 at 07:04:42AM -0700, Yan Seiner wrote:<br>
><br>
> What I don't want to do is to implement a solution today and then have<br>
> to rip it out a year later. If nothing else, do you have any idea how<br>
> long rsync takes to dump and verify a TB over an ethernet connection? 2+<br>
> days, and it's not quite done..... I hate to think what I'd have to do<br>
> with a 5 or 10 TB array.....<br>
<br>
Gigabit ethernet, 80% efficiency, straight throughput: 800Mb/s,<br>
= 100MB/s, = 10,000 seconds for a terabyte. So, 2 hours 45<br>
minutes. Call it 3 hours per TB.<br>
<br>
You aren't getting 100MB/s off your disks, or you aren't able to<br>
write that fast, or you're using rsync inappropriately (perhaps<br>
in combination with SSH). I would guess all three. If you want<br>
to transfer a large amount of data quickly, rsync's default<br>
options aren't the way to go. Rsync might not be the way to go<br>
for the initial transfer, really.<br>
<br>
-dsr-<br>
<font color="#888888"><br>
--<br>
<a href="http://tao.merseine.nu/%7Edsr/eula.html" target="_blank">http://tao.merseine.nu/~dsr/eula.html</a> is hereby incorporated by reference.<br>
<br>
When freedom gets lots of exercise, it protects itself.<br>
_______________________________________________<br>
mythtv-users mailing list<br>
<a href="mailto:mythtv-users@mythtv.org">mythtv-users@mythtv.org</a><br>
<a href="http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users" target="_blank">http://mythtv.org/cgi-bin/mailman/listinfo/mythtv-users</a><br>
</font></blockquote></div><br><br>Sorry, haven't followed the entire thread so disregard if irrelevant but I'd agree with Dan. I transfer many TB regularly over my home network using mounted NFS and regular ol' cp -rup for large initial transfers and just have rsync -avzdp afterwards in cronjobs or as required.<br>
<br>Bob<br></div>