Improve horizontal scaling #5

andrey-malets · 2015-10-21T14:27:23Z

Sample statistics for 2Gb file for hogs machines and image64 as a seeder with 256MB buffer and 16MB blocks:

1 machine: 34s (~60 MB/s)
4 machines: 38s (~54 MB/s)
12 machines: 42s (~49 MB/s)

The text was updated successfully, but these errors were encountered:

andrey-malets · 2015-10-28T20:16:48Z

Seems like scalability is not a big deal: using 8MB block and 16 MB buffer on 16 hogs machines to transfer partition of approximately 50Gb in size (50556 MiB) took 824 seconds, which is 61MiB/s. This is pretty close to the limit of write speeds for HDDs of those machines.

andrey-malets added the c-core label Oct 23, 2015

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Improve horizontal scaling #5

Improve horizontal scaling #5

Uh oh!