Re: [MooseFS-Users] Bananapi as Chunkserver

[Casper L. <ca...@la...>]

Hi Wolfgang,

I have a BananaPi - OrangePi pair with a custom replication script using 
rsync. The BananaPi serving an ownCloud instance (I love ownCloud almost 
as much as I love MooseFS) and the OrangePi is only used as 'slave'. I 
also use MooseFS professionally, which is why I'm listening in on this 
mailinglist.

I am not surprised by your throughput. You should test a netcat read 
from disk to another computer.

My tests:

root@bananapi:/srv# dd if=/srv/swapfile bs=1M > /dev/null
^C1838+0 records in
1837+0 records out
1926234112 bytes (1.9 GB) copied, 13.3472 s, 144 MB/s

My harddisk gets a base speed of 144MB/s, on the swapfile (which is not 
fragmented) on a Toshiba MQ01ABB200 disk.

I started netcat listening on port 2000 on my linux desktop machine:

nc -kl -p 2000 > /dev/null

Then read from disk and write to that machine:

root@bananapi:/srv# dd if=/srv/swapfile bs=1M | nc <linux-desktop-ip> 2000
^C192+0 records in
191+0 records out
200278016 bytes (200 MB) copied, 7.7876 s, 25.7 MB/s

So I get only 25.7 MB/s. Add a bit of overhead for moosefs chunkservers. 
I think you are lucky to 'pay' only 20% speed reduction to get the 
redundancy and flexibility moosefs brings to the table ;-)

Reading from /dev/zero only gets me a little more throughput:

root@bananapi:/srv# dd if=/dev/zero bs=1M | nc <linux-desktop-ip> 2000
^C303+0 records in
302+0 records out
316669952 bytes (317 MB) copied, 10.3139 s, 30.7 MB/s

Because I also own an OrangePi, I tested that one too and was a little 
surprised it performed worse:

root@orangepi:~# dd if=/dev/zero bs=1M | nc <linux-desktop-ip> 2000
^C197+0 records in
196+0 records out
205520896 bytes (206 MB) copied, 11.1619 s, 18.4 MB/s

In these tests, all machines are connected to a small gigabit switch. 
Nothing fancy, but definitely not the cause for these limits. I have to 
add that the Pi's where still doing their normal stuff, I haven't 
stopped any running services on them, but load average was 0.04, 0.05, 
0.05 on the OrangePi and even lower on the BananaPi.

According to this benchmark 
http://www.htpcguides.com/raspberry-pi-vs-pi-2-vs-banana-pi-pro-benchmarks/

The BananaPi Pro should have radically improved network speed, I would 
like to see a dd if=/dev/zero bs=1M | nc <linux-desktop-ip> 2000 If 
anyone on this list happens to own one...

Greetings, Casper