From: Wolfgang <moo...@wo...> - 2015-10-10 09:57:14
|
Hi List! I'm currently experimenting with 8x Banabapi [1] (similar to Raspberry Pi Computers) as my Chunkservers and a virtual Ubuntu as Master. Advantage of Bananapi to the better known Raspberry Pi is 1Gbit NIC and the direct SATA support for 2.5'' HDD's (Sata and Power plug) [2] I'm using it in my private Gbit LAN at home. Performance for sequental data stream (dd if=/dev/zero ...) and goal=1 is good - but performance for goal = 2 is just abt. 20MB/s and with small files coming from attic backup [3] is poor ~ 2MB/s) Write performance (dd) direct on one of my nodes to the SATA disc is abt. 50MB/s Is anyone in the list also fiddeling around with this type of setup? Is there any configuration which I can do to get more performance? (more nodes?) Thank you. Greetings Wolfgang [1] ... http://www.pollin.de/shop/dt/MTA4NzkyOTk-/Bausaetze_Module/Entwicklerboards/Banana_Pi_Dual_Core_1_GB_DDR3_SATA_G_LAN.html [2] ... http://www.pollin.de/shop/dt/NzI3NzkyOTk-/Bausaetze_Module/Entwicklerboards/Banana_Pi_SATA_Kabel.html [3] ... https://attic-backup.org/ |
From: Casper L. <ca...@la...> - 2015-10-10 17:58:57
|
Hi Wolfgang, I have a BananaPi - OrangePi pair with a custom replication script using rsync. The BananaPi serving an ownCloud instance (I love ownCloud almost as much as I love MooseFS) and the OrangePi is only used as 'slave'. I also use MooseFS professionally, which is why I'm listening in on this mailinglist. I am not surprised by your throughput. You should test a netcat read from disk to another computer. My tests: root@bananapi:/srv# dd if=/srv/swapfile bs=1M > /dev/null ^C1838+0 records in 1837+0 records out 1926234112 bytes (1.9 GB) copied, 13.3472 s, 144 MB/s My harddisk gets a base speed of 144MB/s, on the swapfile (which is not fragmented) on a Toshiba MQ01ABB200 disk. I started netcat listening on port 2000 on my linux desktop machine: nc -kl -p 2000 > /dev/null Then read from disk and write to that machine: root@bananapi:/srv# dd if=/srv/swapfile bs=1M | nc <linux-desktop-ip> 2000 ^C192+0 records in 191+0 records out 200278016 bytes (200 MB) copied, 7.7876 s, 25.7 MB/s So I get only 25.7 MB/s. Add a bit of overhead for moosefs chunkservers. I think you are lucky to 'pay' only 20% speed reduction to get the redundancy and flexibility moosefs brings to the table ;-) Reading from /dev/zero only gets me a little more throughput: root@bananapi:/srv# dd if=/dev/zero bs=1M | nc <linux-desktop-ip> 2000 ^C303+0 records in 302+0 records out 316669952 bytes (317 MB) copied, 10.3139 s, 30.7 MB/s Because I also own an OrangePi, I tested that one too and was a little surprised it performed worse: root@orangepi:~# dd if=/dev/zero bs=1M | nc <linux-desktop-ip> 2000 ^C197+0 records in 196+0 records out 205520896 bytes (206 MB) copied, 11.1619 s, 18.4 MB/s In these tests, all machines are connected to a small gigabit switch. Nothing fancy, but definitely not the cause for these limits. I have to add that the Pi's where still doing their normal stuff, I haven't stopped any running services on them, but load average was 0.04, 0.05, 0.05 on the OrangePi and even lower on the BananaPi. According to this benchmark http://www.htpcguides.com/raspberry-pi-vs-pi-2-vs-banana-pi-pro-benchmarks/ The BananaPi Pro should have radically improved network speed, I would like to see a dd if=/dev/zero bs=1M | nc <linux-desktop-ip> 2000 If anyone on this list happens to own one... Greetings, Casper |
From: Aleksander W. <ale...@mo...> - 2015-10-12 06:29:37
|
Hi! Can you tell as some details about your configuration like: - MooseFS version? - Ping time from chunkserver to mfsmaster? - Chunkserver(bananaPI) NIC speed? Can you set up some ftp or SAMBA server on chunkserver and tell as what transfer speed you can achieve? Best regards Aleksander Wieliczko Technical Support Engineer MooseFS.com <moosefs.com> On 10/10/2015 11:40 AM, Wolfgang wrote: > Hi List! > > I'm currently experimenting with 8x Banabapi [1] (similar to Raspberry > Pi Computers) as my Chunkservers > and a virtual Ubuntu as Master. > Advantage of Bananapi to the better known Raspberry Pi is 1Gbit NIC and > the direct SATA support for 2.5'' HDD's (Sata and Power plug) [2] > I'm using it in my private Gbit LAN at home. > Performance for sequental data stream (dd if=/dev/zero ...) and goal=1 > is good - but performance for goal = 2 is just abt. 20MB/s and with > small files coming from attic backup [3] is poor ~ 2MB/s) > Write performance (dd) direct on one of my nodes to the SATA disc is > abt. 50MB/s > > Is anyone in the list also fiddeling around with this type of setup? > Is there any configuration which I can do to get more performance? (more > nodes?) > > Thank you. > > Greetings > Wolfgang > > > [1] ... > http://www.pollin.de/shop/dt/MTA4NzkyOTk-/Bausaetze_Module/Entwicklerboards/Banana_Pi_Dual_Core_1_GB_DDR3_SATA_G_LAN.html > [2] ... > http://www.pollin.de/shop/dt/NzI3NzkyOTk-/Bausaetze_Module/Entwicklerboards/Banana_Pi_SATA_Kabel.html > [3] ... https://attic-backup.org/ > > ------------------------------------------------------------------------------ > _________________________________________ > moosefs-users mailing list > moo...@li... > https://lists.sourceforge.net/lists/listinfo/moosefs-users |
From: Wolfgang <moo...@wo...> - 2015-10-14 08:50:43
|
Hi! On 2015-10-12 08:29, Aleksander Wieliczko wrote: > Hi! > Can you tell as some details about your configuration like: > > - MooseFS version? Master (Ubuntu 14.04) 3.0.51 Chunkservers (from arm rp2 Repository) 3.0.13 > - Ping time from chunkserver to mfsmaster? 0.252ms > - Chunkserver(bananaPI) NIC speed? 1Gbit > > Can you set up some ftp or SAMBA server on chunkserver and tell as > what transfer speed you can achieve? I installed vsftp on one chunkserver - transfer 2GB file via FTP - to external PC Speed for Up-/ and Download was about 37MB/s Thanks for your effort and greetings Wolfgang > > Best regards > Aleksander Wieliczko > Technical Support Engineer > MooseFS.com <moosefs.com> > > On 10/10/2015 11:40 AM, Wolfgang wrote: >> Hi List! >> >> I'm currently experimenting with 8x Banabapi [1] (similar to Raspberry >> Pi Computers) as my Chunkservers >> and a virtual Ubuntu as Master. >> Advantage of Bananapi to the better known Raspberry Pi is 1Gbit NIC and >> the direct SATA support for 2.5'' HDD's (Sata and Power plug) [2] >> I'm using it in my private Gbit LAN at home. >> Performance for sequental data stream (dd if=/dev/zero ...) and goal=1 >> is good - but performance for goal = 2 is just abt. 20MB/s and with >> small files coming from attic backup [3] is poor ~ 2MB/s) >> Write performance (dd) direct on one of my nodes to the SATA disc is >> abt. 50MB/s >> >> Is anyone in the list also fiddeling around with this type of setup? >> Is there any configuration which I can do to get more performance? (more >> nodes?) >> >> Thank you. >> >> Greetings >> Wolfgang >> >> >> [1] ... >> http://www.pollin.de/shop/dt/MTA4NzkyOTk-/Bausaetze_Module/Entwicklerboards/Banana_Pi_Dual_Core_1_GB_DDR3_SATA_G_LAN.html >> [2] ... >> http://www.pollin.de/shop/dt/NzI3NzkyOTk-/Bausaetze_Module/Entwicklerboards/Banana_Pi_SATA_Kabel.html >> [3] ...https://attic-backup.org/ >> >> ------------------------------------------------------------------------------ >> _________________________________________ >> moosefs-users mailing list >> moo...@li... >> https://lists.sourceforge.net/lists/listinfo/moosefs-users > > > > ------------------------------------------------------------------------------ > > > _________________________________________ > moosefs-users mailing list > moo...@li... > https://lists.sourceforge.net/lists/listinfo/moosefs-users |
From: Boli <bo...@le...> - 2015-10-14 12:35:29
|
thats very slow. was it ftp/ssl? or uncrypted ftp? On 14/10/2015 11:50, Wolfgang wrote: > >> >> Can you set up some ftp or SAMBA server on chunkserver and tell as >> what transfer speed you can achieve? > I installed vsftp on one chunkserver - transfer 2GB file via FTP - to > external PC > Speed for Up-/ and Download was about 37MB/s > > > Thanks for your effort and greetings > Wolfgang > |
From: Wolfgang <moo...@wo...> - 2015-10-14 13:32:40
|
Hi! On 2015-10-14 14:13, Boli wrote: > thats very slow. was it ftp/ssl? or uncrypted ftp? It was uncrypted ftp (good old plain ftp) As written in my initial mail to the list - write performance direct on the banana pi to the sata disc via dd is abt. 50MB/s. Greetings Wolfgang > > On 14/10/2015 11:50, Wolfgang wrote: >> >>> >>> Can you set up some ftp or SAMBA server on chunkserver and tell as >>> what transfer speed you can achieve? >> I installed vsftp on one chunkserver - transfer 2GB file via FTP - to >> external PC >> Speed for Up-/ and Download was about 37MB/s >> >> >> Thanks for your effort and greetings >> Wolfgang >> > > > > ------------------------------------------------------------------------------ > > > _________________________________________ > moosefs-users mailing list > moo...@li... > https://lists.sourceforge.net/lists/listinfo/moosefs-users |