Menu
▾
▴
moosefs-users
|
From: Alexander A. <ba...@ya...> - 2018-08-21 06:46:02
|
Hi dear All ! As far as I can see MooseFS client on FreeBSD works faster then on Linux: # uname -a FreeBSD 11.1-RELEASE-p13 FreeBSD 11.1-RELEASE-p13 #0: Tue Aug 14 19:34:21 UTC 2018 ro...@am...:/usr/obj/usr/src/sys/GENERIC amd64 # dd if=/moosefs/mnt/random_test_data of=/dev/null bs=1G 77928873984 bytes transferred in 143.082525 secs (544642847 bytes/sec) vs # uname -a Linux 4.9.0-7-amd64 #1 SMP Debian 4.9.110-3+deb9u2 (2018-08-13) x86_64 GNU/Linux # dd if=/moosefs/mnt/random_test_data of=/dev/null bs=1G 77928873984 bytes (78 GB, 73 GiB) copied, 258.288 s, 302 MB/s All MooseFS involved hosts are connected via 10 Gigabit Ethernet. Am I right? Why!? WBR Alexander |
|
From: Aleksander W. <ale...@mo...> - 2018-08-21 10:35:48
|
On 21.08.2018 08:45, Alexander AKHOBADZE wrote: > Hi dear All ! > > > As far as I can see MooseFS client on FreeBSD works faster then on Linux: Every thing is possible, but try execute test 5 times, than remove highest and lowest results and count average value from 3 results that left :) Good idea is to read file size twice big as your RAM amount. #LINUX dd if=/moosefs/mnt/random_test_data of=/dev/null bs=1M count=1024 #FreeBSD dd if=/moosefs/mnt/random_test_data of=/dev/null bs=1m count=1024 > > # uname -a > FreeBSD 11.1-RELEASE-p13 FreeBSD 11.1-RELEASE-p13 #0: Tue Aug 14 > 19:34:21 UTC 2018 > ro...@am...:/usr/obj/usr/src/sys/GENERIC amd64 > # dd if=/moosefs/mnt/random_test_data of=/dev/null bs=1G > 77928873984 bytes transferred in 143.082525 secs (544642847 bytes/sec) > > vs > > # uname -a > Linux 4.9.0-7-amd64 #1 SMP Debian 4.9.110-3+deb9u2 (2018-08-13) x86_64 > GNU/Linux > # dd if=/moosefs/mnt/random_test_data of=/dev/null bs=1G > 77928873984 bytes (78 GB, 73 GiB) copied, 258.288 s, 302 MB/s > > > All MooseFS involved hosts are connected via 10 Gigabit Ethernet. > > > Am I right? Why!? > > > WBR > > Alexander > > ------------------------------------------------------------------------------ > > Check out the vibrant tech community on one of the world's most > engaging tech sites, Slashdot.org! http://sdm.link/slashdot > _________________________________________ > moosefs-users mailing list > moo...@li... > https://lists.sourceforge.net/lists/listinfo/moosefs-users |
|
From: Marco M. <mar...@gm...> - 2018-08-21 16:52:51
|
Alexander AKHOBADZE, Can you repeat your test with bs=1M ? Are you getting the same results with bs=1M ? -- Marco On 08/21/2018 02:45 AM, Alexander AKHOBADZE wrote: > Hi dear All ! > > > As far as I can see MooseFS client on FreeBSD works faster then on Linux: > > # uname -a > FreeBSD 11.1-RELEASE-p13 FreeBSD 11.1-RELEASE-p13 #0: Tue Aug 14 19:34:21 UTC 2018 ro...@am...:/usr/obj/usr/src/sys/GENERIC amd64 > # dd if=/moosefs/mnt/random_test_data of=/dev/null bs=1G > 77928873984 bytes transferred in 143.082525 secs (544642847 bytes/sec) > > vs > > # uname -a > Linux 4.9.0-7-amd64 #1 SMP Debian 4.9.110-3+deb9u2 (2018-08-13) x86_64 GNU/Linux > # dd if=/moosefs/mnt/random_test_data of=/dev/null bs=1G > 77928873984 bytes (78 GB, 73 GiB) copied, 258.288 s, 302 MB/s > > > All MooseFS involved hosts are connected via 10 Gigabit Ethernet. > > > Am I right? Why!? > > > WBR > > Alexander > > ------------------------------------------------------------------------------ > Check out the vibrant tech community on one of the world's most > engaging tech sites, Slashdot.org! http://sdm.link/slashdot > _________________________________________ > moosefs-users mailing list > moo...@li... > https://lists.sourceforge.net/lists/listinfo/moosefs-users > |
|
From: <ba...@na...> - 2018-08-21 18:40:00
|
Hi again! OK. I'v made test file size twice bigger and no changes. I'v launched dd several times and I have a stable results like this: Linux # dd if=/moosefs/mnt/random_test_data of=/dev/null bs=1G 155 857 747 968 bytes (156 GB, 145 GiB) copied, 595.506 s, 262 MB/s FreeBSD: # dd if=/moosefs/mnt/random_test_data of=/dev/null bs=1G 155 857 747 968 bytes transferred in 296.450686 secs (525 745 951 bytes/sec) Cluster consists of 3 chunk server each with 64 GB RAM. And Linux client is one of them. FreeBSD host has 48 GB RAM. All hosts have mtu 9000. WBR Alexander ----------------------------------------------------------------------------- From: Aleksander Wieliczko <aleksander.wieliczko@mo...> - 2018-08-21 10:35:48 Every thing is possible, but try execute test 5 times, than remove highest and lowest results and count average value from 3 results that left :) Good idea is to read file size twice big as your RAM amount. ----------------------------------------------------------------------------- >> Hi dear All ! >> >> >> As far as I can see MooseFS client on FreeBSD works faster then on Linux: >> >> # uname -a >> FreeBSD 11.1-RELEASE-p13 FreeBSD 11.1-RELEASE-p13 #0: Tue Aug 14 19:34:21 UTC 2018 ro...@am...:/usr/obj/usr/src/sys/GENERIC amd64 >> # dd if=/moosefs/mnt/random_test_data of=/dev/null bs=1G >> 77928873984 bytes transferred in 143.082525 secs (544642847 bytes/sec) >> >> vs >> >> # uname -a >> Linux 4.9.0-7-amd64 #1 SMP Debian 4.9.110-3+deb9u2 (2018-08-13) x86_64 GNU/Linux >> # dd if=/moosefs/mnt/random_test_data of=/dev/null bs=1G >> 77928873984 bytes (78 GB, 73 GiB) copied, 258.288 s, 302 MB/s >> >> >> All MooseFS involved hosts are connected via 10 Gigabit Ethernet. >> >> >> Am I right? Why!? >> >> >> WBR >> >> Alexander >> >> ------------------------------------------------------------------------------ >> Check out the vibrant tech community on one of the world's most >> engaging tech sites, Slashdot.org! http://sdm.link/slashdot >> _________________________________________ >> moosefs-users mailing list >> moo...@li... >> https://lists.sourceforge.net/lists/listinfo/moosefs-users >> > ------------------------------------------------------------------------------ > Check out the vibrant tech community on one of the world's most > engaging tech sites, Slashdot.org! http://sdm.link/slashdot > _________________________________________ > moosefs-users mailing list > moo...@li... > https://lists.sourceforge.net/lists/listinfo/moosefs-users -- С уважением, Badurls mailto:ba...@na... |
|
From: Marco M. <mar...@gm...> - 2018-08-21 17:00:24
|
Also can you transfer about 50GB between the Linux client and the FreeBSD client just to test the network speed? (no disk, just /dev/zero and /dev/null and no other substantial network activity during the test) On 08/21/2018 12:52 PM, Marco Milano wrote: > Alexander AKHOBADZE, > > Can you repeat your test with bs=1M ? > Are you getting the same results with bs=1M ? > > -- Marco > > On 08/21/2018 02:45 AM, Alexander AKHOBADZE wrote: >> Hi dear All ! >> >> >> As far as I can see MooseFS client on FreeBSD works faster then on Linux: >> >> # uname -a >> FreeBSD 11.1-RELEASE-p13 FreeBSD 11.1-RELEASE-p13 #0: Tue Aug 14 19:34:21 UTC 2018 ro...@am...:/usr/obj/usr/src/sys/GENERIC amd64 >> # dd if=/moosefs/mnt/random_test_data of=/dev/null bs=1G >> 77928873984 bytes transferred in 143.082525 secs (544642847 bytes/sec) >> >> vs >> >> # uname -a >> Linux 4.9.0-7-amd64 #1 SMP Debian 4.9.110-3+deb9u2 (2018-08-13) x86_64 GNU/Linux >> # dd if=/moosefs/mnt/random_test_data of=/dev/null bs=1G >> 77928873984 bytes (78 GB, 73 GiB) copied, 258.288 s, 302 MB/s >> >> >> All MooseFS involved hosts are connected via 10 Gigabit Ethernet. >> >> >> Am I right? Why!? >> >> >> WBR >> >> Alexander >> >> ------------------------------------------------------------------------------ >> Check out the vibrant tech community on one of the world's most >> engaging tech sites, Slashdot.org! http://sdm.link/slashdot >> _________________________________________ >> moosefs-users mailing list >> moo...@li... >> https://lists.sourceforge.net/lists/listinfo/moosefs-users >> > > ------------------------------------------------------------------------------ > Check out the vibrant tech community on one of the world's most > engaging tech sites, Slashdot.org! http://sdm.link/slashdot > _________________________________________ > moosefs-users mailing list > moo...@li... > https://lists.sourceforge.net/lists/listinfo/moosefs-users > |
|
From: Alexander A. <ba...@ya...> - 2018-08-21 18:33:22
|
Hi again! OK. I'v made test file size twice bigger and no changes. I'v launched dd several times and I have a stable results like this: Linux # dd if=/moosefs/mnt/random_test_data of=/dev/null bs=1G 155 857 747 968 bytes (156 GB, 145 GiB) copied, 595.506 s, 262 MB/s FreeBSD: # dd if=/moosefs/mnt/random_test_data of=/dev/null bs=1G 155 857 747 968 bytes transferred in 296.450686 secs (525 745 951 bytes/sec) Cluster consists of 3 chunk server each with 64 GB RAM. And Linux client is one of them. FreeBSD host has 48 GB RAM. All hosts have mtu 9000. WBR Alexander ----------------------------------------------------------------------------- From: Aleksander Wieliczko <aleksander.wieliczko@mo...> - 2018-08-21 10:35:48 Every thing is possible, but try execute test 5 times, than remove highest and lowest results and count average value from 3 results that left :) Good idea is to read file size twice big as your RAM amount. ----------------------------------------------------------------------------- >> Hi dear All ! >> >> >> As far as I can see MooseFS client on FreeBSD works faster then on Linux: >> >> # uname -a >> FreeBSD 11.1-RELEASE-p13 FreeBSD 11.1-RELEASE-p13 #0: Tue Aug 14 19:34:21 UTC 2018 ro...@am...:/usr/obj/usr/src/sys/GENERIC amd64 >> # dd if=/moosefs/mnt/random_test_data of=/dev/null bs=1G >> 77928873984 bytes transferred in 143.082525 secs (544642847 bytes/sec) >> >> vs >> >> # uname -a >> Linux 4.9.0-7-amd64 #1 SMP Debian 4.9.110-3+deb9u2 (2018-08-13) x86_64 GNU/Linux >> # dd if=/moosefs/mnt/random_test_data of=/dev/null bs=1G >> 77928873984 bytes (78 GB, 73 GiB) copied, 258.288 s, 302 MB/s >> >> >> All MooseFS involved hosts are connected via 10 Gigabit Ethernet. >> >> >> Am I right? Why!? >> >> >> WBR >> >> Alexander |
|
From: Marco M. <mar...@gm...> - 2018-08-21 19:17:00
|
You have double the network IO on the Linux client. (because it is both a chunkserver and a client.) That is why your Linux client gets about half the bandwidth. It is easy to test my theory. Boot the FreeBSD machine temporarily with Linux, install MoooseFS client on it, my guess is that you will get about the same speed as the FreeBSD client. Other option for this test is to temporarily shutdown the chunkserver on that test Linux client.(make sure that it doesn't start moving chunks around for re-balancing when you do shut it down.), and repeat the test, FreeBSD client and Linux client speed should be same in this case. -- Marco On 08/21/2018 02:33 PM, Alexander AKHOBADZE wrote: > > Hi again! > > OK. I'v made test file size twice bigger and no changes. > I'v launched dd several times and I have a stable results like this: > > Linux # dd if=/moosefs/mnt/random_test_data of=/dev/null bs=1G > 155 857 747 968 bytes (156 GB, 145 GiB) copied, 595.506 s, 262 MB/s > > FreeBSD: # dd if=/moosefs/mnt/random_test_data of=/dev/null bs=1G > 155 857 747 968 bytes transferred in 296.450686 secs (525 745 951 bytes/sec) > > Cluster consists of 3 chunk server each with 64 GB RAM. And Linux client is one of them. > FreeBSD host has 48 GB RAM. All hosts have mtu 9000. > > WBR > Alexander > > ----------------------------------------------------------------------------- > > From: Aleksander Wieliczko <aleksander.wieliczko@mo...> - 2018-08-21 10:35:48 > > Every thing is possible, but try execute test 5 times, than remove > highest and lowest results and count average value from 3 results that > left :) > Good idea is to read file size twice big as your RAM amount. > > ----------------------------------------------------------------------------- > > >> Hi dear All ! > >> > >> > >> As far as I can see MooseFS client on FreeBSD works faster then on Linux: > >> > >> # uname -a > >> FreeBSD 11.1-RELEASE-p13 FreeBSD 11.1-RELEASE-p13 #0: Tue Aug 14 19:34:21 UTC 2018 ro...@am...:/usr/obj/usr/src/sys/GENERIC amd64 > >> # dd if=/moosefs/mnt/random_test_data of=/dev/null bs=1G > >> 77928873984 bytes transferred in 143.082525 secs (544642847 bytes/sec) > >> > >> vs > >> > >> # uname -a > >> Linux 4.9.0-7-amd64 #1 SMP Debian 4.9.110-3+deb9u2 (2018-08-13) x86_64 GNU/Linux > >> # dd if=/moosefs/mnt/random_test_data of=/dev/null bs=1G > >> 77928873984 bytes (78 GB, 73 GiB) copied, 258.288 s, 302 MB/s > >> > >> > >> All MooseFS involved hosts are connected via 10 Gigabit Ethernet. > >> > >> > >> Am I right? Why!? > >> > >> > >> WBR > >> > >> Alexander > > ------------------------------------------------------------------------------ > Check out the vibrant tech community on one of the world's most > engaging tech sites, Slashdot.org! http://sdm.link/slashdot > _________________________________________ > moosefs-users mailing list > moo...@li... > https://lists.sourceforge.net/lists/listinfo/moosefs-users > |
×
Want the latest updates on software, tech news, and AI?
Get latest updates about software, tech news, and AI from SourceForge directly in your inbox once a month.
Thanks for helping keep SourceForge clean.
X