From: Roman <int...@gm...> - 2018-08-09 11:39:36
|
Hello! I have problems with the drop in the speed of reading and writing. I have a 1 Gbit network. Initially, the write and read speed in the Moosefs cluster was ~100Mbps (3 copies of the data). At the moment it is about 10Mbps. There are no problems with the network. Switches and network cards work as it should. Where to dig? Thanks, Roman |
From: Roman <int...@gm...> - 2018-08-09 12:16:40
|
Hi, Problem fixed! There was a problem with the network card. I did not notice that it changed from 1 Gbit/s to 100 Mb/s after the power failure. Thanks, Roman > Hi, > Would you be so kind and tell us something more about this case. > What have changed? > > Maybe broken hard disk? > > Best regards > Alex > > On 09.08.2018 13:39, Roman wrote: >> Hello! >> >> I have problems with the drop in the speed of reading and writing. >> I have a 1 Gbit network. Initially, the write and read speed in the >> Moosefs cluster was ~100Mbps (3 copies of the data). At the moment it >> is about 10Mbps. >> There are no problems with the network. Switches and network cards >> work as it should. >> >> Where to dig? >> >> >> Thanks, >> Roman > . > |
From: Wilson, S. M <st...@pu...> - 2018-08-09 14:18:31
|
Hi Roman, I've had that happen to me on a couple of different servers over the past few months. You might find it worthwhile to monitor network interface speed using a tool like Monit: https://mmonit.com/monit/documentation/monit.html#NETWORK-INTERFACE-TESTS I haven't done it yet but your email reminded me to implement this kind of monitoring on my workstations and servers. Thanks for the reminder! :-) Regards, Steve ________________________________________ From: Roman <int...@gm...> Sent: Thursday, August 9, 2018 8:16 AM To: Aleksander Wieliczko; moo...@li... Subject: Re: [MooseFS-Users] speed drop Hi, Problem fixed! There was a problem with the network card. I did not notice that it changed from 1 Gbit/s to 100 Mb/s after the power failure. Thanks, Roman > Hi, > Would you be so kind and tell us something more about this case. > What have changed? > > Maybe broken hard disk? > > Best regards > Alex > > On 09.08.2018 13:39, Roman wrote: >> Hello! >> >> I have problems with the drop in the speed of reading and writing. >> I have a 1 Gbit network. Initially, the write and read speed in the >> Moosefs cluster was ~100Mbps (3 copies of the data). At the moment it >> is about 10Mbps. >> There are no problems with the network. Switches and network cards >> work as it should. >> >> Where to dig? >> >> >> Thanks, >> Roman > . > ------------------------------------------------------------------------------ Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot _________________________________________ moosefs-users mailing list moo...@li... https://lists.sourceforge.net/lists/listinfo/moosefs-users |
From: Aleksander W. <ale...@mo...> - 2018-08-09 12:19:21
|
Hi, Would you be so kind and tell us something more about this case. What have changed? Maybe broken hard disk? Best regards Alex On 09.08.2018 13:39, Roman wrote: > Hello! > > I have problems with the drop in the speed of reading and writing. > I have a 1 Gbit network. Initially, the write and read speed in the > Moosefs cluster was ~100Mbps (3 copies of the data). At the moment it > is about 10Mbps. > There are no problems with the network. Switches and network cards > work as it should. > > Where to dig? > > > Thanks, > Roman |
From: Remolina, D. J <dij...@ae...> - 2018-08-09 19:47:49
|
When you say 100Mbps, do you mean megabits per second or megabytes per second? 100Mbps is much different to 100MB/s At Gigabit interconnect, your network limitation will be ~112MB/s (megabytes per second) read/writes which is the maximum bandwidth of your gigabit network cards. Have you tried mounting the file system itself on one of the servers? This should rule out network. If the reads/writes are slow there, then it may help you isolate the issue to the backend storage. To make sure you are getting the full gigabit bandwith on your servers, also use a tool to measure the connectivity between them, perhaps a tool like iperf can help. HTH, Diego ________________________________ From: Roman <int...@gm...> Sent: Thursday, August 9, 2018 7:39:23 AM To: moo...@li... Subject: [MooseFS-Users] speed drop Hello! I have problems with the drop in the speed of reading and writing. I have a 1 Gbit network. Initially, the write and read speed in the Moosefs cluster was ~100Mbps (3 copies of the data). At the moment it is about 10Mbps. There are no problems with the network. Switches and network cards work as it should. Where to dig? Thanks, Roman ------------------------------------------------------------------------------ Check out the vibrant tech community on one of the world's most engaging tech sites, Slashdot.org! http://sdm.link/slashdot _________________________________________ moosefs-users mailing list moo...@li... https://lists.sourceforge.net/lists/listinfo/moosefs-users |
From: Piotr R. K. <pio...@ge...> - 2018-08-10 16:24:21
|
> To make sure you are getting the full gigabit bandwith on your servers, also use a tool to measure the connectivity between them, perhaps a tool like iperf can help. The simplest you can run is dd + netcat: First machine - listener: nc -v -l 2222 > /dev/null Second machine - sender: dd if=/dev/zero bs=1M count=1024 | nc -v IP_OF_FIRST_MACHINE 2222 or iperf as Diego suggested: Listener: iperf -s Sender: iperf -c LISTENER_IP -t 30 Best regards, Peter Piotr Robert Konopelko | m: +48 601 476 440 | e: pio...@mo... Business & Technical Support Manager MooseFS Client Support Team WWW | GitHub | Twitter | Facebook | LinkedIn > On 9 Aug 2018, at 2:10 PM, Remolina, Diego J <dij...@ae...> wrote: > > When you say 100Mbps, do you mean megabits per second or megabytes per second? 100Mbps is much different to 100MB/s > > At Gigabit interconnect, your network limitation will be ~112MB/s (megabytes per second) read/writes which is the maximum bandwidth of your gigabit network cards. > > Have you tried mounting the file system itself on one of the servers? This should rule out network. If the reads/writes are slow there, then it may help you isolate the issue to the backend storage. > > To make sure you are getting the full gigabit bandwith on your servers, also use a tool to measure the connectivity between them, perhaps a tool like iperf can help. > > HTH, > > Diego > From: Roman <int...@gm...> > Sent: Thursday, August 9, 2018 7:39:23 AM > To: moo...@li... > Subject: [MooseFS-Users] speed drop > > Hello! > > I have problems with the drop in the speed of reading and writing. > I have a 1 Gbit network. Initially, the write and read speed in the > Moosefs cluster was ~100Mbps (3 copies of the data). At the moment it is > about 10Mbps. > There are no problems with the network. Switches and network cards work > as it should. > > Where to dig? > > > Thanks, > Roman > > ------------------------------------------------------------------------------ > Check out the vibrant tech community on one of the world's most > engaging tech sites, Slashdot.org! http://sdm.link/slashdot > _________________________________________ > moosefs-users mailing list > moo...@li... > https://lists.sourceforge.net/lists/listinfo/moosefs-users > ------------------------------------------------------------------------------ > Check out the vibrant tech community on one of the world's most > engaging tech sites, Slashdot.org! http://sdm.link/slashdot_________________________________________ > moosefs-users mailing list > moo...@li... > https://lists.sourceforge.net/lists/listinfo/moosefs-users |
From: Roman <int...@gm...> - 2019-03-19 18:27:29
|
Hi, All! After updating the master from 3.0.101 to 3.0.103, I noticed increase load on the cluster. Approximately 0.5 units for each storage element. Is it normal? OS: Centos 7. One of chunkserver. The same picture on others. Upgraded 18 march. Master have normal load. Roman |