I just copied a column with 300000 rows from one table to another. 25mb file should have columns with lesser rows than that I guess.. are you using 32 bit or 64 bit ?
there should be some thing more to it. why dont you upload the file for testing purposes...
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
I attached a testfile with one column; if I import this file, ignoring the first two lines, and then copy the first column in a second one (after adding an empty column), SciDaVis crashes.
On Arch I am running scidavis 1.14-4.
On Xubuntu it was only 1.D9 (sorry for this inaccuracy).
But as I said, on both system SciDaVis crashes.
Please let me know, if it crashes on your pc when you do the same copy&paste thing.
Best regards
Arthur Niedermayr
-------- Original Message --------
Subject: [scidavis:scidavis-bugs] #292 Program Crashes if Pasting a Column
Local Time: December 20, 2016 11:14 PM
UTC Time: December 20, 2016 10:14 PM
From: narunlifescienc@users.sf.net
To: [scidavis:scidavis-bugs]292@scidavis-bugs.scidavis.p.re.sf.net
I just copied a column with 300000 rows from one table to another. 25mb file should have columns with lesser rows than that I guess.. are you using 32 bit or 64 bit ?
there should be some thing more to it. why dont you upload the file for testing purposes...
[[scidavis-bugs:#292]](https://sourceforge.net/p/scidavis/scidavis-bugs/292/) Program Crashes if Pasting a Column
Status: open
Group: 1.14
Labels: crash
Created: Mon Dec 19, 2016 08:35 PM UTC by arthur
Last Updated: Mon Dec 19, 2016 08:35 PM UTC
Owner: nobody
If I copy a column from one table and paste it to an other table the program crashes.
Tested with a file of 25Mb.
I tried importing your file and found it contains almost 317939 rows :). when trying to copy the column it does nt seem to crash but take a huge amount of resources(cpu, ram) as well as time. while copying one of my cpu core was 100%(Scidavis is single threaded so it seems to use the entire cpu resource it has) and it took ridiculous amount of ram (close to 3.5 GB). clearly some thing is not right under the hood but you can wait it out until scidavis copies the column.
An alternative I would suggest is to use muParser to do the copying job instead of scidavis implementation (formula editor). In this way I was able to copy the entire column in 2 seconds and no overuse of resource. However this can only be used to copy columns with in a table and not between tables.
1) select the column you need to copy stuff to
2) go to formula editor tab of the table
3) give the formula as the name of the column containing imported data and click apply
Hope that helps :)
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
Were there any code changes related to this issue?
I've been having somewhat similar problems with the x86_64 Fedora 27 1.22 build.
I do get increased CPU/RAM usage when I try to copy a column from LibreOffice Calc to SciDAVis - didn't wait for it to finish, killed it after a couple of minutes or so, but the computer I'm using is a piece of ****, so maybe it will succeed eventually, given enough time.
The other problem appears when I am trying to copy a column from one table to another. If the second table is empty, there are only 30 values that get copied over. If the table already contains some values, the column that gets pasted has as many values as the longest existing column in that table.
Can anyone else confirm these?
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
I do get increased CPU/RAM usage when I try to copy a column from LibreOffice Calc to SciDAVis - didn't wait for it to finish, killed it after a couple of minutes or so, but the computer I'm using is a piece of ****, so maybe it will succeed eventually, given enough time.
Unfortunately SciDAVis is very slow when one paste a large volume data on a column/table. And it doesn't matter where were the source data (*Office, text file, Origin, ...).
The other problem appears when I am trying to copy a column from one table to another. If the second table is empty, there are only 30 values that get copied over. If the table already contains some values, the column that gets pasted has as many values as the longest existing column in that table.
This happens only if you select "the column" by clicking on its name. If you just click on the first cell of a column/table, the column/table dimensions will be extended up to the dimensions of pasted data. As far I know, it is the intended behavior for pasting data in columns/tables, according to the former SciDAVis developers (I asked them about this a long time ago, and I disagreed with them at the time about this being good ...).
Best regards.
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
Unfortunately SciDAVis is very slow when one paste a large volume data on a column/table. And it doesn't matter where were the source data (*Office, text file, Origin, ...).
I vaguely remember being able to paste stuff on a 6-core Phenom II with a slight delay. It's good to know that it even with the load spikes, it works.
As far I know, it is the intended behavior for pasting data in columns/tables, according to the former SciDAVis developers
I was wondering if that was actually a bug or a feature…
Thank you for the information
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
I just copied a column with 300000 rows from one table to another. 25mb file should have columns with lesser rows than that I guess.. are you using 32 bit or 64 bit ?
there should be some thing more to it. why dont you upload the file for testing purposes...
Hi, sorry for my late reply.
My Arch Linux os is a 64 bit os, I am using this package:
https://aur.archlinux.org/packages/scidavis/ (downloaded today, I installed it via pacaur)
I attached a testfile with one column; if I import this file, ignoring the first two lines, and then copy the first column in a second one (after adding an empty column), SciDaVis crashes.
On Arch I am running scidavis 1.14-4.
On Xubuntu it was only 1.D9 (sorry for this inaccuracy).
But as I said, on both system SciDaVis crashes.
Please let me know, if it crashes on your pc when you do the same copy&paste thing.
Best regards
Arthur Niedermayr
-------- Original Message --------
Subject: [scidavis:scidavis-bugs] #292 Program Crashes if Pasting a Column
Local Time: December 20, 2016 11:14 PM
UTC Time: December 20, 2016 10:14 PM
From: narunlifescienc@users.sf.net
To: [scidavis:scidavis-bugs] 292@scidavis-bugs.scidavis.p.re.sf.net
I just copied a column with 300000 rows from one table to another. 25mb file should have columns with lesser rows than that I guess.. are you using 32 bit or 64 bit ?
there should be some thing more to it. why dont you upload the file for testing purposes...
[[scidavis-bugs:#292]](https://sourceforge.net/p/scidavis/scidavis-bugs/292/) Program Crashes if Pasting a Column
Status: open
Group: 1.14
Labels: crash
Created: Mon Dec 19, 2016 08:35 PM UTC by arthur
Last Updated: Mon Dec 19, 2016 08:35 PM UTC
Owner: nobody
If I copy a column from one table and paste it to an other table the program crashes.
Tested with a file of 25Mb.
Tested on Arch Linux and Xubuntu (16.04).
Sent from sourceforge.net because you indicated interest in https://sourceforge.net/p/scidavis/scidavis-bugs/292/
To unsubscribe from further messages, please visit https://sourceforge.net/auth/subscriptions/
I tried importing your file and found it contains almost 317939 rows :). when trying to copy the column it does nt seem to crash but take a huge amount of resources(cpu, ram) as well as time. while copying one of my cpu core was 100%(Scidavis is single threaded so it seems to use the entire cpu resource it has) and it took ridiculous amount of ram (close to 3.5 GB). clearly some thing is not right under the hood but you can wait it out until scidavis copies the column.
An alternative I would suggest is to use muParser to do the copying job instead of scidavis implementation (formula editor). In this way I was able to copy the entire column in 2 seconds and no overuse of resource. However this can only be used to copy columns with in a table and not between tables.
1) select the column you need to copy stuff to
2) go to formula editor tab of the table
3) give the formula as the name of the column containing imported data and click apply
Hope that helps :)
Hello,
Were there any code changes related to this issue?
I've been having somewhat similar problems with the x86_64 Fedora 27 1.22 build.
I do get increased CPU/RAM usage when I try to copy a column from LibreOffice Calc to SciDAVis - didn't wait for it to finish, killed it after a couple of minutes or so, but the computer I'm using is a piece of ****, so maybe it will succeed eventually, given enough time.
The other problem appears when I am trying to copy a column from one table to another. If the second table is empty, there are only 30 values that get copied over. If the table already contains some values, the column that gets pasted has as many values as the longest existing column in that table.
Can anyone else confirm these?
Hi Alexander,
Unfortunately SciDAVis is very slow when one paste a large volume data on a column/table. And it doesn't matter where were the source data (*Office, text file, Origin, ...).
This happens only if you select "the column" by clicking on its name. If you just click on the first cell of a column/table, the column/table dimensions will be extended up to the dimensions of pasted data. As far I know, it is the intended behavior for pasting data in columns/tables, according to the former SciDAVis developers (I asked them about this a long time ago, and I disagreed with them at the time about this being good ...).
Best regards.
Hello Fellype,
I vaguely remember being able to paste stuff on a 6-core Phenom II with a slight delay. It's good to know that it even with the load spikes, it works.
I was wondering if that was actually a bug or a feature…
Thank you for the information
Hi Alexander, Fellype,
Please, try attached patch. It should significantly reduce the time to Paste a large volume of data.
Miquel
Hello Miquel,
I've just tried the patch and pasting is now instantaneous.
I will rebuild Fedora packages with it later today.
Thank you!
Hi Miquel,
Tested here (Slackware 14.2) also. Same results as Alexander.
Very good work. Thank you!
Only for information:
Tested using 10000 rows × 4 columns floating data.