Menu
▾
▴
#1605 Bulk delete of 20k records does not work
not-a-bug
nobody
User Interface
Medium
2.4.1
defect
2018-08-16
2018-06-15
No
Hi,
I have 26.000 NetworkInterface items which I want to bulk delete, all of them.
I also use teemip module, some of these interfaces have hence also IP objects assigned.
The bulk delete via GUI simply does not work. Sometimes I get a blank page as a result, sometimes a timeout error message. But nothing is deleted. I assume it's simply because there are too many items to be removed at once.
I could first use some filter to shorten the selection for deletion, but this is still not user friendly in case I need to perform the deletion often.
Is there a way to perform a bulk delete of thousands of records with all their dependencies all at once?
Is it a MySQL or PHP timeout? What's the timeout value right now? Is it an option for you to increase it?
defnitely php script execution timeout (max_execution_time), maybe in combination with max memory limit (memory_limit). there is nothing wrong directly with application itself. I can imagine object dependency calculation per each "subject-to-delete" item is causing this....
Today it either replies with an empty page after just few seconds, or it keeps on loading forever, while the CPU is on 100% because of apache service running like crazy. I was hoping, there is some straightforward way how to get rid of so many records, perhaps purging some mysql tables directly. But I don't know how the dependencies are affected in that case.
I faced the same problem with a lot of entries in the PCSoftware class and solved it by increasing the variable "max_input_vars" in php.ini. Default seems to be 1000 which is way to low! Unfortunately the time to render the website to show all the results and confirm the delete button ist extremely high and the (user) configuration setting to limit the results and enable paging did not work within bulk delete operations.
Hello,
Deleting such a volume of data is low, but our customers do this very rarely. There is no plan to improve this in a near future.
You might develop a custom iBackgroundProcess in an extension to do the deletion ?
I'm closing this ticket, you can post a new thread in the discussion tab if you need assistance on a workaround.
Hi Pierre,
OK understood. I only wanted to know if there is any easier way to delete so many records.
It was only meant for the time I was developing the synchronization of iTop with one external system, where I had to start over from scratch quite often. Hopefully, once it's all done, there will be no need anymore to bulk delete so many records at the same time.