|
From: Alireza N. <ali...@gm...> - 2012-07-01 18:49:23
|
Hi, I've used wikiprep on a 2012 dump of WIkipedia (8GB) on my 4GB ram machine, ubuntu linux. I didn't split dump file and after the *prescan* phase, wikiprep process crashed with Out of memory! error. I know that the *prescan * phase was completed because my log file ends with these lines: Jul 01 08:31:52 [NOTICE] total 12300930 pages (30654051304 bytes) Jul 01 08:32:00 [NOTICE] Loaded 5992645 titles Jul 01 08:32:00 [NOTICE] Loaded 5471056 redirects Jul 01 08:32:01 [NOTICE] Loaded 346913 templates Is it possible to continue process from the *transform* phase? I also tested -transform option and that resulted this error: Can't call method "filter_fetch_value" on an undefined value at /usr/local/bin/wikiprep line 483 using Wikiprep-3.04 version. |