I am trying to rebuild database on a folder that contains 117 HD movies (file size around 2GB and 15GB). It runs well for about an hour or so and after that, it crashed:
here's the log file:
Sep 8 05:35:23 freenas smbd: lib/util_sock.c:474(read_fd_with_timeout)
Sep 8 05:35:23 freenas smbd: lib/util_sock.c:1432(get_peer_addr_internal)
Sep 8 05:35:23 freenas smbd: getpeername failed. Error was Socket is not connected
Sep 8 05:35:23 freenas smbd: read_fd_with_timeout: client 0.0.0.0 read error = Socket is not connected.
Sep 8 05:35:48 freenas kernel: swap_pager_getswapspace(16): failed
Sep 8 05:35:49 freenas kernel: swap_pager_getswapspace(12): failed
Sep 8 05:35:49 freenas kernel: swap_pager_getswapspace(9): failed
Sep 8 05:35:49 freenas kernel: pid 1961 (smbd), uid 0, was killed: out of swap space
Sep 8 05:35:49 freenas kernel: pid 2191 (fuppesd), uid 0, was killed: out of swap space
I have increased my swap memory space to 2GB and I have 2GB of memory…is it normal that it needs that much ? Note that I am running a USB stick and my swap file is under one of my mounted disk.
Here's one of the output while doing the rebuild…
Memory usage 92% of 1854MiB
Swap usage 24% of 1.95GB
Device: /dev/md2 | Total: 1.95G | Used: 847.33M | Free: 1.13G
How much should I increase it ?
I just realized that the swap not getting release it, it's never go lower, only keep increasing…is this normal ? maybe a memory leak at some point… ? could it be ?
It seems that it's one of my movie (maybe more actually but found one) that is causing the problem. I had around 160 movies in my folder. I've done severals tests, tried to removed some in the folder. I was able to rebuild if I had like 15 movies in the folder without any problems (took less than 10 sec to rebuild).
However, I found a movie that is causing my problem, if I remove all the movie except that one, now, the rebuild process just takes forever, actually, it was running from 3 hours and It didn't finish (I could see the CPU at 80%-100%). I suspect something is wrong with that move.
The file extension is .m2ts for all my movies. Anyone might know the problem here ? Could it be a codec problem or I don't know ? Why some movies run just fine and some other, not… What could it be ?
thanks !!!
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
FreeNAS 0.7.2 (revision 5266) amd64-embedded
A_M_I_ OEMXSDT AMD Athlon™ 64 X2 Dual Core Processor 4400+ 2048MiB RAM
I am trying to rebuild database on a folder that contains 117 HD movies (file size around 2GB and 15GB). It runs well for about an hour or so and after that, it crashed:
here's the log file:
Sep 8 05:35:23 freenas smbd: lib/util_sock.c:474(read_fd_with_timeout)
Sep 8 05:35:23 freenas smbd: lib/util_sock.c:1432(get_peer_addr_internal)
Sep 8 05:35:23 freenas smbd: getpeername failed. Error was Socket is not connected
Sep 8 05:35:23 freenas smbd: read_fd_with_timeout: client 0.0.0.0 read error = Socket is not connected.
Sep 8 05:35:48 freenas kernel: swap_pager_getswapspace(16): failed
Sep 8 05:35:49 freenas kernel: swap_pager_getswapspace(12): failed
Sep 8 05:35:49 freenas kernel: swap_pager_getswapspace(9): failed
Sep 8 05:35:49 freenas kernel: pid 1961 (smbd), uid 0, was killed: out of swap space
Sep 8 05:35:49 freenas kernel: pid 2191 (fuppesd), uid 0, was killed: out of swap space
I have increased my swap memory space to 2GB and I have 2GB of memory…is it normal that it needs that much ? Note that I am running a USB stick and my swap file is under one of my mounted disk.
Here's one of the output while doing the rebuild…
Memory usage 92% of 1854MiB
Swap usage 24% of 1.95GB
Device: /dev/md2 | Total: 1.95G | Used: 847.33M | Free: 1.13G
How much should I increase it ?
I just realized that the swap not getting release it, it's never go lower, only keep increasing…is this normal ? maybe a memory leak at some point… ? could it be ?
It seems that it's one of my movie (maybe more actually but found one) that is causing the problem. I had around 160 movies in my folder. I've done severals tests, tried to removed some in the folder. I was able to rebuild if I had like 15 movies in the folder without any problems (took less than 10 sec to rebuild).
However, I found a movie that is causing my problem, if I remove all the movie except that one, now, the rebuild process just takes forever, actually, it was running from 3 hours and It didn't finish (I could see the CPU at 80%-100%). I suspect something is wrong with that move.
The file extension is .m2ts for all my movies. Anyone might know the problem here ? Could it be a codec problem or I don't know ? Why some movies run just fine and some other, not… What could it be ?
thanks !!!