From: ning ji <ni...@ho...> - 2011-12-10 18:33:23
|
Hi all, when i run 60 umls in the same host with "mem=128M""free -m" says almost no free memory left. if i run more, all umls got killed. Now if i run uml with "mem=64M", was trying to run 100 umls, but still got terminated.Why ? (our goal is to run 200 umls in each host, 4GB memory each host.)(Also disk size is big enough, each rootfs is 0.1 G, 100 of umls is 10G) Thanks ! |
From: <cl...@cl...> - 2011-12-11 09:51:14
|
Hello, For UML machines, you have to look carefully at the /dev/shm value with df, if the used up /dev/shm gets too high, new UML cannot be launched. To look at the value you have: df -h /dev/shm/ To change it to 2 giga: mount -t tmpfs shmfs -o size=2g /dev/shm Look again: df -h /dev/shm/ > > Hi all, > when i run 60 umls in the same host with "mem=128M""free -m" says almost > no free memory left. > if i run more, all umls got killed. > Now if i run uml with "mem=64M", was trying to run 100 umls, but still got > terminated.Why ? > (our goal is to run 200 umls in each host, 4GB memory each host.)(Also > disk size is big enough, each rootfs is 0.1 G, 100 of umls is 10G) > Thanks ! > > ------------------------------------------------------------------------------ > Learn Windows Azure Live! Tuesday, Dec 13, 2011 > Microsoft is holding a special Learn Windows Azure training event for > developers. It will provide a great way to learn Windows Azure and what it > provides. You can attend the event by watching it streamed LIVE online. > Learn more at > http://p.sf.net/sfu/ms-windowsazure_______________________________________________ > User-mode-linux-user mailing list > Use...@li... > https://lists.sourceforge.net/lists/listinfo/user-mode-linux-user > |
From: <ro...@mm...> - 2011-12-12 15:48:39
|
cl...@cl... wrote: > > Hello, > For UML machines, you have to look carefully at the /dev/shm value with > df, if the used up /dev/shm gets too high, new UML cannot be launched. Excuse a newbie question, but if I understand correctly your statement, then the following: host@:~# df -h Filesystem Size Used Avail Use% Mounted on /dev/root 183G 15G 159G 9% / tmpfs 119M 0 119M 0% /dev/shm implies that the maximum memory a single UML instance can have is 119MB? As in: ./linux ubda=root_fs mem=119MB Thank you for your time, -Stathis > > To look at the value you have: > df -h /dev/shm/ > > To change it to 2 giga: > mount -t tmpfs shmfs -o size=2g /dev/shm > > Look again: > df -h /dev/shm/ > > > > > >> >> Hi all, >> when i run 60 umls in the same host with "mem=128M""free -m" says almost >> no free memory left. >> if i run more, all umls got killed. >> Now if i run uml with "mem=64M", was trying to run 100 umls, but still >> got >> terminated.Why ? >> (our goal is to run 200 umls in each host, 4GB memory each host.)(Also >> disk size is big enough, each rootfs is 0.1 G, 100 of umls is 10G) >> Thanks ! >> >> ------------------------------------------------------------------------------ >> Learn Windows Azure Live! Tuesday, Dec 13, 2011 >> Microsoft is holding a special Learn Windows Azure training event for >> developers. It will provide a great way to learn Windows Azure and what >> it >> provides. You can attend the event by watching it streamed LIVE online. >> Learn more at >> http://p.sf.net/sfu/ms-windowsazure_______________________________________________ >> User-mode-linux-user mailing list >> Use...@li... >> https://lists.sourceforge.net/lists/listinfo/user-mode-linux-user >> > > > ------------------------------------------------------------------------------ > Learn Windows Azure Live! Tuesday, Dec 13, 2011 > Microsoft is holding a special Learn Windows Azure training event for > developers. It will provide a great way to learn Windows Azure and what it > provides. You can attend the event by watching it streamed LIVE online. > Learn more at http://p.sf.net/sfu/ms-windowsazure > _______________________________________________ > User-mode-linux-user mailing list > Use...@li... > https://lists.sourceforge.net/lists/listinfo/user-mode-linux-user > |
From: ning ji <ni...@ho...> - 2011-12-12 17:51:17
|
Thanks for the info, that's a great help. BTW, 1. when i change "mem=128M" to "mem=64M", seems it didn't help, still uses the same amount of /dev/shm. why ? 2. Where did you learn the /dev/shm info for uml ? Have a nice day ! > Date: Sun, 11 Dec 2011 03:20:44 -0600 > Subject: Re: [uml-user] The max instance of uml is limited by memory and disk size ? > From: cl...@cl... > To: ni...@ho... > CC: use...@li... > > > Hello, > For UML machines, you have to look carefully at the /dev/shm value with > df, if the used up /dev/shm gets too high, new UML cannot be launched. > > To look at the value you have: > df -h /dev/shm/ > > To change it to 2 giga: > mount -t tmpfs shmfs -o size=2g /dev/shm > > Look again: > df -h /dev/shm/ > > > > > > > > > Hi all, > > when i run 60 umls in the same host with "mem=128M""free -m" says almost > > no free memory left. > > if i run more, all umls got killed. > > Now if i run uml with "mem=64M", was trying to run 100 umls, but still got > > terminated.Why ? > > (our goal is to run 200 umls in each host, 4GB memory each host.)(Also > > disk size is big enough, each rootfs is 0.1 G, 100 of umls is 10G) > > Thanks ! > > > > ------------------------------------------------------------------------------ > > Learn Windows Azure Live! Tuesday, Dec 13, 2011 > > Microsoft is holding a special Learn Windows Azure training event for > > developers. It will provide a great way to learn Windows Azure and what it > > provides. You can attend the event by watching it streamed LIVE online. > > Learn more at > > http://p.sf.net/sfu/ms-windowsazure_______________________________________________ > > User-mode-linux-user mailing list > > Use...@li... > > https://lists.sourceforge.net/lists/listinfo/user-mode-linux-user > > > |
From: <cl...@cl...> - 2011-12-12 18:36:09
|
I do not remember when I first had this problem, but I made cloonix, a virtual network and I have always tried to have many machines in one PC, uml, kvm or lxc machines in a cloonix network. The uml need shared memory because the processes inside a vm are processes of the host and they have to "see" the same memory, this shared memory is the virtual machine's, I think. If you set mem=500 or mem=32 it will probably take the same amount of memory in both cases (which is just the minimum needed to run). Try big mallocs inside your uml to see where it is taken, I suppose it will come from shared memory. > > > Thanks for the info, that's a great help. > BTW, > 1. when i change "mem=128M" to "mem=64M", seems it didn't help, still uses > the same amount of /dev/shm. why ? > 2. Where did you learn the /dev/shm info for uml ? > Have a nice day ! > >> Date: Sun, 11 Dec 2011 03:20:44 -0600 >> Subject: Re: [uml-user] The max instance of uml is limited by memory and >> disk size ? >> From: cl...@cl... >> To: ni...@ho... >> CC: use...@li... >> >> >> Hello, >> For UML machines, you have to look carefully at the /dev/shm value with >> df, if the used up /dev/shm gets too high, new UML cannot be launched. >> >> To look at the value you have: >> df -h /dev/shm/ >> >> To change it to 2 giga: >> mount -t tmpfs shmfs -o size=2g /dev/shm >> >> Look again: >> df -h /dev/shm/ >> >> >> >> >> >> > >> > Hi all, >> > when i run 60 umls in the same host with "mem=128M""free -m" says >> almost >> > no free memory left. >> > if i run more, all umls got killed. >> > Now if i run uml with "mem=64M", was trying to run 100 umls, but still >> got >> > terminated.Why ? >> > (our goal is to run 200 umls in each host, 4GB memory each host.)(Also >> > disk size is big enough, each rootfs is 0.1 G, 100 of umls is 10G) >> > Thanks ! >> > >> > ------------------------------------------------------------------------------ >> > Learn Windows Azure Live! Tuesday, Dec 13, 2011 >> > Microsoft is holding a special Learn Windows Azure training event for >> > developers. It will provide a great way to learn Windows Azure and >> what it >> > provides. You can attend the event by watching it streamed LIVE >> online. >> > Learn more at >> > http://p.sf.net/sfu/ms-windowsazure_______________________________________________ >> > User-mode-linux-user mailing list >> > Use...@li... >> > https://lists.sourceforge.net/lists/listinfo/user-mode-linux-user >> > >> > |
From: <cl...@cl...> - 2011-12-12 18:52:06
|
I do not know exactly how much shm is taken in that case, just try to launch the uml it an see the percent taken from shm. UML has to have shm, this is all I know. > cl...@cl... wrote: >> >> Hello, >> For UML machines, you have to look carefully at the /dev/shm value with >> df, if the used up /dev/shm gets too high, new UML cannot be launched. > > Excuse a newbie question, but if I understand correctly your statement, > then the following: > > host@:~# df -h > Filesystem Size Used Avail Use% Mounted on > /dev/root 183G 15G 159G 9% / > tmpfs 119M 0 119M 0% /dev/shm > > implies that the maximum memory a single UML instance can have is 119MB? > As in: > > ./linux ubda=root_fs mem=119MB > > Thank you for your time, > -Stathis > >> >> To look at the value you have: >> df -h /dev/shm/ >> >> To change it to 2 giga: >> mount -t tmpfs shmfs -o size=2g /dev/shm >> >> Look again: >> df -h /dev/shm/ >> >> >> >> >> >>> >>> Hi all, >>> when i run 60 umls in the same host with "mem=128M""free -m" says >>> almost >>> no free memory left. >>> if i run more, all umls got killed. >>> Now if i run uml with "mem=64M", was trying to run 100 umls, but still >>> got >>> terminated.Why ? >>> (our goal is to run 200 umls in each host, 4GB memory each host.)(Also >>> disk size is big enough, each rootfs is 0.1 G, 100 of umls is 10G) >>> Thanks ! >>> >>> ------------------------------------------------------------------------------ >>> Learn Windows Azure Live! Tuesday, Dec 13, 2011 >>> Microsoft is holding a special Learn Windows Azure training event for >>> developers. It will provide a great way to learn Windows Azure and what >>> it >>> provides. You can attend the event by watching it streamed LIVE online. >>> Learn more at >>> http://p.sf.net/sfu/ms-windowsazure_______________________________________________ >>> User-mode-linux-user mailing list >>> Use...@li... >>> https://lists.sourceforge.net/lists/listinfo/user-mode-linux-user >>> >> >> >> ------------------------------------------------------------------------------ >> Learn Windows Azure Live! Tuesday, Dec 13, 2011 >> Microsoft is holding a special Learn Windows Azure training event for >> developers. It will provide a great way to learn Windows Azure and what >> it >> provides. You can attend the event by watching it streamed LIVE online. >> Learn more at http://p.sf.net/sfu/ms-windowsazure >> _______________________________________________ >> User-mode-linux-user mailing list >> Use...@li... >> https://lists.sourceforge.net/lists/listinfo/user-mode-linux-user >> > > > > ------------------------------------------------------------------------------ > Learn Windows Azure Live! Tuesday, Dec 13, 2011 > Microsoft is holding a special Learn Windows Azure training event for > developers. It will provide a great way to learn Windows Azure and what it > provides. You can attend the event by watching it streamed LIVE online. > Learn more at http://p.sf.net/sfu/ms-windowsazure > _______________________________________________ > User-mode-linux-user mailing list > Use...@li... > https://lists.sourceforge.net/lists/listinfo/user-mode-linux-user > |
From: ning ji <ni...@ho...> - 2011-12-13 23:48:36
|
Hi all, 1. I run uml in linux1, ./umlinux ubda=my_rootfs mem=128M eth0=tuntap,,,192.117.0.254 2. after it boot up, i set the uml ip to be 192.117.0.7 route add default gw 192.117.0.254 3. in the linux1, i addiptables -t nat -A POSTROUTING -o eth0 -j MASQUERADE 4. linux 1 and linux 2 can ping each other5. uml and linux1 can ping each other6. uml can ping linux 27. but linux 2 cannot ping uml pls advice what to do, thanks ! |
From: ning ji <ni...@ho...> - 2011-12-20 01:13:19
|
hi everyone, i'm running 20 UMLs in linux,each of them can access a public folder in the host linux.( http://user-mode-linux.sourceforge.net/hostfs.html )So i don't need to copy these apps/libs to each UML.so i start all these UMLs at the same time, they will automatically run the same appin the public fold (/mnt/host).But i run intostack smashing detected errorfor 1 of our lib.so.My questions is,is these a bug in the application/lib itself,or i'm running out of resources as i have 20 VMs ?Thanks !-- |
From: ning ji <ni...@ho...> - 2011-12-20 02:46:31
|
just to be clear, if we run the application in the stand alone linux pc, never seen such errors. From: ni...@ho... To: ni...@ho... CC: use...@li... Subject: stack smashing detected when running apps in the hostfs Date: Tue, 20 Dec 2011 01:13:09 +0000 hi everyone, i'm running 20 UMLs in linux,each of them can access a public folder in the host linux.( http://user-mode-linux.sourceforge.net/hostfs.html )So i don't need to copy these apps/libs to each UML.so i start all these UMLs at the same time, they will automatically run the same appin the public fold (/mnt/host).But i run intostack smashing detected errorfor 1 of our lib.so.My questions is,is these a bug in the application/lib itself,or i'm running out of resources as i have 20 VMs ?Thanks !-- |
From: ning ji <ni...@ho...> - 2011-12-23 02:10:37
|
This problem solved, it's a bug in our app. But i'll come with another question. From: ni...@ho... CC: use...@li... Date: Tue, 20 Dec 2011 02:46:25 +0000 Subject: Re: [uml-user] stack smashing detected when running apps in the hostfs just to be clear, if we run the application in the stand alone linux pc, never seen such errors. From: ni...@ho... To: ni...@ho... CC: use...@li... Subject: stack smashing detected when running apps in the hostfs Date: Tue, 20 Dec 2011 01:13:09 +0000 hi everyone, i'm running 20 UMLs in linux,each of them can access a public folder in the host linux.( http://user-mode-linux.sourceforge.net/hostfs.html )So i don't need to copy these apps/libs to each UML.so i start all these UMLs at the same time, they will automatically run the same appin the public fold (/mnt/host).But i run intostack smashing detected errorfor 1 of our lib.so.My questions is,is these a bug in the application/lib itself,or i'm running out of resources as i have 20 VMs ?Thanks !-- ------------------------------------------------------------------------------ Write once. Port to many. Get the SDK and tools to simplify cross-platform app development. Create new or port existing apps to sell to consumers worldwide. Explore the Intel AppUpSM program developer opportunity. appdeveloper.intel.com/join http://p.sf.net/sfu/intel-appdev _______________________________________________ User-mode-linux-user mailing list Use...@li... https://lists.sourceforge.net/lists/listinfo/user-mode-linux-user |
From: ning ji <ni...@ho...> - 2011-12-23 02:15:00
|
it's a little bit complicated,1. i have a script starts 20 xterms like this, xterm -e "uml ..." so basically i run 20 umls in my pc, each in a xterm so i can check the progress.2. each of uml will automatically start my application, which is multithreaded, has pipes, sockets etc.when i do this, every once a while some xterms disappear.if the UMLs don't run my app, i know it's fine.but if my app has bug, how can it kills the xterm ?During this procedure, i keep on checking pc memory by "free -m",and seems it has plenty of free memory.Total is ~3GB, but i never see the used memory exceed 2GB. Shared memory usage is only ~20%.thanks ! |
From: Lars E. G <lar...@er...> - 2011-12-23 08:51:25
|
Hi, Use "-hold" option to xterm. The terminal window will stay open even when the executed program has terminated. But you will have to close all windows manually, which you might find very annoying considering the number of vm's. Regards, Lars Ekman -----Original Message----- From: ning ji [mailto:ni...@ho...] Sent: den 23 december 2011 03:15 Cc: use...@li... Subject: [uml-user] xterm got kill when i run application in uml, how come ? it's a little bit complicated, 1. i have a script starts 20 xterms like this, xterm -e "uml ..." so basically i run 20 umls in my pc, each in a xterm so i can check the progress. 2. each of uml will automatically start my application, which is multithreaded, has pipes, sockets etc. when i do this, every once a while some xterms disappear. if the UMLs don't run my app, i know it's fine. but if my app has bug, how can it kills the xterm ? During this procedure, i keep on checking pc memory by "free -m", and seems it has plenty of free memory. Total is ~3GB, but i never see the used memory exceed 2GB. Shared memory usage is only ~20%. thanks ! |
From: ning ji <ni...@ho...> - 2011-12-24 03:42:21
|
Thanks Lars. Actually i did more testing, without my app, i just start 20 UMLs all together, some xterms got killed.So the problem is UML, not my app. I left the error message in the company, but briefly the TAP devices have issues.In my case, each UML has a static ip. When all 20 starts, you can easily see the error with stack trace. Now if i run all these in a vm in a vmWare server, it's even easier to reproduce, everything seems to be slower. So far this project turns out to be a mess and i'm praying they won't fire me. > From: lar...@er... > To: ni...@ho... > CC: use...@li... > Date: Fri, 23 Dec 2011 09:51:15 +0100 > Subject: RE: [uml-user] xterm got kill when i run application in uml, how come ? > > > Hi, > > Use "-hold" option to xterm. The terminal window will stay open > even when the executed program has terminated. But you will have > to close all windows manually, which you might find very annoying > considering the number of vm's. > > Regards, > Lars Ekman > > > -----Original Message----- > From: ning ji [mailto:ni...@ho...] > Sent: den 23 december 2011 03:15 > Cc: use...@li... > Subject: [uml-user] xterm got kill when i run application in uml, how come ? > > it's a little bit complicated, > 1. i have a script starts 20 xterms like this, > xterm -e "uml ..." > so basically i run 20 umls in my pc, each in a xterm so i can check > the progress. > > 2. each of uml will automatically start my application, > which is multithreaded, has pipes, sockets etc. > > when i do this, every once a while some xterms disappear. > > if the UMLs don't run my app, i know it's fine. > but if my app has bug, how can it kills the xterm ? > > During this procedure, i keep on checking pc memory by "free -m", > and seems it has plenty of free memory. > Total is ~3GB, but i never see the used memory exceed 2GB. > > Shared memory usage is only ~20%. > > thanks ! > |
From: richard -r. w. <ric...@gm...> - 2011-12-24 10:19:13
|
On Sat, Dec 24, 2011 at 4:42 AM, ning ji <ni...@ho...> wrote: > I left the error message in the company, but briefly the TAP devices have > issues. Without the exact message nobody can help you. > So far this project turns out to be a mess and i'm praying they won't fire > me. > If UML is the root cause of your problems, there are lots of alternatives. Most UML users are using KVM today... -- Thanks, //richard |
From: ning ji <ni...@ho...> - 2012-01-03 17:01:45
|
This is what i get when running 20 instances of uml in a vmware, kernel is 2.6.39.4. Thanks ! Starting system logger: [ OK ] Retrigger failed udev events[ OK ] [ 156.810000] helper_wait : waitpid process 13447 failed, errno = 10 [ 156.810000] * modprobe tun [ 156.810000] * ifconfig tap4 10.38.145.169 netmask 255.255.255.255 up [ 156.810000] * bash -c echo 1 > /proc/sys/net/ipv4/ip_forward [ 156.810000] Kernel panic - not syncing: Kernel mode signal 4 [ 156.810000] 0861381c: [<084d18bc>] dump_stack+0x1c/0x20 [ 156.810000] 08613834: [<084d190d>] panic+0x4d/0x13f [ 156.810000] 08613868: [<08065b66>] relay_signal+0x30/0x72 [ 156.810000] 08613888: [<08071916>] sig_handler_common+0x61/0x70 [ 156.810000] 08613900: [<08071a3e>] sig_handler+0x31/0x3d [ 156.810000] 0861390c: [<08071be2>] handle_signal+0x4d/0x7b [ 156.810000] 0861392c: [<080732f7>] hard_handler+0xf/0x14 [ 156.810000] 0861393c: [<0068f400>] 0x68f400 [ 156.810000] 08613c34: [<080639e9>] do_IRQ+0x26/0x3d [ 156.810000] 08613c50: [<08063b83>] sigio_handler+0x46/0x5f [ 156.810000] 08613c68: [<08071916>] sig_handler_common+0x61/0x70 [ 156.810000] 08613ce0: [<08071a3e>] sig_handler+0x31/0x3d [ 156.810000] 08613cec: [<08071be2>] handle_signal+0x4d/0x7b [ 156.810000] 08613d0c: [<080732f7>] hard_handler+0xf/0x14 [ 156.810000] 08613d1c: [<0068f400>] 0x68f400 "bug3" 50 lines, 2697 characters > Date: Sat, 24 Dec 2011 11:19:07 +0100 > Subject: Re: [uml-user] xterm got kill when i run application in uml, how come ? > From: ric...@gm... > To: ni...@ho... > CC: lar...@er...; use...@li... > > On Sat, Dec 24, 2011 at 4:42 AM, ning ji <ni...@ho...> wrote: > > I left the error message in the company, but briefly the TAP devices have > > issues. > > Without the exact message nobody can help you. > > > So far this project turns out to be a mess and i'm praying they won't fire > > me. > > > > If UML is the root cause of your problems, there are lots of alternatives. > Most UML users are using KVM today... > > -- > Thanks, > //richard |
From: richard -r. w. <ric...@gm...> - 2012-01-03 18:06:41
|
On Tue, Jan 3, 2012 at 6:01 PM, ning ji <ni...@ho...> wrote: > Starting system logger: [ OK ] > Retrigger failed udev events[ OK ] > [ 156.810000] helper_wait : waitpid process 13447 failed, errno = 10 > [ 156.810000] * modprobe tun > [ 156.810000] * ifconfig tap4 10.38.145.169 netmask 255.255.255.255 up > [ 156.810000] * bash -c echo 1 > /proc/sys/net/ipv4/ip_forward Maybe you're running out of host resources. It looks like a helper program is dying. -- Thanks, //richard |
From: ning ji <ni...@ho...> - 2012-01-03 19:18:38
|
Hi Richard, so i run 20 of them again, at the moment i can find the 1st kernel panic, i dumped the memory stats, they look fine to me. (The numbers look pretty much the same after all umls are loaded.) Is there anything else i need to check ? thanks ! root@VQEUbuntu32:/home/shadmin/10uml# free -m total used free shared buffers cached Mem: 3024 1071 1952 0 4 837 -/+ buffers/cache: 229 2794 Swap: 8855 0 8855 root@VQEUbuntu32:/home/shadmin/10uml# df /dev/shm Filesystem 1K-blocks Used Available Use% Mounted on none 1548436 442072 1106364 29% /dev/shm > Date: Tue, 3 Jan 2012 19:06:35 +0100 > Subject: Re: [uml-user] xterm got kill when i run application in uml, how come ? > From: ric...@gm... > To: ni...@ho... > CC: lar...@er...; use...@li... > > On Tue, Jan 3, 2012 at 6:01 PM, ning ji <ni...@ho...> wrote: > > Starting system logger: [ OK ] > > Retrigger failed udev events[ OK ] > > [ 156.810000] helper_wait : waitpid process 13447 failed, errno = 10 > > [ 156.810000] * modprobe tun > > [ 156.810000] * ifconfig tap4 10.38.145.169 netmask 255.255.255.255 up > > [ 156.810000] * bash -c echo 1 > /proc/sys/net/ipv4/ip_forward > > Maybe you're running out of host resources. > It looks like a helper program is dying. > > -- > Thanks, > //richard |