Menu
▾
▴
gridsim-developers — GridSim DevelopersFor contributing to GridSim or questions related to the existi
You can subscribe to this list here.
| 2007 |
Jan
|
Feb
|
Mar
|
Apr
|
May
|
Jun
|
Jul
|
Aug
|
Sep
(7) |
Oct
(2) |
Nov
|
Dec
|
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 2008 |
Jan
(2) |
Feb
(1) |
Mar
|
Apr
|
May
|
Jun
(3) |
Jul
(3) |
Aug
|
Sep
(14) |
Oct
(1) |
Nov
(3) |
Dec
(2) |
| 2009 |
Jan
|
Feb
(21) |
Mar
(2) |
Apr
(6) |
May
(1) |
Jun
|
Jul
|
Aug
(1) |
Sep
|
Oct
(4) |
Nov
(1) |
Dec
|
| 2010 |
Jan
(2) |
Feb
(5) |
Mar
(5) |
Apr
(17) |
May
|
Jun
(1) |
Jul
|
Aug
(2) |
Sep
(4) |
Oct
(1) |
Nov
(2) |
Dec
|
| 2011 |
Jan
(4) |
Feb
(7) |
Mar
(3) |
Apr
(3) |
May
|
Jun
|
Jul
(1) |
Aug
|
Sep
|
Oct
|
Nov
|
Dec
(1) |
| 2012 |
Jan
|
Feb
(1) |
Mar
(5) |
Apr
(7) |
May
(4) |
Jun
|
Jul
|
Aug
|
Sep
|
Oct
|
Nov
|
Dec
|
| 2013 |
Jan
|
Feb
(1) |
Mar
|
Apr
(10) |
May
(1) |
Jun
(1) |
Jul
|
Aug
(3) |
Sep
|
Oct
|
Nov
|
Dec
|
| 2014 |
Jan
|
Feb
|
Mar
(2) |
Apr
|
May
|
Jun
|
Jul
(5) |
Aug
|
Sep
|
Oct
|
Nov
(3) |
Dec
(2) |
| 2015 |
Jan
|
Feb
(1) |
Mar
(1) |
Apr
(3) |
May
|
Jun
|
Jul
|
Aug
|
Sep
|
Oct
|
Nov
|
Dec
|
| 2016 |
Jan
|
Feb
|
Mar
|
Apr
|
May
|
Jun
|
Jul
(2) |
Aug
|
Sep
(4) |
Oct
|
Nov
|
Dec
|
| 2019 |
Jan
|
Feb
|
Mar
|
Apr
|
May
|
Jun
|
Jul
(1) |
Aug
|
Sep
|
Oct
|
Nov
|
Dec
|
|
From: Marcos D. de A. <ma...@cs...> - 2008-11-28 13:00:43
|
The time unit used for simulation in GridSim is the second. So, if a job takes 60 seconds in the 'real world' to be executed, when simulated in GridSim it should run for 60 time units. Sim_system maintains two event queues: the future event queue and the deferred queue. Sum_system has a loop that keeps iterating the future event queue while it is not empty. If you start the simulation and you have one event in the future event queue for time unit 10, then Sim_system will retrieve this event from the future event queue, set the clock to 10, put the event in the deferred event queue and wake up entities to handle events. If you have 15 events scheduled for time 10, Sim_system will remove all of them from future event queue and put them in the deferred event queue. After all entities handle the events, Sim_system's loop will retrieve the next event. If the next event is for time 50, then the same process will be repeated and the simulation clock will be set to 50. This is repeated until the future event queue is empty. This process is common in discrete event simulators. Regards, Marcos On 28/11/2008, at 11:29 PM, ye huang wrote: > Hi, Dear all: > I have a similar ask with Gilberto: how is GridSim clock ticking? > How to exchange the clock in GridSim and real world? I mean, One > realworld second equals to how many GridSim seconds? > > regards > ye > > On 24 Nov, 2008, at 12:35 PM, Gilberto Cunha wrote: > >> Hi... My name is Gilberto. >> >> I'm trying understand, how the clock of the gridsim work, but i >> don't understand very well.. >> Could you explain how gridsim clock is work and how the clock of >> the gridsim is increased? >> >> One doubt, for example: what's happen when: an entity 'X' is >> started and send an event for itself at 3600 seconds. After in >> other moment, an entity 'A' send an event for entity 'B' at 320 >> second. How GridSim clock is synchronized? >> >> Other doubt is, how resources register influence the gridsim clock? >> >> Regards and Thanks for your atention, >> >> Gilberto >> >> On Mon, Nov 24, 2008 at 7:18 AM, <gridsim-users- >> re...@li...> wrote: >> Send Gridsim-users mailing list submissions to >> gri...@li... >> >> To subscribe or unsubscribe via the World Wide Web, visit >> https://lists.sourceforge.net/lists/listinfo/gridsim-users >> or, via email, send a message with subject or body 'help' to >> gri...@li... >> >> You can reach the person managing the list at >> gri...@li... >> >> When replying, please edit your Subject line so it is more specific >> than "Re: Contents of Gridsim-users digest..." >> >> >> Today's Topics: >> >> 1. Re: GridSim instalation (Anthony Sulistio) >> >> >> --------------------------------------------------------------------- >> - >> >> Message: 1 >> Date: Mon, 24 Nov 2008 21:18:28 +1100 (EST) >> From: Anthony Sulistio <an...@cs...> >> Subject: Re: [GridSim-users] GridSim instalation >> To: Gil Noe Zavala Ramirez <gt...@ya...> >> Cc: her...@ho..., gri...@li... >> Message-ID: >> <Pin...@mu...> >> Content-Type: text/plain; charset="iso-8859-1" >> >> >> Hi Gil and Juan, >> >> On GridSim website, under the Documentation section, there >> are instructions on how to use GridSim with a Java IDE: >> * Eclipse http://www.gridbus.org/gridsim/paper/eclipse.pdf >> * JBuilder http://www.gridbus.org/gridsim/paper/jbuilder.pdf >> * JCreator http://www.gridbus.org/gridsim/paper/jcreator.pdf >> >> >> In the future, please email us through our mailing list: >> gridsim-users (at) lists.sourceforge.net : >> for general queries and feedbacks. >> >> gridsim-developers (at) lists.sourceforge.net : >> for contributing to GridSim or questions related to the existing >> GridSim code. >> >> To subscribe to the above mailing lists, please go to: >> https://lists.sourceforge.net/lists/listinfo/gridsim-users >> https://lists.sourceforge.net/lists/listinfo/gridsim-developers >> >> >> anthony >> >> >> On Thu, 20 Nov 2008, Gil Noe Zavala Ramirez wrote: >> >> > Hi >> > my name is Gil >> > and... >> > I am?student of the technologic institute of Mexicali http:// >> www.itmexicali.edu.mx/,?? >> > I have problems about how to install gridsimtoolkit in windows >> vista and >> > XP with easy eclipse or jcreator. >> > ? >> > the type of problem is shown like this: >> > ? >> > package Gridsim does not exist. >> > cannot find symbol class GridletList. >> > ? >> > please can you lend? a hand, Mr.Anthony. >> > ? >> > Regards: >> > ? >> > Zavala Ramirez Gil Noe. >> >> >> ?Todo sobre Amor y Sexo! >> La gu?a completa para tu vida en Mujer de Hoy. >> http://mx.mujer.yahoo.com/ >> >> ------------------------------ >> >> --------------------------------------------------------------------- >> ---- >> This SF.Net email is sponsored by the Moblin Your Move Developer's >> challenge >> Build the coolest Linux based applications with Moblin SDK & win >> great prizes >> Grand prize is a trip for two to an Open Source event anywhere in >> the world >> http://moblin-contest.org/redirect.php?banner_id=100&url=/ >> >> ------------------------------ >> >> _______________________________________________ >> Gridsim-users mailing list >> Gri...@li... >> https://lists.sourceforge.net/lists/listinfo/gridsim-users >> >> >> End of Gridsim-users Digest, Vol 57, Issue 1 >> ******************************************** >> >> >> >> -- >> Gilberto Cunha Filho >> gil...@gm... >> SISMO - Laboratório de Sistemas e Mobilidade >> UFMA >> --------------------------------------------------------------------- >> ---- >> This SF.Net email is sponsored by the Moblin Your Move Developer's >> challenge >> Build the coolest Linux based applications with Moblin SDK & win >> great prizes >> Grand prize is a trip for two to an Open Source event anywhere in >> the world >> http://moblin-contest.org/redirect.php?banner_id=100&url=/ >> _______________________________________________ >> Gridsim-users mailing list >> Gri...@li... >> https://lists.sourceforge.net/lists/listinfo/gridsim-users > > > > > > > ---------------------------------------------------------------------- > --- > This SF.Net email is sponsored by the Moblin Your Move Developer's > challenge > Build the coolest Linux based applications with Moblin SDK & win > great prizes > Grand prize is a trip for two to an Open Source event anywhere in > the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > _______________________________________________ > Gridsim-users mailing list > Gri...@li... > https://lists.sourceforge.net/lists/listinfo/gridsim-users Marcos Dias de Assuncao Grid Computing and Distributed Systems (GRIDS) Laboratory Department of Computer Science and Software Engineering The University of Melbourne, Australia Email: ma...@cs... ------------- "The bankers own the earth. Take it away from them, but leave them the power to create money, and with the flick of the pen they will create enough money to buy it back again. However, take away from them the power to create money, and all the great fortunes like mine will disappear and they ought to disappear, for this would be a happier and better world to live in. But, if you wish to remain the slaves of bankers and pay the cost of your own slavery, let them continue to create money." Sir Josiah Stamp Former Director of The Bank of England |
|
From: ye h. <hua...@gm...> - 2008-11-28 12:29:23
|
Hi, Dear all: I have a similar ask with Gilberto: how is GridSim clock ticking? How to exchange the clock in GridSim and real world? I mean, One realworld second equals to how many GridSim seconds? regards ye On 24 Nov, 2008, at 12:35 PM, Gilberto Cunha wrote: > Hi... My name is Gilberto. > > I'm trying understand, how the clock of the gridsim work, but i > don't understand very well.. > Could you explain how gridsim clock is work and how the clock of the > gridsim is increased? > > One doubt, for example: what's happen when: an entity 'X' is started > and send an event for itself at 3600 seconds. After in other moment, > an entity 'A' send an event for entity 'B' at 320 second. How > GridSim clock is synchronized? > > Other doubt is, how resources register influence the gridsim clock? > > Regards and Thanks for your atention, > > Gilberto > > On Mon, Nov 24, 2008 at 7:18 AM, <gri...@li... > > wrote: > Send Gridsim-users mailing list submissions to > gri...@li... > > To subscribe or unsubscribe via the World Wide Web, visit > https://lists.sourceforge.net/lists/listinfo/gridsim-users > or, via email, send a message with subject or body 'help' to > gri...@li... > > You can reach the person managing the list at > gri...@li... > > When replying, please edit your Subject line so it is more specific > than "Re: Contents of Gridsim-users digest..." > > > Today's Topics: > > 1. Re: GridSim instalation (Anthony Sulistio) > > > ---------------------------------------------------------------------- > > Message: 1 > Date: Mon, 24 Nov 2008 21:18:28 +1100 (EST) > From: Anthony Sulistio <an...@cs...> > Subject: Re: [GridSim-users] GridSim instalation > To: Gil Noe Zavala Ramirez <gt...@ya...> > Cc: her...@ho..., gri...@li... > Message-ID: > <Pin...@mu...> > Content-Type: text/plain; charset="iso-8859-1" > > > Hi Gil and Juan, > > On GridSim website, under the Documentation section, there > are instructions on how to use GridSim with a Java IDE: > * Eclipse http://www.gridbus.org/gridsim/paper/eclipse.pdf > * JBuilder http://www.gridbus.org/gridsim/paper/jbuilder.pdf > * JCreator http://www.gridbus.org/gridsim/paper/jcreator.pdf > > > In the future, please email us through our mailing list: > gridsim-users (at) lists.sourceforge.net : > for general queries and feedbacks. > > gridsim-developers (at) lists.sourceforge.net : > for contributing to GridSim or questions related to the existing > GridSim code. > > To subscribe to the above mailing lists, please go to: > https://lists.sourceforge.net/lists/listinfo/gridsim-users > https://lists.sourceforge.net/lists/listinfo/gridsim-developers > > > anthony > > > On Thu, 20 Nov 2008, Gil Noe Zavala Ramirez wrote: > > > Hi > > my name is Gil > > and... > > I am?student of the technologic institute of Mexicali http://www.itmexicali.edu.mx/,? > ? > > I have problems about how to install gridsimtoolkit in windows > vista and > > XP with easy eclipse or jcreator. > > ? > > the type of problem is shown like this: > > ? > > package Gridsim does not exist. > > cannot find symbol class GridletList. > > ? > > please can you lend? a hand, Mr.Anthony. > > ? > > Regards: > > ? > > Zavala Ramirez Gil Noe. > > > ?Todo sobre Amor y Sexo! > La gu?a completa para tu vida en Mujer de Hoy. > http://mx.mujer.yahoo.com/ > > ------------------------------ > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's > challenge > Build the coolest Linux based applications with Moblin SDK & win > great prizes > Grand prize is a trip for two to an Open Source event anywhere in > the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > > ------------------------------ > > _______________________________________________ > Gridsim-users mailing list > Gri...@li... > https://lists.sourceforge.net/lists/listinfo/gridsim-users > > > End of Gridsim-users Digest, Vol 57, Issue 1 > ******************************************** > > > > -- > Gilberto Cunha Filho > gil...@gm... > SISMO - Laboratório de Sistemas e Mobilidade > UFMA > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's > challenge > Build the coolest Linux based applications with Moblin SDK & win > great prizes > Grand prize is a trip for two to an Open Source event anywhere in > the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/_______________________________________________ > Gridsim-users mailing list > Gri...@li... > https://lists.sourceforge.net/lists/listinfo/gridsim-users |
|
From: Marcos D. de A. <ma...@cs...> - 2008-10-01 07:28:33
|
Hi All,
adding something to a previous discussion about the way simjava2
manages the threads (i.e. entities), I think that you have probably
faced the same problems.
As simjava2 restarts all entities that have events scheduled for the
same time (i.e. a clock tick), it may happen that both a GridResource
and its policy have two separate events to be handled at the same
simulation time. The event received by the GridResource may be a
gridlet submission whereas the event received by the policy may be an
internal event used to update some list.
(From sim_system.run_tick()) :
int entities_size = entities.size();
for (int i=0; i < entities_size; i++) {
ent = (Sim_entity)entities.get(i);
if (ent.get_state() == Sim_entity.RUNNABLE) {
ent.restart();
num_started++;
}
}
If you have used java 5's features such as "for(Object obj :
Iterable) {" you will notice that if you try to iterate an iterable
object in the gridletSubmit method and update it somewhere else, you
are likely to receive a ConcurrentModificationException. The reason
is that the methods:
public void gridletSubmit(Gridlet gl, boolean ack);
public void gridletCancel(int gridletId, int userId);
public void gridletPause(int gridletId, int userId, boolean ack);
public void gridletResume(int gridletId, int userId, boolean ack);
public int gridletStatus(int gridletId, int userId);
public void gridletMove(int gridletId, int userId, int destId,
boolean ack);
public void processOtherEvent(Sim_event ev)
are not synchronised. This way, GridResource may be invoking some of
the policie's method running in one thread while the policy is
updating the list in another thread.
Although this may look obvious, a user trying to implement its policy
might get quite puzzled about it. I am also wondering, another
problem is that the results may look different if a simulation is run
on different computers with different numbers of cores.
Regards,
Marcos
Marcos Dias de Assuncao
Grid Computing and Distributed Systems (GRIDS) Laboratory
Department of Computer Science and Software Engineering
The University of Melbourne, Australia
Email: ma...@cs...
-------------
"No serious sociologist any longer believes that the voice of the
people expresses any divine or specially wise idea. The voice of the
people expresses the mind of the people, and that mind is made up for
it by the group leaders in whom it believes and by those persons who
understand the manipulation of the public opinion. It is composed of
inherited prejudices and symbols and cliché's and verbal formulas
supplied to them by the leaders."
Edward L. Bernays
|
|
From: Marcos D. de A. <ma...@cs...> - 2008-09-30 12:43:07
|
Hi Ye, You can get information from the allocation policy or you can extend the GridResource class in order to handle additional messages such as querying the number of jobs waiting in the queue from the policy and returning it to whoever requested it. Everything depends on what you intend to do. The method forecastFinishTime() just calculates how long a given gridlet will take to execute on a PE given the PE's capability in MIPS and the gridlet's length in number of MIs. That is, the method only divides length by the PE's rating. In the SpaceShared policy, the algorithm is FCFS (First Come First Served). If a job cannot start when it arrives because there are not enough PEs available, the job will be put in the waiting queue. The job's start time is not defined at that moment and will be defined once a gridlet completes and releases a PE to the waiting Gridlet. You can implement an aggressive backfilling policy (also known as EASY backfilling). In this case you will have information about the schedule of the first job waiting in the queue. If you want to define a schedule for every job when it arrives at the resource, then you might be interested in implementing a conservative backfilling policy. Please have a look at: Ahuva W. Mu'alem and Dror G. Feitelson, Utilization, Predictability, Workloads, and User Runtime Estimates in Scheduling the IBM SP2 with Backfilling. IEEE Transactions on Parallel and Distributed Systems, 12:(6), pp. 529-543, 2001. In addition, please not that the SpaceShare policy that comes with GridSim is rather simple. Each job can allocate a maximum of one PE. GridSim does not implement the policies described above. I have implemented the policies described above for a modified version of GridSim (http://gridsim.svn.sourceforge.net/viewvc/gridsim/branches/ gridsim4.0-branch3/). They will work only with that version of GridSim, which has not been incorporated in the main distribution. However, they may be used as an example. Thanks for using GridSim. Regards, Marcos On 29/09/2008, at 6:46 PM, ye huang wrote: > Hi, Marcos: > Thanks a lot for kindly help and useful information. > > I was messed up while searching for method inside GridResource class. > > In this context, Does it mean I am able to get information such as > queued jobs (e.g. gridletQueueList_), job in processing (e.g. > gridletInExecList_), total resource load (e.g. calculateTotalLoad) > by asking for AllocPolicy series, instead of GridResource itself? > > I have one more question as follows: > what is the result of "forecastFinishTime" if all the PEs of a > resource is currently busy with something else? For example, a > submitted job requests 2 PE for 1000 seconds, if the resource is > only able to provide two free PEs in future 500 seconds, will the > policy put the expected finish time "1500" to the job immediately, > or keep the job in queue for 500 seconds and calculate the expected > finish time "1000" later? Or I should implement it myself? > > regards > ye > > On Sep 29, 2008, at 1:36 AM, Marcos Dias de Assuncao wrote: > >> >> Hi Ye, >> >> The gridlet is not returned as soon as it arrives at the resource. >> The only thing that is returned as soon as the gridlet arrives is >> an ack., if the user requested it. The gridlet is returned to the >> user after its processing is complete. The processing time is >> calculated based on the gridlet's number of MIs and the resource's >> MIPS capability. The allocation policies schedule internal events >> (i.e. events sent to themselves) to know when a job completes. See >> for example the method allocatePEtoGridlet(ResGridlet rgl) of >> SpaceShared. After the execution time is calculated, the method >> sends an event to the policy itself, which will be handled at the >> event's time (i.e. this event is the job's completion): >> >> // Identify Completion Time and Set Interrupt >> int rating = machineRating_[ rgl.getMachineID() ]; >> double time = forecastFinishTime( rating , >> rgl.getRemainingGridletLength() ); >> >> int roundUpTime = (int) (time+1); // rounding up >> rgl.setFinishTime(roundUpTime); >> >> // then send this into itself >> super.sendInternalEvent(roundUpTime); >> return true; >> >> Regards, >> >> Marcos >> >> On 29/09/2008, at 2:41 AM, ye huang wrote: >> >>> Hi, all: >>> Is there anyone could help to explain the job executing process of a >>> GridResource? >>> If I understand right, once the GridResource receives submitted jobs >>> via "processGridletSubmit", it only calculates the cost for >>> processing >>> the gridlet, and send the gridlet back. That means, the GridResource >>> won't wait a while for "real job processing". >>> >>> If I am right, is it possible to trace the resource's workload? I >>> mean, once a resource received a lot of gridlets, since each gridlet >>> needs some time for its execution, is it possible to simulate the >>> "busy status" of a resource? For example, the resource will be wait >>> for while to process the next gridlet request? Further more, >>> could the >>> users be able to get the workload of a resource? >>> >>> regards >>> ye >>> >>> -- >>> >>> Ye Huang, Department of Informatics >>> University of Fribourg / Pérolles 2 - Bld de Pérolles 90 >>> 1700 Fribourg, Switzerland >>> >>> e-mail: ye....@he..., ye....@un... >>> http://diuf.unifr.ch/people/huangy/ >>> Office: +41 26 429 65 95 >>> >>> >>> >>> >>> -------------------------------------------------------------------- >>> ----- >>> This SF.Net email is sponsored by the Moblin Your Move >>> Developer's challenge >>> Build the coolest Linux based applications with Moblin SDK & win >>> great prizes >>> Grand prize is a trip for two to an Open Source event anywhere in >>> the world >>> http://moblin-contest.org/redirect.php?banner_id=100&url=/ >>> _______________________________________________ >>> Gridsim-developers mailing list >>> Gri...@li... >>> https://lists.sourceforge.net/lists/listinfo/gridsim-developers >> >> Marcos Dias de Assuncao >> Grid Computing and Distributed Systems (GRIDS) Laboratory >> Department of Computer Science and Software Engineering >> The University of Melbourne, Australia >> Email: ma...@cs... >> >> ------------- >> "No serious sociologist any longer believes that the voice of the >> people expresses any divine or specially wise idea. The voice of >> the people expresses the mind of the people, and that mind is made >> up for it by the group leaders in whom it believes and by those >> persons who understand the manipulation of the public opinion. It >> is composed of inherited prejudices and symbols and cliché's and >> verbal formulas supplied to them by the leaders." >> Edward L. Bernays >> > > > -- > > Ye Huang, Department of Informatics > University of Fribourg / Pérolles 2 - Bld de Pérolles 90 > 1700 Fribourg, Switzerland > > e-mail: ye....@he..., ye....@un... > http://diuf.unifr.ch/people/huangy/ > Office: +41 26 429 65 95 > > > > Marcos Dias de Assuncao Grid Computing and Distributed Systems (GRIDS) Laboratory Department of Computer Science and Software Engineering The University of Melbourne, Australia Email: ma...@cs... ------------- "No serious sociologist any longer believes that the voice of the people expresses any divine or specially wise idea. The voice of the people expresses the mind of the people, and that mind is made up for it by the group leaders in whom it believes and by those persons who understand the manipulation of the public opinion. It is composed of inherited prejudices and symbols and cliché's and verbal formulas supplied to them by the leaders." Edward L. Bernays |
|
From: ye h. <hua...@gm...> - 2008-09-29 08:46:55
|
Hi, Marcos: Thanks a lot for kindly help and useful information. I was messed up while searching for method inside GridResource class. In this context, Does it mean I am able to get information such as queued jobs (e.g. gridletQueueList_), job in processing (e.g. gridletInExecList_), total resource load (e.g. calculateTotalLoad) by asking for AllocPolicy series, instead of GridResource itself? I have one more question as follows: what is the result of "forecastFinishTime" if all the PEs of a resource is currently busy with something else? For example, a submitted job requests 2 PE for 1000 seconds, if the resource is only able to provide two free PEs in future 500 seconds, will the policy put the expected finish time "1500" to the job immediately, or keep the job in queue for 500 seconds and calculate the expected finish time "1000" later? Or I should implement it myself? regards ye On Sep 29, 2008, at 1:36 AM, Marcos Dias de Assuncao wrote: > > Hi Ye, > > The gridlet is not returned as soon as it arrives at the resource. > The only thing that is returned as soon as the gridlet arrives is an > ack., if the user requested it. The gridlet is returned to the user > after its processing is complete. The processing time is calculated > based on the gridlet's number of MIs and the resource's MIPS > capability. The allocation policies schedule internal events (i.e. > events sent to themselves) to know when a job completes. See for > example the method allocatePEtoGridlet(ResGridlet rgl) of > SpaceShared. After the execution time is calculated, the method > sends an event to the policy itself, which will be handled at the > event's time (i.e. this event is the job's completion): > > // Identify Completion Time and Set Interrupt > int rating = machineRating_[ rgl.getMachineID() ]; > double time = forecastFinishTime( rating , > rgl.getRemainingGridletLength() ); > > int roundUpTime = (int) (time+1); // rounding up > rgl.setFinishTime(roundUpTime); > > // then send this into itself > super.sendInternalEvent(roundUpTime); > return true; > > Regards, > > Marcos > > On 29/09/2008, at 2:41 AM, ye huang wrote: > >> Hi, all: >> Is there anyone could help to explain the job executing process of a >> GridResource? >> If I understand right, once the GridResource receives submitted jobs >> via "processGridletSubmit", it only calculates the cost for >> processing >> the gridlet, and send the gridlet back. That means, the GridResource >> won't wait a while for "real job processing". >> >> If I am right, is it possible to trace the resource's workload? I >> mean, once a resource received a lot of gridlets, since each gridlet >> needs some time for its execution, is it possible to simulate the >> "busy status" of a resource? For example, the resource will be wait >> for while to process the next gridlet request? Further more, could >> the >> users be able to get the workload of a resource? >> >> regards >> ye >> >> -- >> >> Ye Huang, Department of Informatics >> University of Fribourg / Pérolles 2 - Bld de Pérolles 90 >> 1700 Fribourg, Switzerland >> >> e-mail: ye....@he..., ye....@un... >> http://diuf.unifr.ch/people/huangy/ >> Office: +41 26 429 65 95 >> >> >> >> >> ------------------------------------------------------------------------- >> This SF.Net email is sponsored by the Moblin Your Move Developer's >> challenge >> Build the coolest Linux based applications with Moblin SDK & win >> great prizes >> Grand prize is a trip for two to an Open Source event anywhere in >> the world >> http://moblin-contest.org/redirect.php?banner_id=100&url=/ >> _______________________________________________ >> Gridsim-developers mailing list >> Gri...@li... >> https://lists.sourceforge.net/lists/listinfo/gridsim-developers > > Marcos Dias de Assuncao > Grid Computing and Distributed Systems (GRIDS) Laboratory > Department of Computer Science and Software Engineering > The University of Melbourne, Australia > Email: ma...@cs... > > ------------- > "No serious sociologist any longer believes that the voice of the > people expresses any divine or specially wise idea. The voice of the > people expresses the mind of the people, and that mind is made up > for it by the group leaders in whom it believes and by those persons > who understand the manipulation of the public opinion. It is > composed of inherited prejudices and symbols and cliché's and verbal > formulas supplied to them by the leaders." > Edward L. Bernays > -- Ye Huang, Department of Informatics University of Fribourg / Pérolles 2 - Bld de Pérolles 90 1700 Fribourg, Switzerland e-mail: ye....@he..., ye....@un... http://diuf.unifr.ch/people/huangy/ Office: +41 26 429 65 95 |
|
From: Marcos D. de A. <ma...@cs...> - 2008-09-28 23:41:33
|
Hi Ye, The Workload class loads a workload trace file and creates gridlets according to the information in the trace. In other words, you need to download a file that represents the workload of the resource you are modelling from http://www.cs.huji.ac.il/labs/parallel/workload/ logs.html. Then, you provide this file, or part of it, to the workload object which will in turn create gridlets that have the same number of processors and submission times of the jobs in the trace. The examples fail because they cannot find those workload files in your system. You need to download them. Regards, Marcos On 29/09/2008, at 4:44 AM, ye huang wrote: > Hi, Dear all: > I am a little bit confused by the usage of WorkLoad class. > 1. Does it provide the workload of a resource/machine, like the > information presented in http://www.cs.huji.ac.il/labs/parallel/ > workload/logs.html > ? > 2. Or it traces the jobs submitted via same grid user (user's jobs > workload trace?), since it's declared as "This class can be classified > as one grid user entity" in the comment. > 3. What's the type of this traced workload information? Dynamic or > statistic? > > I tried to run the WorkLoadTrace demo codes from sample, however, i > always got the following errors: > --- > Initializing GridSim package > Initialising... > Creates one Grid resource with name = Res_0 > Creates one Grid resource with name = Res_1 > Load_0: Creating a workload object ... > Load_1: Creating a workload object ... > Custom: Creating a workload object ... > Starting GridSim version 4.0 > Entities started. > > Load_0.body() :%%%% Start ... > > Load_1.body() :%%%% Start ... > Load_1: Error - the file was not found: ../l_sdsc_blue.swf.txt.gz (No > such file or directory) > Load_1.body(): Error - unable to parse from a file. > > Custom.body() :%%%% Start ... > Custom: Error - the file was not found: ../custom_trace.txt (No such > file or directory) > Custom.body(): Error - unable to parse from a file. > Load_0: Error - an IOException occurred: No such file or directory > Load_0.body(): Error - unable to parse from a file. > Load_0.body() : %%%% Exit ... > Load_1.body() : %%%% Exit ... > Custom.body() : %%%% Exit ... > GridInformationService: Notify all GridSim entities for shutting down. > Sim_system: No more future events > Gathering simulation data. > Simulation completed. > java.lang.NullPointerException > at gridsim.util.Workload.printGridletList(Unknown Source) > at WorkloadTrace.TraceEx01.TraceEx01.main(TraceEx01.java:141) > --- > > It warns some files are missing, does it mean my file hierarchy is > incorrect: > --- > ye-Mac:WorkloadTrace yehuang$ pwd > /Users/yehuang/workspace/GridSimDemo/src/WorkloadTrace > ye-Mac:WorkloadTrace yehuang$ ls > README.txt TraceEx02 custom_trace.txt l_sdsc_blue.swf.txt > TraceEx01 TraceEx03 l_lanl_o2k.swf.txt > ye-Mac:WorkloadTrace yehuang$ cd TraceEx01/ > ye-Mac:TraceEx01 yehuang$ ls > README.txt custom_trace.txt l_sdsc_blue.swf.txt > TraceEx01.java l_lanl_o2k.swf.txt output.txt > --- > > Thanks a lot! > > regards > ye > > -- > > Ye Huang, Department of Informatics > University of Fribourg / Pérolles 2 - Bld de Pérolles 90 > 1700 Fribourg, Switzerland > > e-mail: ye....@he..., ye....@un... > http://diuf.unifr.ch/people/huangy/ > Office: +41 26 429 65 95 > > > > > ---------------------------------------------------------------------- > --- > This SF.Net email is sponsored by the Moblin Your Move Developer's > challenge > Build the coolest Linux based applications with Moblin SDK & win > great prizes > Grand prize is a trip for two to an Open Source event anywhere in > the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > _______________________________________________ > Gridsim-developers mailing list > Gri...@li... > https://lists.sourceforge.net/lists/listinfo/gridsim-developers Marcos Dias de Assuncao Grid Computing and Distributed Systems (GRIDS) Laboratory Department of Computer Science and Software Engineering The University of Melbourne, Australia Email: ma...@cs... ------------- "No serious sociologist any longer believes that the voice of the people expresses any divine or specially wise idea. The voice of the people expresses the mind of the people, and that mind is made up for it by the group leaders in whom it believes and by those persons who understand the manipulation of the public opinion. It is composed of inherited prejudices and symbols and cliché's and verbal formulas supplied to them by the leaders." Edward L. Bernays |
|
From: Marcos D. de A. <ma...@cs...> - 2008-09-28 23:37:19
|
Hi Ye,
The gridlet is not returned as soon as it arrives at the resource.
The only thing that is returned as soon as the gridlet arrives is an
ack., if the user requested it. The gridlet is returned to the user
after its processing is complete. The processing time is calculated
based on the gridlet's number of MIs and the resource's MIPS
capability. The allocation policies schedule internal events (i.e.
events sent to themselves) to know when a job completes. See for
example the method allocatePEtoGridlet(ResGridlet rgl) of
SpaceShared. After the execution time is calculated, the method sends
an event to the policy itself, which will be handled at the event's
time (i.e. this event is the job's completion):
// Identify Completion Time and Set Interrupt
int rating = machineRating_[ rgl.getMachineID() ];
double time = forecastFinishTime( rating ,
rgl.getRemainingGridletLength() );
int roundUpTime = (int) (time+1); // rounding up
rgl.setFinishTime(roundUpTime);
// then send this into itself
super.sendInternalEvent(roundUpTime);
return true;
Regards,
Marcos
On 29/09/2008, at 2:41 AM, ye huang wrote:
> Hi, all:
> Is there anyone could help to explain the job executing process of a
> GridResource?
> If I understand right, once the GridResource receives submitted jobs
> via "processGridletSubmit", it only calculates the cost for processing
> the gridlet, and send the gridlet back. That means, the GridResource
> won't wait a while for "real job processing".
>
> If I am right, is it possible to trace the resource's workload? I
> mean, once a resource received a lot of gridlets, since each gridlet
> needs some time for its execution, is it possible to simulate the
> "busy status" of a resource? For example, the resource will be wait
> for while to process the next gridlet request? Further more, could the
> users be able to get the workload of a resource?
>
> regards
> ye
>
> --
>
> Ye Huang, Department of Informatics
> University of Fribourg / Pérolles 2 - Bld de Pérolles 90
> 1700 Fribourg, Switzerland
>
> e-mail: ye....@he..., ye....@un...
> http://diuf.unifr.ch/people/huangy/
> Office: +41 26 429 65 95
>
>
>
>
> ----------------------------------------------------------------------
> ---
> This SF.Net email is sponsored by the Moblin Your Move Developer's
> challenge
> Build the coolest Linux based applications with Moblin SDK & win
> great prizes
> Grand prize is a trip for two to an Open Source event anywhere in
> the world
> http://moblin-contest.org/redirect.php?banner_id=100&url=/
> _______________________________________________
> Gridsim-developers mailing list
> Gri...@li...
> https://lists.sourceforge.net/lists/listinfo/gridsim-developers
Marcos Dias de Assuncao
Grid Computing and Distributed Systems (GRIDS) Laboratory
Department of Computer Science and Software Engineering
The University of Melbourne, Australia
Email: ma...@cs...
-------------
"No serious sociologist any longer believes that the voice of the
people expresses any divine or specially wise idea. The voice of the
people expresses the mind of the people, and that mind is made up for
it by the group leaders in whom it believes and by those persons who
understand the manipulation of the public opinion. It is composed of
inherited prejudices and symbols and cliché's and verbal formulas
supplied to them by the leaders."
Edward L. Bernays
|
|
From: ye h. <ye....@un...> - 2008-09-28 18:45:06
|
Hi, Dear all: I am a little bit confused by the usage of WorkLoad class. 1. Does it provide the workload of a resource/machine, like the information presented in http://www.cs.huji.ac.il/labs/parallel/workload/logs.html ? 2. Or it traces the jobs submitted via same grid user (user's jobs workload trace?), since it's declared as "This class can be classified as one grid user entity" in the comment. 3. What's the type of this traced workload information? Dynamic or statistic? I tried to run the WorkLoadTrace demo codes from sample, however, i always got the following errors: --- Initializing GridSim package Initialising... Creates one Grid resource with name = Res_0 Creates one Grid resource with name = Res_1 Load_0: Creating a workload object ... Load_1: Creating a workload object ... Custom: Creating a workload object ... Starting GridSim version 4.0 Entities started. Load_0.body() :%%%% Start ... Load_1.body() :%%%% Start ... Load_1: Error - the file was not found: ../l_sdsc_blue.swf.txt.gz (No such file or directory) Load_1.body(): Error - unable to parse from a file. Custom.body() :%%%% Start ... Custom: Error - the file was not found: ../custom_trace.txt (No such file or directory) Custom.body(): Error - unable to parse from a file. Load_0: Error - an IOException occurred: No such file or directory Load_0.body(): Error - unable to parse from a file. Load_0.body() : %%%% Exit ... Load_1.body() : %%%% Exit ... Custom.body() : %%%% Exit ... GridInformationService: Notify all GridSim entities for shutting down. Sim_system: No more future events Gathering simulation data. Simulation completed. java.lang.NullPointerException at gridsim.util.Workload.printGridletList(Unknown Source) at WorkloadTrace.TraceEx01.TraceEx01.main(TraceEx01.java:141) --- It warns some files are missing, does it mean my file hierarchy is incorrect: --- ye-Mac:WorkloadTrace yehuang$ pwd /Users/yehuang/workspace/GridSimDemo/src/WorkloadTrace ye-Mac:WorkloadTrace yehuang$ ls README.txt TraceEx02 custom_trace.txt l_sdsc_blue.swf.txt TraceEx01 TraceEx03 l_lanl_o2k.swf.txt ye-Mac:WorkloadTrace yehuang$ cd TraceEx01/ ye-Mac:TraceEx01 yehuang$ ls README.txt custom_trace.txt l_sdsc_blue.swf.txt TraceEx01.java l_lanl_o2k.swf.txt output.txt --- Thanks a lot! regards ye -- Ye Huang, Department of Informatics University of Fribourg / Pérolles 2 - Bld de Pérolles 90 1700 Fribourg, Switzerland e-mail: ye....@he..., ye....@un... http://diuf.unifr.ch/people/huangy/ Office: +41 26 429 65 95 |
|
From: ye h. <hua...@gm...> - 2008-09-28 16:41:41
|
Hi, all: Is there anyone could help to explain the job executing process of a GridResource? If I understand right, once the GridResource receives submitted jobs via "processGridletSubmit", it only calculates the cost for processing the gridlet, and send the gridlet back. That means, the GridResource won't wait a while for "real job processing". If I am right, is it possible to trace the resource's workload? I mean, once a resource received a lot of gridlets, since each gridlet needs some time for its execution, is it possible to simulate the "busy status" of a resource? For example, the resource will be wait for while to process the next gridlet request? Further more, could the users be able to get the workload of a resource? regards ye -- Ye Huang, Department of Informatics University of Fribourg / Pérolles 2 - Bld de Pérolles 90 1700 Fribourg, Switzerland e-mail: ye....@he..., ye....@un... http://diuf.unifr.ch/people/huangy/ Office: +41 26 429 65 95 |
|
From: Marcos D. de A. <ma...@cs...> - 2008-09-24 04:39:39
|
Hi Alex,
> So do you mean that the monster that eats up all JVM memory is the
event
> queue containing close to 1 million events?
No, I am not saying that. That's because there are other things in
GridSim that may be using too much memory. You are right about the
thread pool for example. I don't think that the way simjava manages
the threaded entities is ideal either. For example, at each clock
tick Sim_system scans the future event queue and puts all events with
the same time either in the deferred queue or in the buffer of the
entities:
// If there are more future events then deal with them
if (future.size() > 0) {
queue_empty = false;
Sim_event first = future.pop();
process_event(first);
// Check if next events are at same time...
boolean trymore = (future.size() > 0);
while (trymore) {
Sim_event next = future.top();
if (next.event_time() == first.event_time()) {
process_event(future.pop());
trymore = (future.size() > 0);
} else
trymore = false;
}
}
}
After that, in the next clock tick Sim_system will restart all
threads and let them process the events in the deferred queue. I am
just wondering what would happen on a multi-core machine when all
entities are and they race to process events. I mean, although there
are some synchronisations, I don't know in which order the entities
will process the events:
int entities_size = entities.size();
for (int i=0; i < entities_size; i++) {
ent = (Sim_entity)entities.get(i);
if (ent.get_state() == Sim_entity.RUNNABLE) {
ent.restart();
num_started++;
}
}
Regarding the use of memory, GridSim 4.1 had a small bug in the
Workload/Gridlet class:
http://sourceforge.net/tracker/index.php?
func=detail&aid=1871718&group_id=94592&atid=608392
Which means that by default each Gridlet came with a StringBuffer of
1000 bytes to store the history of the job. In the simulations I have
been performing, I simulate 2 months in which a Grid with 5 clusters
processes approximately 92,000 jobs. In that case, I would need close
to 92MB of RAM only to store the information about the jobs.
> It seems that your library is more efficient. Have you tested it
against
> the original one? Would you like to share your modified simjava2
library
> such that we can all benefit?
As simjava does not iterate much of the event queue at each clock
tick, a TreeSet does a good job. I have put the modified version of
simjava at www.cs.mu.oz.au/~marcosd/files/simjava.zip
Also, I have a branch (branch 3) of GridSim at sourceforge where a
created a different monster to eat memory. I have stripped a few
things from simjava and worked with ranges of processing elements and
availability profiles for the resources instead of having one PE
object for each processing element in a resource. The source code is
available at branch 3. Moreover, In the version I am using I have
made other changes to Simjava/GridSim which are not there in the
sourceforge. Basically, I have converted the simulation times to
longs, made simjava single threaded (with the provision to use a
thread pool) and created a data structure for managing PEs which can
be used to create other allocation policies. However, I am cannot
make this available right now because I will need to document it first.
We would be happy to know your thoughts about GridSim or any changes
you might have made to it. I think we can improve the tool, this way.
Regards,
Marcos
On 23/09/2008, at 10:38 PM, Shuo Yang wrote:
> Dear Marcos,
>
> Many thanks for your reply and contribution.
>
> So do you mean that the monster that eats up all JVM memory is the
> event
> queue containing close to 1 million events?
>
> It seems that your library is more efficient. Have you tested it
> against
> the original one? Would you like to share your modified simjava2
> library
> such that we can all benefit?
>
>
> Alex
>
> On Tue, 2008-09-23 at 15:11 +1000, Marcos Dias de Assuncao wrote:
>> Hi Shuo,
>>
>> I was cleaning my inbox after a few days without reading e-mails and
>> found this one. :-)
>>
>> I have made some changes in SimJava because I also face some problems
>> about scalability. As discussed beforehand, GridSim uses SimJava 2.
>> The event queue in SimJava 2 is a linked list:
>>
>> public class Evqueue extends LinkedList
>>
>> Also, please note that when an event is inserted in the queue,
>> SimJava does only a silly optimisation. That is, an Evqueue instance
>> maintains an attribute called max_time, which is the time of the last
>> event that would be processed. Evqueue will not iterate the list when
>> it adds an event to the queue only if the event's time is greater
>> than max_time:
>>
>> public void add_event(Sim_event new_event) {
>> double new_event_time = new_event.event_time();
>> if (new_event_time >= max_time) {
>> add(new_event);
>> max_time = new_event_time;
>> return;
>> }
>> ListIterator iterator = listIterator();
>> Sim_event event;
>> while (iterator.hasNext()) {
>> event = (Sim_event)iterator.next();
>> if (event.event_time() > new_event_time) {
>> iterator.previous();
>> iterator.add(new_event);
>> return;
>> }
>> }
>> add(new_event);
>> }
>>
>> You can see what is going to happen if things in the simulator are
>> not managed properly. If you consider the Workload class for example,
>> it reads a job trace file and creates job submissions (events)
>> according to this trace. If you have only one Workload entity in your
>> simulation creating events and reading, let's say, 1000 jobs, you
>> will have 1000 events in the future queue right when you start the
>> simulation. Also, consider that one of these jobs is to be submitted
>> (i.e. received by the resource) far in the future. All events created
>> from the start until the end of the simulation (i.e. job completion,
>> internal messages, packets, etc) will probably lead to the iteration
>> of the event queue because of one event that was created at the start
>> of the simulation and changed max_time. If you are simulating a Grid,
>> it is very likely that you will have multiple Workloads dispatching
>> jobs, changing max_time and making one another's events to iterate
>> the queue. The deferred event queue is not a problem because you will
>> hardly have a very long deferred queue.
>>
>> In some simulations I have run, the future event queue can contain
>> close to 1 million events at a particular time. This way, I've
>> changed the future event queue to use a modified version of TreeMap.
>> TreeMaps are quicker to insert an object into, but one may argue that
>> they are costly to iterate. In that sense, I modified the Java's
>> implementation of TreeMap to keep a double linked list between the
>> siblings nodes. This way, the iterator uses the list to iterate and
>> not the java's red-black tree.
>>
>> Moreover, the event this is not the only scalability issue of
>> SimJava. Each simulation entity is a Thread and SimJava puts them to
>> wait and notifies entities at each clock tick, that is, each time the
>> simulation clock is changed.
>>
>> Regards,
>>
>> Marcos
>>
>>
>> On 06/09/2008, at 12:55 AM, Shuo Yang wrote:
>>
>>> All,
>>>
>>> I think the problem also lies in the scalability of the underlying
>>> simjava
>>> package. Simjava uses an event queue to manage all internal events
>>> flying
>>> between entities. The event queue is a Vector. If you refer to
>>> eduni.simjava.Evqueue.java, you can see the doc:
>>>
>>> /**
>>> * This class implements an event queue used internally by the
>>> Sim_system to
>>> * manage
>>> * the list of future and deferred Sim_events. It should not be
>>> needed in
>>> * a user simulation. It works like a normal FIFO
>>> * queue, but during insertion events are kept in order from the
>>> smallest
>>> time
>>> * stamp to the largest. This means the next event to occur will be
>>> at the
>>> top
>>> * of the queue. <P>
>>> * The current implementation
>>> * is uses a Vector to store the queue and is inefficient for
>>> popping
>>> * and inserting elements because the rest of the array has to be
>>> * moved down one space. A better method would be to use a circular
>>> array.
>>> * @see eduni.simjava.Sim_system
>>> * @version 0.1, 25 June 1995
>>> * @author Ross McNab
>>> */
>>>
>>> Also, the event queue in Sim_system is accessed using
>>> 'synchronized' to
>>> ensure consistency and the simulation clock. Therefore when there
>>> are a huge
>>> amount of entities/messages, the event queue becomes the system
>>> bottleneck -
>>> only one entity/thread can write to event queue while the others
>>> will wait,
>>> and wait, and wait, and wait...
>>>
>>> It may have problem with java's handling large memories. But a re-
>>> design and
>>> re-implemenation of the underlying thread pool is ideal, which is
>>> exactly
>>> what I'm doing now.
>>>
>>> Cheers,
>>>
>>> Shuo 'Alex' Yang
>>> University of Manchester
>>>
>>>
>>> ----- Original Message -----
>>> From: "Agustín Caminero Herráez" <ag...@ds...>
>>> To: "ye" <hua...@gm...>
>>> Cc: <gri...@li...>;
>>> <gri...@li...>
>>> Sent: Friday, September 05, 2008 3:35 PM
>>> Subject: Re: [GridSim-developers] [GridSim-users] simulation fails
>>> (OOME)with
>>> 1000 resources
>>>
>>>
>>> Hi Ye,
>>>
>>> I've also suffered the problems u describe, and I'm afraid there
>>> is no
>>> solution for them. The only suggestion I can give to u is to scale
>>> down
>>> your simulations.
>>>
>>> The problem comes from Java's inability to handle more than 1.5
>>> GB of
>>> memory, so there is nothing u can do.
>>>
>>> Just one thing, are u using Sun Java? Because using another
>>> different
>>> java may cause problems... The java I us is Sun v1.4.2
>>>
>>> Regards,
>>>
>>> Agustin
>>>
>>> ye escribió:
>>>> Hi, Dear all:
>>>> Although I have asked a similar question in gridsim-user maillist,
>>>> there seems no similar experience from other developers. Since
>>>> it's an
>>>> crucial problem for me, I'd to make the scenario much clear and beg
>>>> for help.
>>>>
>>>> For brief, is there any scale limit for simulation created via
>>>> GridSim?
>>>>
>>>> I was trying to set up a gridsim simulation with 1000 resource;
>>>> each
>>>> resource contains one machine, each machine has two PEs. Then, I
>>>> wrote
>>>> a user to retrieve resource list within its body(), and print the
>>>> total size. However, the program halts with an OutOfMemoryError,
>>>> every
>>>> time before "Entities started" was printed. The user's body() was
>>>> never visited.
>>>>
>>>> I am working on a mac 10.5, 2GB 667 Mhz memory, mac JVM 1.5;
>>>> meanwhile, I already adjust the vm parameter into "-Xms512m -
>>>> Xmx1024m".
>>>>
>>>> Later, I tried the same program on my server (ubuntu 8.04, 3.2GB).
>>>> Fortunately, it works... but, it halts again with OOME while i
>>>> decide
>>>> create 1100 resources.
>>>>
>>>> I am not sure the problem is caused by lacking of memory? Is there
>>>> any
>>>> limit for gridsim simulation scale, or just for GridSim
>>>> Resource? Or
>>>> it's bug derived from simjava?
>>>>
>>>> Finally, is it possible to solve it?
>>>>
>>>> Thank you guys a lot!!
>>>>
>>>> regards
>>>> ye
>>>>
>>>> --
>>>> Ye Huang, Department of Informatics
>>>> University of Fribourg / Pérolles 2 - Bld de Pérolles 90
>>>> 1700 Fribourg, Switzerland
>>>>
>>>> e-mail: ye....@he..., ye....@un...
>>>> http://diuf.unifr.ch/people/huangy/
>>>> Office: +41 26 429 65 95
>>>> -------------------------------------------------------------------
>>>> --
>>>> ---
>>>>
>>>> -------------------------------------------------------------------
>>>> --
>>>> ----
>>>> This SF.Net email is sponsored by the Moblin Your Move Developer's
>>>> challenge
>>>> Build the coolest Linux based applications with Moblin SDK & win
>>>> great
>>>> prizes
>>>> Grand prize is a trip for two to an Open Source event anywhere
>>>> in the
>>>> world
>>>> http://moblin-contest.org/redirect.php?banner_id=100&url=/
>>>> -------------------------------------------------------------------
>>>> --
>>>> ---
>>>>
>>>> _______________________________________________
>>>> Gridsim-users mailing list
>>>> Gri...@li...
>>>> https://lists.sourceforge.net/lists/listinfo/gridsim-users
>>>>
>>>
>>> --
>>> ===============================================
>>> Agustin Caminero
>>> Research Assistant.
>>> Computing Systems Department.
>>> Albacete Research Institute of Informatics (I3A).
>>> The University of Castilla La Mancha.
>>> Campus Universitario s/n, 02071, Albacete. Spain.
>>> Phone: +34 967 599 200 Ext. 2693. Fax: +34 967 599 343
>>> http://www.i3a.uclm.es/
>>> ===============================================
>>>
>>>
>>>
>>>
>>> --------------------------------------------------------------------
>>> --
>>> ----------
>>>
>>>
>>>> -------------------------------------------------------------------
>>>> --
>>>> ----
>>>> This SF.Net email is sponsored by the Moblin Your Move Developer's
>>>> challenge
>>>> Build the coolest Linux based applications with Moblin SDK & win
>>>> great
>>>> prizes
>>>> Grand prize is a trip for two to an Open Source event anywhere
>>>> in the
>>>> world
>>>> http://moblin-contest.org/redirect.php?banner_id=100&url=/
>>>
>>>
>>> --------------------------------------------------------------------
>>> --
>>> ----------
>>>
>>>
>>>> _______________________________________________
>>>> Gridsim-developers mailing list
>>>> Gri...@li...
>>>> https://lists.sourceforge.net/lists/listinfo/gridsim-developers
>>>>
>>>
>>>
>>> --------------------------------------------------------------------
>>> --
>>> ---
>>> This SF.Net email is sponsored by the Moblin Your Move Developer's
>>> challenge
>>> Build the coolest Linux based applications with Moblin SDK & win
>>> great prizes
>>> Grand prize is a trip for two to an Open Source event anywhere in
>>> the world
>>> http://moblin-contest.org/redirect.php?banner_id=100&url=/
>>> _______________________________________________
>>> Gridsim-users mailing list
>>> Gri...@li...
>>> https://lists.sourceforge.net/lists/listinfo/gridsim-users
>>
>> Marcos Dias de Assuncao
>> Grid Computing and Distributed Systems (GRIDS) Laboratory
>> Department of Computer Science and Software Engineering
>> The University of Melbourne, Australia
>> Email: ma...@cs...
>>
>> -------------
>> "No serious sociologist any longer believes that the voice of the
>> people expresses any divine or specially wise idea. The voice of the
>> people expresses the mind of the people, and that mind is made up for
>> it by the group leaders in whom it believes and by those persons who
>> understand the manipulation of the public opinion. It is composed of
>> inherited prejudices and symbols and cliché's and verbal formulas
>> supplied to them by the leaders."
>> Edward L. Bernays
>>
>
Marcos Dias de Assuncao
Grid Computing and Distributed Systems (GRIDS) Laboratory
Department of Computer Science and Software Engineering
The University of Melbourne, Australia
Email: ma...@cs...
-------------
"No serious sociologist any longer believes that the voice of the
people expresses any divine or specially wise idea. The voice of the
people expresses the mind of the people, and that mind is made up for
it by the group leaders in whom it believes and by those persons who
understand the manipulation of the public opinion. It is composed of
inherited prejudices and symbols and cliché's and verbal formulas
supplied to them by the leaders."
Edward L. Bernays
|
|
From: Shuo Y. <ya...@cs...> - 2008-09-23 13:37:16
|
Dear Marcos,
Many thanks for your reply and contribution.
So do you mean that the monster that eats up all JVM memory is the event
queue containing close to 1 million events?
It seems that your library is more efficient. Have you tested it against
the original one? Would you like to share your modified simjava2 library
such that we can all benefit?
Alex
On Tue, 2008-09-23 at 15:11 +1000, Marcos Dias de Assuncao wrote:
> Hi Shuo,
>
> I was cleaning my inbox after a few days without reading e-mails and
> found this one. :-)
>
> I have made some changes in SimJava because I also face some problems
> about scalability. As discussed beforehand, GridSim uses SimJava 2.
> The event queue in SimJava 2 is a linked list:
>
> public class Evqueue extends LinkedList
>
> Also, please note that when an event is inserted in the queue,
> SimJava does only a silly optimisation. That is, an Evqueue instance
> maintains an attribute called max_time, which is the time of the last
> event that would be processed. Evqueue will not iterate the list when
> it adds an event to the queue only if the event's time is greater
> than max_time:
>
> public void add_event(Sim_event new_event) {
> double new_event_time = new_event.event_time();
> if (new_event_time >= max_time) {
> add(new_event);
> max_time = new_event_time;
> return;
> }
> ListIterator iterator = listIterator();
> Sim_event event;
> while (iterator.hasNext()) {
> event = (Sim_event)iterator.next();
> if (event.event_time() > new_event_time) {
> iterator.previous();
> iterator.add(new_event);
> return;
> }
> }
> add(new_event);
> }
>
> You can see what is going to happen if things in the simulator are
> not managed properly. If you consider the Workload class for example,
> it reads a job trace file and creates job submissions (events)
> according to this trace. If you have only one Workload entity in your
> simulation creating events and reading, let's say, 1000 jobs, you
> will have 1000 events in the future queue right when you start the
> simulation. Also, consider that one of these jobs is to be submitted
> (i.e. received by the resource) far in the future. All events created
> from the start until the end of the simulation (i.e. job completion,
> internal messages, packets, etc) will probably lead to the iteration
> of the event queue because of one event that was created at the start
> of the simulation and changed max_time. If you are simulating a Grid,
> it is very likely that you will have multiple Workloads dispatching
> jobs, changing max_time and making one another's events to iterate
> the queue. The deferred event queue is not a problem because you will
> hardly have a very long deferred queue.
>
> In some simulations I have run, the future event queue can contain
> close to 1 million events at a particular time. This way, I've
> changed the future event queue to use a modified version of TreeMap.
> TreeMaps are quicker to insert an object into, but one may argue that
> they are costly to iterate. In that sense, I modified the Java's
> implementation of TreeMap to keep a double linked list between the
> siblings nodes. This way, the iterator uses the list to iterate and
> not the java's red-black tree.
>
> Moreover, the event this is not the only scalability issue of
> SimJava. Each simulation entity is a Thread and SimJava puts them to
> wait and notifies entities at each clock tick, that is, each time the
> simulation clock is changed.
>
> Regards,
>
> Marcos
>
>
> On 06/09/2008, at 12:55 AM, Shuo Yang wrote:
>
> > All,
> >
> > I think the problem also lies in the scalability of the underlying
> > simjava
> > package. Simjava uses an event queue to manage all internal events
> > flying
> > between entities. The event queue is a Vector. If you refer to
> > eduni.simjava.Evqueue.java, you can see the doc:
> >
> > /**
> > * This class implements an event queue used internally by the
> > Sim_system to
> > * manage
> > * the list of future and deferred Sim_events. It should not be
> > needed in
> > * a user simulation. It works like a normal FIFO
> > * queue, but during insertion events are kept in order from the
> > smallest
> > time
> > * stamp to the largest. This means the next event to occur will be
> > at the
> > top
> > * of the queue. <P>
> > * The current implementation
> > * is uses a Vector to store the queue and is inefficient for popping
> > * and inserting elements because the rest of the array has to be
> > * moved down one space. A better method would be to use a circular
> > array.
> > * @see eduni.simjava.Sim_system
> > * @version 0.1, 25 June 1995
> > * @author Ross McNab
> > */
> >
> > Also, the event queue in Sim_system is accessed using
> > 'synchronized' to
> > ensure consistency and the simulation clock. Therefore when there
> > are a huge
> > amount of entities/messages, the event queue becomes the system
> > bottleneck -
> > only one entity/thread can write to event queue while the others
> > will wait,
> > and wait, and wait, and wait...
> >
> > It may have problem with java's handling large memories. But a re-
> > design and
> > re-implemenation of the underlying thread pool is ideal, which is
> > exactly
> > what I'm doing now.
> >
> > Cheers,
> >
> > Shuo 'Alex' Yang
> > University of Manchester
> >
> >
> > ----- Original Message -----
> > From: "Agustín Caminero Herráez" <ag...@ds...>
> > To: "ye" <hua...@gm...>
> > Cc: <gri...@li...>;
> > <gri...@li...>
> > Sent: Friday, September 05, 2008 3:35 PM
> > Subject: Re: [GridSim-developers] [GridSim-users] simulation fails
> > (OOME)with
> > 1000 resources
> >
> >
> > Hi Ye,
> >
> > I've also suffered the problems u describe, and I'm afraid there is no
> > solution for them. The only suggestion I can give to u is to scale
> > down
> > your simulations.
> >
> > The problem comes from Java's inability to handle more than 1.5 GB of
> > memory, so there is nothing u can do.
> >
> > Just one thing, are u using Sun Java? Because using another different
> > java may cause problems... The java I us is Sun v1.4.2
> >
> > Regards,
> >
> > Agustin
> >
> > ye escribió:
> >> Hi, Dear all:
> >> Although I have asked a similar question in gridsim-user maillist,
> >> there seems no similar experience from other developers. Since
> >> it's an
> >> crucial problem for me, I'd to make the scenario much clear and beg
> >> for help.
> >>
> >> For brief, is there any scale limit for simulation created via
> >> GridSim?
> >>
> >> I was trying to set up a gridsim simulation with 1000 resource; each
> >> resource contains one machine, each machine has two PEs. Then, I
> >> wrote
> >> a user to retrieve resource list within its body(), and print the
> >> total size. However, the program halts with an OutOfMemoryError,
> >> every
> >> time before "Entities started" was printed. The user's body() was
> >> never visited.
> >>
> >> I am working on a mac 10.5, 2GB 667 Mhz memory, mac JVM 1.5;
> >> meanwhile, I already adjust the vm parameter into "-Xms512m -
> >> Xmx1024m".
> >>
> >> Later, I tried the same program on my server (ubuntu 8.04, 3.2GB).
> >> Fortunately, it works... but, it halts again with OOME while i decide
> >> create 1100 resources.
> >>
> >> I am not sure the problem is caused by lacking of memory? Is there
> >> any
> >> limit for gridsim simulation scale, or just for GridSim Resource? Or
> >> it's bug derived from simjava?
> >>
> >> Finally, is it possible to solve it?
> >>
> >> Thank you guys a lot!!
> >>
> >> regards
> >> ye
> >>
> >> --
> >> Ye Huang, Department of Informatics
> >> University of Fribourg / Pérolles 2 - Bld de Pérolles 90
> >> 1700 Fribourg, Switzerland
> >>
> >> e-mail: ye....@he..., ye....@un...
> >> http://diuf.unifr.ch/people/huangy/
> >> Office: +41 26 429 65 95
> >> ---------------------------------------------------------------------
> >> ---
> >>
> >> ---------------------------------------------------------------------
> >> ----
> >> This SF.Net email is sponsored by the Moblin Your Move Developer's
> >> challenge
> >> Build the coolest Linux based applications with Moblin SDK & win
> >> great
> >> prizes
> >> Grand prize is a trip for two to an Open Source event anywhere in the
> >> world
> >> http://moblin-contest.org/redirect.php?banner_id=100&url=/
> >> ---------------------------------------------------------------------
> >> ---
> >>
> >> _______________________________________________
> >> Gridsim-users mailing list
> >> Gri...@li...
> >> https://lists.sourceforge.net/lists/listinfo/gridsim-users
> >>
> >
> > --
> > ===============================================
> > Agustin Caminero
> > Research Assistant.
> > Computing Systems Department.
> > Albacete Research Institute of Informatics (I3A).
> > The University of Castilla La Mancha.
> > Campus Universitario s/n, 02071, Albacete. Spain.
> > Phone: +34 967 599 200 Ext. 2693. Fax: +34 967 599 343
> > http://www.i3a.uclm.es/
> > ===============================================
> >
> >
> >
> >
> > ----------------------------------------------------------------------
> > ----------
> >
> >
> >> ---------------------------------------------------------------------
> >> ----
> >> This SF.Net email is sponsored by the Moblin Your Move Developer's
> >> challenge
> >> Build the coolest Linux based applications with Moblin SDK & win
> >> great
> >> prizes
> >> Grand prize is a trip for two to an Open Source event anywhere in the
> >> world
> >> http://moblin-contest.org/redirect.php?banner_id=100&url=/
> >
> >
> > ----------------------------------------------------------------------
> > ----------
> >
> >
> >> _______________________________________________
> >> Gridsim-developers mailing list
> >> Gri...@li...
> >> https://lists.sourceforge.net/lists/listinfo/gridsim-developers
> >>
> >
> >
> > ----------------------------------------------------------------------
> > ---
> > This SF.Net email is sponsored by the Moblin Your Move Developer's
> > challenge
> > Build the coolest Linux based applications with Moblin SDK & win
> > great prizes
> > Grand prize is a trip for two to an Open Source event anywhere in
> > the world
> > http://moblin-contest.org/redirect.php?banner_id=100&url=/
> > _______________________________________________
> > Gridsim-users mailing list
> > Gri...@li...
> > https://lists.sourceforge.net/lists/listinfo/gridsim-users
>
> Marcos Dias de Assuncao
> Grid Computing and Distributed Systems (GRIDS) Laboratory
> Department of Computer Science and Software Engineering
> The University of Melbourne, Australia
> Email: ma...@cs...
>
> -------------
> "No serious sociologist any longer believes that the voice of the
> people expresses any divine or specially wise idea. The voice of the
> people expresses the mind of the people, and that mind is made up for
> it by the group leaders in whom it believes and by those persons who
> understand the manipulation of the public opinion. It is composed of
> inherited prejudices and symbols and cliché's and verbal formulas
> supplied to them by the leaders."
> Edward L. Bernays
>
|
|
From: Marcos D. de A. <ma...@cs...> - 2008-09-23 06:12:20
|
Hi Shuo,
I was cleaning my inbox after a few days without reading e-mails and
found this one. :-)
I have made some changes in SimJava because I also face some problems
about scalability. As discussed beforehand, GridSim uses SimJava 2.
The event queue in SimJava 2 is a linked list:
public class Evqueue extends LinkedList
Also, please note that when an event is inserted in the queue,
SimJava does only a silly optimisation. That is, an Evqueue instance
maintains an attribute called max_time, which is the time of the last
event that would be processed. Evqueue will not iterate the list when
it adds an event to the queue only if the event's time is greater
than max_time:
public void add_event(Sim_event new_event) {
double new_event_time = new_event.event_time();
if (new_event_time >= max_time) {
add(new_event);
max_time = new_event_time;
return;
}
ListIterator iterator = listIterator();
Sim_event event;
while (iterator.hasNext()) {
event = (Sim_event)iterator.next();
if (event.event_time() > new_event_time) {
iterator.previous();
iterator.add(new_event);
return;
}
}
add(new_event);
}
You can see what is going to happen if things in the simulator are
not managed properly. If you consider the Workload class for example,
it reads a job trace file and creates job submissions (events)
according to this trace. If you have only one Workload entity in your
simulation creating events and reading, let's say, 1000 jobs, you
will have 1000 events in the future queue right when you start the
simulation. Also, consider that one of these jobs is to be submitted
(i.e. received by the resource) far in the future. All events created
from the start until the end of the simulation (i.e. job completion,
internal messages, packets, etc) will probably lead to the iteration
of the event queue because of one event that was created at the start
of the simulation and changed max_time. If you are simulating a Grid,
it is very likely that you will have multiple Workloads dispatching
jobs, changing max_time and making one another's events to iterate
the queue. The deferred event queue is not a problem because you will
hardly have a very long deferred queue.
In some simulations I have run, the future event queue can contain
close to 1 million events at a particular time. This way, I've
changed the future event queue to use a modified version of TreeMap.
TreeMaps are quicker to insert an object into, but one may argue that
they are costly to iterate. In that sense, I modified the Java's
implementation of TreeMap to keep a double linked list between the
siblings nodes. This way, the iterator uses the list to iterate and
not the java's red-black tree.
Moreover, the event this is not the only scalability issue of
SimJava. Each simulation entity is a Thread and SimJava puts them to
wait and notifies entities at each clock tick, that is, each time the
simulation clock is changed.
Regards,
Marcos
On 06/09/2008, at 12:55 AM, Shuo Yang wrote:
> All,
>
> I think the problem also lies in the scalability of the underlying
> simjava
> package. Simjava uses an event queue to manage all internal events
> flying
> between entities. The event queue is a Vector. If you refer to
> eduni.simjava.Evqueue.java, you can see the doc:
>
> /**
> * This class implements an event queue used internally by the
> Sim_system to
> * manage
> * the list of future and deferred Sim_events. It should not be
> needed in
> * a user simulation. It works like a normal FIFO
> * queue, but during insertion events are kept in order from the
> smallest
> time
> * stamp to the largest. This means the next event to occur will be
> at the
> top
> * of the queue. <P>
> * The current implementation
> * is uses a Vector to store the queue and is inefficient for popping
> * and inserting elements because the rest of the array has to be
> * moved down one space. A better method would be to use a circular
> array.
> * @see eduni.simjava.Sim_system
> * @version 0.1, 25 June 1995
> * @author Ross McNab
> */
>
> Also, the event queue in Sim_system is accessed using
> 'synchronized' to
> ensure consistency and the simulation clock. Therefore when there
> are a huge
> amount of entities/messages, the event queue becomes the system
> bottleneck -
> only one entity/thread can write to event queue while the others
> will wait,
> and wait, and wait, and wait...
>
> It may have problem with java's handling large memories. But a re-
> design and
> re-implemenation of the underlying thread pool is ideal, which is
> exactly
> what I'm doing now.
>
> Cheers,
>
> Shuo 'Alex' Yang
> University of Manchester
>
>
> ----- Original Message -----
> From: "Agustín Caminero Herráez" <ag...@ds...>
> To: "ye" <hua...@gm...>
> Cc: <gri...@li...>;
> <gri...@li...>
> Sent: Friday, September 05, 2008 3:35 PM
> Subject: Re: [GridSim-developers] [GridSim-users] simulation fails
> (OOME)with
> 1000 resources
>
>
> Hi Ye,
>
> I've also suffered the problems u describe, and I'm afraid there is no
> solution for them. The only suggestion I can give to u is to scale
> down
> your simulations.
>
> The problem comes from Java's inability to handle more than 1.5 GB of
> memory, so there is nothing u can do.
>
> Just one thing, are u using Sun Java? Because using another different
> java may cause problems... The java I us is Sun v1.4.2
>
> Regards,
>
> Agustin
>
> ye escribió:
>> Hi, Dear all:
>> Although I have asked a similar question in gridsim-user maillist,
>> there seems no similar experience from other developers. Since
>> it's an
>> crucial problem for me, I'd to make the scenario much clear and beg
>> for help.
>>
>> For brief, is there any scale limit for simulation created via
>> GridSim?
>>
>> I was trying to set up a gridsim simulation with 1000 resource; each
>> resource contains one machine, each machine has two PEs. Then, I
>> wrote
>> a user to retrieve resource list within its body(), and print the
>> total size. However, the program halts with an OutOfMemoryError,
>> every
>> time before "Entities started" was printed. The user's body() was
>> never visited.
>>
>> I am working on a mac 10.5, 2GB 667 Mhz memory, mac JVM 1.5;
>> meanwhile, I already adjust the vm parameter into "-Xms512m -
>> Xmx1024m".
>>
>> Later, I tried the same program on my server (ubuntu 8.04, 3.2GB).
>> Fortunately, it works... but, it halts again with OOME while i decide
>> create 1100 resources.
>>
>> I am not sure the problem is caused by lacking of memory? Is there
>> any
>> limit for gridsim simulation scale, or just for GridSim Resource? Or
>> it's bug derived from simjava?
>>
>> Finally, is it possible to solve it?
>>
>> Thank you guys a lot!!
>>
>> regards
>> ye
>>
>> --
>> Ye Huang, Department of Informatics
>> University of Fribourg / Pérolles 2 - Bld de Pérolles 90
>> 1700 Fribourg, Switzerland
>>
>> e-mail: ye....@he..., ye....@un...
>> http://diuf.unifr.ch/people/huangy/
>> Office: +41 26 429 65 95
>> ---------------------------------------------------------------------
>> ---
>>
>> ---------------------------------------------------------------------
>> ----
>> This SF.Net email is sponsored by the Moblin Your Move Developer's
>> challenge
>> Build the coolest Linux based applications with Moblin SDK & win
>> great
>> prizes
>> Grand prize is a trip for two to an Open Source event anywhere in the
>> world
>> http://moblin-contest.org/redirect.php?banner_id=100&url=/
>> ---------------------------------------------------------------------
>> ---
>>
>> _______________________________________________
>> Gridsim-users mailing list
>> Gri...@li...
>> https://lists.sourceforge.net/lists/listinfo/gridsim-users
>>
>
> --
> ===============================================
> Agustin Caminero
> Research Assistant.
> Computing Systems Department.
> Albacete Research Institute of Informatics (I3A).
> The University of Castilla La Mancha.
> Campus Universitario s/n, 02071, Albacete. Spain.
> Phone: +34 967 599 200 Ext. 2693. Fax: +34 967 599 343
> http://www.i3a.uclm.es/
> ===============================================
>
>
>
>
> ----------------------------------------------------------------------
> ----------
>
>
>> ---------------------------------------------------------------------
>> ----
>> This SF.Net email is sponsored by the Moblin Your Move Developer's
>> challenge
>> Build the coolest Linux based applications with Moblin SDK & win
>> great
>> prizes
>> Grand prize is a trip for two to an Open Source event anywhere in the
>> world
>> http://moblin-contest.org/redirect.php?banner_id=100&url=/
>
>
> ----------------------------------------------------------------------
> ----------
>
>
>> _______________________________________________
>> Gridsim-developers mailing list
>> Gri...@li...
>> https://lists.sourceforge.net/lists/listinfo/gridsim-developers
>>
>
>
> ----------------------------------------------------------------------
> ---
> This SF.Net email is sponsored by the Moblin Your Move Developer's
> challenge
> Build the coolest Linux based applications with Moblin SDK & win
> great prizes
> Grand prize is a trip for two to an Open Source event anywhere in
> the world
> http://moblin-contest.org/redirect.php?banner_id=100&url=/
> _______________________________________________
> Gridsim-users mailing list
> Gri...@li...
> https://lists.sourceforge.net/lists/listinfo/gridsim-users
Marcos Dias de Assuncao
Grid Computing and Distributed Systems (GRIDS) Laboratory
Department of Computer Science and Software Engineering
The University of Melbourne, Australia
Email: ma...@cs...
-------------
"No serious sociologist any longer believes that the voice of the
people expresses any divine or specially wise idea. The voice of the
people expresses the mind of the people, and that mind is made up for
it by the group leaders in whom it believes and by those persons who
understand the manipulation of the public opinion. It is composed of
inherited prejudices and symbols and cliché's and verbal formulas
supplied to them by the leaders."
Edward L. Bernays
|
|
From: ye <hua...@gm...> - 2008-09-05 15:55:04
|
Hi, Dear all: to Shuo, Thanks for your advice and help! I have downloaded simjava1.2 from its original website. However, I am afraid it's not the same thing used within gridsim currently, at least partially. The source code included by GridSim concerns only the src package started from "gridsim.", such as gridsim.auction, gridsim.util. However, after I unfold the class package "gridsim.jar" (/gridsimtoolkit-4.1/jars/), I noticed it contains two aditional src package started as "eduni", e.g. eduni.simjava.distributions. These packages also appear in /gridsimtoolkit-4.1/jars/simjava2.jar. The trick is, original simjava1.2 doesn't have "eduni.simjava.distributions". Does that mean gridsim has modified some classes under package "eduni.simjava" (e.g. Evqueue) and "eduni.simjava.distributions", which is not from simjava itself. If the answer is true, then I am wondering about two questions: 1. Is there anyone have the source code of the modified simjava classes? I couldn't find it from gridsim source directory. 2. What's the reason of these modification? Did Dr. Buyya encounter the same problem what we have now? Then maybe people could contribute without tooooo much work. (what do you say, shuo? :-) Best Regards ye On Fri, Sep 5, 2008 at 4:55 PM, Shuo Yang <ya...@cs...> wrote: > All, > > I think the problem also lies in the scalability of the underlying simjava > package. Simjava uses an event queue to manage all internal events flying > between entities. The event queue is a Vector. If you refer to > eduni.simjava.Evqueue.java, you can see the doc: > > /** > * This class implements an event queue used internally by the Sim_system to > * manage > * the list of future and deferred Sim_events. It should not be needed in > * a user simulation. It works like a normal FIFO > * queue, but during insertion events are kept in order from the smallest > time > * stamp to the largest. This means the next event to occur will be at the > top > * of the queue. <P> > * The current implementation > * is uses a Vector to store the queue and is inefficient for popping > * and inserting elements because the rest of the array has to be > * moved down one space. A better method would be to use a circular array. > * @see eduni.simjava.Sim_system > * @version 0.1, 25 June 1995 > * @author Ross McNab > */ > > Also, the event queue in Sim_system is accessed using 'synchronized' to > ensure consistency and the simulation clock. Therefore when there are a huge > amount of entities/messages, the event queue becomes the system bottleneck - > only one entity/thread can write to event queue while the others will wait, > and wait, and wait, and wait... > > It may have problem with java's handling large memories. But a re-design > and re-implemenation of the underlying thread pool is ideal, which is > exactly what I'm doing now. > > Cheers, > > Shuo 'Alex' Yang > University of Manchester > > > ----- Original Message ----- From: "Agustín Caminero Herráez" < > ag...@ds...> > To: "ye" <hua...@gm...> > Cc: <gri...@li...>; < > gri...@li...> > Sent: Friday, September 05, 2008 3:35 PM > Subject: Re: [GridSim-developers] [GridSim-users] simulation > fails(OOME)with 1000 resources > > > > Hi Ye, > > I've also suffered the problems u describe, and I'm afraid there is no > solution for them. The only suggestion I can give to u is to scale down > your simulations. > > The problem comes from Java's inability to handle more than 1.5 GB of > memory, so there is nothing u can do. > > Just one thing, are u using Sun Java? Because using another different > java may cause problems... The java I us is Sun v1.4.2 > > Regards, > > Agustin > > ye escribió: > >> Hi, Dear all: >> Although I have asked a similar question in gridsim-user maillist, >> there seems no similar experience from other developers. Since it's an >> crucial problem for me, I'd to make the scenario much clear and beg >> for help. >> >> For brief, is there any scale limit for simulation created via GridSim? >> >> I was trying to set up a gridsim simulation with 1000 resource; each >> resource contains one machine, each machine has two PEs. Then, I wrote >> a user to retrieve resource list within its body(), and print the >> total size. However, the program halts with an OutOfMemoryError, every >> time before "Entities started" was printed. The user's body() was >> never visited. >> >> I am working on a mac 10.5, 2GB 667 Mhz memory, mac JVM 1.5; >> meanwhile, I already adjust the vm parameter into "-Xms512m -Xmx1024m". >> >> Later, I tried the same program on my server (ubuntu 8.04, 3.2GB). >> Fortunately, it works... but, it halts again with OOME while i decide >> create 1100 resources. >> >> I am not sure the problem is caused by lacking of memory? Is there any >> limit for gridsim simulation scale, or just for GridSim Resource? Or >> it's bug derived from simjava? >> >> Finally, is it possible to solve it? >> >> Thank you guys a lot!! >> >> regards >> ye >> >> -- >> Ye Huang, Department of Informatics >> University of Fribourg / Pérolles 2 - Bld de Pérolles 90 >> 1700 Fribourg, Switzerland >> >> e-mail: ye....@he..., ye....@un... >> http://diuf.unifr.ch/people/huangy/ >> Office: +41 26 429 65 95 >> ------------------------------------------------------------------------ >> >> ------------------------------------------------------------------------- >> This SF.Net email is sponsored by the Moblin Your Move Developer's >> challenge >> Build the coolest Linux based applications with Moblin SDK & win great >> prizes >> Grand prize is a trip for two to an Open Source event anywhere in the >> world >> http://moblin-contest.org/redirect.php?banner_id=100&url=/ >> ------------------------------------------------------------------------ >> >> _______________________________________________ >> Gridsim-users mailing list >> Gri...@li... >> https://lists.sourceforge.net/lists/listinfo/gridsim-users >> >> > -- > =============================================== > Agustin Caminero > Research Assistant. > Computing Systems Department. > Albacete Research Institute of Informatics (I3A). > The University of Castilla La Mancha. > Campus Universitario s/n, 02071, Albacete. Spain. > Phone: +34 967 599 200 Ext. 2693. Fax: +34 967 599 343 > http://www.i3a.uclm.es/ > =============================================== > > > > > > -------------------------------------------------------------------------------- > > > ------------------------------------------------------------------------- >> This SF.Net email is sponsored by the Moblin Your Move Developer's >> challenge >> Build the coolest Linux based applications with Moblin SDK & win great >> prizes >> Grand prize is a trip for two to an Open Source event anywhere in the >> world >> http://moblin-contest.org/redirect.php?banner_id=100&url=/ >> > > > > -------------------------------------------------------------------------------- > > > _______________________________________________ >> Gridsim-developers mailing list >> Gri...@li... >> https://lists.sourceforge.net/lists/listinfo/gridsim-developers >> >> > -- Ye Huang, Department of Informatics University of Fribourg / Pérolles 2 - Bld de Pérolles 90 1700 Fribourg, Switzerland e-mail: ye....@he..., ye....@un... http://diuf.unifr.ch/people/huangy/ Office: +41 26 429 65 95 |
|
From: ye <hua...@gm...> - 2008-09-05 15:01:59
|
Hi, Agustín: Thanks for reply! Unfortunately, I am using mac jvm 1.5.0 and openjdk 1.6 instead of sun java. However, are you sure your problem is caused by java's inability to handle memory upto 1.5GB? Does it mean that you have monitored the memory use of your machine has exceeded (or close) 1.5GB. For my scenario, the simulation memory usage is only around 300MB, far before the jvm configuration (1024M). In the other hand, although I never have the expirence of using 1GB memory with java, I suppose most of the real OutOfMemoryError should be caused by the limit of machine. The limit of memory usage of 32-bit system is 4GB (2e32), and some OSs will reserve certain amount of memory for kernel process, e.g. windows 2000 normally reserve 2GB for its own. For your problem, if you are sure the crash is caused by memory overload (> 1.5GB), I think it might not be a bad news. You should be able to solve this problem by using a 64-bit system. Best Regards ye On Fri, Sep 5, 2008 at 4:35 PM, Agustín Caminero Herráez < ag...@ds...> wrote: > Hi Ye, > > I've also suffered the problems u describe, and I'm afraid there is no > solution for them. The only suggestion I can give to u is to scale down your > simulations. > > The problem comes from Java's inability to handle more than 1.5 GB of > memory, so there is nothing u can do. > > Just one thing, are u using Sun Java? Because using another different java > may cause problems... The java I us is Sun v1.4.2 > > Regards, > > Agustin > > ye escribió: > >> Hi, Dear all: >> Although I have asked a similar question in gridsim-user maillist, there >> seems no similar experience from other developers. Since it's an crucial >> problem for me, I'd to make the scenario much clear and beg for help. >> >> For brief, is there any scale limit for simulation created via GridSim? >> >> I was trying to set up a gridsim simulation with 1000 resource; each >> resource contains one machine, each machine has two PEs. Then, I wrote a >> user to retrieve resource list within its body(), and print the total size. >> However, the program halts with an OutOfMemoryError, every time before >> "Entities started" was printed. The user's body() was never visited. >> >> I am working on a mac 10.5, 2GB 667 Mhz memory, mac JVM 1.5; meanwhile, I >> already adjust the vm parameter into "-Xms512m -Xmx1024m". >> >> Later, I tried the same program on my server (ubuntu 8.04, 3.2GB). >> Fortunately, it works... but, it halts again with OOME while i decide create >> 1100 resources. >> >> I am not sure the problem is caused by lacking of memory? Is there any >> limit for gridsim simulation scale, or just for GridSim Resource? Or it's >> bug derived from simjava? >> >> Finally, is it possible to solve it? >> >> Thank you guys a lot!! >> >> regards >> ye >> >> -- >> Ye Huang, Department of Informatics >> University of Fribourg / Pérolles 2 - Bld de Pérolles 90 >> 1700 Fribourg, Switzerland >> >> e-mail: ye....@he..., ye....@un... >> http://diuf.unifr.ch/people/huangy/ >> Office: +41 26 429 65 95 >> ------------------------------------------------------------------------ >> >> ------------------------------------------------------------------------- >> This SF.Net email is sponsored by the Moblin Your Move Developer's >> challenge >> Build the coolest Linux based applications with Moblin SDK & win great >> prizes >> Grand prize is a trip for two to an Open Source event anywhere in the >> world >> http://moblin-contest.org/redirect.php?banner_id=100&url=/ >> ------------------------------------------------------------------------ >> >> _______________________________________________ >> Gridsim-users mailing list >> Gri...@li... >> https://lists.sourceforge.net/lists/listinfo/gridsim-users >> >> > > -- > =============================================== > Agustin Caminero > Research Assistant. > Computing Systems Department. > Albacete Research Institute of Informatics (I3A). > The University of Castilla La Mancha. > Campus Universitario s/n, 02071, Albacete. Spain. > Phone: +34 967 599 200 Ext. 2693. Fax: +34 967 599 343 > http://www.i3a.uclm.es/ > =============================================== > > -- Ye Huang, Department of Informatics University of Fribourg / Pérolles 2 - Bld de Pérolles 90 1700 Fribourg, Switzerland e-mail: ye....@he..., ye....@un... http://diuf.unifr.ch/people/huangy/ Office: +41 26 429 65 95 |
|
From: Shuo Y. <ya...@cs...> - 2008-09-05 14:57:24
|
All, I think the problem also lies in the scalability of the underlying simjava package. Simjava uses an event queue to manage all internal events flying between entities. The event queue is a Vector. If you refer to eduni.simjava.Evqueue.java, you can see the doc: /** * This class implements an event queue used internally by the Sim_system to * manage * the list of future and deferred Sim_events. It should not be needed in * a user simulation. It works like a normal FIFO * queue, but during insertion events are kept in order from the smallest time * stamp to the largest. This means the next event to occur will be at the top * of the queue. <P> * The current implementation * is uses a Vector to store the queue and is inefficient for popping * and inserting elements because the rest of the array has to be * moved down one space. A better method would be to use a circular array. * @see eduni.simjava.Sim_system * @version 0.1, 25 June 1995 * @author Ross McNab */ Also, the event queue in Sim_system is accessed using 'synchronized' to ensure consistency and the simulation clock. Therefore when there are a huge amount of entities/messages, the event queue becomes the system bottleneck - only one entity/thread can write to event queue while the others will wait, and wait, and wait, and wait... It may have problem with java's handling large memories. But a re-design and re-implemenation of the underlying thread pool is ideal, which is exactly what I'm doing now. Cheers, Shuo 'Alex' Yang University of Manchester ----- Original Message ----- From: "Agustín Caminero Herráez" <ag...@ds...> To: "ye" <hua...@gm...> Cc: <gri...@li...>; <gri...@li...> Sent: Friday, September 05, 2008 3:35 PM Subject: Re: [GridSim-developers] [GridSim-users] simulation fails(OOME)with 1000 resources Hi Ye, I've also suffered the problems u describe, and I'm afraid there is no solution for them. The only suggestion I can give to u is to scale down your simulations. The problem comes from Java's inability to handle more than 1.5 GB of memory, so there is nothing u can do. Just one thing, are u using Sun Java? Because using another different java may cause problems... The java I us is Sun v1.4.2 Regards, Agustin ye escribió: > Hi, Dear all: > Although I have asked a similar question in gridsim-user maillist, > there seems no similar experience from other developers. Since it's an > crucial problem for me, I'd to make the scenario much clear and beg > for help. > > For brief, is there any scale limit for simulation created via GridSim? > > I was trying to set up a gridsim simulation with 1000 resource; each > resource contains one machine, each machine has two PEs. Then, I wrote > a user to retrieve resource list within its body(), and print the > total size. However, the program halts with an OutOfMemoryError, every > time before "Entities started" was printed. The user's body() was > never visited. > > I am working on a mac 10.5, 2GB 667 Mhz memory, mac JVM 1.5; > meanwhile, I already adjust the vm parameter into "-Xms512m -Xmx1024m". > > Later, I tried the same program on my server (ubuntu 8.04, 3.2GB). > Fortunately, it works... but, it halts again with OOME while i decide > create 1100 resources. > > I am not sure the problem is caused by lacking of memory? Is there any > limit for gridsim simulation scale, or just for GridSim Resource? Or > it's bug derived from simjava? > > Finally, is it possible to solve it? > > Thank you guys a lot!! > > regards > ye > > -- > Ye Huang, Department of Informatics > University of Fribourg / Pérolles 2 - Bld de Pérolles 90 > 1700 Fribourg, Switzerland > > e-mail: ye....@he..., ye....@un... > http://diuf.unifr.ch/people/huangy/ > Office: +41 26 429 65 95 > ------------------------------------------------------------------------ > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's > challenge > Build the coolest Linux based applications with Moblin SDK & win great > prizes > Grand prize is a trip for two to an Open Source event anywhere in the > world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > ------------------------------------------------------------------------ > > _______________________________________________ > Gridsim-users mailing list > Gri...@li... > https://lists.sourceforge.net/lists/listinfo/gridsim-users > -- =============================================== Agustin Caminero Research Assistant. Computing Systems Department. Albacete Research Institute of Informatics (I3A). The University of Castilla La Mancha. Campus Universitario s/n, 02071, Albacete. Spain. Phone: +34 967 599 200 Ext. 2693. Fax: +34 967 599 343 http://www.i3a.uclm.es/ =============================================== -------------------------------------------------------------------------------- > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's > challenge > Build the coolest Linux based applications with Moblin SDK & win great > prizes > Grand prize is a trip for two to an Open Source event anywhere in the > world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ -------------------------------------------------------------------------------- > _______________________________________________ > Gridsim-developers mailing list > Gri...@li... > https://lists.sourceforge.net/lists/listinfo/gridsim-developers > |
|
From: Agustín C. H. <ag...@ds...> - 2008-09-05 14:35:42
|
Hi Ye, I've also suffered the problems u describe, and I'm afraid there is no solution for them. The only suggestion I can give to u is to scale down your simulations. The problem comes from Java's inability to handle more than 1.5 GB of memory, so there is nothing u can do. Just one thing, are u using Sun Java? Because using another different java may cause problems... The java I us is Sun v1.4.2 Regards, Agustin ye escribió: > Hi, Dear all: > Although I have asked a similar question in gridsim-user maillist, > there seems no similar experience from other developers. Since it's an > crucial problem for me, I'd to make the scenario much clear and beg > for help. > > For brief, is there any scale limit for simulation created via GridSim? > > I was trying to set up a gridsim simulation with 1000 resource; each > resource contains one machine, each machine has two PEs. Then, I wrote > a user to retrieve resource list within its body(), and print the > total size. However, the program halts with an OutOfMemoryError, every > time before "Entities started" was printed. The user's body() was > never visited. > > I am working on a mac 10.5, 2GB 667 Mhz memory, mac JVM 1.5; > meanwhile, I already adjust the vm parameter into "-Xms512m -Xmx1024m". > > Later, I tried the same program on my server (ubuntu 8.04, 3.2GB). > Fortunately, it works... but, it halts again with OOME while i decide > create 1100 resources. > > I am not sure the problem is caused by lacking of memory? Is there any > limit for gridsim simulation scale, or just for GridSim Resource? Or > it's bug derived from simjava? > > Finally, is it possible to solve it? > > Thank you guys a lot!! > > regards > ye > > -- > Ye Huang, Department of Informatics > University of Fribourg / Pérolles 2 - Bld de Pérolles 90 > 1700 Fribourg, Switzerland > > e-mail: ye....@he..., ye....@un... > http://diuf.unifr.ch/people/huangy/ > Office: +41 26 429 65 95 > ------------------------------------------------------------------------ > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > ------------------------------------------------------------------------ > > _______________________________________________ > Gridsim-users mailing list > Gri...@li... > https://lists.sourceforge.net/lists/listinfo/gridsim-users > -- =============================================== Agustin Caminero Research Assistant. Computing Systems Department. Albacete Research Institute of Informatics (I3A). The University of Castilla La Mancha. Campus Universitario s/n, 02071, Albacete. Spain. Phone: +34 967 599 200 Ext. 2693. Fax: +34 967 599 343 http://www.i3a.uclm.es/ =============================================== |
|
From: ye <hua...@gm...> - 2008-09-05 13:23:40
|
Hi, Dear all: Although I have asked a similar question in gridsim-user maillist, there seems no similar experience from other developers. Since it's an crucial problem for me, I'd to make the scenario much clear and beg for help. For brief, is there any scale limit for simulation created via GridSim? I was trying to set up a gridsim simulation with 1000 resource; each resource contains one machine, each machine has two PEs. Then, I wrote a user to retrieve resource list within its body(), and print the total size. However, the program halts with an OutOfMemoryError, every time before "Entities started" was printed. The user's body() was never visited. I am working on a mac 10.5, 2GB 667 Mhz memory, mac JVM 1.5; meanwhile, I already adjust the vm parameter into "-Xms512m -Xmx1024m". Later, I tried the same program on my server (ubuntu 8.04, 3.2GB). Fortunately, it works... but, it halts again with OOME while i decide create 1100 resources. I am not sure the problem is caused by lacking of memory? Is there any limit for gridsim simulation scale, or just for GridSim Resource? Or it's bug derived from simjava? Finally, is it possible to solve it? Thank you guys a lot!! regards ye -- Ye Huang, Department of Informatics University of Fribourg / Pérolles 2 - Bld de Pérolles 90 1700 Fribourg, Switzerland e-mail: ye....@he..., ye....@un... http://diuf.unifr.ch/people/huangy/ Office: +41 26 429 65 95 |
|
From: Marcos D. de A. <ma...@cs...> - 2008-07-11 06:58:07
|
Dear Shuo Yang, I am wondering if you could explain in more detail what the 4,000 entities actually do. Are you using the Workload class for job submission? If yes, how many instances of it do you have? How many jobs in average are the user entities/workloads submitting? Have you enabled the trace mode (the simulation is generating log files)? How many resources do you have? What resource allocation policies are they using? Regards, Marcos On 10/07/2008, at 7:12 PM, Shuo Yang wrote: > Dear GridSim team, > > I'm Shuo Yang, a PhD student at University of Manchester, UK. I'm > doing > my research project with simulations based on GridSim. However I > encountered scalability issues in the simulation where there are > around > 4000 threads (entities) with Java exception > > 'java.lang.OutOfMemoryError: Java heap space' > > The simulation ran for ~48 hours with increasing memory usage and > ended > up with the OutOfMemoryError exceptions. Please could you help more > with > tuning? Here's more info: > > $ uname -a > Linux nimue.rcs.manchester.ac.uk 2.6.18-1.2798.fc6 #1 SMP Mon Oct 16 > 14:54:20 EDT 2006 i686 i686 i386 GNU/Linux > > $ java -version > java version "1.6.0_06" > Java(TM) SE Runtime Environment (build 1.6.0_06-b02) > Java HotSpot(TM) Server VM (build 10.0-b22, mixed mode) > > > $ ps aux | grep java > > yangs 12579 109 43.7 2915672 1473316 ? Sl 03:10 1011:15 java > -Xss128k -Xms1024m -Xmx1024m -cp gridsim-lib/gridsim.jar:. > topology/HierarchySimulation true > > > $ free -mt > total used free shared buffers > cached > Mem: 3290 2055 1235 0 83 > 363 > -/+ buffers/cache: 1608 1682 > Swap: 8001 0 8001 > Total: 11291 2055 9236 > > > $ top > PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ SWAP CODE > DATA COMMAND > 12579 yangs 17 0 2847m 1.4g 5624 S 100 43.7 1057:02 1.4g 40 > 2.8g java > > > > > Many thanks, > > Shuo 'Alex' Yang. > School of Computer Science > University of Manchester > > > ---------------------------------------------------------------------- > --- > Sponsored by: SourceForge.net Community Choice Awards: VOTE NOW! > Studies have shown that voting for your favorite open source project, > along with a healthy diet, reduces your potential for chronic lameness > and boredom. Vote Now at http://www.sourceforge.net/community/cca08 > _______________________________________________ > Gridsim-users mailing list > Gri...@li... > https://lists.sourceforge.net/lists/listinfo/gridsim-users Marcos Dias de Assuncao Grid Computing and Distributed Systems (GRIDS) Laboratory Department of Computer Science and Software Engineering The University of Melbourne, Australia Email: ma...@cs... ------------- "I sincerely believe the banking institutions having the issuing power of money are more dangerous to liberty than standing armies" Thomas Jefferson |
|
From: Agustín C. H. <ag...@ds...> - 2008-07-10 12:03:21
|
Dear Shuo Yang, The problem u r facing is quite difficult, and I think that the best way of tackling it is by tuning ur code. This is, make sure u don't waste memory unnecessarily. So, for example, every time that some object is not needed any more, delete it (set it to null so that the garbage collector releases the memory). Also, u can scale ur experiments, so that they become smaller. Hope this helps, Agustin Shuo Yang escribió: > Dear GridSim team, > > I'm Shuo Yang, a PhD student at University of Manchester, UK. I'm doing > my research project with simulations based on GridSim. However I > encountered scalability issues in the simulation where there are around > 4000 threads (entities) with Java exception > > 'java.lang.OutOfMemoryError: Java heap space' > > The simulation ran for ~48 hours with increasing memory usage and ended > up with the OutOfMemoryError exceptions. Please could you help more with > tuning? Here's more info: > > $ uname -a > Linux nimue.rcs.manchester.ac.uk 2.6.18-1.2798.fc6 #1 SMP Mon Oct 16 > 14:54:20 EDT 2006 i686 i686 i386 GNU/Linux > > $ java -version > java version "1.6.0_06" > Java(TM) SE Runtime Environment (build 1.6.0_06-b02) > Java HotSpot(TM) Server VM (build 10.0-b22, mixed mode) > > > $ ps aux | grep java > > yangs 12579 109 43.7 2915672 1473316 ? Sl 03:10 1011:15 java > -Xss128k -Xms1024m -Xmx1024m -cp gridsim-lib/gridsim.jar:. > topology/HierarchySimulation true > > > $ free -mt > total used free shared buffers > cached > Mem: 3290 2055 1235 0 83 > 363 > -/+ buffers/cache: 1608 1682 > Swap: 8001 0 8001 > Total: 11291 2055 9236 > > > $ top > PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ SWAP CODE > DATA COMMAND > 12579 yangs 17 0 2847m 1.4g 5624 S 100 43.7 1057:02 1.4g 40 > 2.8g java > > > > > Many thanks, > > Shuo 'Alex' Yang. > School of Computer Science > University of Manchester > > > ------------------------------------------------------------------------- > Sponsored by: SourceForge.net Community Choice Awards: VOTE NOW! > Studies have shown that voting for your favorite open source project, > along with a healthy diet, reduces your potential for chronic lameness > and boredom. Vote Now at http://www.sourceforge.net/community/cca08 > _______________________________________________ > Gridsim-users mailing list > Gri...@li... > https://lists.sourceforge.net/lists/listinfo/gridsim-users > -- =============================================== Agustin Caminero Research Assistant. Computing Systems Department. Albacete Research Institute of Informatics (I3A). The University of Castilla La Mancha. Campus Universitario s/n, 02071, Albacete. Spain. Phone: +34 967 599 200 Ext. 2693. Fax: +34 967 599 343 http://www.i3a.uclm.es/ =============================================== |
|
From: Shuo Y. <ya...@cs...> - 2008-07-10 09:25:52
|
Dear GridSim team, I'm Shuo Yang, a PhD student at University of Manchester, UK. I'm doing my research project with simulations based on GridSim. However I encountered scalability issues in the simulation where there are around 4000 threads (entities) with Java exception 'java.lang.OutOfMemoryError: Java heap space' The simulation ran for ~48 hours with increasing memory usage and ended up with the OutOfMemoryError exceptions. Please could you help more with tuning? Here's more info: $ uname -a Linux nimue.rcs.manchester.ac.uk 2.6.18-1.2798.fc6 #1 SMP Mon Oct 16 14:54:20 EDT 2006 i686 i686 i386 GNU/Linux $ java -version java version "1.6.0_06" Java(TM) SE Runtime Environment (build 1.6.0_06-b02) Java HotSpot(TM) Server VM (build 10.0-b22, mixed mode) $ ps aux | grep java yangs 12579 109 43.7 2915672 1473316 ? Sl 03:10 1011:15 java -Xss128k -Xms1024m -Xmx1024m -cp gridsim-lib/gridsim.jar:. topology/HierarchySimulation true $ free -mt total used free shared buffers cached Mem: 3290 2055 1235 0 83 363 -/+ buffers/cache: 1608 1682 Swap: 8001 0 8001 Total: 11291 2055 9236 $ top PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ SWAP CODE DATA COMMAND 12579 yangs 17 0 2847m 1.4g 5624 S 100 43.7 1057:02 1.4g 40 2.8g java Many thanks, Shuo 'Alex' Yang. School of Computer Science University of Manchester |
|
From: 黄. <yua...@js...> - 2008-06-11 03:07:52
|
Hi,everyone:
i meet some difficulty when i use gridsim to implement my thoughts. I plan to create a architecture that node A has two sub-nodes B,C, and B,C have two sub-nodes D,E and F,G respectively, which like this: F------|
|-------C----|
G------| |
|-------A
D------| |
|-------B----|
E------|
At the first beginning, D E F G will send messages to B C, and B C then send new messages to A. After processing in A, messages will be back from A to D E F G through B C, then the next cycle begin again. But i found the amount of messages send by D E F G will not be very large. 200~500 is ok, but when it exceed 1000, i will get the message "Sim_system: No more future events". I try to solve it by myself, but found no reason. So i hope anyone here can help me. Thanks a lot!!
hyqgod
2008-06-11
|
|
From: Agustin C. Herra¡ez <sup...@gm...> - 2008-06-09 16:07:24
|
Hello, I have a question regarding RateControlledScheduler. My problem is as follows: I have 2 network classes, with different baud rates associated to each one. If I understood the explanation of RateControlledScheduler, each traffic class has its own baud rate in each link. This is, no matter how much traffic from one class exists, the other class will use the same baud rate at all times, am I right? But I found that ping packets (from one of the classes) took different time depending on how much gridlets traffic (from the other class) exists. My experiments are as follows, my gridlets belong to one of the classes, and I do pings which belong to the other class. Nothing else flow through the network apart from pings and gridlets. What do u think is the reason for this behavior? Can anything else affect the latencies of pings packets? Perhaps the load of computing resources affects latencies of pings? Thanks in advance for ur help! All the best, Agustin |
|
From: Agustín C. H. <ag...@ds...> - 2008-06-09 08:05:55
|
Hello, I have a question regarding RateControlledScheduler. My problem is as follows: I have 2 network classes, with different baud rates associated to each one. If I understood the explanation of RateControlledScheduler, each traffic class has its own baud rate in each link. This is, no matter how much traffic from one class exists, the other class will use the same baud rate at all times, am I right? But I found that ping packets (from one of the classes) took different time depending on how much gridlets traffic (from the other class) exists. My experiments are as follows, my gridlets belong to one of the classes, and I do pings which belong to the other class. Nothing else flow through the network apart from pings and gridlets. What do u think is the reason for this behavior? Can anything else affect the latencies of pings packets? Perhaps the load of computing resources affects latencies of pings? Thanks in advance for ur help! All the best, Agustin -- =============================================== Agustin Caminero PhD Student Computing Systems Department The University of Castilla La Mancha, Albacete. Spain. Phone: +34 967 599 200 Ext. 2693. Fax: +34 967 599 343 http://www.i3a.uclm.es/ =============================================== |
|
From: Azin M. <az...@ma...> - 2008-02-08 17:48:40
|
I want to move a *Gridlet* from one Machine to another and I want to leave some information in the nodes which the *Gridlet* is visiting as it moves towards its destination. Could you please help me how I can do this ? Thank you very much in advance, Azin |
|
From: Anthony S. <an...@cs...> - 2008-01-10 02:16:58
|
Follow Example 8 closely. It shows how you can create a new scheduling policy. anthony On Sat, 5 Jan 2008, mansoor hussain wrote: > dear sir, > im interedted n designing of new scheduling > algorithm in gridsim so please suggest me to implement > various scheduling algorithm. > > > yours, > mansoor |
4 messages has been excluded from this view by a project administrator.
