[SSI-devel] Re: Parallel make on SSI
Brought to you by:
brucewalker,
rogertsang
From: Matt C. <mco...@am...> - 2003-08-22 18:28:18
|
Hi Bruce- Thanks for the update regarding parallel makes. We haven't been able to get machines to implement SSI on here yet, but we're hoping to have it running in a test environment soon. I think the important part is to be able to distribute all those 'cc' processes across the nodes. The challenge will be to roundrobin them or something, since I think they're going to be too short-lived to be able to analyze and migrate them once they've been spawned. -matt Walker, Bruce J wrote: > Matt, > Thanks for your interest in the openSSI project and stopping by at > LinuxWorld. We noticed a couple of things while you playing with the > system - parallel make (make -j18) was not migrating the make program > itself and there wasn't a good way to determine which of your processes > were running on which nodes. > > Laura Ramirez, who works on the project, looked into the first issue and > discovered that make -j uses cloning. As we discussed (I think), we > currently can't split cloned processes between nodes (actually there is > no plan to ever do that). Without a change to make, the best we are > going to do is to distribute all the things the make spawns (cc's, ar's, > etc.). Sometime next week we should have an initial look at the > performance impact spreading those processes around the cluster might have. > > As for the "ps" issue, I'll send a note on the ssi-linux-devel list > later today to start a discussion of what we can/should do with ps to > address the issue of knowing where your processes are running. > > Note that the "current" release (0.9.9) has problems with NFS. If > anyone needs a fixed release, Brian has a 0.9.9b. He wasn't planning on > putting it up on the Web (wait a bit until we have a few more > features/fixes), but will if there is a need. > > Bruce > |