Menu

Job Splitting among nodes

2012-10-22
2012-10-25
  • Alex Fihman

    Alex Fihman - 2012-10-22

    Suppose I need to calculate sum

    1/i where i between 1 and 1e8

    Suppose each node can perform 1e6 divisions per second in single thread, lets ignore time for additions.

    I can start 10 Amazon EC2 nodes running 16 threads each, and ....
    Starting the servers and managing them will take much more time than doing actual job.

    Now we have 10 GPU nodes capable 16 threads each, we need a simple job split (by range) and job result merge, and task can be done in a second or two.

    What do you think?

     
  • dangermouse

    dangermouse - 2012-10-25

    Yes, GPU should implement a MapReduce over a random network topology...
    We probably should start with a list of Use Cases of what we want that the GPU does...

     

Log in to post a comment.

Want the latest updates on software, tech news, and AI?
Get latest updates about software, tech news, and AI from SourceForge directly in your inbox once a month.