Drexel dragonThe Math ForumDonate to the Math Forum



Search All of the Math Forum:

Views expressed in these public forums are not endorsed by Drexel University or The Math Forum.


Math Forum » Discussions » Software » comp.soft-sys.matlab

Topic: spmd overhead and sharing small amounts of data
Replies: 2   Last Post: Dec 20, 2012 10:44 AM

Advanced Search

Back to Topic List Back to Topic List Jump to Tree View Jump to Tree View   Messages: [ Previous | Next ]
Chuck37

Posts: 93
Registered: 2/23/10
spmd overhead and sharing small amounts of data
Posted: Dec 19, 2012 11:49 AM
  Click to see the message monospaced in plain text Plain Text   Click to reply to this topic Reply

I think my processing time is being chewed up by spmd overhead. I have a simulation that looks like this:

for x = 1:N
spmd
D = expensiveFunction(D)
end
<gather small bits from workers>
<fast simple function>
spmd
D = expensiveFunction2(D)
end

<repeat the above basic idea 3-4 times>

end

Watching my processors, they are seldom above 20% utilization, so it makes me think that I'm suffering from going in and out of spmd and maybe gathering even small pieces of data is a problem. Any alternatives? For one, is there a way to gather directly worker to worker without exiting spmd and bringing it all to the master? The data is small and functions cheap, so maybe I'd be ahead to let everyone do the same computations just to keep things flowing.

Thanks.



Point your RSS reader here for a feed of the latest messages in this topic.

[Privacy Policy] [Terms of Use]

© Drexel University 1994-2014. All Rights Reserved.
The Math Forum is a research and educational enterprise of the Drexel University School of Education.