The Math Forum

Search All of the Math Forum:

Views expressed in these public forums are not endorsed by NCTM or The Math Forum.

Math Forum » Discussions » Software » comp.soft-sys.matlab

Notice: We are no longer accepting new posts, but the forums will continue to be readable.

Topic: spmd overhead and sharing small amounts of data
Replies: 2   Last Post: Dec 20, 2012 10:44 AM

Advanced Search

Back to Topic List Back to Topic List Jump to Tree View Jump to Tree View   Messages: [ Previous | Next ]

Posts: 95
Registered: 2/23/10
spmd overhead and sharing small amounts of data
Posted: Dec 19, 2012 11:49 AM
  Click to see the message monospaced in plain text Plain Text   Click to reply to this topic Reply

I think my processing time is being chewed up by spmd overhead. I have a simulation that looks like this:

for x = 1:N
D = expensiveFunction(D)
<gather small bits from workers>
<fast simple function>
D = expensiveFunction2(D)

<repeat the above basic idea 3-4 times>


Watching my processors, they are seldom above 20% utilization, so it makes me think that I'm suffering from going in and out of spmd and maybe gathering even small pieces of data is a problem. Any alternatives? For one, is there a way to gather directly worker to worker without exiting spmd and bringing it all to the master? The data is small and functions cheap, so maybe I'd be ahead to let everyone do the same computations just to keep things flowing.


Point your RSS reader here for a feed of the latest messages in this topic.

[Privacy Policy] [Terms of Use]

© The Math Forum at NCTM 1994-2018. All Rights Reserved.