Search All of the Math Forum:
Views expressed in these public forums are not endorsed by
Drexel University or The Math Forum.
|
|
|
|
Re: PCT output data transfer
Posted:
Jun 25, 2014 3:30 AM
|
|
"Sujit Das" <SujitRDas@gmail.com> writes:
> Interesting. Yes, we are using PARFOR in our application. The size of
> result set that each worker (Linux) needs to return to client (Wintel
> or Linux) could be as large as 1 to 2 GB. How does the worker return
> this result set (which are in-memory Matlab variables) to client? Is
> the transfer taking place directly from worker memory to client memory
> (RMI??) without ever hitting the file or disk I/O unlike what happens
> in the batch jobs?
Yes, when results are returned from a PARFOR loop, a type of RMI is used
to transfer the data from the workers back to the client, no on-disk
storage is used. However, note that there is some overhead to doing this
- the MATLAB data needs to be turned into a serialized form for
transmission - this is part of the same process that happens when
variables are saved to disk, so if for example you were transmitting an
object with a very slow SAVEOBJ, then you'd see that slowness.
Cheers,
Edric.
|
|
|
|
