Outspan
Posts:
18
Registered:
7/14/09
|
|
Re: Problem with memory usage (R2009a)
Posted:
Oct 21, 2009 6:57 AM
|
|
On Oct 21, 10:52 am, "Sebastiaan "
<s.breedv...@erasmusmc.REMOVE.BOO.BOO.nl> wrote:
> Outspan <borghibor...@gmail.com> wrote in message <d003bdee-a668-4702-9486-b367d1625...@m11g2000vbl.googlegroups.com>...
> > On Oct 20, 1:53?pm, "Bruno Luong" <b.lu...@fogale.findmycountry>
> > wrote:
> > > Outspan <borghibor...@gmail.com> wrote in message <32cf3331-9441-4f73-9b6f-f29d3fbf6...@s6g2000vbp.googlegroups.com>...
> > > > Hi all,
>
> > > >... ?I also use up 300MB of
> > > > memory, and I don't understand why.
>
> > > Because of the REPMAT instruction.
>
> > > > bars = struct('date', [], 'time', [], 'open', [], 'high', [], 'low',
> > > > [], 'close', [], 'volume', []);
> > > > bars = repmat(bars, [1 500000]);
>
> > I wrote earlier that I had 50K lines, but I really have 500K (so the
> > parameters in repmat are correct). Is there a way to do this and use
> > less memory? How come the .mat file is only 10MB but the script is
> > using this much memory?
>
> The .MAT files are compressed, while in memory, the data is raw (decompressed).
>
> About the memory usage after loading the MAT file: what is the output of your 'whos' for the relevant matrix?
>
> Sebastiaan
>> whos
Name Size Bytes Class Attributes
eurusd 1x500000 238000448 struct
but the fields in the struct are 7 doubles, which should put the total
uncompressed size to roughly
>> 500000*7*8
ans =
28000000
and also,
>> a = eurusd(1); whos
Name Size Bytes Class Attributes
a 1x1 924
struct
eurusd 1x500000 238000448 struct
even though every single field of the struct is only 8 bytes in size.
I hope that in its internal representation it's not replicating the
field names 500K times...
|
|
