More on memory usage problems

[Nose Nada]

Hello there again!

I have other problems with memory usage in Octave that I didn't comment in my previous post ("Memory usage problems", 8/8/2008 at 1:20 am).
All start with a tab delimited .txt datafile of 25MB. When I use 'xlsread' to extract the numeric and the string data from this file and save it in a new binary file, it takes a long time because my 3GB of RAM are consumed and around 300MB of swap are used. Still, after 2 hours I have a binary file containing the numeric and the string data output by "xlsread". The resulting binary file has 280MB and it is the input of the "load" I described in my previous post. I get rid of "xlsread" and used fread instead, but the problem persists.
Why is the resulting binary 10 times bigger than the original .txt?
Why the use of RAM far exceeds the size of the data file I'm dealing with?

I'm stuck here. This issue don't allow me to go ahead with my work. I would appreciate to have some feedback.

Best regards,

Omar

[John W. Eaton]

On  8-Aug-2008, Nose Nada wrote:

| I have other problems with memory usage in Octave that I didn't comment in
| my previous post ("Memory usage problems", 8/8/2008 at 1:20 am).
| All start with a tab delimited .txt datafile of 25MB. When I use 'xlsread'
| to extract the numeric and the string data from this file and save it in a
| new binary file, it takes a long time because my 3GB of RAM are consumed and
| around 300MB of swap are used. Still, after 2 hours I have a binary file
| containing the numeric and the string data output by "xlsread". The
| resulting binary file has 280MB and it is the input of the "load" I
| described in my previous post. I get rid of "xlsread" and used fread
| instead, but the problem persists.
| Why is the resulting binary 10 times bigger than the original .txt?
| Why the use of RAM far exceeds the size of the data file I'm dealing with?

I think your description is too vague.  What do you mean by "save it
in a binary file"?  What format?  Precisely what is the original
format of your file?  Precisely how are you trying to read it?

| I'm stuck here. This issue don't allow me to go ahead with my work. I would
| appreciate to have some feedback.

Please remember that everyone on this list is an Octave user just like
you, and volunteers their time to help answer questions.

jwe
_______________________________________________
Help-octave mailing list
Help-octave@...
https://www.cae.wisc.edu/mailman/listinfo/help-octave