Sparse matrix memory problem

1 Ansicht (letzte 30 Tage)
Pawel
Pawel am 5 Apr. 2012
I need to create really big sparse matrix, which will have very few non zero elements. I am trying to do this callling function:
A = sparse([1], [1000000000], 1);
But Matlab then allocates 7GB of memory! I think sparse matrices uses memory only for non zero elements, but it seems it allocates full matrix. Am I doing something wrong or this is Matlab bug? How can I bypass it?

Akzeptierte Antwort

Teja Muppirala
Teja Muppirala am 5 Apr. 2012
Sparse matrices keep track of data by each column. This means that if you have a lot of columns (here you have one billion of them...), then you will need lots of memory even though it is sparse. A workaround would be to make it a single column vector with 1e9 rows instead.
A = sparse(1000000000, 1, 1);

Weitere Antworten (1)

Pawel
Pawel am 5 Apr. 2012
I am wondering why is that. When you have sparse data like features extracted from web pages common case is: in rows you have samples and columns are sparse features. All statistics algorithms in Matlab makes such assumption. So with this implementation of sparse matrix all algorithms from statistics toolbox are useless for sparse data :/

Kategorien

Mehr zu Sparse Matrices finden Sie in Help Center und File Exchange

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by