Compress a sparse matrix

Hi, I have a matrix with %98 of its elements zero and the rest is integers. I would like to perform lossless compression on it.cI've tried Huffman and Arithmetic coding but I wonder if I can find a compression way better than those. Is there anyone who could give me advise? Thank you.

Michael Dunn