how to read 2gb txt?

how to read 2gb txt?

The txt file has four columns, n rows (very many rows), all of which are pure numbers.The content of the file is on the photo.

Answer 1

[Rahul]

Hi @fang yu,

I understand that you wish to read a large txt file with four columns and many rows in MATLAB.

A possible way to approach this can be to read the required data in smaller chunks. Functions like 'datastore' or 'mapreduce' can help to read the data in smaller chunks. It is also mentioned in the following answer with a similar question:

https://www.mathworks.com/matlabcentral/answers/274076-loading-very-large-csv-files-20gb

You can also refer to this answer which also mentions reading the data sequentially using the 'fgetl'

function: https://www.mathworks.com/matlabcentral/answers/2133681-big-csv-file-read-in-matlab

You can refer to the following MathWorks documentations to know more about these functions:

'datastore': https://www.mathworks.com/help/releases/R2021a/matlab/ref/datastore.html

'mapreduce': https://www.mathworks.com/help/releases/R2021a/matlab/ref/mapreduce.html

'fgetl': https://www.mathworks.com/help/releases/R2024a/matlab/ref/fgetl.html

Hope this helps! Thanks.