Trying to read text file inside parfor loop versus passing it as a parameter

I have a couple txt/csv files that contain upward to 5000 lines. Each line contains information that I intend to read in as input to a function inside parfor loop. Is it best if I read the text files as a matrix/struct/etc. and the parfor loop can access the information from said matrix/struct? Or is it better have the part that read files inside the parfor loop?

[Mohammad Sami]

Does each loop operate on a different file ?

[Giang Le]

Same file! The file basically contains multiple lines. Each line is a set of different parameters/function input.

[Mohammad Sami]

I suggest just load it once before parfor loop. As long as each loop is not modifying the contents, it should be fine.

Answer 1

[Rashed Mohammed]

Hi Giang Le,

Assuming that you are trying to call a function with its parameters read from a file parallelly. However, using IO functions inside parfor loop can be slow. Hence as suggested by Sami, read the data before hand using readmatrix and then pass the content as parameters to function parallelly using parfor.

Hope this helps!