hdfread, NFS, and I/O Performance

2 Ansichten (letzte 30 Tage)
millercommamatt
millercommamatt am 18 Jul. 2014
I'm encountering a vexing performance issue.
I have a script that uses the hdfread command to get variables from HDF files stored on a remote directory mounted in Windows via NFS. I wrote a benchmarking script that's telling me that when I try to read data from the network mounted directory, it's taking about 196 seconds per file. If I copy those file to a local directory and point the hdfread command at that directory, it's taking 3 seconds per file.
Here's were things get interesting. Copying and pasting the files in Windows sees them all copied in only a second or two per file. I used the copyfile command to copy the files from the remote directory to a local folder. The per file copy time is 2 seconds per file. It would seem that network I/O doesn't explain the extreme slowness.
Is there something about the hdfread command or its subfunctions that can explain this behavior? Is there some quirk about network file systems at play that I'm not aware of?

Antworten (0)

Kategorien

Mehr zu Startup and Shutdown finden Sie in Help Center und File Exchange

Produkte

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by