MATLAB Answers

How can I recompile the GPU libraries ?

91 views (last 30 days)
Chanho Park
Chanho Park on 31 Dec 2018
Commented: fei wong on 25 Jun 2019
Hello,
I want to test my machine learning code on GPU environment but it doesn't work.
I constantly getting warnning below
Warning: The CUDA driver must recompile the GPU libraries
because your device is more recent than the libraries.
Recompiling can take several minutes. Learn more.
>In run_MNIST_pinv (line 9)
and continuously another errors erupt
Error using gpuArray/hTimesTranspose
Call to dgemm in CUBLAS failed with error status:
CUBLAS_STATUS_EXECUTION_FAILED.
...
etc
so I want to fix warnning(require recompile the GPU libraries) first to solve these errors
how can I recompile the GPU library
ref. my HW
OS : ubuntu 18.10
CPU : AMD Ryzen Threadripper 2990WX
GPU : NVIDIA Geforce RTX2080 Ti
MATLAB ver : R2018b
I already checked GPU driver version.!
Thanks !

  2 Comments

Matt J
Matt J on 31 Dec 2018
Did you try rebooting?
Chanho Park
Chanho Park on 1 Jan 2019
Yes, I already did, but the messages still rise

Sign in to comment.

Accepted Answer

Joss Knight
Joss Knight on 1 Jan 2019
This is a known issue with CUDA 9.1 and the new Turing generation of GPUs. You don't need to do anything except ignore the initial warning or error.
There are multiple issues. The warning about recompiling of libraries is spurious and not relevant. The error from cublas is one-time only. And there is an equivalent error in cuDNN. A permanent workaround is to put the following into your startup.m file:
warning off parallel:gpu:device:DeviceLibsNeedsRecompiling
try
gpuArray.eye(2)^2;
catch ME
end
try
nnet.internal.cnngpu.reluForward(1);
catch ME
end

  2 Comments

Chanho Park
Chanho Park on 1 Jan 2019
Thanks a lot!
but Error from cuBlas still rises. cublas error isn't one-time only
Is there any way to access 'gpuArray/hTimesTranspose'??
Joss Knight
Joss Knight on 1 Jan 2019
That's annoying for you. In my tests on my Turing card the error is a one-off between each device reset. Perhaps you are resetting the device? You should give me your reproduction code so I can investigate.

Sign in to comment.

More Answers (1)

JIE WANG
JIE WANG on 4 Apr 2019
Hello, Did you solve this problem? I also meet this problem and want to obtain some experience from you.

  2 Comments

Joss Knight
Joss Knight on 4 Apr 2019
This issue is fixed in R2019a.
fei wong
fei wong on 25 Jun 2019
Hello, Did you solve this problem? I also meet this problem, it annoyed me a lot.

Sign in to comment.

Sign in to answer this question.