cuda 官网
.run 文件直接sh运行,切记 不要安装驱动
sample 、 demo 、document 也可以不装。
安装完后配置环境:
sudo gedit ~/.bashrc export PATH=/usr/local/cuda-11.3/bin:$PATH export LD_LIBRARY_PATH=/usr/local/cuda-11.3/lib64:$LD_LIBRARY_PATH source ~/.bashrc
验证
nvcc -V
cudann 官网
(1)将cuda/include/cudnn.h文件复制到usr/local/cuda/include文件夹,将cuda/lib64/下所有文件复制到/usr/local/cuda/lib64文件夹中,并添加读取权限:
sudo cp cuda/include/cudnn.h /usr/local/cuda/include sudo cp cuda/lib64/libcudnn* /usr/local/cuda/lib64
然后更改权限
sudo chmod a+r /usr/local/cuda/include/cudnn.h /usr/local/cuda/lib64/libcudnn*
接下来安装Deb包,
cuDNN Runtime Library for Ubuntu18.04(Deb),
cuDNN Developer Library for Ubuntu18.04(Deb),
cuDNN Code Samples and User Guide for Ubuntu18.04(Deb)
sudo dpkg -i libcudnn8_8.0.5.39-1+cuda11.0_amd64.deb sudo dpkg -i libcudnn8-dev_8.0.5.39-1+cuda11.0_amd64.deb sudo dpkg -i libcudnn8-samples_8.0.5.39-1+cuda11.0_amd64.deb
安装deb时, 可能会报错如下:
/sbin/ldconfig.real: /usr/local/cuda-11.3/targets/x86_64-linux/lib/libcudnn_cnn_train.so.8 is not a symbolic link /sbin/ldconfig.real: /usr/local/cuda-11.3/targets/x86_64-linux/lib/libcudnn_cnn_infer.so.8 is not a symbolic link /sbin/ldconfig.real: /usr/local/cuda-11.3/targets/x86_64-linux/lib/libcudnn_adv_infer.so.8 is not a symbolic link /sbin/ldconfig.real: /usr/local/cuda-11.3/targets/x86_64-linux/lib/libcudnn_adv_train.so.8 is not a symbolic link /sbin/ldconfig.real: /usr/local/cuda-11.3/targets/x86_64-linux/lib/libcudnn_ops_infer.so.8 is not a symbolic link /sbin/ldconfig.real: /usr/local/cuda-11.3/targets/x86_64-linux/lib/libcudnn_ops_train.so.8 is not a symbolic link /sbin/ldconfig.real: /usr/local/cuda-11.3/targets/x86_64-linux/lib/libcudnn.so.8 is not a symbolic link
解决,创建链接:
切记 cuda 版本 和 cudann 版本要对应,比如这里cuda 11.3 , cudnn 为8.2.1, 具体根据自己安装的情况,不要Ctrl+C && Ctrl+V
sudo ln -sf /usr/local/cuda-11.3/targets/x86_64-linux/lib/libcudnn_adv_train.so.8.2.1 /usr/local/cuda-11.3/targets/x86_64-linux/lib/libcudnn_adv_train.so.8 sudo ln -sf /usr/local/cuda-11.3/targets/x86_64-linux/lib/libcudnn_ops_infer.so.8.2.1 /usr/local/cuda-11.3/targets/x86_64-linux/lib/libcudnn_ops_infer.so.8 sudo ln -sf /usr/local/cuda-11.3/targets/x86_64-linux/lib/libcudnn_cnn_train.so.8.2.1 /usr/local/cuda-11.3/targets/x86_64-linux/lib/libcudnn_cnn_train.so.8 sudo ln -sf /usr/local/cuda-11.3/targets/x86_64-linux/lib/libcudnn_adv_infer.so.8.2.1 /usr/local/cuda-11.3/targets/x86_64-linux/lib/libcudnn_adv_infer.so.8 sudo ln -sf /usr/local/cuda-11.3/targets/x86_64-linux/lib/libcudnn_ops_train.so.8.2.1 /usr/local/cuda-11.3/targets/x86_64-linux/lib/libcudnn_ops_train.so.8 sudo ln -sf /usr/local/cuda-11.3/targets/x86_64-linux/lib/libcudnn_cnn_infer.so.8.2.1 /usr/local/cuda-11.3/targets/x86_64-linux/lib/libcudnn_cnn_infer.so.8 sudo ln -sf /usr/local/cuda-11.3/targets/x86_64-linux/lib/libcudnn.so.8.2.1 /usr/local/cuda-11.3/targets/x86_64-linux/lib/libcudnn.so.8
测试是否安装成功,分别输入以下四个命令:
cp -r /usr/src/cudnn_samples_v8/ ~
cd ~/cudnn_samples_v8/mnistCUDNN/
make clean && make
./mnistCUDNN
tensorrt官网
1、激活虚拟环境
conda activate ××× tar xzvf TensorRT-8.××××.tar
#解压得到TensorRT-8.××××的文件夹,将里边的lib绝对路径添加到环境变量中
export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/home/用户名/TensorRT-8.××××/lib
2 、装TensorRT
cd TensorRT-8.××/python pip install tensorrt-8.××.whl
注意:使用ls看一下目录下文件,如果你是python3.7环境,对应选择cp37版本,下面也一样,如果只有单一文件,那就选那个;
3、安装UFF
cd TensorRT-8.××/uff pip install uff-××××.whl
4、安装graphsurgeon
cd TensorRT-6.××/graphsurgeon pip install graphsurgeon-××××.whl
5. 测试
python
import tensorrt
cd ~/TensorRT-8.0.3.4/samples/sampleMNIST make cd ../../bin/ ./sample_mnist
可能遇到的问题:
报 what() driver Error : 更新 NVIDIA 显卡驱动 与 显卡匹配。
pytorch 安装https://pytorch.org/
在conda 环境中安装torch需要用以下命令,安装 pytorch==1.10.0 版本,否则有可能装的版本不对,导致无法使用 GPU。
# CUDA 11.3 conda install pytorch==1.10.0 torchvision==0.11.0 torchaudio==0.10.0 cudatoolkit=11.3 -c pytorch -c conda-forge CUDA 11.1 pip install torch==1.9.0+cu111 torchvision==0.10.0+cu111 torchaudio==0.9.0 -f https://download.pytorch.org/whl/torch_stable.html
测试: torch.cuda.is_available() 返回 true ,返回false说明有问题。



