Live data from Hacker News

CUDA 11.0

docs.nvidia.com

1–10 of 67 posts

Re: CUDA 11.0

#2
> Added support for Ubuntu 20.04 LTS on x86_64 platforms.

Huh? I've been using CUDA for a while now on my Ubuntu 20.04 machine

Re: CUDA 11.0

#3
I noticed CUDA 11.0 was almost ready for release last week when I went to install CUDA and the default download page linked to the 11.0 Release Candidate. The 10.1 and 10.2 links were buried behind a link off to the side labeled "legacy". The thing is, no library you use is going to be supporting the CUDA 11.0 RC, that's ridiculous. For example, Pytorch stable is on 10.2 and Tensorflow only goes up to 10.1.

This is generally indicative of how poorly organized the CUDA documentation and installation instructions are. The Conda dependency manager has made this a lot easier recently. Especially by, e.g., providing pytorch binaries. Though if you want to use packages like NVIDIA Apex for mixed precision DL[0] you're going to be in for a huge headache trying to compile torch from source while also managing your cuda and nvcc version, which sometimes must be the same but sometimes can not be![1]

[0] Yes, I'm aware that Apex was very recently brought into torch but it seems that the performance issues haven't been ironed out yet.

[1] https://stackoverflow.com/questions/53422407/different-cuda-...

Re: CUDA 11.0

#4
post #2

> Added support for Ubuntu 20.04 LTS on x86_64 platforms. Huh? I've been using CUDA for a while now on my Ubuntu 20.04 machine

Coincidentally I was just looking at this after upgrading from 19.10 to 20.04 today -- basically, the version installed from Nvidia's old 18.04 repos work fine on 20.04.

Re: CUDA 11.0

#5
post #2

> Added support for Ubuntu 20.04 LTS on x86_64 platforms. Huh? I've been using CUDA for a while now on my Ubuntu 20.04 machine

That probably just means that they are testing that they are testing that platform in CI now, and are officially supporting it (taking bug reports into account, etc.).

Re: CUDA 11.0

#6
post #3

I noticed CUDA 11.0 was almost ready for release last week when I went to install CUDA and the default download page linked to the 11.0 Release Candidate. The 10.1 and 10.2 links were buried behind a link off to the side labeled "legacy". The thing is, no library you use is going to be supporting the CUDA 11.0 RC, that's ridiculous. For example, Pytorch stable is on 10.2 and Tensorflow only goes up to 10.1. This is g…

Yeah. To make the matter worse, they have updated libnccl-dev from their apt repo to be CUDA-11 based a few weeks ago. That breaks my CUDA app (because it is still on 10.2 and not compatible) in interesting ways. apt-hold libnccl-dev for a while and waiting for this release.

Re: CUDA 11.0

#7
Interesting that Fedora support seems to have been dropped. Anyone know why that might be?

Edit: oh wait I think I see. Latest supported gcc for CUDA 11 is gcc 9.x, but I think latest Fedora is on gcc 10.

Re: CUDA 11.0

#8
>cuFFT now accepts __nv_bfloat16 input and output data type for power-of-two sizes with single precision computations within the kernels.

This exact sentence is listed both under "New Feature" and "Known Issues". I'm not super familiar with CUDA stuff, but, it can't be both right?

Re: CUDA 11.0

#9
post #8

>cuFFT now accepts __nv_bfloat16 input and output data type for power-of-two sizes with single precision computations within the kernels. This exact sentence is listed both under "New Feature" and "Known Issues". I'm not super familiar with CUDA stuff, but, it can't be both right?

Looks like a mistake, should only be in New Features.

Re: CUDA 11.0

#10
post #7

Interesting that Fedora support seems to have been dropped. Anyone know why that might be? Edit: oh wait I think I see. Latest supported gcc for CUDA 11 is gcc 9.x, but I think latest Fedora is on gcc 10.

I'm guessing it was an oversight in the table given they still have all the fedora installation instructions on the install page:

https://docs.nvidia.com/cuda/cuda-installation-guide-linux/i...

Post reply on HN