Technology Sharing

CUDA device unavailable issue in multi-GPU system

2024-07-11

한어Русский языкEnglishFrançaisIndonesianSanskrit日本語DeutschPortuguêsΕλληνικάespañolItalianoSuomalainenLatina

We encountered the problem of CUDA device unavailability when using a multi-GPU system, the details are as follows:

Problem description: We encountered the following error when running a CUDA program on a server equipped with 8 NVIDIA GeForce RTX 3090 graphics cards:

cudaErrorDevicesUnavailable: CUDA-capable device(s) is/are busy or unavailable