Skip to content

Commit 3e157e0

Browse files
committed
Update fair GPU allocation information
1 parent 1e66872 commit 3e157e0

File tree

1 file changed

+15
-0
lines changed

1 file changed

+15
-0
lines changed

docs/slurm/gpus.md

+15
Original file line numberDiff line numberDiff line change
@@ -36,6 +36,21 @@ default job QoS:
3636
#SBATCH --gres=gpu:<type>:<number_of_gpus>
3737
```
3838

39+
### Requesting CPU and memory resources with GPUs
40+
41+
To ensure fair GPU allocations a restriction on the CPU and memory resources that can be requested per GPU is implemented.
42+
43+
In the past, we observed that GPU resources were often left unused because some jobs requested disproportionately large amounts of CPU or memory per GPU. To address this issue, we have implemented a restriction on the CPU and memory resources that can be requested per GPU:
44+
45+
| Type | CPUs per GPU | Memory per GPU |
46+
| ---- | -------------| -------------- |
47+
| Nvidia GTX 1080 Ti | 3 | 30GB |
48+
| Nvidia RTX 3090 | 4 | 60GB |
49+
| Nvidia RTX 4090 | 16 | 90GB |
50+
| Nvidia P100 | 3 | 30GB |
51+
| Nvidia A100 | 20 | 80GB |
52+
53+
If you submit a GPU job that requests more resources than are available per GPU, your job will be rejected. If your job requires more CPU and memory resources, you may choose to allocate additional GPUs even if these additional GPUs remain unused by your application.
3954

4055
## QoS `job_gpu_preemptable`
4156

0 commit comments

Comments
 (0)