Skip to main content

Deploy GPU VMs using Terraform

Manage GPU VMs using nodeshift_bucket resource:

resource "nodeshift_gpu" "example" {
gpu_name = "RTX 3090"
image = "ubuntu:latest"
ssh_key = "ssh-rsa ..."
disk_size_gb = 30
gpu_count = 1
region = "Europe"
min_cuda_version = "12.4"
}

Parameters​

Use allowed values

Please note that some parameters only accept specific values. For example, gpu_name must be one of the available GPU models listed below, and region must be one of the available regions. Even after that - rental result is the subject of availability in the selected region and GPU model.

Required​

  • gpu_name (Enum) Name of the GPU to be used in deployment. See the list below for available GPU models.
  • image (String) Image used to run your Docker container name:version
  • ssh_key (String) SSH key to add to the target GPU to make it possible to connect to your deployment
  • disk_size_gb (Number) Size of the disk in GB to be allocated for your deployment.

Optional​

  • gpu_count (Number) Number of GPU instances for your deployment. If not provided it defaults to 1.
  • region (Enum) Region where you want to deploy your GPU. If not provided - the cheapest possible region will be applied. Please refer to the list below for available regions.
  • min_cuda_version (String) Minimum CUDA version to be installed on the GPU. Semver format supported. This is useful for ensuring compatibility with specific software requirements.

Read-Only​

  • uuid (String) String UUID of the GPU, computed

Available list of regions to use in region:​

List of available regions
Region Name
Northern America
Central America
South America
Europe
Asia
Africa
Oceania
Caribbean

Available list of gpus to use in gpu_name:​

List of available GPU models
GPU Model Name
H200
H100 SXM
H100 PCIE
H100 NVL
A100X
A100 SXM4
A100 PCIE
RTX 5090
RTX 5080
RTX 4090
RTX 4080
Titan Xp
Titan V
Tesla V100
Tesla T4
Tesla P40
RTX A6000
RTX A5000
RTX A4000
RTX A2000
RTX 6000Ada
RTX 5070 Ti
RTX 5070
RTX 5000Ada
RTX 4080S
RTX 4070 Ti
RTX 4070S Ti
RTX 4070S
RTX 4070
RTX 4060 Ti
RTX 4060
RTX 4000Ada
RTX 3090 Ti
RTX 3090
RTX 3080 Ti
RTX 3080
RTX 3070 Ti
RTX 3070
RTX 3060 Ti
RTX 3060
RTX 3050
RTX 2080 Ti
Quadro K2200
Q RTX 8000
Q RTX 6000
L40S
L40
L4
GTX TITAN X
GTX 1660 Ti
GTX 1660 S
GTX 1080 Ti
GTX 1080
GTX 1070 Ti
GTX 1070
GTX 1050 Ti
A40
A10
H100
RTX 8000
A2