Supported Node Types

When launching new clusters, it is possible to specify the instance types to be used for the head node and for worker nodes launched by the autoscaler. The instance types vary depending on the cloud provider availability and nomenclature.

AWS

In Your AWS Account

Anyscale currently supports all of the instance types offered by AWS. In order to specify any AWS instance type, specify the AWS "instance size" (i.e., the name) as referenced in the AWS documentation. Note that availability of instance types may vary by region (refer to the AWS documentation for more details).

In Anyscale's Managed Service

Anyscale currently supports the following AWS node type.

AWS node type	vCPUs	Memory (GB)	GPU model	GPUs
m5.2xlarge	8	32	N/A	N/A
m5.4xlarge	16	64	N/A	N/A
m5.8xlarge	32	128	N/A	N/A
m5.12xlarge	48	192	N/A	N/A
m5.16xlarge	64	256	N/A	N/A
m5.24xlarge	96	384	N/A	N/A
g3.4xlarge	16	122	NVIDIA Tesla M60	1
g3.8xlarge	32	244	NVIDIA Tesla M60	2
g4dn.2xlarge	8	32	NVIDIA T4	1
g4dn.4xlarge	16	64	NVIDIA T4	1
g4dn.8xlarge	32	128	NVIDIA T4	1
g4dn.12xlarge	48	192	NVIDIA T4	4
p2.8xlarge	32	488	NVIDIA K80	8
p2.16xlarge	64	732	NVIDIA K80	16
p3.2xlarge	8	61	NVIDIA V100 Tensor Core	1
p3.8xlarge	32	244	NVIDIA V100 Tensor Core	4
p3.16xlarge	64	488	NVIDIA V100 Tensor Core	8
p4d.24xlarge	96	1152	NVIDIA A100 Tensor Core	8

GCP

Predefined VMs

Anyscale supports all of the predefined VMs in the following families:

• N2 (general-purpose) (including N2 standard, N2 high-mem and N2 high-cpu)

• C2 (compute-optimized)

• A2 (accelerator-optimized)

Only nodes with 8 vCPUs or more are supported (this means that nodes in the N2 and C2 family should end with -8 or greater.)

In order to specify any VM from the supported CPU families, specify the GCP "machine type" (i.e., the name) as referenced in the GCP documentation.

Custom VMs

Anyscale incorporates some custom VM configurations to add support for additional GPU accelerator types. These can be specified by using the Anyscale node type:

Anyscale node type	GCP base type	vCPUs	Memory (GB)	GPU model	GPUs
n1-highmem-4-nvidia-tesla-v100-1	n1-highmem-4	4	26	nvidia-tesla-v100	1
n1-highmem-8-nvidia-tesla-v100-1	n1-highmem-8	8	52	nvidia-tesla-v100	1
n1-highmem-32-nvidia-tesla-v100-4	n1-highmem-32	32	208	nvidia-tesla-v100	4
n1-highmem-64-nvidia-tesla-v100-8	n1-highmem-64	64	416	nvidia-tesla-v100	8
n1-highmem-96-nvidia-tesla-v100-8	n1-highmem-96	96	624	nvidia-tesla-v100	8
n1-highmem-8-nvidia-tesla-k80-1	n1-highmem-8	8	52	nvidia-tesla-k80	1
n1-highmem-32-nvidia-tesla-k80-8	n1-highmem-32	32	208	nvidia-tesla-k80	8
n1-standard-4-nvidia-tesla-t4-1	n1-standard-4	4	15	nvidia-tesla-t4	1
n1-standard-8-nvidia-tesla-t4-1	n1-standard-8	8	30	nvidia-tesla-t4	1
n1-standard-16-nvidia-tesla-t4-1	n1-standard-16	16	60	nvidia-tesla-t4	1