Snowpark Container Services: AWS Instance Families¶

Instance families are grouped as current generation or previous generation. AWS instance families are available in three types:

General Compute (GEN): Best price-performance for general-purpose containerized workloads.
High Memory (MEM): High memory-to-vCPU ratio for applications that require large amounts of RAM, such as CPU-based model serving, large-scale in-memory data processing, and vector index serving.
GPU Accelerated (GPU): For machine learning training, inference, and AI workloads requiring GPU acceleration.

For pricing information, see the Snowflake Service Consumption Table.

Note

Region availability is subject to change. To retrieve current availability and instance family specifications programmatically, use SHOW COMPUTE POOL INSTANCE FAMILIES.

Current Generation Instance Families¶

General Compute Instance Families (Current Generation)¶

Current generation x86 instances offering the best price-performance for general-purpose workloads.


Instance Family	vCPU	Memory (GiB)	Storage (GB)	Bandwidth limit (Gbps)	Node limit	Region Availability
GEN_X64_G2_2	1	6	100	12.5	150	Not available in af-south-1, cn-northwest-1
GEN_X64_G2_4	3	13	100	12.5	150	Not available in af-south-1, cn-northwest-1
GEN_X64_G2_8	6	28	100	12.5	150	Not available in af-south-1, cn-northwest-1
GEN_X64_G2_32	28	116	100	12.5	150	Not available in af-south-1, cn-northwest-1

High Memory Instance Families (Current Generation)¶

Current generation x86 instances optimized for memory-intensive workloads.


Instance Family	vCPU	Memory (GiB)	Storage (GB)	Bandwidth limit (Gbps)	Node limit	Region Availability
MEM_X64_G2_8	6	58	100	12.5	150	Not available in af-south-1, cn-northwest-1, eu-central-2, me-central-1
MEM_X64_G2_32	28	240	100	12.5	150	Not available in af-south-1, cn-northwest-1, eu-central-2, me-central-1
MEM_X64_G2_64	60	492	100	25.0	150	Not available in af-south-1, cn-northwest-1, eu-central-2, me-central-1
MEM_X64_G2_192	188	1436	100	50.0	150	Not available in af-south-1, cn-northwest-1, eu-central-2, me-central-1

GPU Accelerated Instance Families (Current Generation)¶

AWS GPU instance families feature four NVIDIA GPU architectures, each suited to different AI and ML workloads.

NVIDIA A10G¶

Mid-range Ampere GPU for ML model development and inference on small to medium models.


Instance Family	vCPU	Memory (GiB)	Storage (GB)	Bandwidth limit (Gbps)	GPU	GPU Memory per GPU (GB)	Node limit	Region Availability
GPU_NV_S	6	28	450	10.0	1 NVIDIA A10G	24	150	Not available in ap-southeast-1, eu-central-2, eu-west-3, ap-northeast-3
GPU_NV_M	44	178	3800	40.0	4 NVIDIA A10G	96	10	Not available in Gov Regions, ap-southeast-1, eu-central-2, eu-west-3, ap-northeast-3

NVIDIA A100¶

High-throughput Ampere GPU for large-scale model training and large dataset processing.


Instance Family	vCPU	Memory (GiB)	Storage (GB)	Bandwidth limit (Gbps)	GPU	GPU Memory per GPU (GB)	Node limit	Region Availability
GPU_NV_L	92	1112	100	400.0	8 NVIDIA A100	320	On Request	Available only in AWS US West and US East non-gov regions; limited availability in other regions upon request

NVIDIA L40S¶

Ada Lovelace GPU optimized for GenAI inference and fine-tuning.


Instance Family	vCPU	Memory (GiB)	Storage (GB)	Bandwidth limit (Gbps)	GPU	GPU Memory per GPU (GB)	Node limit	Region Availability
GPU_L40S_G1_8	6	58	450	25.0	1 NVIDIA L40S	48	5	Only available in us-east-1, us-east-2, us-west-2, eu-central-1, eu-north-1, ap-northeast-1, ap-northeast-2
GPU_L40S_G1_16	14	116	600	25.0	1 NVIDIA L40S	48	5	Only available in us-east-1, us-east-2, us-west-2, eu-central-1, eu-north-1, ap-northeast-1, ap-northeast-2
GPU_L40S_G1_48	44	368	3800	100.0	4 NVIDIA L40S	192	On Request	Only available in us-east-1, us-east-2, us-west-2, eu-central-1, eu-north-1, ap-northeast-1, ap-northeast-2
GPU_L40S_G1_192	188	1436	3800	400.0	8 NVIDIA L40S	384	On Request	Only available in us-east-1, us-east-2, us-west-2, eu-central-1, eu-north-1, ap-northeast-1, ap-northeast-2

NVIDIA RTX PRO 6000¶

Blackwell GPU with 96GB VRAM per GPU for large-scale inference and data-intensive workloads.


Instance Family	vCPU	Memory (GiB)	Storage (GB)	Bandwidth limit (Gbps)	GPU	GPU Memory per GPU (GB)	Node limit	Region Availability
GPU_R6K_G1_8	6	58	1900	50.0	1 NVIDIA RTX PRO 6000	96	5	Only available in us-west-2, us-east-1, us-east-2, ap-northeast-1
GPU_R6K_G1_16	14	116	1900	50.0	1 NVIDIA RTX PRO 6000	96	5	Only available in us-west-2, us-east-1, us-east-2, ap-northeast-1
GPU_R6K_G1_32	28	240	1900	100.0	1 NVIDIA RTX PRO 6000	96	5	Only available in us-west-2, us-east-1, us-east-2, ap-northeast-1
GPU_R6K_G1_48	44	490	3800	400.0	2 NVIDIA RTX PRO 6000	192	On Request	Only available in us-west-2, us-east-1, us-east-2, ap-northeast-1
GPU_R6K_G1_96	92	984	7600	800.0	4 NVIDIA RTX PRO 6000	384	On Request	Only available in us-west-2, us-east-1, us-east-2, ap-northeast-1
GPU_R6K_G1_192	188	1843	11400	1600.0	8 NVIDIA RTX PRO 6000	768	On Request	Only available in us-west-2, us-east-1, us-east-2, ap-northeast-1

Previous Generation Instance Families¶

General Compute Instance Families (Previous Generation)¶

Previous generation x86 instances. For new workloads, use GEN_X64_G2 instances instead.


Instance Family	vCPU	Memory (GiB)	Storage (GB)	Bandwidth limit (Gbps)	Node limit	Region Availability
CPU_X64_XS	1	6	100	12.5	500	Available everywhere
CPU_X64_S	3	13	100	12.5	500	Available everywhere
CPU_X64_M	6	28	100	12.5	500	Available everywhere
CPU_X64_SL	14	58	100	12.5	500	Not available in China
CPU_X64_L	28	116	100	12.5	500	Available everywhere

High Memory Instance Families (Previous Generation)¶

Previous generation x86 instances optimized for memory. For new workloads, use MEM_X64_G2 instances instead.


Instance Family	vCPU	Memory (GiB)	Storage (GB)	Bandwidth limit (Gbps)	Node limit	Region Availability
HIGHMEM_X64_S	6	58	100	12.5	500	Available everywhere
HIGHMEM_X64_M	28	240	100	12.5	500	Available everywhere
HIGHMEM_X64_L	124	984	100	50.0	500	Available everywhere