Snowpark Container Services: Google Cloud Instance Families¶
Instance families are grouped as current generation or previous generation. Google Cloud instance families are available in three types:
- General Compute (GEN): Recommended for general-purpose containerized workloads.
- High Memory (MEM): High memory-to-vCPU ratio for applications that require large amounts of RAM, such as CPU-based model serving, large-scale in-memory data processing, and vector index serving.
- GPU Accelerated (GPU): For machine learning training, inference, and AI workloads requiring GPU acceleration.
For pricing information, see the Snowflake Service Consumption Table.
Note
Region availability is subject to change. To retrieve current availability and instance family specifications programmatically, use SHOW COMPUTE POOL INSTANCE FAMILIES.
Current Generation Instance Families¶
General Compute Instance Families¶
Current generation instances recommended for general-purpose workloads.
x86 General Compute¶
Current generation x86 instances for general-purpose workloads.
| Instance Family | vCPU | Memory (GiB) | Storage (GB) | Bandwidth limit (Gbps) | Node limit | Region Availability |
|---|---|---|---|---|---|---|
| CPU_X64_XS | 1 | 6 | 100 | 10.0 | 500 | Available everywhere |
| CPU_X64_S | 3 | 13 | 100 | 10.0 | 500 | Available everywhere |
| CPU_X64_M | 6 | 28 | 100 | 16.0 | 500 | Available everywhere |
| CPU_X64_SL | 14 | 58 | 100 | 32.0 | 500 | Available everywhere |
| CPU_X64_L | 28 | 116 | 100 | 32.0 | 500 | Available everywhere |
ARM general compute¶
Current generation ARM instances for general-purpose workloads.
| Instance family | vCPU | Memory (GiB) | Storage (GB) | Bandwidth limit (Gbps) | Node limit | Region availability |
|---|---|---|---|---|---|---|
| GEN_ARM_G1_2 | 1 | 6 | 100 | 10.0 | 150 | Available everywhere |
| GEN_ARM_G1_4 | 3 | 13 | 100 | 23.0 | 150 | Available everywhere |
| GEN_ARM_G1_8 | 6 | 28 | 100 | 23.0 | 150 | Available everywhere |
| GEN_ARM_G1_16 | 14 | 58 | 100 | 23.0 | 150 | Available everywhere |
| GEN_ARM_G1_32 | 28 | 116 | 100 | 23.0 | 150 | Available everywhere |
Note
ARM instances require container images built for the linux/arm64 platform.
x86 instances require linux/amd64. For multi-architecture deployments, use
multi-platform container images.
GEN_ARM_G1 can’t be a backup instance family for x86 compute pools.
High Memory Instance Families¶
Current generation x86 instances optimized for memory-intensive workloads.
| Instance Family | vCPU | Memory (GiB) | Storage (GB) | Bandwidth limit (Gbps) | Node limit | Region Availability |
|---|---|---|---|---|---|---|
| HIGHMEM_X64_S | 6 | 58 | 100 | 16.0 | 500 | Available everywhere |
| HIGHMEM_X64_M | 28 | 240 | 100 | 32.0 | 500 | Available everywhere |
| HIGHMEM_X64_SL | 92 | 654 | 100 | 67.0 | 500 | Not available in me-central2 |
GPU Accelerated Instance Families¶
Google Cloud GPU instance families feature two NVIDIA GPU architectures, each suited to different AI and ML workloads.
NVIDIA L4¶
Ada Lovelace GPU for efficient AI inference and media workloads.
| Instance Family | vCPU | Memory (GiB) | NVMe Storage (GB) | Bandwidth limit (Gbps) | GPU | GPU Memory per Instance (GB) | Node limit | Region Availability |
|---|---|---|---|---|---|---|---|---|
| GPU_GCP_NV_L4_1_24G | 6 | 28 | 100 | 16.0 | 1 NVIDIA L4 | 24 | 10 | Available everywhere |
| GPU_GCP_NV_L4_4_24G | 44 | 178 | 100 | 50.0 | 4 NVIDIA L4 | 24 | 10 | Available everywhere |
NVIDIA A100¶
High-throughput Ampere GPU for large-scale model training and large dataset processing.
| Instance Family | vCPU | Memory (GiB) | NVMe Storage (GB) | Bandwidth limit (Gbps) | GPU | GPU Memory per Instance (GB) | Node limit | Region Availability |
|---|---|---|---|---|---|---|---|---|
| GPU_A100_G1_12 | 10 | 77 | 100 | 10.0 | 1 NVIDIA A100 | 40 | On Request | Only available in us-central1 and europe-west4 |
| GPU_A100_G1_48 | 44 | 324 | 100 | 50.0 | 4 NVIDIA A100 | 160 | On Request | Only available in us-central1 and europe-west4 |
| GPU_GCP_NV_A100_8_40G | 92 | 654 | 100 | 100.0 | 8 NVIDIA A100 | 320 | On Request | Only available in us-central1 and europe-west4 |
Previous Generation Instance Families¶
General compute instance families¶
Previous generation x86 instances. For new workloads, use CPU_X64 instances instead.
GEN_X64_G1 and CPU_X64 instance families can’t be backup instance families for each other because they use incompatible block storage volume types. To use GEN_X64_G1, create a new compute pool with a GEN_X64_G1 instance family and deploy your services to that pool. For more information, see Backup instance types.
| Instance family | vCPU | Memory (GiB) | Storage (GB) | Bandwidth limit (Gbps) | Node limit | Region availability |
|---|---|---|---|---|---|---|
| GEN_X64_G1_2 | 1 | 6 | 100 | 10.0 | 150 | Available everywhere |
| GEN_X64_G1_4 | 3 | 13 | 100 | 10.0 | 150 | Available everywhere |
| GEN_X64_G1_8 | 6 | 28 | 100 | 16.0 | 150 | Available everywhere |
| GEN_X64_G1_16 | 14 | 58 | 100 | 32.0 | 150 | Available everywhere |
| GEN_X64_G1_32 | 28 | 116 | 100 | 32.0 | 150 | Available everywhere |