Cortex Training models¶
Cortex Training supports a curated set of third-party, open models. Use the canonical model ID (for
example, Qwen/Qwen3-8B) as the model_name when you create a job. Copy a model ID
directly from any card below.
Each card shows whether inference and training are supported. For supported training models, the card summarizes the maximum context length for LoRA (low-rank adaptation) and full-parameter training.
Select View recommended configurations on a card for a copyable Python starting configuration. Select supervised fine-tuning (SFT) or reinforcement learning (RL), then use the Use LoRA checkbox to switch between the complete recommended LoRA and full-parameter profiles when both are available. For models with standard and long-context profiles, use the Enable long sequence checkbox to switch between the model’s two context tiers. The profiles can differ in job topology and distributed training settings, not only in the PEFT configuration. Tune batch sizes and optimization parameters for your workload.
Note
Model availability and specifications are subject to change during the preview.
Available for training¶
These open weights models support fine-tuning. They also support inference.
Important
Saving and loading LoRA checkpoints for Qwen/Qwen3.6-35B-A3B requires the
arctic model provider. LoRA for this mixture-of-experts model currently supports the
attention projections (q_proj, k_proj, v_proj, and o_proj). Routed expert LoRA is
not yet supported. The Hugging Face MLP names gate_proj, up_proj, and down_proj do
not select routed expert parameters in the model implementation used by the arctic
provider.
DeepSeek-V4.1-Flash-1017
deepseek-ai/DeepSeek-V4.1-Flash-1017gemma-3-4b-it
google/gemma-3-4b-itgemma-4-31B-it
google/gemma-4-31B-itGLM-5.3-Flash
zai-org/GLM-5.3-FlashGLM-5.3-Flash-BF16
zai-org/GLM-5.3-Flash-BF16Inkling-2-Small-MXFP8
thinkingmachines/Inkling-2-Small-MXFP8medgemma-1.5-4b-it
google/medgemma-1.5-4b-itmedgemma-4b-it
google/medgemma-4b-itNVIDIA-Nemotron-3-Nano-30B-A3B-BF16
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16
nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16Qwen3-0.6B
Qwen/Qwen3-0.6BQwen3-1.7B
Qwen/Qwen3-1.7BQwen3-30B-A3B
Qwen/Qwen3-30B-A3BQwen3-4B-Instruct-2507
Qwen/Qwen3-4B-Instruct-2507Qwen3-8B
Qwen/Qwen3-8BQwen3.5-2B
Qwen/Qwen3.5-2BQwen3.5-4B
Qwen/Qwen3.5-4BQwen3.5-9B
Qwen/Qwen3.5-9BQwen3.6-35B-A3B
Qwen/Qwen3.6-35B-A3BQwen3.8-27B
Qwen/Qwen3.8-27BInference only¶
These models support inference (sampling) but not fine-tuning.
GLM-5.3
zai-org/GLM-5.3gpt-oss-120b
openai/gpt-oss-120b