Cortex Training models¶
Cortex Training supports a curated set of third-party, open models. Use the canonical model ID (for
example, Qwen/Qwen3-8B) as the model_name when you create a job. Copy a model ID
directly from any card below.
Each card shows whether inference and training are supported. For supported training models, the card summarizes the maximum context length for LoRA (low-rank adaptation) and full-parameter training.
Select View recommended configurations on a card for a copyable Python starting configuration. Select supervised fine-tuning (SFT) or reinforcement learning (RL), then use the Use LoRA checkbox to switch between the complete recommended LoRA and full-parameter profiles. For models with a long-context profile, use the Enable long sequence checkbox to switch from the standard sequence length with sequence parallelism set to 1 to the maximum sequence length with sequence parallelism set to 8. The profiles can differ in job topology and distributed training settings, not only in the PEFT configuration. Tune batch sizes and optimization parameters for your workload.
Note
Model availability and specifications are subject to change during the preview.
Available for training¶
These open weights models support fine-tuning. They also support inference.
Important
Saving and loading LoRA checkpoints for Qwen/Qwen3.6-35B-A3B requires the
prime_rl model provider. LoRA for this mixture-of-experts model currently supports the
attention projections (q_proj, k_proj, v_proj, and o_proj). Routed expert LoRA is
not yet supported. The Hugging Face MLP names gate_proj, up_proj, and down_proj do
not select routed expert parameters in the model implementation used by the prime_rl
provider.
Qwen3 0.6B
Qwen/Qwen3-0.6BQwen3 1.7B
Qwen/Qwen3-1.7BQwen3 8B
Qwen/Qwen3-8BQwen3.5 4B
Qwen/Qwen3.5-4BQwen3.6 35B-A3B
Qwen/Qwen3.6-35B-A3BQwen3.8 27B
Qwen/Qwen3.8-27BInference only¶
These models support inference (sampling) but not fine-tuning.
DeepSeek V4 Flash
deepseek-ai/DeepSeek-V4-Flash-0731GPT-OSS 120B
openai/gpt-oss-120bGLM 5.2
zai-org/GLM-5.2GLM 5.2 FP8
zai-org/GLM-5.2-FP8