Migrate from LLaMA-Factory to Soup CLI

Switching from LLaMA-Factory to Soup CLI takes one command. Soup CLI offers a simpler YAML schema, 2–5× faster training via Unsloth, and a unified CLI for training, serving, and export.

One-line migration

bash
soup migrate --from llamafactory path/to/your/llamafactory_config.yaml

This produces a soup.yaml file equivalent to your LLaMA-Factory config, mapping:

LLaMA-FactorySoup CLI
model_name_or_pathbase.model
stage: sfttask: sft
finetuning_type: loratraining.lora.enabled: true
lora_ranktraining.lora.r
lora_alphatraining.lora.alpha
per_device_train_batch_sizetraining.batch_size
templatedata.template

Side-by-side example

LLaMA-Factory config:

yaml
model_name_or_path: meta-llama/Llama-3.1-8B-Instruct
stage: sft
do_train: true
finetuning_type: lora
lora_rank: 16
lora_alpha: 32
dataset: alpaca_en
template: llama3
cutoff_len: 2048
per_device_train_batch_size: 2
gradient_accumulation_steps: 8
learning_rate: 2.0e-4
num_train_epochs: 3

Soup CLI equivalent:

yaml
base:
  model: meta-llama/Llama-3.1-8B-Instruct

task: sft

data:
  train: alpaca_en
  format: alpaca

training:
  backend: unsloth
  epochs: 3
  learning_rate: 2.0e-4
  batch_size: 2
  gradient_accumulation_steps: 8
  max_seq_length: 2048
  lora:
    enabled: true
    r: 16
    alpha: 32

Why migrate?

  • Faster training — backend: unsloth gives 2–5× speedup on Llama/Qwen/Gemma/Mistral
  • Single YAML schema validated by Pydantic v2 (no silent typos)
  • Unified CLI — soup train, soup chat, soup eval, soup serve, soup export all in one tool
  • 30 ready-made recipes — soup recipes list
  • Built-in GGUF/Ollama export
  • Dry-run migration — preview the config with --dry-run before writing

Dry-run preview

bash
soup migrate --from llamafactory config.yaml --dry-run

Prints the converted config to stdout without writing.

Related

  • [Migrate from Axolotl](/docs/migrate-from-axolotl)
  • [Configuration reference](/docs/configuration)