Full fine-tuning recipe: QLoRA (4-bit) on Qwen 2.5 7B via DeepSpeed, targeting single RTX 3090 (24GB), with data mix and eval plan.
Full fine-tuning recipe: QLoRA (4-bit) on Qwen 2.5-Coder 7B via Unsloth, targeting single RTX 3090 (24GB), with data mix and eval plan.
Full fine-tuning recipe: QLoRA (4-bit) on Gemma 2 9B via OpenRLHF, targeting 2x RTX 4090, with data mix and eval plan.
Full fine-tuning recipe: QLoRA (4-bit) on Phi-3.5-mini via DeepSpeed, targeting 2x RTX 4090, with data mix and eval plan.
Full fine-tuning recipe: QLoRA (4-bit) on Phi-4 via Hugging Face TRL, targeting AWS g5.12xlarge, with data mix and eval plan.
Full fine-tuning recipe: QLoRA (4-bit) on Mixtral 8x7B via Megatron-LM, targeting AWS g5.12xlarge, with data mix and eval plan.
Full fine-tuning recipe: QLoRA (4-bit) on Mixtral 8x22B via FSDP, targeting AWS g5.12xlarge, with data mix and eval plan.
Full fine-tuning recipe: QLoRA (4-bit) on Qwen 2.5 7B via Axolotl, targeting single A100 80GB, with data mix and eval plan.
Full fine-tuning recipe: QLoRA (4-bit) on Llama 3.1 70B via Unsloth, targeting 4x A100 40GB, with data mix and eval plan.
Full fine-tuning recipe: QLoRA (4-bit) on Qwen 2.5 7B via DeepSpeed, targeting 8x H100, with data mix and eval plan.
Full fine-tuning recipe: QLoRA (4-bit) on Llama 3.1 70B via LitGPT, targeting AWS g5.12xlarge, with data mix and eval plan.
Full fine-tuning recipe: QLoRA (4-bit) on Llama 3.1 70B via Hugging Face TRL, targeting single H100 80GB, with data mix and eval plan.