Qwen2.5-Omini 3B

Qwen/Qwen2.5-Omni-3B · Hugging Face

<Fine-tuning 예제>

공식 Qwen2.5-Omini github에는 fine-tuning 예제는 포함되어있지 않음

하지만 커뮤니티에 여러 fine-tuning 방법이 공유되어 있음

1. LlamaFactory

LlamaFactory를 커뮤니티 중에서 제일 많이 씀

https://github.com/hiyouga/LlamaFactory/pull/7537

https://github.com/hiyouga/LlamaFactory

1)) LlamaFactory 설치

git clone --depth 1 <https://github.com/hiyouga/LlamaFactory.git>
cd LlamaFactory
pip install -e .
pip install -r requirements/metrics.txt

2)) 데이터셋 구축

https://github.com/hiyouga/LlamaFactory/blob/main/data/README.md

3)) train config 작성

https://github.com/hiyouga/LlamaFactory/pull/7537