从 HuggingFace 下载模型
1. 安装依赖
pip config set global.index-url https://mirrors.aliyun.com/pypi/simple/
pip install -U huggingface_hub
2. 设置环境变量
Linux
export HF_ENDPOINT=https://hf-mirror.com
Windows Powershell
$env:HF_ENDPOINT = "https://hf-mirror.com"
3.1 下载模型
huggingface-cli download --resume-download SakuraLLM/Sakura-32B-Qwen2beta-v0.9.1-GGUF sakura-32b-qwen2beta-v0.9.1-iq4xs.gguf --local-dir sakura32b
huggingface-cli download --resume-download SakuraLLM/Sakura-7B-Qwen2.5-v1.0-GGUF sakura-7b-qwen2.5-v1.0-iq4xs.gguf --local-dir sakura7b
huggingface-cli download --resume-download SakuraLLM/LN-Korean-14B-v0.2.1 --local-dir LN-Korean-14B-v0.2.1