2025年5月17日星期六

linux下的ollama的代理设置

需要在/etc/systemd/system/ollama.service的内容修改如下:

[Unit]

Description=Ollama Service

After=network-online.target

[Service]

ExecStart=/usr/local/bin/ollama serve

User=ollama

Group=ollama

Restart=always

RestartSec=3

Environment="PATH=/home/abc/.local/bin"

Environment="PATH=$PATH"

Environment="CUDA_VISIBLE_DEVICES=0,1,2,3"

Environment="OLLAMA_SCHED_SPREAD=1"

Environment="OLLAMA_KEEP_ALIVE=-1"

Environment="OLLAMA_HOST=0.0.0.0"

Environment="OLLAMA_NUM_PARALLEL=10"

Environment="OLLAMA_ORIGINS=*"

Environment="https_proxy=http://abc.com:80"

Environment="http_proxy=http://abc.com:80"

[Install]

WantedBy=default.target


没有评论:

发表评论

Nextcloud Talk 高性能后端配置

先生成几个密钥,后面会用到: bash openssl rand -hex 32 # TURN_SECRET(coturn 与 signaling 共用) openssl rand -hex 32 # BACKEND_SECRET(signaling 与 Nextclo...