Skip to content

Latest commit

 

History

History
28 lines (24 loc) · 1.08 KB

README.md

File metadata and controls

28 lines (24 loc) · 1.08 KB

Onllama.LiteGateway

Prevent Ollama from being abused by exposing it directly to the public network. The easiest way to add Apikey authentication to Ollama.

防止 Ollama 直接暴露在公网受到滥用，为 Ollama 添加 Apikey 鉴权的最简单方式。

wget https://github.com/onllama/Onllama.LiteGateway/releases/latest/download/Onllama.LiteGateway.linux-x64 -O /usr/bin/Onllama.LiteGateway
wget https://raw.githubusercontent.com/onllama/Onllama.LiteGateway/refs/heads/main/[email protected] -O /etc/systemd/system/[email protected]
chmod +x /usr/bin/Onllama.LiteGateway 
systemctl enable onllama-litegateway@sk-just-for-example --now

# Please replace 'sk-just-for-example' with the apikey you want to set. / 请替换 'sk-just-for-example' 为你想要设置的 apikey。
# curl http://127.0.0.1:22434

TODO

  • HTTPS
  • Host
  • Log
  • CORS
  • Rate Limit
  • Public URL
  • Trim <think/>
  • Override num_ctx
  • Input content security based on llama-guard
  • Auto context summary compress
  • Apikey from DB
  • ACME Auto HTTPS