Security advisory — Malicious litellm versions 1.82.7 and 1.82.8 were removed from PyPI (potential API key exfiltration). Uninstall them, rotate exposed credentials, and upgrade to a safe release (e.g. 1.82.9+). Run pip show litellm to verify. PyPI · README

Enterprise deployment

There are two production paths. A Helm chart is not provided.

Enterprise deployment

There are two production paths. A Helm chart is not provided.

PathUse whenRead first
Local / self-hosted DockerYour own servers or intranet; Docker for Postgres/Redis; run portal + admin + gatewaylocal-selfhost.md
Vercel + external gatewayportal/admin on Vercel; Go gateway on your hostvercel-env-checklist.md · vercel-git-autodeploy.md

Local development (not production) uses enterprise/scripts/start-dev.sh / start-dev-with-infra.sh. See development/local-dev.md.


Where plaintext secrets go

  • Real PEMs, tokens, and DATABASE_URL belong in enterprise/.local-secrets/
  • That directory is gitignored (same class as .env*.local). Do not commit it
  • Keep a local copy of vercel-env-checklist.md as enterprise/.local-secrets/vercel-env-values.local.md and fill values there

Upstream keys are env vars or Channel api_key_cipher. PAT plaintext is shown once at create time. See gateway/api-tokens.md.

Database

Also

Made-with: Damon Li