Security advisory — Malicious litellm versions 1.82.7 and 1.82.8 were removed from PyPI (potential API key exfiltration). Uninstall them, rotate exposed credentials, and upgrade to a safe release (e.g. 1.82.9+). Run pip show litellm to verify. PyPI · README

Wasm Plugin Ops Runbook

1. Edit plugins/<name>/manifest.yaml or upload a new wasm

Wasm Plugin Ops Runbook

Feature flags

  • GATEWAY_WASM_PLUGINS=off: disables the entire Wasm runtime (declarative rule-packs are unaffected)
  • GATEWAY_PLUGINS_DIR: plugin root directory, default enterprise/plugins

Hot reload

  1. Edit plugins/<name>/manifest.yaml or upload a new wasm
  2. The filesystem watcher reloads automatically; you can also call:

- Gateway: POST /internal/plugins/reload (requires GATEWAY_INTERNAL_TOKEN)

- Admin: PUT /api/admin/plugins

Sample plugins

PluginRoleDefault
wasm-keyword-rewriteResponse keyword replacementEnabled
wasm-waf-basicPrompt injection / basic WAFDisabled
wasm-audit-taggerAudit tag injectionDisabled
wasm-bearer-extractorCustom header → propertyDisabled

Fault isolation

  • Plugin panics are caught at the hook layer; the main gateway keeps serving
  • Plugins that fail to start are skipped (manifest validation / Start failure)
  • Prometheus: agx_plugin_invocations_total / agx_plugin_errors_total / agx_plugin_latency_seconds

Pyroscope (optional)

bash
1export PYROSCOPE_URL=https://pyroscope.example.com
2export GATEWAY_PYROSCOPE=on

Admin /admin/perf shows a jump link.

Made-with: Damon Li