Brandon Schneider
|
69e5b31c4f
|
docs(infra): add Ollama inference serving to k3s-cluster-setup
Add inference serving section documenting:
- Ollama host-level deployment on Neon-64GB (bypasses KServe RAM limits)
- Caddy reverse proxy on racknerd (:8443 → 100.64.19.78:11434)
- Troubleshooting: autosave.json stale config, passt port interception
- curl/wget verification commands
Fixes 502 Bad Gateway from Caddy (--resume loading stale autosave.json).
|
2026-05-30 00:02:49 -05:00 |
|