Always-on grounded retrieval with SearxNG and role-scoped Ollama models (#62).
CI / test (pull_request) Successful in 11s
Unit Tests / test (pull_request) Successful in 10s

Phases 1–3: split THINKING/FAST/UTILITY/EMBED models, structured search with
SearxNG primary + DDGS failover, fail-open grounding, citations on Prompt + WS
frames, single history window with prompt budgeting, and reindex_embeddings.
This commit is contained in:
2026-08-02 09:05:45 -05:00
parent 57a2350b8e
commit d51033809f
32 changed files with 1734 additions and 187 deletions
+16 -2
View File
@@ -32,8 +32,22 @@ WEB_PORT=8003
# Ollama on GPU host (ai-server-4080). Firewall must allow 10.0.0.0/24 → :11434.
OLLAMA_BASE_URL=http://10.0.0.128:11434
OLLAMA_MODEL=llama3.2
OLLAMA_EMBED_MODEL=llama3.2
# Role-scoped models (#62). After changing OLLAMA_EMBED_MODEL, run:
# python manage.py reindex_embeddings
OLLAMA_MODEL=gpt-oss:20b
OLLAMA_MODEL_THINKING=gpt-oss:20b
OLLAMA_MODEL_FAST=gemma4:latest
OLLAMA_MODEL_UTILITY=llama3.2
OLLAMA_EMBED_MODEL=nomic-embed-text
OLLAMA_NUM_CTX_THINKING=16384
OLLAMA_NUM_CTX_FAST=8192
# Web search (#62) — self-hosted SearxNG (recommended). DDGS is automatic failover.
ALLOW_INTERNET_ACCESS=true
SEARCH_PROVIDER=searxng
SEARCH_FAILOVER_PROVIDER=ddgs
# Point at the SearxNG container/service on the LAN (see README "SearxNG").
SEARXNG_BASE_URL=http://10.0.0.128:8080
# Email (SMTP2GO)
EMAIL_HOST=mail.smtp2go.com