Automatic periodic heartbeat requests to LLM, embedding, and vector store services Prevents TCP connections from being silently closed by network infrastructure Configurable heartbeat interval ...
You have a small, mostly static corpus (e.g., a few hundred to a few thousand chunks). You want zero‑infrastructure local retrieval with fast, predictable latency. You’re assembling “infinite few‑shot ...