The Problem
Most model servers—Ollama, vLLM, hosted APIs—ship without authentication. Multi-agent protocols assume a bearer token exists but don’t tell you how to issue, verify, or carry it across tools. So teams end up sprinkling JWT code everywhere, bolting on memory as an afterthought, and debugging observability gaps when things break in production.
What We’re Building
Attach Gateway sits between your apps/agents and the model server. It handles the boring-but-critical parts:
- Identity: SSO, OIDC, service accounts—validated at the edge, stamped as verified headers downstream
- Memory: Reads and writes to a pluggable memory layer, so context lives outside the model
- Metering & Observability: Audit logs, usage tracking, and metrics built in—not bolted on
No model server rewrites. No JWT code scattered across microservices.
How It Works
Think of it as Lego bricks: pick your auth method, memory backend, metering approach, and runtime. We generate an implementation plan that wires everything together for your specific stack.
Our defaults are opinionated:
- Local-first, cloud-optional
- Zero-trust by default
- Memory outside the model
- Stateless and observable—JWT is the state, everything else is logged
The Bigger Bet
If identity is the missing primitive inside multi-agent workflows, then agent identity on the open web is the same problem: verification, attribution, and safe interoperability.
That’s why we’re also working on OpenBotAuth—bringing RFC 9421 HTTP signatures to bot/agent authentication. Same philosophy: treat auth as infrastructure, not an afterthought.
Where We’re Headed
We’re shipping in public. The first pieces—gateway + cloud starter—are live. What’s next:
- Predictable API gateway for LLM calls
- Long-term memory with context boundaries for multi-user collaboration
- Orchestration layer that runs locally or in the cloud with deterministic execution
Teams will keep building richer agent systems. The ones who win will treat auth, memory, and observability as infrastructure from day one.
Questions? Reach us at attach.dev