I built an open source LLM proxy as a single Go binary — here's why

go dev.to

About 18 months ago I started building Stockyard. It's an LLM proxy: you point your apps at it instead of directly at OpenAI or Anthropic or Gemini, and it handles routing, caching, rate limiting, logging, and retries. You can self-host it in under a minute. The interesting design decision: it ships as a single ~25MB Go binary with embedded SQLite and zero external dependencies. That choice drives everything else. Here's why I made it, and where it hurts. Why not Postgres + Redis?

Read Full Tutorial open_in_new
arrow_back Back to Tutorials