High-performance, local-first website crawler, 120-rule technical SEO audit engine, and AI-native auditor written in Rust.

Black Sparrow is a lightweight, blazing-fast website crawler and technical SEO auditor designed as a modern, local-first alternative to heavy legacy tools like Screaming Frog and expensive cloud crawlers.

Built from the ground up in Rust, Black Sparrow streams HTML responses through Cloudflare's zero-copy lol_html parser, dynamically adjusts crawl speed using network congestion algorithms (AIMD), persists audit history in an embedded SQLite database, and exposes a native Model Context Protocol (MCP) server for autonomous AI coding agents.

• ⚡ Blazingly Fast: Crawls ~500–800 pages/second on raw HTTP using under 50 MB of RAM.
• 🔒 Local-First & Private: All data stays on your machine in an embedded SQLite WAL database. No accounts, no cloud dependencies, zero telemetry.
• 🧠 AI-Native (MCP): Native stdio Model Context Protocol server. AI agents in…