build Featured We Gave Every MCP Tool a readOnlyHint: Agent-Safety by Design Trawl's MCP server gives ten tools to AI agents. We hand-annotated all ten so a grounding agent never fires a billable scrape run by accident.
build Featured What Actually Breaks a Scraper in Production A column of zeros looks like one bug. It's four: nav fails, selector rot, blocks, geo incoherence, each needing the opposite fix. Diagnose before you heal.
build Featured Why We Run Scrape Scheduling on Mongo, Not Kafka Why we coordinate scheduled scrapes on MongoDB instead of a message broker: the incident that forced it, one atomic lock, and the honest trade-offs.
News Featured Trawl Is Now in Private Beta (Plus MCP Upgrades) Trawl is now in private beta: limited seats, free plan, no credit card. Plus a sharper MCP server for AI agents, fairer billing, and reliability polish.
