I couldn't stand waiting 4.6s per page on Firecrawl, so I wrote my own web scraper in Rust

Last year I was building an AI agent. Simple job: scrape web pages, convert to markdown, feed to an...