News and release information for the InterroBot web crawler.
· Leverage your InterroBot website crawl data with AI language models using mcp-server-webcrawl. Connect Claude Desktop to your search index for powerful natural language analysis of website content, SEO insights, and technical monitoring through simple MCP integration.
· Discover InterroBot's Website Word Cloud plugin, a powerful tool that leverages web crawl data to create accurate, customizable word clouds.
· With the arrival of InterroBot 2.5, spellchecking an entire website is no problem. A new built-in utility, Spellcheck, leverages the InterroBot crawl data to compile a list of spelling irregularities in seconds.
· Crawler on Crawlers. Retrospective review of Astra SiteManager 1.03 (1996, Mercury Interactive).
· Grepping NGINX access logs is a powerful way to investigate issues with a website. Here, I will run through some common scenarios where grepping an access log can help.