Getting Started

Installation

Windows. For Windows 10/11, you'll need the InterroBot installer for Windows x64.
macOS. InterroBot for macOS is exclusively available via the App Store.
Linux. Linux users need to download and run a suitable installer.
Android. InterroBot for Android is exclusively available via Google Play.

Understanding the Navigation Bar

At all times within the application, there are six navigation buttons on the left margin. These can be inactive, as is the case with Search and Crawl on the home screen. The buttons become active when a project is loaded.

Creating a New Project

At the home screen, you'll want to add your website (or website path) so it can be indexed. Just make sure your project URL contains, at minimum, http(s) and a domain. For example, https://example.com or https://interro.bot/help/ are acceptable. Once you've added your site, the crawler will get to work immediately.

Entering a new URL creates a project, and immediately initiates a web crawl.

Crawling Your Project

The time required to crawl a website is variable. Small sites index in minutes, often seconds, while larger (10,000+ page) sites take hours. The search index generated from the crawl is stable and reusable as long as it is useful. You can reindex at any time.

InterroBot crawler follows links recursively, on large sites you may want to search or work with an intermediate crawl. If you need to take a break, no problem! You can pause the crawl at any time and even search or report from the partial crawl. Allowing the crawl to finish, however, will yield the best search results.

Better yet, use settings to tune your crawl to collect exactly what you need. Crawler Options include External Pages, Page Assets, and Directory/Path Exclusions settings allow fine control of crawled surface area.

The crawl screen has the pause and continue controls at the top left, the status of the crawl is organized below, with a crawl log to the right.

InterroBot is a web crawler and developer tool for Windows, macOS, Linux, and Android.
Want to learn more? Check out our help section or download the latest build.

	Back. Active when a back state exists.
	Home. Navigates to the projects listing.
	Crawl. Navigates to the crawler. Active when a project is loaded.
	Reports. Navigates to the reporting. Active when a project is loaded.
	Search. Navigates to the search. Active when a project is loaded.
	Options. Navigates to app options/preferences.

	Play. Start or continue crawl.
	Pause. Pauses an active crawl.
	Network. Turns red when internet is unavailable.
	Robots.txt status. Turns red when project URL is uncrawlable.