XcoutBot

XcoutBot is the crawler behind Xcout Intel, a company-intelligence service. It identifies itself on every request:

Mozilla/5.0 (compatible; XcoutBot/1.0; +https://intel.xcout.app/bot)

What it fetches

• Public company home pages and careers pages, to confirm a company exists, what it does, and whether it is hiring.
• Public news articles about funding rounds, to read the details a headline leaves out.
• Nothing behind a login, nothing personal, no forms, no admin paths, no port or vulnerability scanning.

How it behaves

• It reads your robots.txt before the first request and obeys Disallow, Allow and Crawl-delay for XcoutBot, falling back to *.
• It leaves at least half a second between requests to the same site, and honours a longer crawl-delay if you set one.
• A page is fetched once and revisited rarely — a home page every few weeks, an article once.

To block it

The fastest way is two lines in your robots.txt; they take effect within a day:

User-agent: XcoutBot
Disallow: /

Or ask here. An opt-out applies to the domain and all of its subdomains and stays until you tell us otherwise. We check each request before applying it, so nobody can switch off a site they do not run; that usually takes a working day. robots.txt takes effect without waiting for us.

Questions or a report about this crawler: email us.