• Pricing
  • Download
  • Contact Us
Wope's crawler

Meet WopeBot.

WopeBot is the crawler of Wope, an SEO analytics product built on Google Search Console.

The crawl, at a glance

What WopeBot readsand how often.

alt_text_3
Up to 2,000 pages per site
Only websites connected to Wope by their owners on the Super plan. WopeBot reads the pages that bring most of each site's search clicks.
alt_text_3
Each page, once a week
If a page's HTTP status changes, WopeBot reads it once more about an hour later to confirm.
alt_text_3
At most one request per second
Requests are limited per host. WopeBot does not follow links to find new pages and does not read any other website.
For site owners

Recognize WopeBot.Control access.

The WopeBot user agent

WopeBot identifies itself with this user agent:

Mozilla/5.0 (compatible; WopeBot/1.0; +https://wope.com/bot)

Pages that only show their content with JavaScript are opened in a headless browser run by Cloudflare (Browser Run), with the same user agent. Those requests also carry Cloudflare's own signature headers.

Your robots.txt rules apply

WopeBot obeys robots.txt: the rules for WopeBot, or the rules for * when WopeBot is not named, and Crawl-delay. It reads robots.txt again at most once a day.

To stop WopeBot reading your site, add this to robots.txt:

User-agent: WopeBot
Disallow: /

A Disallow for WopeBot in robots.txt stops both WopeBot and reads through scrape.do.

Firewalls & third-party fetching

If your firewall or bot protection blocks WopeBot, allow requests whose user agent contains WopeBot. When a connected site blocks WopeBot, Wope may read the same pages through scrape.do, a third-party fetch service, still obeying robots.txt.

Page changes & privacy

Changes for your project.Not for AI training.

What changes between reads

WopeBot compares each page with its previous read and shows what changed: title, meta description, H1, canonical, robots tag, main text, HTTP status, and links between the site's pages.

Pages and their changes are shown only to that site's own Wope project. Pages are not used to train AI models.

How long page copies are kept

Wope keeps the current copy of each page and copies of changed versions for 90 days.

All page copies are deleted when the site is disconnected.

Get in touch

Questions about WopeBot?

For questions or problems with WopeBot, contact our support team.