SEOmise

Crawler information

SEOmiseBot

SEOmiseBot visits a website only because someone added it to an SEOmise project — usually its owner, their agency, or a business comparing itself with a competitor.

User agent

SEOmiseBot/1.0 (+https://seomise.com/bot)

What it does

  • Reads robots.txt and sitemaps, then follows internal links to audit pages: status codes, titles, headings, links, canonicals, structured data and similar on-page signals.
  • Checks that known backlinks still exist and records their rel attribute and anchor.
  • Skips images, videos, archives, feeds, login pages and other files it does not need.
  • Does not submit forms, log in, run checkout flows or try to reach private network addresses.

Crawl rate

At most five requests at a time to one site, fewer automatically when a site responds slowly. Crawl-delay in robots.txt is honoured up to 10 seconds. Each scan is limited to the page budget of the customer's plan.

Controlling SEOmiseBot with robots.txt

SEOmiseBot obeys rules for User-agent: SEOmiseBot and for User-agent: *. To block it completely:

User-agent: SEOmiseBot
Disallow: /

To keep it out of one folder and slow it down:

User-agent: SEOmiseBot
Disallow: /private/
Crawl-delay: 5

Changes take effect at the start of the next scan, because robots.txt is read when a scan begins.

Contact

If SEOmiseBot causes a problem on your site, write to SEOmise with your domain and the approximate time. We will look into it and can exclude your domain.