About our crawler

WebFixPlanBot

This page is for site owners and administrators who found our crawler in their server logs. It explains what it does and how to allow it.

How it identifies itself

WebFixPlanBot/1.0 (+https://www.webfixplan.com/bot)

This is the full User-Agent header sent with every request we make.

What it does

  • Fetches at most 5 public pages, one request each.
  • Runs only when a person enters an address on our site. It is not a continuously running web crawler.
  • Reads robots.txt before anything else and obeys what it disallows.
  • Takes HTML only. It sends no cookies, fills in and submits no forms, and runs no JavaScript.
  • Keeps no raw page source — only the results of the checks remain.

What it does not do

  • It does not work around bot protection or disguise itself as a browser.
  • It does not collect data from sites nobody asked us to check.
  • It does not probe for vulnerabilities or attempt to sign in.

How to allow it

If your site answers 403 or presents a challenge, our audit stops. You can allow the crawler by its User-Agent:

robots.txt

User-agent: WebFixPlanBot
Allow: /

Firewall or CDN

In Cloudflare, AWS WAF or similar, add an allow rule for requests whose User-Agent contains “WebFixPlanBot”. We cannot publish a fixed list of IP addresses: the crawler runs without dedicated servers, so the addresses change. Matching on the User-Agent is the reliable way.

Checking your own site?

Allow the crawler on your own site only, and only for as long as the audit needs. We do not ask anyone to weaken protection on sites they do not control, and we do not do it ourselves.

Run an audit