Crawlens is a change-monitoring and evidence archive. Publishing an unverified success rate would contradict the product’s premise. The measurement tooling is ready, but we will not present a result until a dated report artifact exists.
This is a preregistered measurement plan, not a results report.
Pilot set
server/scripts/seed_pilot.py groups 23 public URLs into four categories:
- Noisy pages stress false-alert handling with rotating headlines, ads, and timestamps.
- Stable documentation makes unnecessary alerts easy to identify.
- Pricing pages represent meaningful content changes an agency may care about.
- Status pages exercise availability changes and the notification path.
These are not customer sites. Public pages can measure engine behaviour; weekly agency usage, retention, and willingness to pay still require external pilots.
Thresholds fixed before results
| Metric | Target | Current status |
|---|---|---|
| Crawl success rate | ≥ 97% | Awaiting results |
| Controlled-change catch | ≥ 95% | Awaiting results |
| Human-reviewed false-alert rate | ≤ 20% | Awaiting results |
| Critical notification delivery | ≥ 99% | Awaiting results |
We publish thresholds in advance so they cannot be adjusted after seeing the outcome.
Reproducing the report
Once pilot data exists, the same window is measured with:
python server/scripts/pilot_report.py --days 30
The script reports no data instead of inventing a percentage. It also separates the three market measures that need real agencies: weekly usage, willingness to pay, and 30-day post-pilot retention.
A result will appear here only after its date range, denominator, and script output have been preserved. Until then, every percentage on this page is a target—not an outcome.
Review Crawlens plans and limits or contact us to discuss a pilot on your own sites.
Read next
- Monitoring Multiple Client Websites: A Practical Guide for Agencies
- The Direct Cost of UI Errors on Conversion Rates in E-commerce
Results
Not yet run — this section fills in when results are published.