Tune crawl settings, handle staging environments, and avoid noisy results from third-party widgets.
Scope and crawl depth
Define the maximum crawl depth and page cap to keep scans predictable while ensuring coverage.
- Use include rules for key sections (e.g., /docs, /pricing)
- Exclude known non-product pages (e.g., /careers)
- Set page caps for very large sites
Authentication and staging
For private sites, use a staging URL or secure tunnel. Keep environments stable to avoid flaky results.
- Prefer staging mirrors of production content
- Ensure authentication banners do not block rendering
- Schedule scans during low-traffic periods
Cookie banners and overlays
Remove overlays before scanning to avoid false positives and blocked content.
- Enable cookie banner removal
- Validate DOM after banner removal
- Re-scan if overlays block navigation