Web Crawler

PRO

Crawls a site (robots.txt, sitemap and its own crawl) and extracts contacts, profiles and documents.

Screenshot coming soon.

Required plan

PRO

Via REST API (PRO+)

This tool has no REST API endpoint (it needs a file upload, or the analysis is too slow for a synchronous call).

Full guide with screenshots and use cases

View on osint-ui.com ↗