Wayurls

Инструмент CLI предназначен для извлечения URL-адресов из различных источников, включая Wayback Machine, Common Crawl и VirusTotal. Сам инструмент написан на Go.

Требования:

• Go

Использование:

Установка

go install github.com/alwalxed/wayurls@latest

Использование

wayurls [OPTIONS] [DOMAIN...]

Options:
  -d               Show fetch date in first column
  -t <domain|file> Target domain or file with list of domains
  -n               Exclude subdomains
  -o <file>        Output file (default: stdout)
  -v               List crawled URL versions
  -vt <key>        VirusTotal API key

Пример

# Fetch URLs for a single domain
wayurls example.com

# Fetch URLs from a list of domains
wayurls -t domains.txt -o results.txt

# Fetch URLs with dates, excluding subdomains
wayurls -d -n -t example.com

# List crawled versions of URLs
wayurls -v example.com

Download | Github