waybackurlsgithub.com
Pulls every URL the Wayback Machine knows for a domain into stdout. Good for finding old endpoints, files and parameters.
domaindetails
tools / gau
gau (GetAllUrls)
Fetches known URLs for a domain from the Wayback Machine, Common Crawl, AlienVault OTX and urlscan in one command.
freeosscli
used in playbooks
similar tools
archive.todayarchive.ph
On-demand page archiver (archive.ph / archive.is) that captures a snapshot and screenshot, often working on pages the Wayback Machine can't capture, such as social posts.
urldomaindetails
Wayback Machineweb.archive.org
Internet Archive's archive of 900B+ web page captures since 1996. View past versions of sites, list every archived URL for a domain, and save pages on demand.
urldomaindetails
Intelligence Xintelx.io
Search engine and archive of leaks, pastes, dark-web pages, and historical data. Supports email, domain, IP, CIDR, URL, and crypto address selectors.
emaildomainip / asnurlcryptophonedetails
4plebsarchive.4plebs.org
Searchable archive of several 4chan boards (/pol/, /x/, /tv/ and others) with images, filterable by text, poster ID, country flag and date.
keywordimagedetails
Arctic Shiftarctic-shift.photon-reddit.com
Searchable archive of Reddit posts and comments (the successor to Pushshift), filterable by author, subreddit, keyword and date, including deleted content.
usernamekeyworddetails