Here's a cool tip if you need to scrap links with curl & grep: curl yourdomain.com | grep -Eo "(http|https)://[a-zA-Z0-9./?=_%:-]*" | sort -u (please like it if interest)