[–] collegetoker [S] 0 points 0 points 0 points (+0|-0) 3.8 years ago
Please follow the link over. I'm trying to find a way to archive the amazon hosted mp3 files linked to from veritas, and thusfar I have:
wget -c -H -A '*.mp3' -r -l2 -nd -nH http://projectveritas.com/2017/02/21/cnnleaks-part-i/
is this the correct way to go about it or am I taking the wrong approach? Should robots.txt be turned off?
[–] collegetoker [S] ago
Please follow the link over. I'm trying to find a way to archive the amazon hosted mp3 files linked to from veritas, and thusfar I have:
is this the correct way to go about it or am I taking the wrong approach? Should robots.txt be turned off?