You are viewing a single comment's thread.

view the rest of the comments →

0
0

[–] collegetoker [S] ago 

Please follow the link over. I'm trying to find a way to archive the amazon hosted mp3 files linked to from veritas, and thusfar I have:

wget -c -H -A '*.mp3' -r -l2 -nd -nH http://projectveritas.com/2017/02/21/cnnleaks-part-i/

is this the correct way to go about it or am I taking the wrong approach? Should robots.txt be turned off?