{"id":406,"date":"1997-09-09T01:36:29","date_gmt":"1997-09-09T09:36:29","guid":{"rendered":"http:\/\/www.birdhouse.org\/betips\/?p=406"},"modified":"1997-09-09T01:36:29","modified_gmt":"1997-09-09T09:36:29","slug":"download-files-while-you-sleep","status":"publish","type":"post","link":"https:\/\/www.betips.net\/?p=406","title":{"rendered":"Download files while you sleep"},"content":{"rendered":"

If you need to download a lot of files from various web sites and don’t want to sit there clicking and waiting all day, build yourself a quick wget<\/a> script. With wget installed in ~\/config\/bin<\/code>, create a text file looking something like this:<\/p>\n

\nwget http:\/\/www.somesite.com\/dir\/filename.zip\nwget http:\/\/www.anothersite.com\/files\/mp3\/audiotest.mp3\nwget http:\/\/www.hoohaa.com\/images\/screenshot.gif\n<\/pre>\n
and so on. The easiest way to get the download URLs is to right-click the actual link in your browser, choose Copy Link Location, and paste it into the script. Save the script to ~\/config\/bin<\/code> as, say, getfiles<\/code>. Launch a Terminal, cd to the directory you’d like the files downloaded to, and type getfiles<\/code>. Go to bed.
\nThis is a great way to download lots of software from BeBits<\/a>, for example.
\nSee also: Use SoftwareValet for Batch Transfers<\/a>.<\/p>\n
\n
Joachim Seemer (J.Seemer@gmx.de) adds:
\nThere’s also the „-c“ flag, which allows you to resume cancelled downloads. With it, even large downloads of game demos etc. are no problem. Just enter<\/p>\n
wget -c http:\/\/www.site.com\/largefile.zip<\/pre>\n
each time you connect to the net and watch how it gets the file step for step, skipping over the already downloaded part. Of course you’ll have to make sure to always call wget from the same folder or it keeps starting from the beginning.
\nHere’s<\/a> a tip to easily get the URL of an incompletely downloaded file.
\nAnd here’s<\/a> a tip to achieve similar things with SoftwareValet.<\/p>\n","protected":false},"excerpt":{"rendered":"
If you need to download a lot of files from various web sites and don’t want to sit there clicking and waiting all day, build yourself a quick wget script. With wget installed in ~\/config\/bin, create a text file looking something like this: wget http:\/\/www.somesite.com\/dir\/filename.zip wget http:\/\/www.anothersite.com\/files\/mp3\/audiotest.mp3 wget http:\/\/www.hoohaa.com\/images\/screenshot.gif and so on. The easiest way […]<\/p>\n","protected":false},"author":3,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[],"tags":[8],"class_list":["post-406","post","type-post","status-publish","format-standard","hentry","tag-misc"],"_links":{"self":[{"href":"https:\/\/www.betips.net\/index.php?rest_route=\/wp\/v2\/posts\/406","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.betips.net\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.betips.net\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.betips.net\/index.php?rest_route=\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/www.betips.net\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=406"}],"version-history":[{"count":0,"href":"https:\/\/www.betips.net\/index.php?rest_route=\/wp\/v2\/posts\/406\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.betips.net\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=406"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.betips.net\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=406"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.betips.net\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=406"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}