Geek to Live: Mastering Wget

11 Sep 11

Jess C

mac linux Ubuntu Terminal

15 Aug 10

momo_armo

wget -r -l1 -H -t1 -nd -N -np -A.mp3 -erobots=off -i mp3_sites.txt
That Wget recipe recursively downloads only MP3 files linked from the sites listed in mp3_sites.txt that are newer than any you've already downloaded. There are a few other specifications in there - like to not create a new directory for every music file, to ignore robots.txt and to not crawl up to the parent directory of a link. Jeff breaks it all down in his original post.

12 Jul 10

Matt Hobbs

wget -m http://ginatrapani.googlepages.com

wget howto tools tutorial download

08 Jun 09

dan r

wget -H -r --level=1 -k -p

software linux tutorial

06 May 09

d b

wget

29 Apr 09

Mert Nuhoglu

Whether you want to mirror an entire web site, automatically download music or movies from a set of favorite weblogs, or transfer huge files painlessly on a slow or intermittent network connection, Wget's for you.

software productivity

wget [option]... [URL]...
Mirror an entire web site
wget -m http://ginatrapani.googlepages.com
to retrieve all the pages in a site PLUS the pages that site links to
Download all the pages (-r, recursive) on http://ginatrapani.googlepages.com plus one level (—level=1) into any other sites it links to (-H, span hosts), and convert the links in the downloaded version to point to the other site
-c --output-document=mavericks.avi
-c ("continue") option
the URL is in quotes, necessary for any address with &'s in it
I scheduled an hourly download of Lifehacker's daily traffic chart to run automatically
traffic_$(date +\%Y\%m\%d\%H).gif
result in unique filenames
from the sites listed in mp3_sites.txt
Jeff breaks it all down in his original post.

11 more annotations...

20 Apr 09

Kovan .

linux *

13 Mar 09

James Larkin

linux wget

20 Feb 09

patricktingen

reference tutorial utilities windows tools

31 Jan 09

Thomas James

Your browser does a good job of fetching web documents and displaying them, but there are times when you need an extra strength download manager to get those tougher HTTP jobs done.

A versatile, old school Unix program called Wget is a highly hackable, h

lifehacks software Linux internet web tutorial tools howto datastorage UNIX datarecovery delicious HTTP wget

25 Jan 09

Ryan Baldwin

wget

02 Jan 09

soviel

wget guide howto unix tutorial

24 Nov 08

Don Mego

SU linux unix Tags

17 Nov 08

lukeusetheforce

web tutorial howto wget utilities unix lifehacker linux productivity

11 Nov 08

Ken Garland

wget

27 Oct 08

Engelbert Tejeda

related:gls*curl backup google notebook
related:http://lifehacker.com/software/hack-attack/back-up-your-google-apps-data-281635.php
childof:http://lifehacker.com/software/download-managers/geek-to-live--wget-local-copies-of-your-online-research-delicious-

computers-network_tcpip-windows computers-commandline-windows computers-commandline-network_tcpip-windows computers-documentation

08 Sep 08