Tool to dowload web-page hierarchy?

Visitors can check out the Forum FAQ by clicking this link. You have to register before you can post: click the REGISTER link above to proceed. To start viewing messages, select the forum that you want to visit from the selection below. View our Forum Privacy Policy.
Want to receive the latest contracting news and advice straight to your inbox? Sign up to the ContractorUK newsletter here. Every sign up will also be entered into a draw to WIN £100 Amazon vouchers!

You are not logged in or you do not have permission to access this page. This could be due to one of several reasons:

You are not logged in. If you are already registered, fill in the form below to log in, or follow the "Sign Up" link to register a new account.
You may not have sufficient privileges to access this page. Are you trying to edit someone else's post, access administrative features or some other privileged system?
If you are trying to post, the administrator may have disabled your account, or it may be awaiting activation.

NickFitz replied

22 June 2009, 14:36
Originally posted by xchaotic View Post

Change user agent string?

WHS: --user-agent="Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1)" (or whatever UA floats your - or rather their - boat).
Leave a comment:
xchaotic replied

22 June 2009, 10:09
Originally posted by Sysman View Post

WHS++

Some sites do block wget though. What do folks do with those?

Change user agent string?
The only one I know is packet storm, but it doesn't block, it just doesn't want excessive bandwidth bills
Leave a comment:
Sysman replied

20 June 2009, 14:34
Originally posted by NickFitz View Post

WHS

Even if you're unfortunate enough to be using some non-Unix OS like Windows, you can still get hold of that GNU goodness

WHS++

Some sites do block wget though. What do folks do with those?

Last edited by Sysman; 20 June 2009, 14:38.
Leave a comment:
Platypus replied

20 June 2009, 10:06
Originally posted by themistry View Post

Teleport pro was always useful to me.

TM

Yep, great product!
Leave a comment:
minestrone replied

19 June 2009, 22:11
http://softbytelabs.com/us/bw/

Black widow IS THE download manager for ripping sites.
Leave a comment:
themistry replied

19 June 2009, 21:33
Teleport pro was always useful to me.

TM
Leave a comment:
NickFitz replied

19 June 2009, 11:42
Originally posted by basshead View Post

wget

WHS

Even if you're unfortunate enough to be using some non-Unix OS like Windows, you can still get hold of that GNU goodness
Leave a comment:
basshead replied

19 June 2009, 10:46
wget
Leave a comment:
d000hg started a topic Tool to dowload web-page hierarchy?

19 June 2009, 00:12
Tool to dowload web-page hierarchy?

I've come across a technical resource online which I thought I'd never find. I want to take a copy as the site it's on could disappear one day. It's basically a manual with each page a separate HTML file, linked from a contents page etc... are there tools that will let me feed in the index.html page and it will download all linked pages on the same domain?
Tags: None