• Visitors can check out the Forum FAQ by clicking this link. You have to register before you can post: click the REGISTER link above to proceed. To start viewing messages, select the forum that you want to visit from the selection below. View our Forum Privacy Policy.
  • Want to receive the latest contracting news and advice straight to your inbox? Sign up to the ContractorUK newsletter here. Every sign up will also be entered into a draw to WIN £100 Amazon vouchers!

Tool to dowload web-page hierarchy?

Collapse
X
  •  
  • Filter
  • Time
  • Show
Clear All
new posts

    Tool to dowload web-page hierarchy?

    I've come across a technical resource online which I thought I'd never find. I want to take a copy as the site it's on could disappear one day. It's basically a manual with each page a separate HTML file, linked from a contents page etc... are there tools that will let me feed in the index.html page and it will download all linked pages on the same domain?
    Originally posted by MaryPoppins
    I'd still not breastfeed a nazi
    Originally posted by vetran
    Urine is quite nourishing

    #2
    wget

    Comment


      #3
      Originally posted by basshead View Post
      wget
      WHS

      Even if you're unfortunate enough to be using some non-Unix OS like Windows, you can still get hold of that GNU goodness

      Comment


        #4
        Teleport pro was always useful to me.

        TM

        Comment


          #5
          http://softbytelabs.com/us/bw/

          Black widow IS THE download manager for ripping sites.

          Comment


            #6
            Originally posted by themistry View Post
            Teleport pro was always useful to me.

            TM
            Yep, great product!

            Comment


              #7
              Originally posted by NickFitz View Post
              WHS

              Even if you're unfortunate enough to be using some non-Unix OS like Windows, you can still get hold of that GNU goodness
              WHS++

              Some sites do block wget though. What do folks do with those?
              Last edited by Sysman; 20 June 2009, 14:38.
              Behold the warranty -- the bold print giveth and the fine print taketh away.

              Comment


                #8
                Originally posted by Sysman View Post
                WHS++

                Some sites do block wget though. What do folks do with those?
                Change user agent string?
                The only one I know is packet storm, but it doesn't block, it just doesn't want excessive bandwidth bills

                Comment


                  #9
                  Originally posted by xchaotic View Post
                  Change user agent string?
                  WHS: --user-agent="Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1)" (or whatever UA floats your - or rather their - boat).

                  Comment

                  Working...
                  X