How to download the entire contents of an ASP website?

[TheMonkey]

Perl.

WHY is there always ONE! wget is far better than hacking some piece of sh1t together with LWP.

[swamp]

Perl.

[TheMonkey]

Thanks Monkey. Much appreciated. Way behind today, baby has been screaming all day and it is doing my head in and havent managed to finish the first piece of work, let alone browse the net and see which software does the biz.

Let's help some more:

http://users.ugent.be/~bpuype/cgi-bi...=wget/wget.exe <-- download
http://users.ugent.be/~bpuype/wget/#usage <-- usage

Works wonders on pr0n.

[MarillionFan]

Thanks Monkey. Much appreciated. Way behind today, baby has been screaming all day and it is doing my head in and havent managed to finish the first piece of work, let alone browse the net and see which software does the biz.

[TheMonkey]

GNU wget or curl (google for them)

[AtW]

Hit some nerve again, just like with the cold beans?

[MarillionFan]

"MF sounds like your day job is consulting - learn how to make your own decisions ffs!"

So I take it the fkcuing russian know-it-all doesn't know. So f-ck off ***** and dont respond to posts you know f-ck all about - yet again.

In fact don't respond to any of my posts again. Pr1ck.

[AtW]

MF sounds like your day job is consulting - learn how to make your own decisions ffs!

[MarillionFan]

Before I root around for software, can anyone recommend one?

[hattra]

MF

have a look on download.com - they have a number of utils on there that might do what you want. I think there was one called freedownloader or something like (and there are probably others) that that you could rip off, er sorry, download complete sites with - whether it does everything you want, I don't know - but possibly worth a look.

HTH

[MarillionFan]

Its an online catalogue of products. About 5000. I took a snapshot last year by doing it manually but it took forever. It's passworded and I am allowed to take the photos but it takes for ever.

I can write something in VB (yes VB) but I was hoping there was some software I could point at a site and it would crawl every link etc.

Come on, it cannot be that difficult!!!!

[bogeyman]

Preferably ASP?

It's ok to do this for static sites, but it makes no sense for dynamic ones. You can never be sure you have captured the 'entire' site.

If it's a dynamic site then you're only going to get a snapshot of whatever URIs you request.

Also, dynamic sites can have an infinite (unknowable) number of pages (e.g. they could be DB-driven) so you don't know how much you're going to get for the 'entire site'.

Never mind. I'm sure Atw's SKA will do the job perfectly

Why do you need to do this anyhway?

[AtW]

SKA v2.0 will do it.

hth

[MarillionFan]

OK flame me if you like. I dont know.

Can someone tell me a way or piece of software I can point at someones website (preferably ASP) and download everything.

Cheers

MF