Reply to: Just added 2TB NAS

[AtW]

Assuming doubling of capacity every 18 months or so, I should have a petabyte on the home server by 2017.

And it will cost £1 mln... or 100 euros...

[bobhope]

It was only a few years ago that I worked out how long until I would have a terabyte of storage at home.

Assuming doubling of capacity every 18 months or so, I should have a petabyte on the home server by 2017.

[threaded]

2 x 1TB Buffalo NAS arrived today

Oodles of space!

I have 4TB disk, 32GB ram and 8 cores on the desktop I use for surfing.

What is sad is that the biggest user of disk space is Boinc.

[AtW]

You must have a seriously massive internet connection to be able to download 5TB a day.

Either that OR I actually used my brains to devise a solution that worked it around. That was hard to do, economics is a much easier subject.

[TykeMerc]

I am a pro mate, that's my business uses so much data - each day 5 TB more crawled and analysed: it's the power of SKA

You must have a seriously massive internet connection to be able to download 5TB a day.

[b0redom]

Take a look at FreeNAS. Cheap as chips....

[TheFaQQer]

Was considering getting a drobo - anybody got one? I'm not sure I'll ever need more than 32TB.

Not got one with the DroboShare as NAS though, but it's dead easy to use, expand and have running.

One annoying thing is that it will show up as a 2TB drive (or multiple drives) whether there is more or less than 2TB - unless they have updated the firmware recently. So I have 1.25TB free (plus the striping / redundancy) but it shows up as 2TB free when I started it.

That said, for expandable, more reliable backup, I'd recommend one. I just then use xcopy to copy the files over from the hard drive to the drobo.

IIRC someone else here has one - spacecadet, possibly??

[Moscow Mule]

Was considering getting a drobo - anybody got one? I'm not sure I'll ever need more than 32TB.

[Board Game Geek]

Anyone still backing up to C90 cassettes ?

[AtW]

My 5 TB is recorded white noise. It just won't compress.

It will if you think outside of a box...

[NotAllThere]

5 TB of daily raw data gets compressed to around 40 GB, but what I do know about filtering and compression...

My 5 TB is recorded white noise. It just won't compress.

[Platypus]

I think I'll wait till USB 3 though, it'll take days to backup that amount of stuff.

I also backup to DLT tape using Vertias through a SCSI controller. It's very fast! But the tape drive was mighty expensive. The one time I needed to do a full restore from tape, it saved my butt, so was worth the investment.

[PAH]

2 x 1TB Buffalo NAS arrived today

Oodles of space!

You should have bought 4 of them. No good having all your stuff in one place if it's not backed up!

Was looking at external drives and notice you can now get a 1TB usb drive for about 2 quid more than a bare drive! Around £70-75 inc vat.

Currently got 2.5TB in my home server, about half used. Could do with backing it up incase some scrote nicks it whilst I'm out.

I think I'll wait till USB 3 though, it'll take days to backup that amount of stuff.

[AtW]

I recommend some sort of filter to reduce your storage requirements.

5 TB of daily raw data gets compressed to around 40 GB, but what I do know about filtering and compression...

[PAH]

I am a pro mate, that's my business uses so much data - each day 5 TB more crawled and analysed: it's the power of SKA

If it all goes Pete Tongue, you can always get a job at the local recycling centre. I think they have the same issues you have, sorting the quality from the junk.

I recommend some sort of filter to reduce your storage requirements. There are actually only about a dozen sites on the internet worth bothering about. The task you have is finding them amongst the billions of pages of useless blogs and adverts.