test please delete

[BrilloPad]

It's snowing again.

It will snow for the baptism tomorrow...

[BrilloPad]

Newbies are a problem, too - their posts don't appear immediately, but when they're approved, they bump things up

Once I've got all the data from this first pass analysed, I'll move it over to Amazon's SimpleDB web service, and take it from there. Then I can run a dedicated spidering and analysis server on Amazon EC2, and the domain will just host the front end, and cache frequently-requested data.

Newbies should have a placeholder - with <awaiting approval> in it. full traceability needed...

[BrilloPad]

"Rat-on-a-Stick, Sir?"

[NickFitz]

So can you leave the laptop on?

When is the eta now?

Just coming up to page 4200. Probably get into real time tonight.

Which means I'd better get on with writing the code that detects real time...

public static function are_we_there_yet {
   // TODO: clever stuff
}

[BrilloPad]

Wow! I haven't seen that for some time!

Disadvantage of being in real-time...

[NickFitz]

Did you see this one, Scourer?

[NickFitz]

Oops... spider just stalled. It does that occasionally - probably a timeout fetching the page - I really should put some sensible error handling in there

Still, it allowed me time to have a look at the database.

I've missed forty posts, probably from other times when it's stalled. So at some point I'll have to get those to fill in the gaps.

[NickFitz]

Database just coming up to 40 meg, and I should be half-way to real time in 53 minutes

[AtW]

Oops... spider just stalled. It does that occasionally - probably a timeout fetching the page - I really should put some sensible error handling in there

Surely writing a spider is easy?

[BrilloPad]

Just coming up to page 4200. Probably get into real time tonight.

Which means I'd better get on with writing the code that detects real time...

public static function are_we_there_yet {
   // TODO: clever stuff
}

if (post_number = 1/0)
return true
else
return false