Home Truths

[doodab]

Your ETL strategy seems to be based on the assumption that headless chickens run faster...

[suityou01]

Your ETL strategy seems to be based on the assumption that headless chickens run faster...

Most companies are like this when it comes to ETL. They don't understand it.

Unless you've been on a failed ETL project you won't get it either.

I just finished digging one out of the tulipe.

[MarillionFan]

I just finished digging one right into the tulipe.

Ftfy

[aussielong]

I'd rather clean toilets than work on ETL, and i've done both. When you were a teenager and you bought the "go to Uni and be successful" dream, I bet you didn't think you would end up doing something as dull as ETL.

Yes, where there is muck, there is brass but what is the IT equivalent of holding your nose as you wash the skids out of the toilet pan?

[suityou01]

I'd rather clean toilets than work on ETL, and i've done both. When you were a teenager and you bought the "go to Uni and be successful" dream, I bet you didn't think you would end up doing something as dull as ETL.

Yes, where there is muck, there is brass but what is the IT equivalent of holding your nose as you wash the skids out of the toilet pan?

One of those headless chickens you were talking about Doodab.

[Lockhouse]

I do a lot of ETL, it's not rocket science but it's surprising how many people want to go the long way round.

[suityou01]

I do a lot of ETL, it's not rocket science but it's surprising how many people want to go the long way round.

that's one problem. In terms of data migration, it's surprising how it's always tacked on the end of a project whereas it should start ahead of development.

[doodab]

I'd rather clean toilets than work on ETL, and i've done both. When you were a teenager and you bought the "go to Uni and be successful" dream, I bet you didn't think you would end up doing something as dull as ETL.

Yes, where there is muck, there is brass but what is the IT equivalent of holding your nose as you wash the skids out of the toilet pan?

The funny thing is I don't do ETL, I use a combination of proper coding skills and arcane knowledge to inhabit various technical niches within a fairly specialised vendor ecosystem. It's just that in this instance some idiot has decided that the most practical way to get some data from some system to some other system is by creating lots of spreadsheets and loading them into the sort of system I work on. This decision appears to based on the fact that it's cheaper and easier to slip me £30k than deal with the buraucracy involved in establishing a connection between two systems that really ought to be connected.

This isn't ETL, more what the L?

Outsourcing FTW.

[suityou01]

The funny thing is I don't do ETL, I use a combination of proper coding skills and arcane knowledge to inhabit various technical niches within a fairly specialised vendor ecosystem. It's just that in this instance some idiot has decided that the most practical way to get some data from some system to some other system is by creating lots of spreadsheets and loading them into the sort of system I work on. This decision appears to based on the fact that it's cheaper and easier to slip me £30k than deal with the buraucracy involved in establishing a connection between two systems that really ought to be connected.

Outsourcing FTW.

Keeeeeeeerching!

[bobspud]

Your ETL strategy seems to be based on the assumption that headless chickens run faster...

They could try what one of my previous clients did: namely leave the pipe to dev null in the middle of the load section...

Apparently the bob in question only wanted the E and T sections to work to save time

It just a shame that the client didn't catch this in the code and executed it on live then spent 5 days waiting for the load to actually load...