Journey to SQL Authority

[Freamon]

Because the sort component takes way too long for large data sets.

If you bulk load the incoming data into a database first, then pull it out in the correct order you'll find its a lot quicker (as in orders of magnitude quicker) and you've got the raw data in the database ready for audit reporting on the ETL process .

Basically what this tells you is that microsoft have implemented two sort algorithms (one in SSIS and one in SQL Server) and the performance of one is way better than the other. If only they would update SSIS to use the same algorithm as SQL Server...

[Spacecadet]

Basically what this tells you is that microsoft have implemented two sort algorithms (one in SSIS and one in SQL Server) and the performance of one is way better than the other. If only they would update SSIS to use the same algorithm as SQL Server...

Yup, the cack sort is one of the few aspects of SSIS which I hate.
The fact you can load the data to disk, index it and then pull it back off the disk in order faster than it takes SSIS to sort it is fairly shocking!
And it's not as if they don't sell other products which can do in memory sorting in a reasonably performant manner.