Originally posted by dx4100
View Post
- Visitors can check out the Forum FAQ by clicking this link. You have to register before you can post: click the REGISTER link above to proceed. To start viewing messages, select the forum that you want to visit from the selection below. View our Forum Privacy Policy.
- Want to receive the latest contracting news and advice straight to your inbox? Sign up to the ContractorUK newsletter here. Every sign up will also be entered into a draw to WIN £100 Amazon vouchers!
Collapse
You are not logged in or you do not have permission to access this page. This could be due to one of several reasons:
- You are not logged in. If you are already registered, fill in the form below to log in, or follow the "Sign Up" link to register a new account.
- You may not have sufficient privileges to access this page. Are you trying to edit someone else's post, access administrative features or some other privileged system?
- If you are trying to post, the administrator may have disabled your account, or it may be awaiting activation.
Logging in...
Previously on "Importing a data from a flat file to SQL server."
Collapse
-
I'd be tempted to create a staging table, that mimics the structure of the file, and use SSIS to create a package to import the data.
Then call a sproc to process the data in the staging table further.
How to import a fixed width flat file into database using SSIS? - Stack Overflow
Don't know if this helps?
Leave a comment:
-
Importing a data from a flat file to SQL server.
Trying to figure out a sensible way to achieve this.
I receive a data file which is a straight structured fixed length file with cr/lf delimters. Something like:
aaaaaaaaaaaBBBBBBBBBBB123.45
My objective is simply to import this into rows in a table.
This needs to be within a transaction, and can be part of a .NET process. It's sql server 2008.
Ideally I would like to pass an array of "records" to a stored procedure, because further processing is required on them.
It seems to me that I could achieve this by:-
1. Create a TYPE as a table in SQL server
2. Read the file in .NET and create a DataTable from it
3. Pass said datatable and any other parameters to the stored procedure
4. In the stored procedure, create a transaction, iterate the table via a cursor, do stuff with the data, end the transaction
Is this the usual sort of way or should I be looking at something different ??
Another hiccup.
The file should only be able to be processed once and needs to be deleted, but only in the success case.
Not sure how best to achieve this because it could fail after the sp completes and before the file gets deleted.
My thought is to also have a table containing the details of files that have been processed, then when I find a file if it is in there I know it has already been done and can ignore it. This table could be updated in the transaction in the stored procedure.
Again a bit klunky, so any other suggestions are welcome.Tags: None
- Home
- News & Features
- First Timers
- IR35 / S660 / BN66
- Employee Benefit Trusts
- Agency Workers Regulations
- MSC Legislation
- Limited Companies
- Dividends
- Umbrella Company
- VAT / Flat Rate VAT
- Job News & Guides
- Money News & Guides
- Guide to Contracts
- Successful Contracting
- Contracting Overseas
- Contractor Calculators
- MVL
- Contractor Expenses
Advertisers
Contractor Services
CUK News
- Streamline Your Retirement with iSIPP: A Solution for Contractor Pensions Sep 1 09:13
- Making the most of pension lump sums: overview for contractors Sep 1 08:36
- Umbrella company tribunal cases are opening up; are your wages subject to unlawful deductions, too? Aug 31 08:38
- Contractors, relabelling 'labour' as 'services' to appear 'fully contracted out' won't dupe IR35 inspectors Aug 31 08:30
- How often does HMRC check tax returns? Aug 30 08:27
- Work-life balance as an IT contractor: 5 top tips from a tech recruiter Aug 30 08:20
- Autumn Statement 2023 tipped to prioritise mental health, in a boost for UK workplaces Aug 29 08:33
- Final reminder for contractors to respond to the umbrella consultation (closing today) Aug 29 08:09
- Top 5 most in demand cyber security contract roles Aug 25 08:38
- Changes to the right to request flexible working are incoming, but how will contractors be affected? Aug 24 08:25
Leave a comment: