Thanks
just tried out DBeaver, certainly a better interface and experience than the default web interface.
There are lots of tables and columns with missing rows, missing parent/child rows or wrong values in columns. Only possible resolution is to identify the missing records which is fine but I then have to rebuild the data by looking at multiple tables and applying some additional business logic ... before finally inserting/ updating. Easy work in oracle.
Client will most likely be using tableau/cognos for the reporting layer but I am not invoved in that side of things.
Looks like javascript may be the way to go.
- Visitors can check out the Forum FAQ by clicking this link. You have to register before you can post: click the REGISTER link above to proceed. To start viewing messages, select the forum that you want to visit from the selection below. View our Forum Privacy Policy.
- Want to receive the latest contracting news and advice straight to your inbox? Sign up to the ContractorUK newsletter here. Every sign up will also be entered into a draw to WIN £100 Amazon vouchers!
Reply to: Snowflake cloud Question?
Collapse
You are not logged in or you do not have permission to access this page. This could be due to one of several reasons:
- You are not logged in. If you are already registered, fill in the form below to log in, or follow the "Sign Up" link to register a new account.
- You may not have sufficient privileges to access this page. Are you trying to edit someone else's post, access administrative features or some other privileged system?
- If you are trying to post, the administrator may have disabled your account, or it may be awaiting activation.
Logging in...
Previously on "Snowflake cloud Question?"
Collapse
-
Python's useful but I would imagine they have their own ETL tool functionality. If they don't, they should!
In terms of reporting, depends what your reporting requirements are - very much a case of visualisation vs canned reports. Best tools I've used are Tableau for visualisation and Business Objects for generic reporting and analysis. A lot of bigger companies have different tools for both with varies combinations of Tableau, Power BI, Qlik, etc for visualisation and Cognos/SSRS/BusinessObjects for reporting.
An interesting new contending for the cloud is Chartio: Chartio + Snowflake = Data for All in the Cloud | Chartio Blog . I've never used it but they do a free trial so may be worth a look.
Leave a comment:
-
I guess another option if you are using blob storage is Data Factory. That would allow you to ingest the files in blob storage, fix them and then output to another blob storage and then load that into Snowflake.
Could you give more detail about what kind of fix you need that can't be done in SQL against a staging table and then selected into the final table?
Leave a comment:
-
I've used DBeaver to connect to Snowflake and it was way better than the web interface. Free as well.
Snowflake allows you to write stored procedures in javascript if that helps.
Leave a comment:
-
Snowflake cloud Question?
My skillset is primarily on Oracle database and unix, so snowflake is literally very new to me, .... as in a couple of days
I am currently ingesting data from Oracle into snowflake cloud via blob storage. Some of the 30yr old data is afragmented so needs some fixing. This would have been easy within my comfort zone using pl/sql to deal with the issues that can't be resolved with sql. Absolutely no chance of cleansing the data at oracle source so needs to be done at the staging side in snowflake.
Question is what is the best progaming language to use within snowflake for data cleansing?, someone mentioned python but just wanted to be sure that gives just as much flexibility as pl/sql.
Also what is the best 3rd party too to run queries in snowflakes, the web interface is just not my cup of tea
ThanksTags: None
- Home
- News & Features
- First Timers
- IR35 / S660 / BN66
- Employee Benefit Trusts
- Agency Workers Regulations
- MSC Legislation
- Limited Companies
- Dividends
- Umbrella Company
- VAT / Flat Rate VAT
- Job News & Guides
- Money News & Guides
- Guide to Contracts
- Successful Contracting
- Contracting Overseas
- Contractor Calculators
- MVL
- Contractor Expenses
Advertisers
Contractor Services
CUK News
- Streamline Your Retirement with iSIPP: A Solution for Contractor Pensions Sep 1 09:13
- Making the most of pension lump sums: overview for contractors Sep 1 08:36
- Umbrella company tribunal cases are opening up; are your wages subject to unlawful deductions, too? Aug 31 08:38
- Contractors, relabelling 'labour' as 'services' to appear 'fully contracted out' won't dupe IR35 inspectors Aug 31 08:30
- How often does HMRC check tax returns? Aug 30 08:27
- Work-life balance as an IT contractor: 5 top tips from a tech recruiter Aug 30 08:20
- Autumn Statement 2023 tipped to prioritise mental health, in a boost for UK workplaces Aug 29 08:33
- Final reminder for contractors to respond to the umbrella consultation (closing today) Aug 29 08:09
- Top 5 most in demand cyber security contract roles Aug 25 08:38
- Changes to the right to request flexible working are incoming, but how will contractors be affected? Aug 24 08:25
Leave a comment: