On a recent project, I heard a colleague recommend dbt and it sounded amazing. Every feature of this product seemed to address challenges I run into on almost every data project. I decided it was time to take a look. Unravelling the Spaghetti As a consultant, I...
Snowflake Secure Data Sharing enables users to provide specific data points to consumers using the same cloud provider within the same region. Providers can share tables, external tables, secure views, secure materialized views or secure user defined functions with consumers. Data sharing is customizable, and...
There is a simple and effective way to ingest and transform ad reporting data from multiple platforms by using Fivetran and dbt in tandem. Fivetran is used to ingest the data from a variety of platforms including Apple Search, Facebook, Google, LinkedIn, Microsoft, Pinterest, Snapchat,...
Every Snowflake account comes with a shared database called "SNOWFLAKE" which stores a fantastic amount of account-level and organisation-level information. Most notably, this shared database contains a series of account usage views which covers all of the activity that has taken place in the account. This...
The purpose of this post is to step through the processes involved in setting up a new Snowflake account to replicate an existing one. There are several reasons to do this, the main two being: Fully migrating to a new account, for example if you...
We've all seen situations where, for whatever reason, we have more data than we need in a table and we want to deduplicate. There are plenty of reasons for this, from dodgy ingestion processes to deliberate intent. Without diving into the "why" of it all,...
It’s kind of hard keeping track of terms in the world of data. It seems like every time you turn around, there’s a new concept, idea, implementation, tool or even argument about data. To contribute to the confusion, each and every idea is given a...
Have you encountered errors trying to install older versions of dbt on your fancy, new MacBook? This could be related to compatibility issues with the new M1 CPU. Dependency packages written for Intel CPUs can cause issues preventing proper installation. But don't worry, Apple provides...
Snowflake have developed a simple command line tool that can be used to investigate snowflake connectivity issues. This tool's full name is the Snowflake Connectivity Diagnostic Tool, however it is more commonly referred to as SnowCD. If you are seeing connection issues with Snowflake, I would...
In my last blog, I showed you how to iterate through a variable to bring multiple tables into the raw layer of your data warehouse. Today, I’m going to build on that concept by creating a DIM table and performing an UPSERT. Now, to start,...
Of the many useful functions available in Snowflake, one of my favourites is the GENERATOR function. This function allows you to create rows of data from nothing and can be useful in many ways. Any time you don't have physical data to get you started...
Interworks GmbH
Ratinger Straße 9
40213 Düsseldorf
Germany
Geschäftsführer: Mel Stephenson
Kontaktaufnahme: markus@interworks.eu
Telefon: +49 (0)211 5408 5301
Amtsgericht Düsseldorf HRB 79752
UstldNr: DE 313 353 072