February may be the shortest month of the year, but it's definitely been one of the busiest here at InterWorks! There's 28 days in the shortest month, but we've got a whopping 25 blog posts here for your review. You'll notice that there's a new...
To stream/ingest data automatically from an AWS S3 bucket into Snowflake using native functionality, Snowpipe is likely the solution you're seeking. We do have two related posts you can explore for related content: Configuring Storage Integrations Between Snowflake and AWS S3 Automated Ingestion from Azure...
To ingest data stored in AWS S3 into Snowflake, you can use either direct COPY INTO statements or a Snowpipe for automation. Both options require a Snowflake object called an external stage to connect Snowflake to AWS. It's recommended to use Storage Integrations for authentication...
This article is builds on the following two previous articles: Intro to Azure Functions and Snowpark: Populating Snowflake Control Tables Using Azure App Settings to Authenticate Snowflake with Python The above articles do a great job at building a foundation for building Azure Functions that leverage...
New year, new me! Tired of hearing that one yet? It's the time of year to start (and potentially abandon) your New Year's Resolutions. If you're kinda over the whole trend, I recommend this video from CGP Grey that replaces a single resolution with "Themes"...
Earlier this month, my colleague Jason Hoehn published the following article: Intro to Azure Functions and Snowpark: Populating Snowflake Control Tables Jason's article did a great job at building a foundation for building Azure Functions that leverage Snowpark for Python to interact with Snowflake. However, the focus...
If you wish to automatically stream/ingest data from an Azure Storage container into Snowflake, using native functionality, you will most likely be considering what is commonly referred to as a Snowpipe. In real terms, a Snowpipe for Azure is actually a combination of multiple components: ...
If you have data stored in an Azure Storage container and wish to ingest it into Snowflake using native functionality, you will most likely be considering either direct COPY INTO statements or an automated Snowpipe to ingest the data. Both of these options would expect...
If you’ve heard about ThoughtSpot, you are probably as excited as we are here at Interworks about its potential. If you are not too familiar with this tool I’d strongly suggest this article series. Several of our clients in Sydney and Melbourne all agree on one...
Snowflake is a powerful software that can store data points that are important for auditing the ETL process. This is done by creating a control table, which tracks ETL jobs that have been run and their statuses. There are a variety of methods for populating...
Happy New Year, everyone! We hope you all had a fantastic holiday season and are coming into the new year refreshed and ready for a fantastic 12 months. To cap off 2022, we opted for quality over quantity on the blog front. (It also helps...
Snowflake Secure Data Sharing enables users to provide specific data points to consumers using the same cloud provider within the same region. Providers can share tables, external tables, secure views, secure materialized views or secure user defined functions with consumers. Data sharing is customizable, and...
Snowflake itself is really strong at reporting task schedules and history. If you ever use the TASK_HISTORY table function, you can even view the NEXT_SCHEDULED_TIME for each scheduled task. However, it is common to be in a situation where you are leveraging another tool for your pipeline orchestration,...
In another post earlier this year, we discussed how to store the results of a Snowflake SHOW/LIST/DESCRIBE metadata command in a table. Refresher To refresh our memory, in Snowflake, there are several commands that can be used to retrieve metadata from the Snowflake environment without using a...
We've made it to the tail end of 2022. Holiday season is upon us, and it's fitting that Snowflake is the most blogged about topic for us to share in this edition of the InterWorks Blog Roundup — we randomly had a night of golfball-sized...
This is the third and last installment of the three-part series on SSO, SAML and user provisioning in general. Today, we’ll focus on SAML and setting up SSO between Snowflake and Azure AD / ADFS. What Is SAML, ADFS, Azure AD, Okta, Etc.? It is useful to...
Snowpark for Python is the name for the new Python functionality integration that Snowflake has recently developed. At the Snowflake Summit in June 2022, Snowpark for Python was officially released into Public Preview, which means anybody is able to get started using Python in their...
Snowpark for Python is the name for the new Python functionality integration that Snowflake has recently developed. At the Snowflake Summit in June 2022, Snowpark for Python was officially released into Public Preview, which means anybody is able to get started using Python in their...
Snowpark for Python is the name for the new Python functionality integration that Snowflake has recently developed. At the Snowflake Summit in June 2022, Snowpark for Python was officially released into Public Preview, which means anybody is able to get started using Python in their...
Every Snowflake account comes with a shared database called "SNOWFLAKE" which stores a fantastic amount of account-level and organisation-level information. Most notably, this shared database contains a series of account usage views which covers all of the activity that has taken place in the account. This...
Interworks GmbH
Ratinger Straße 9
40213 Düsseldorf
Germany
Geschäftsführer: Mel Stephenson
Kontaktaufnahme: markus@interworks.eu
Telefon: +49 (0)211 5408 5301
Amtsgericht Düsseldorf HRB 79752
UstldNr: DE 313 353 072