Snowflake recently held their 2023 Data for Breakfast series in Australia. InterWorks was a black diamond partner for two events in the series (Perth and Melbourne), and I was lucky enough to attend both of these events and present on behalf of our amazing company...
If you've ever tried running SQL queries against Snowflake from an AWS Lambda function using Python, chances are you may have run into an error message like this: ⛔️ No module named 'snowflake' Fear not, there's a simple solution you can apply in no time. In this...
Welcome back to our mini-series on Snowflake External Functions with Azure. Before we proceed, please read the previous post on how to set up these functions and how Snowflake interacts with Azure: A Definitive Guide to Setting up Snowflake External Functions with Azure Why Choose an...
As you may be aware, Snowflake has a cool feature which allows its standard functionality to be extended through the use of external functions. Among several other capabilities, this includes the ability to leverage Azure Functions within Snowflake. This unlocks a whole new realm of...
There are several ways to develop, debug and deploy serverless applications to Amazon Web Services (AWS). One of my favorite tools to achieve this locally is the AWS Toolkit for VSCode because it streamlines the application development process in a simple and pain-free manner. For...
February may be the shortest month of the year, but it's definitely been one of the busiest here at InterWorks! There's 28 days in the shortest month, but we've got a whopping 25 blog posts here for your review. You'll notice that there's a new...
To stream/ingest data automatically from an AWS S3 bucket into Snowflake using native functionality, Snowpipe is likely the solution you're seeking. We do have two related posts you can explore for related content: Configuring Storage Integrations Between Snowflake and AWS S3 Automated Ingestion from Azure...
To ingest data stored in AWS S3 into Snowflake, you can use either direct COPY INTO statements or a Snowpipe for automation. Both options require a Snowflake object called an external stage to connect Snowflake to AWS. It's recommended to use Storage Integrations for authentication...
This article is builds on the following two previous articles: Intro to Azure Functions and Snowpark: Populating Snowflake Control Tables Using Azure App Settings to Authenticate Snowflake with Python The above articles do a great job at building a foundation for building Azure Functions that leverage...
New year, new me! Tired of hearing that one yet? It's the time of year to start (and potentially abandon) your New Year's Resolutions. If you're kinda over the whole trend, I recommend this video from CGP Grey that replaces a single resolution with "Themes"...
Earlier this month, my colleague Jason Hoehn published the following article: Intro to Azure Functions and Snowpark: Populating Snowflake Control Tables Jason's article did a great job at building a foundation for building Azure Functions that leverage Snowpark for Python to interact with Snowflake. However, the focus...
If you wish to automatically stream/ingest data from an Azure Storage container into Snowflake, using native functionality, you will most likely be considering what is commonly referred to as a Snowpipe. In real terms, a Snowpipe for Azure is actually a combination of multiple components: ...
If you have data stored in an Azure Storage container and wish to ingest it into Snowflake using native functionality, you will most likely be considering either direct COPY INTO statements or an automated Snowpipe to ingest the data. Both of these options would expect...
If you’ve heard about ThoughtSpot, you are probably as excited as we are here at Interworks about its potential. If you are not too familiar with this tool I’d strongly suggest this article series. Several of our clients in Sydney and Melbourne all agree on one...
Snowflake is a powerful software that can store data points that are important for auditing the ETL process. This is done by creating a control table, which tracks ETL jobs that have been run and their statuses. There are a variety of methods for populating...
Happy New Year, everyone! We hope you all had a fantastic holiday season and are coming into the new year refreshed and ready for a fantastic 12 months. To cap off 2022, we opted for quality over quantity on the blog front. (It also helps...
Snowflake Secure Data Sharing enables users to provide specific data points to consumers using the same cloud provider within the same region. Providers can share tables, external tables, secure views, secure materialized views or secure user defined functions with consumers. Data sharing is customizable, and...
Snowflake itself is really strong at reporting task schedules and history. If you ever use the TASK_HISTORY table function, you can even view the NEXT_SCHEDULED_TIME for each scheduled task. However, it is common to be in a situation where you are leveraging another tool for your pipeline orchestration,...
In another post earlier this year, we discussed how to store the results of a Snowflake SHOW/LIST/DESCRIBE metadata command in a table. Refresher To refresh our memory, in Snowflake, there are several commands that can be used to retrieve metadata from the Snowflake environment without using a...
We've made it to the tail end of 2022. Holiday season is upon us, and it's fitting that Snowflake is the most blogged about topic for us to share in this edition of the InterWorks Blog Roundup — we randomly had a night of golfball-sized...
Interworks GmbH
Ratinger Straße 9
40213 Düsseldorf
Germany
Geschäftsführer: Mel Stephenson
Kontaktaufnahme: markus@interworks.eu
Telefon: +49 (0)211 5408 5301
Amtsgericht Düsseldorf HRB 79752
UstldNr: DE 313 353 072
