Python is a first class language in the Snowflake eco system, and there are multiple ways to use Python with Snowflake: Snowflake Connector for Python: Listed in Snowflake drivers, this is a standard connector to Snowflake written using Python. It supports developing applications using the...
Recently, Snowflake released external access integrations into general availability. This allows Snowflake admins to create secure tunnels for Snowflake to communicate with the outside world, and can therefore communicate with external APIs to complete all manner of tasks. For example, external access could be used...
Recently, Snowflake released external access integrations into general availability. This allows Snowflake admins to create secure tunnels for Snowflake to communicate with the outside world and can therefore communicate with external APIs to complete all manner of tasks. For example, external access could be used...
I've been a huge fan of Streamlit for years as it enables analysts and data scientists to easily create interactive web apps without the hassle of managing a backend development. I was always happy to read the announcements of new Streamlit features being released and...
What Are Variables? If you have ever done any programming, and since you are reading this blog post you most likely have, you will be familiar with the concept of variables. They are these little helpers in which you can store almost anything, except any physical...
Earlier this year, Snowflake announced the availability of Snowpark ML during its Snowflake Summit. Snowpark ML is a set of tools, including SDKs and underlying infrastructure, to build and deploy machine learning models; all within Snowflake. It works with Snowpark for Python, so you can...
It’s one of my favorite times of year. The weather is cooling, kids are going back to school (phew), and the thrill of Fantasy Football seasons are upon us. Since 2010, a group of my college friends have played in a competitive Fantasy Football league...
Recently, I was involved in a project which required using geospatial (basically maps) data for an analytical application. Now, with ESRI shape files being around for more than three decades, any sincere BI application like Tableau can easily read and work with these spatial files....
As modern applications expand in complexity, effectively managing workflows can become a significant challenge. AWS Step Functions provides a comprehensive solution for orchestrating multi-step workflows in the cloud. Whether it's invoking Lambda functions in Task states, separating branches of execution with Parallel states or running...
In previous articles in this series, we have demonstrated how to set up Azure Functions to leverage Snowpark for Python. This allows us to interact with Snowflake from an Azure Function, unlocking a wide range of opportunities for scripting activity. In this article, we will focus...
If you've ever tried running SQL queries against Snowflake from an AWS Lambda function using Python, chances are you may have run into an error message like this: ⛔️ No module named 'snowflake' Fear not, there's a simple solution you can apply in no time. In this...
Welcome back to our mini-series on Snowflake External Functions with Azure. Before we proceed, please read the previous post on how to set up these functions and how Snowflake interacts with Azure: A Definitive Guide to Setting up Snowflake External Functions with Azure Why Choose an...
I’ve always loved Spotify’s year-in-review analysis. But, as a data nerd, I yearn for the underlying data – the stories I know are there but don’t have access to. While I know Spotify makes a lot of this data accessible through it’s API, I have...
This article is builds on the following two previous articles: Intro to Azure Functions and Snowpark: Populating Snowflake Control Tables Using Azure App Settings to Authenticate Snowflake with Python The above articles do a great job at building a foundation for building Azure Functions that leverage...
Fivetran's custom connector enables customers to create an ingestion process for data sources that are not currently offered by Fivetran's service. This is accomplished by creating a function in Amazon Web Services (AWS), Microsoft Azure or Google Cloud Platform (GCP) using a programming language such...
Earlier this month, my colleague Jason Hoehn published the following article: Intro to Azure Functions and Snowpark: Populating Snowflake Control Tables Jason's article did a great job at building a foundation for building Azure Functions that leverage Snowpark for Python to interact with Snowflake. However, the focus...
Snowflake is a powerful software that can store data points that are important for auditing the ETL process. This is done by creating a control table, which tracks ETL jobs that have been run and their statuses. There are a variety of methods for populating...
Snowflake itself is really strong at reporting task schedules and history. If you ever use the TASK_HISTORY table function, you can even view the NEXT_SCHEDULED_TIME for each scheduled task. However, it is common to be in a situation where you are leveraging another tool for your pipeline orchestration,...
In another post earlier this year, we discussed how to store the results of a Snowflake SHOW/LIST/DESCRIBE metadata command in a table. Refresher To refresh our memory, in Snowflake, there are several commands that can be used to retrieve metadata from the Snowflake environment without using a...
Snowpark for Python is the name for the new Python functionality integration that Snowflake has recently developed. At the Snowflake Summit in June 2022, Snowpark for Python was officially released into Public Preview, which means anybody is able to get started using Python in their...
Interworks GmbH
Ratinger Straße 9
40213 Düsseldorf
Germany
Geschäftsführer: Mel Stephenson
Kontaktaufnahme: markus@interworks.eu
Telefon: +49 (0)211 5408 5301
Amtsgericht Düsseldorf HRB 79752
UstldNr: DE 313 353 072