Optimizing Snowflake — Your Complete Series for Peak Performance at Low Cost
Have been writing various articles about optimizing Snowflake from a cost/performance perspective. This article is a collection of all…
Johan
Optimizing Snowflake (5) — Queuing and spilling, your worst enemies
When executing queries, two things can happen that you want to avoid at all time. Why: because they will cause totally unpredictable…
Snowflake — 120 day trial
We knew about the possibility to start a 30 day Snowflake trial. Just discovered a 120 day trial option. How to find it:
Optimizing Snowflake (3) — Quick wins
Execute these commands to set parameters for your warehouses plus additional settings on the account level. It will reduce credit usage…
Optimizing Snowflake (2) — investigating expensive queries
After being able to identify the most expensive queries, the next step is to zoom in on individual cases. In the previous article, we…
Databricks — trial/community edition (CE)
When going to the website, it is quite easy to start a trial.
Optimizing Snowflake (1)— overview & strategy
This is the first part of a new series of articles I will be posting here: how to optimize Snowflake for cost and performance.
Snowflake — Iceberg tables 101
TL;DR use this Snowflake Quickstart to explore Iceberg tables https://quickstarts.snowflake.com/guide/getting_started_iceberg_tables
to add:
folderstructure, plus add a folder parameter to execute only that folder
An alternative option is to use the session_id, follow this link for more info:
https://community.snowflake.com/s/article/Getting-the-execution-details-of-procedure
Optimizing Snowflake (4): monitoring and debugging stored procedures using query tagging
When you run Snowflake stored procedures, debugging is not the easiest thing. This is my example stored procedure, dynamically dropping tables: create or replace procedure groupby.public.droptables(message VARCHAR) RETURNS VARCHAR NOT NULL LANGUAGE SQL AS $$ DECLARE v_sql_query VARCHAR; c_table CURSOR FOR SELECT TABLE_NAME FROM
Snowflake — CI/CD tooling
TL/DR; take a look at my Python CI/CD tool for Snowflake: SFexecute. Put the SQL you want to execute in a folder, run the script and all…