Insights
Data posts
New job, new cert, new exam version: my SnowPro Core C03 experience
Data engineer Joline prepared for and passed the newly updated SnowPro Core C03 exam within her first two months. How she studied, and what changed since C02.
Explain Snowflake EXPLAIN: Catching Join Explosions Before They Cost You
Stop reacting to massive Snowflake bills after a query has already failed or stalled. Digital Hive shares how implementing the EXPLAIN command during code review shifts your data engineering from reactive debugging to proactive cost prevention. Reach out to Digital Hive to find out how our data team can optimize your pipelines and eliminate expensive cloud waste.
The Dashboard Migration Button Won't Save Your Snowflake Credits
Is your Snowflake dashboard migration just moving the "compute burn" to a new format? Digital Hive explains why Snowflake’s native conversion button is only phase one of a sustainable migration strategy. See our guide on reducing credits with Streamlit and reach out to Digital Hive to see how we can optimize your entire data stack.
Managing Snowflake Infrastructure-as-Code
Discover how to eliminate environment drift by transitioning from imperative SQL to Snowflake Declarative Configuration Management (DCM). Digital Hive demonstrates how to provision a robust Medallion Architecture using native, version-controlled code. Read the guide and reach out to Digital Hive to explore our full suite of bespoke data engineering solutions.
From NiagaraFiles to Snowflake OpenFlow
Digital Hive examines the strategic integration of Apache NiFi into the Snowflake ecosystem as OpenFlow, bridging the gap between legacy reliability and modern AI-ready architecture. Read the complete technical breakdown and reach out to us today to see how our expert services and solutions can scale your data operations.
How I Fast-Tracked My Snowflake SnowPro Certification using Generative AI
Here is how I combined structured learning with a personalized AI tutor to bridge the gap and pass the Snowflake SnowPro Core certification exam on my first try.
Pipeline visibility from Airflow to dbt
Pipeline visibility from Airflow to dbt: Tired of using current_timestamp() capturing the wrong time for data lineage? Learn the exact Airflow-dbt method to stamp every data row with the correct logical DAG run timestamp, ensuring traceability.
SnowPro Associate: Platform Certification
Recently I passed the Snowflake Platform certification exam. Here I want to quickly go over my Snowflake journey, what led me to take the exam and some tips regarding preparation for the exam.
Getting Databricks certified leaning on my Snowflake experience
In this blog, I want to have a look at my experience getting DataBricks certified. My newest certificate: Databricks Data Engineer Associate. I’ll cover why I pursued the certificate, how I prepared, and my thoughts on the resources and the exam itself.
DBT Certificate reflections and lessons learned
After my first year of working with dbt at Digital Hive I was encouraged as part of my growth path to take the dbt Analytics Engineering Certification Exam dbt Analytics engineer certification exam | dbt Labs and passed. As with most exams, things are never as they seem. With this blog I want to provide future exam participants with some pointers that could help them improve their preparation process for the exam.
Orchestrating Snowflake queries in Airflow
Discover how to orchestrate Snowflake SQL queries using Apache Airflow efficiently.
Can I still automate ingestion if my source data is inconsistent ? - A solution using Snowflake's infer schema
In this blog post we dive into how you can safely handle source data inconsistencies using the Snowflake tool stack. Originally intended to infer schemas from semi-structured or structured files during prototyping, Snowflakes INFER_SCHEMA can easily be implemented in production settings.
dbt build selector: A Practical Guide
In this post, we’ll break down how to use the --select and --exclude options with dbt build and how combining them can supercharge your workflow.
Snowflake external stage limit exceeded
When querying an external stage you should be aware of the following limitations. You may encounter an error 001057, which relates to exceeding file descriptor limits.
The road to POC app building with Streamlit
A Python-based tool like Streamlit can be invaluable for quickly building, deploying, and sharing a POC.
The Path to SnowPro Core Certification
After getting certified for SnowPro Core, we want to share the journey one of our data consultants took to pass this certification and help others learn Snowflake.
The path to the dbt Developer Certification
Getting certified with dbt will test your knowledge of the framework. Read this blog for some tips and guidance to make sure you are ready.
Leverage DBT audit to ensure accurate model generation
Transitioning from legacy ETL tools to DBT? Our blog walks you through using the DBT audit_helper library to ensure data transformation accuracy. Learn how to compare row counts, columns, and more between old and new models. This process provides confidence that your DBT models work as intended, ensuring a smooth, reliable migration.
Empty files not showing up in Snowflake external stage?
Why don’t my empty files show up in my snowflake stage when they do show up in S3 ? Currently there is a bug in snowflake with zero-byte (0b) and one-byte (1b) files. This blog gives you the details and, more importantly, how to fix it.
A comparison of Spark pools in Synapse and Fabric
This comparison of Spark pools in Microsoft Synapse and Microsoft Fabric helps you choose the right platform for your compute needs. Synapse offers a cost-effective, flexible solution, while Fabric delivers advanced AI and analytics for a future-ready approach. By breaking down key features and pricing, this guide empowers you to make smart, strategic decisions that align with your project's goals and budget.