snowplow-utils v0.17.1

Summary

This release is aiming to optimize base_create_snowplow_events_this_run macro for spark.

Fix

• Optimize base_create_snowplow_events_this_run for spark

Upgrading

Update the snowplow-utils version in your packages.yml file.

snowplow-utils v0.17.0

Summary

This release focuses on expanding support for Apache Spark with the Iceberg file format and enhancing integration tests.

Features

• Add support for Apache Spark with Iceberg file format

Under the hood

• Modify integration tests to support Spark
• Changed return_limits_from_model macro default limits

Upgrading

Update the snowplow-utils version in your packages.yml file.

snowplow-utils v0.16.8

Summary

This release extends support for those users who would like to use the Snowplow incremental base macros but are using specific older versions of the AMP tracker or the Pixel tracker which do not send dvce_created / dvce_sent_tstamp fields. It also fixes a bug in the apply_grands() macro when the users does not have a grants config defined.

Features

• Add allow_null_dvce_tstamps var

Fixes

• Add default for grant_config macro

Upgrading

To upgrade, bump the package version in your packages.yml file.

snowplow-utils v0.16.7

Summary

This release extends support for the combine_column_versions macro to support column prefixes not ending in a major version number (when used in combination with exclude column versions).

Features

• Extend functionality of combine_column_versions

Under the hood

• Update some of our test to pass with newer versions of dbt utils

Upgrading

To upgrade, bump the package version in your packages.yml file.

snowplow-utils v0.16.6

Summary

This release adds support for a list of unique keys when using the snowplow optimized incremental approach with the delete+insert strategy.

Features

• Support list of unique keys when using delete+insert strategy with snowplow optimize

Upgrading

To upgrade, bump the package version in your packages.yml file.

snowplow-utils v0.16.5

Summary

This release moves the custom sql part of the events this run macro for redshift to the same level as the custom entities or SDEs are joined so that they can be used in any custom sql.

Features

• Allow usage of entity and SDE fields in custom SQL for redshift.

Upgrading

To upgrade, bump the package version in your packages.yml file.

snowplow-utils v0.16.4

Summary

This release adds more flexibility to the exclude_versions argument of the combine_column_versions macro for BigQuery to allow removal of any column with the suffix of the specified version.

Fixes

• Remove hardcoded structure requirement to exclude column versions.

Upgrading

To upgrade, bump the package version in your packages.yml file.

snowplow-utils v0.16.3

Summary

This releases adds the database argument to the get_sde_or_context macro.

Features

• Add database argument to get_sde_or_context macro

Upgrading

To upgrade, bump the package version in your packages.yml file.

snowplow-utils v0.16.2

Summary

This releases adds two new sets of macros, one is parse_agg_dict that generates aggregation sql, and the other is apply_grants which allows the usage of the snowplow__grant_select_to variable to grant select on models to any user/role in that list (does not support BigQuery). We also fix a rare edge case where custom user identifiers made from sql could lead to duplicate sessions in the lifecycle table.

Features

• Add new parse_agg_dict macro for use to generate aggregation sql in other packages
• Overwrite default dbt apply_grants macro to enable using a variable to define grant targets
• Add new default__grant_usage_on_schemas_built_into macro to add as a post-hook in package to grant usage for schemas
• Ensure only one user id even when a custom user sql is provided for the lifecycles manifest table

Upgrading

To upgrade, bump the package version in your packages.yml file.

snowplow-utils v0.16.1

Summary

This release contains a fix to the unnest macro for redshift, which meant the query wasn't complete when using it without the index.

Fixes

• Fix bug in redshift unnest macro

Upgrading

To upgrade, bump the package version in your packages.yml file.