dbt-bigquery v1.1.0rc2

Fixes

• Restore default behavior for query timeout. Set default job_execution_timeout to None by default. Keep 300 seconds as default timeout where previously used.

dbt-bigquery v1.1.0rc1

dbt-bigquery 1.1.0rc1 (April 13, 2022)

Under the hood

• Use dbt.tests.adapter.basic in tests (new test framework) (#135, #142)
• Adding pre-commit and black formatter hooks (#147)
• Adding pre-commit code changes (#148)

dbt-bigquery v1.1.0b1

dbt-bigquery 1.1.0b1 (March 23, 2022)

Features

• Provide a fine-grained control of the timeout and retry of BigQuery query with four new dbt profile configs: job_creation_timeout_seconds, job_execution_timeout_seconds, job_retry_deadline_seconds, and job_retries (#45, #50)
• Adds new integration test to check against new ability to allow unique_key to be a list. #112
• Added upload_file macro to upload a local file to a table. #102
• Add logic to BigQueryConnectionManager to add fuctionality for UPDATE and SELECT statements. #79

Fixes

• Fix test related to preventing coercion of boolean values (True, False) to numeric values (0, 1) in query results (#93)
• Add a check in get_table_options to check that the table has a partition_by in the config.
  This will prevent BigQuery from throwing an error since non-partitioned tables cannot have require_partition_filter (#107)
• Ignore errors of the lack of permissions in list_relations_without_caching (#104)

Under the hood

• Address BigQuery API deprecation warning and simplify usage of TableReference and DatasetReference objects (#97),(#98)
• Add contributing.md file for adapter repo #73
• Add stale messaging workflow to Github Actions #103
• Add unique_key to go in parity with unique_key as a list chagnes made in core #119
• Adding new Enviornment variable for integration testing puproses #116

Contributors

• @hui-zheng(#50)
• @oliverrmaa(#109)
• @yu-iskw(#108)
• @pgoslatara (#66)
• @drewmcdonald(#98)
• @rjh336(#79)

dbt-bigquery v1.0.0

dbt BigQuery 1.0.0

Features

• Add optional scopes profile configuration argument to reduce the BigQuery OAuth scopes down to the minimal set needed. (#23, #63)
• Rework _dbt_max_partition logic in dynamic insert_overwrite incremental strategy. Make the default logic compatible with on_schema_change, and make it possible to disable or reimplement that logic by defining a custom macro declare_dbt_max_partition (#17, #39, #41)

Fixes

• Don't apply require_partition_filter to temporary tables, thereby fixing insert_overwrite strategy when partition filter is required (#64), (#65)
• Fix problem with bytes processed return None value when the service account used to connect DBT in bigquery had a row policy access.
  (#47, #48)
• When on_schema_change is set, pass common columns as dest_columns in incremental merge macros (#4144)
• Reimplement the unique test to handle column expressions and naming overlaps (#33, #35, #10)
• Avoid error in dbt deps + dbt clean if default project is missing (#27, #40)

Under the hood

• Adding execution_project to target object (#66)
• Capping google-api-core to version 1.31.3 due to protobuf dependency conflict (#53)
• Bump google-cloud-core and google-api-core upper bounds to <3, thereby removing <1.31.3 limit on the latter. Remove explicit dependency on six (#57)
• Remove official support for python 3.6, which is reaching end of life on December 23, 2021 (dbt-core#4134, #59)
• Add support for structured logging #55
• Replace sample_profiles.yml with profile_template.yml, for use with new dbt init (#43)
• Initial adapter split out

Contributors

• @pgoslatara (#66)
• @bborysenko (#63)
• @yu-iskw (#65)
• @imartynetz (#48)
• @Kayrnt (#51)
• @DigUpTheHatchet (#10)
• @jeremyyeo (#40)
• @NiallRees (#43)

dbt-bigquery v1.0.0rc2

A second release candidate for dbt-bigquery v1.0.0. Changes since rc1:

Features

• Add optional scopes profile configuration argument to reduce the BigQuery OAuth scopes down to the minimal set needed. (#23, #63)

Fixes

• Don't apply require_partition_filter to temporary tables, thereby fixing insert_overwrite strategy when partition filter is required (#64, #65)

Under the hood

• Adding execution_project to target object (#66)

Contributors

• @pgoslatara (#66)
• @bborysenko (#63)
• @yu-iskw (#65)

dbt-bigquery v1.0.0rc1

Tracking dbt-core v1.0.0rc1.

$ pip install dbt-bigquery==1.0.0rc1

Includes everything in b1 + b2, plus:

Fixes

• Fix problem with bytes processed return None value when the service account used to connect DBT in bigquery had a row policy access.
  (#47, #48)
• When on_schema_change is set, pass common columns as dest_columns in incremental merge macros (#4144)

Under the hood

• Capping google-api-core to version 1.31.3 due to protobuf dependency conflict (#53)
• Bump google-cloud-core and google-api-core upper bounds to <3, thereby removing <1.31.3 limit on the latter. Remove explicit dependency on six (#57)
• Remove official support for python 3.6, which is reaching end of life on December 23, 2021 (dbt-core#4134, #59)
• Add support for structured logging #55

Contributors

• @imartynetz (#48)
• @Kayrnt (#51)

dbt-bigquery v1.0.0b2

Tracking dbt-core v1.0.0b2.

$ pip install dbt-bigquery==1.0.0b2

Features

• Rework _dbt_max_partition logic in dynamic insert_overwrite incremental strategy. Make the default logic compatible with on_schema_change, and make it possible to disable or reimplement that logic by defining a custom macro declare_dbt_max_partition (#17, #39, #41)

Fixes

• Reimplement the unique test to handle column expressions and naming overlaps (#33, #35, #10)
• Avoid error in dbt deps + dbt clean if default project is missing (#27, #40)

Under the hood

• Replace sample_profiles.yml with profile_template.yml, for use with new dbt init (#43)

Contributors

• @DigUpTheHatchet (#10)
• @jeremyyeo (#40)
• @NiallRees (#43)

dbt-bigquery v1.0.0b1

Tracking dbt-core v1.0.0b1.

$ pip install dbt-bigquery==1.0.0b1

Under the hood

Initial adapter split out