Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: Bigquery dataset create table disposition #4649

Open
wants to merge 6 commits into
base: master
Choose a base branch
from

Conversation

danbaron63
Copy link
Contributor

@danbaron63 danbaron63 commented Oct 18, 2024

What this PR does / why we need it:

  • Updates get_historical_features to not create a BigQuery dataset when create_table_disposition is set to CREATE_NEVER.
  • Cleans up or ignores some linting issues preventing pushing due to pre-commit checks.

Which issue(s) this PR fixes:

Fixes #4648

Misc

This PR brings BigQuery dataset creation in line with table creation - this will hopefully be useful to orgs (such as mine!) that have stricter requirements over what can/cannot make infrastructure/warehouse changes in production environments. In our case get_historical_features is expected to be read only operation.

…gration tests, added self param to a method that was failing linting and ignoring other issues

Signed-off-by: Dan Baron <[email protected]>
…n get_historical_features is called

Signed-off-by: Dan Baron <[email protected]>
…o kwargs in the repo_configuration integration tests

Signed-off-by: Dan Baron <[email protected]>
…o fix due to length of type required and imports

Signed-off-by: Dan Baron <[email protected]>
@danbaron63 danbaron63 changed the title Bigquery dataset create table disposition fix: bigquery dataset create table disposition Oct 18, 2024
@danbaron63 danbaron63 changed the title fix: bigquery dataset create table disposition fix: Bigquery dataset create table disposition Oct 18, 2024
@danbaron63 danbaron63 marked this pull request as ready for review October 21, 2024 08:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Feast will attempt to create a BigQuery dataset regardless of table_create_disposition
1 participant