Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Liquid Clustering configuration for Python-based models #411

Closed
ammarchalifah opened this issue Aug 9, 2023 · 3 comments
Closed

Liquid Clustering configuration for Python-based models #411

ammarchalifah opened this issue Aug 9, 2023 · 3 comments
Labels
blocked We cannot currently make progress on this issue, but it is on our radar. enhancement New feature or request Stale

Comments

@ammarchalifah
Copy link
Contributor

Describe the feature

Similar to Liquid Clustering for SQL-based Delta tables in this PR, similar functionality should also be implemented for Python-based model. Currently Liquid Clustering doesn't have stable API in Python, so the implementation of this feature request might wait for that.

Describe alternatives you've considered

Additional context

Who will this benefit?

Databricks customer who wish to use Liquid Clustering & dbt.

Are you interested in contributing this feature?

Yes

@benc-db
Copy link
Collaborator

benc-db commented Aug 16, 2023

Thanks for filing this. Once the python config that I've been working on becomes part of a mainstream release, I will tackle this.

@benc-db
Copy link
Collaborator

benc-db commented Sep 13, 2023

Just updating to note that this work (the python support) is waiting on PySpark to support this feature. Until then not much I can do, since liquid clustering needs to be declared as part of table create.

@benc-db benc-db added the blocked We cannot currently make progress on this issue, but it is on our radar. label Oct 3, 2023
Copy link

github-actions bot commented Apr 1, 2024

This issue has been marked as Stale because it has been open for 180 days with no activity. If you would like the issue to remain open, please remove the stale label or comment on the issue.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
blocked We cannot currently make progress on this issue, but it is on our radar. enhancement New feature or request Stale
Projects
None yet
Development

No branches or pull requests

2 participants