Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[#5370] feat(iceberg): make IcebergTableOperationDispatcher interface more extendable #5369

Open
wants to merge 2 commits into
base: main
Choose a base branch
from

Conversation

FANNG1
Copy link
Contributor

@FANNG1 FANNG1 commented Oct 30, 2024

What changes were proposed in this pull request?

add IcebergRequestContext in IcebergTableOperationDispatcher

Why are the changes needed?

Fix: #5370

Does this PR introduce any user-facing change?

No

How was this patch tested?

existing tests

@FANNG1 FANNG1 changed the title [SIP] feat(iceberg): support iceberg context [#5370] feat(iceberg): make IcebergTableOperationDispatcher interface more extendible Oct 30, 2024
@FANNG1 FANNG1 added the branch-0.7 Automatically cherry-pick commit to branch-0.7 label Oct 30, 2024
@puchengy
Copy link

Do we plan to make similar changes to IcebergNamespaceOperations and IcebergViewOperations once those classes are switched to use getCatalogWrapper method?

Comment on lines 84 to 85
new IcebergCreateTablePreEvent(
PrincipalUtils.getCurrentUserName(), nameIdentifier, createTableRequest));

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Would it be possible to pass the whole context object inside pre-listener and post listener?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Could you describe the scenarios?

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes, the use case is logging request headers within the event listener.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sounds reasonable, @jerryshao WDYT?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

My feeling is that exposing the request header to the event seems not so good, makes the event listener too flexible to do anything. If we want to do check request header check beforehand, maybe we can implement some filters in Jetty, and let Gravitino have the ability to load the custom filters.

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@jerryshao Hi Jerry, I think your idea works for filter checking. What about the use case of headers logging along with table events? How would that look like? Thanks.

@FANNG1
Copy link
Contributor Author

FANNG1 commented Oct 30, 2024

Do we plan to make similar changes to IcebergNamespaceOperations and IcebergViewOperations once those classes are switched to use getCatalogWrapper method?

yes, will do

@jerryshao jerryshao changed the title [#5370] feat(iceberg): make IcebergTableOperationDispatcher interface more extendible [#5370] feat(iceberg): make IcebergTableOperationDispatcher interface more extendable Oct 31, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
branch-0.7 Automatically cherry-pick commit to branch-0.7
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Improvement] make IcebergTableOperationDispatcher interface more extendible
3 participants