[Discuss] How to support dimension lookup query for transform

[hailin0]

Search before asking

• I had searched in the feature and found no similar feature requirement.

Description

How to support dimension lookup query for transform

And as EtLT data synchronization, I think we need to support lookup query for transform, and I want to hear from you all how you think it can be implemented in SeaTunnel.

Usage Scenario

No response

Related issues

No response

Are you willing to submit a PR?

• Yes I am willing to submit a PR!

Code of Conduct

• I agree to follow this project's Code of Conduct

[zhdech]

Implementation method:
Option 1 for batch strategy: When starting the strategy, connect to the database, query the database, and save the data results to the cache; When each line of data arrives, search for cached data.
Option 2 for streaming media strategy: On the basis of 1, regularly refresh cached data to ensure that cached data is updated regularly