-
Notifications
You must be signed in to change notification settings - Fork 1.2k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Garbage collect UIDs—draft for feedback #1736
base: next
Are you sure you want to change the base?
Conversation
distributed processing? |
Store it in distributed cache middleware through plug-in modification? |
It's a big project. |
I'm a newbie, and I want to know if it would be better to do garbage collection with offline batch processing, like spark. Then make a union of the uid used or generated during the processing and the results of offline processing. If it doesn't work, please ignore it, hahaha |
I know this is now ancient. I've been away from the project for a long time and the bulk of the team is working on 3.0. This looks good, did you do any further development on it? |
I did not; I looked into 3.0, but at the time it was not usable in any way. |
This is a sketch of implementation for #1402. I haven't actually tested it manually yet, but wanted to get some feedback.
Thank you!