Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Lock-free Postgres implementation #125

Open
joshbenaron opened this issue Jul 15, 2023 · 2 comments
Open

Lock-free Postgres implementation #125

joshbenaron opened this issue Jul 15, 2023 · 2 comments
Milestone

Comments

@joshbenaron
Copy link

Hey - what's the timeline for Lock-free Postgres implementation?

Feel free to outline the rough problem which needs to be solved and we (Bundlr) might be able to solve, depending on time commitment

@geofmureithi
Copy link
Owner

The idea behind this implementation is inspired by Que
https://github.com/que-rb/que/blob/9b264060d81f639d60bc9084ad6cc7dfb8812eba/lib/que/poller.rb#L60-L113

The full context is provided by the lib author here:
https://gist.github.com/chanks/7585810

This improvement would hopefully get postgres to 10k/s jobs from the current 1.5k/s in Github CI.
This should be straight forward porting and if combined with #126, then I expect huge performance boost.

@geofmureithi geofmureithi added this to the 0.5 milestone Jul 16, 2023
@geofmureithi
Copy link
Owner

What are your thoughts @joshbenaron ?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants