Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Speed up CI and reduce costs #2294

Open
16 tasks
shumkov opened this issue Oct 30, 2024 · 0 comments
Open
16 tasks

Speed up CI and reduce costs #2294

shumkov opened this issue Oct 30, 2024 · 0 comments
Assignees
@shumkov @lklimek @ktechmidas

Comments

@shumkov
Copy link
Member

shumkov commented Oct 30, 2024 •
edited
Loading

Docker image build:

  • Make sure we reuse docker layers
  • cache error in docker build logs

Drive ABCI:

Rust complication and tests:

  • Use nextest to split tests into separate jobs
  • Enable rust build cache between runs
  • Move all possible tests back to free runners

Run strategies:

  • Inpect current issues and errors
  • Remove extra runs (i.e. for each PR we run twice on merge and push to master. also after merge CI is not canceling)
  • Revisit dependecny of package tests

TBD: Split into 2-3 categories when we can run light tests for free and then long-running (upgrade tests in drive abci) on demain or when we merge the PR

Infrastructure:

  • Spot instances
  • On-demand runners if we out of sport instances
  • Use cheaper regions
  • Choose and fine tune the instance types according to the jobs
@shumkov shumkov changed the title Speed up CI Speed up CI and reduce costs Oct 30, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@shumkov shumkov

@lklimek lklimek

@ktechmidas ktechmidas

Labels
None yet
Projects
Platform team
Status: In Progress
Milestone
No milestone
Development

No branches or pull requests
3 participants
@shumkov @lklimek @ktechmidas