Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Proposal: CCM should store downloaded profiles in git #167

Open
gombasg opened this issue Feb 14, 2017 · 4 comments
Open

Proposal: CCM should store downloaded profiles in git #167

gombasg opened this issue Feb 14, 2017 · 4 comments

Comments

@gombasg
Copy link
Contributor

gombasg commented Feb 14, 2017

Hi,

ccm.conf allows specifying how many old versions of the host profile to keep, but that's not always sufficient. Instead of storing old versions of the profile in distinct directories, I propose to use git to store every version of the profile the host ever downloaded. Advantages:

  • Unlimited history, which could still be trimmed with standard git commands should that be needed
  • Our experiences show that git's delta compression is extremely efficient on (at least XML) profiles. So having all previous versions stored in git could easily end up taking less space than a single extra version does currently (well, at least if you run "git gc" often enough)
  • Having git as a dependency does not sound too heavy, it is widely used, and it could be replaced with any other version control system in the future (or the feature could be disabled, if one does not want to track history)
  • There would be no need for ccm-purge anymore

Thoughts?

@stdweird
Copy link
Member

some remarks:

  • easiest way is to add this to the current structure, instead of fully integrating it (i.e. a separate git repo in parallel with the existing directories; not a replacement of the directories). or did you plan to add the cache dbs in git as well?
  • you'll also want a local tool to fetch a profile from this repo and produce the original (or new?) cid directory (not sure if this should)
  • please suggest a commit message; i guess it should include the CID or the profile name

having git as a dependency is ok, see also quattor/CAF#191.

@jrha
Copy link
Member

jrha commented Oct 13, 2017

Having the commit message the same as the Profile updated message would be nice, e.g.
CID 5 name foobar-sandbox-tkk76468

@stdweird stdweird added this to the 17.10 milestone Oct 15, 2017
@jrha
Copy link
Member

jrha commented Oct 25, 2017

Discussed at RAL workshop, general agreement for the idea. @gombasg have you done anything towards this already?

@jrha jrha removed this from the 17.12 milestone Nov 24, 2017
@jrha
Copy link
Member

jrha commented Nov 24, 2017

@gombasg?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Development

No branches or pull requests

3 participants