Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

AI: 'energyConsumption', 'finetuningEnergyConsumption', 'inferenceEnergyConsumption' would vary so is it correct to record them? #768

Open
VenkatTechnologist opened this issue May 9, 2024 · 1 comment
Labels
Profile:AI Artificial intelligence profile
Milestone

Comments

@VenkatTechnologist
Copy link
Contributor

VenkatTechnologist commented May 9, 2024

Description of 'finetuningEnergyConsumption' says that it's the energy consumed for finetuning an AI model.
Description of 'energyConsumption' says that it's the energy consumed for training an AI model.
Description of 'inferenceEnergyConsumption' says that it's the energy consumed during inference.

An AI model could go through multiple fine tunings in its lifecycle. The amount of energy consumed would vary
from instance to instance, and won't be constant to be recorded. Training of an AI model can happen
multiple times, so the energy consumed will not be the same for every instance. Likewise, energy consumed during
inference would vary depending on the amount and nature of the data that's being processed.

These properties attempt to capture these value (as a constant). I am not sure if this is correct.
If it is indeed correct, then more explanation is needed as to what these property mean and is meant for.

@VenkatTechnologist VenkatTechnologist changed the title AI: 'finetuningEnergyConsumption' would vary so is it valuable to specify? AI: 'energyConsumption' and 'finetuningEnergyConsumption' would vary so is it valuable to specify? May 9, 2024
@VenkatTechnologist VenkatTechnologist changed the title AI: 'energyConsumption' and 'finetuningEnergyConsumption' would vary so is it valuable to specify? AI: 'energyConsumption', 'finetuningEnergyConsumption', 'inferenceEnergyConsumption' would vary so is it correct to record them? May 9, 2024
@bact
Copy link
Collaborator

bact commented Jun 5, 2024

In the absence of an actual measurement, an estimation is acceptable -- at least according to the Section 1 of Annex XI of EU AI Act.

The record is from the model provider side, based on their configuration (if it is about training, it can be documented in informationAboutTraining property).

The user/deployer of the model can have different numbers, they can record theirs in a new object/new SPDX document. For example, after they finetuned a pretained model, they will have another set of energy consumption records.

@goneall goneall added the Profile:AI Artificial intelligence profile label Jun 10, 2024
@goneall goneall added this to the 3.1 milestone Jun 10, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Profile:AI Artificial intelligence profile
Projects
None yet
Development

No branches or pull requests

3 participants