Potential Data Leakage?

[joshmyersdean]

Hi again @hanoonaR! (cc: @mmaaz60)

I am going through the code base and I noticed that the caption for GCG gets added to the prompt (on this line) but then is never actually removed from the input ids in the collate_fn? Could you please provide some clarification on what is happening in this scenario?

Thank you!
Josh

[joshmyersdean]

It also looks like in the demo that nothing gets appended to the assistant part of the prompt. When I do append something it gets repeated. I have also confirmed that the model repeats the answer part when generating text. However, this does not appear to be done during testing which is good!