You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Describe the bug
The performance (for example on arc_easy) from litgpt (using hf api) and using our whittle API does not match exactly for Llama-3.1-8B. This is likely due to issue with RoPE Lightning-AI/litgpt#1745 and needs to be investigated further
The text was updated successfully, but these errors were encountered:
Describe the bug
The performance (for example on arc_easy) from litgpt (using hf api) and using our whittle API does not match exactly for Llama-3.1-8B. This is likely due to issue with RoPE Lightning-AI/litgpt#1745 and needs to be investigated further
The text was updated successfully, but these errors were encountered: