Adds LLM cost view in insights

[elijahbenizzy]

This is left with a placeholder for unhardcoding the values. Otherwise it's fixed at 5.00/1m tokens, just to illustrate.

Changes

How I tested this

Notes

Checklist

• PR has an informative and human-readable title (this will be pulled into the release notes)
• Changes are limited to a single goal (no scope creep)
• Code passed the pre-commit check & code is left cleaner/nicer than when first encountered.
• Any change in functionality is tested
• New functions are documented (with a description, list of inputs, and expected output)
• Placeholder code is flagged / future TODOs are captured in comments
• Project documentation has been updated if adding/changing functionality.

---

Important

Adds Total LLM Cost insight to InsightsView.tsx to calculate and display LLM usage cost based on token usage.

• Behavior:
  • Adds Total LLM Cost insight in InsightsView.tsx to calculate and display LLM usage cost.
  • Uses gatherCostAttributes() to aggregate cost-related attributes.
  • Formats cost using Cost component with dynamic decimal places.
• Functions:
  • getCostPerTokenModelDollars() retrieves cost per token for models.
  • gatherCostAttributes() aggregates token usage and calculates total cost.
  • Cost component formats and displays cost values.
• Misc:
  • Adds placeholder for unhardcoding cost values in getCostPerTokenModelDollars().

^{This description was created by for 0ee6618. It will automatically update as commits are pushed.}

[github-actions]

A preview of 0ee6618 is uploaded and can be seen here:

✨ https://burr.dagworks.io/pull/376 ✨

Changes may take a few minutes to propagate. Since this is a preview of production, content with draft: true will not be rendered. The source is here: https://github.com/DAGWorks-Inc/burr/tree/gh-pages/pull/376/

[ellipsis-dev]

❌ Changes requested. Reviewed everything up to 0ee6618 in 1 minute and 9 seconds

More details

• Looked at 4010 lines of code in 4 files
• Skipped 0 files when reviewing.
• Skipped posting 0 drafted comments based on config settings.

Workflow ID: wflow_IFFNHGP3MQfHumgA

---

Want Ellipsis to fix these issues? Tag @ellipsis-dev in a comment. You can customize Ellipsis with 👍 / 👎 feedback, review rules, user-specific overrides, quiet mode, and more.