Skip to content

Latest commit

 

History

History
178 lines (139 loc) · 3.29 KB

grafana.md

File metadata and controls

178 lines (139 loc) · 3.29 KB
Raw

Original queries

Response Time Panel:

SELECT
  timestamp AS time,
  response_time
FROM conversations
ORDER BY timestamp

Relevance Distribution Panel:

SELECT
  relevance,
  COUNT(*) as count
FROM conversations
GROUP BY relevance

Model Usage Panel:

SELECT
  model_used,
  COUNT(*) as count
FROM conversations
GROUP BY model_used

Token Usage Panel:

SELECT
  timestamp AS time,
  total_tokens
FROM conversations
ORDER BY timestamp

OpenAI Cost Panel:

SELECT
  timestamp AS time,
  openai_cost
FROM conversations
WHERE openai_cost > 0
ORDER BY timestamp

Recent Conversations Panel:

SELECT
  timestamp AS time,
  question,
  answer,
  relevance
FROM conversations
ORDER BY timestamp DESC
LIMIT 5

Feedback Statistics Panel:

SELECT
  SUM(CASE WHEN feedback > 0 THEN 1 ELSE 0 END) as thumbs_up,
  SUM(CASE WHEN feedback < 0 THEN 1 ELSE 0 END) as thumbs_down
FROM feedback

Revised queries

We can (and should) also use special grafana variables

  • $__timeFrom() and $__timeTo(): Start and end of the selected time range
  • $__timeGroup(timestamp, $__interval): Groups results by time intervals automatically calculated by Grafana

1. Response Time Panel

This query shows the response time for each conversation within the selected time range:

SELECT
  timestamp AS time,
  response_time
FROM conversations
WHERE timestamp BETWEEN $__timeFrom() AND $__timeTo()
ORDER BY timestamp

2. Relevance Distribution Panel

This query counts the number of conversations for each relevance category within the selected time range:

SELECT
  relevance,
  COUNT(*) as count
FROM conversations
WHERE timestamp BETWEEN $__timeFrom() AND $__timeTo()
GROUP BY relevance

3. Model Usage Panel

This query counts the number of times each model was used within the selected time range:

SELECT
  model_used,
  COUNT(*) as count
FROM conversations
WHERE timestamp BETWEEN $__timeFrom() AND $__timeTo()
GROUP BY model_used

4. Token Usage Panel

This query shows the average token usage over time, grouped by Grafana's automatically calculated interval:

SELECT
  $__timeGroup(timestamp, $__interval) AS time,
  AVG(total_tokens) AS avg_tokens
FROM conversations
WHERE timestamp BETWEEN $__timeFrom() AND $__timeTo()
GROUP BY 1
ORDER BY 1

5. OpenAI Cost Panel

This query shows the total OpenAI cost over time, grouped by Grafana's automatically calculated interval:

SELECT
  $__timeGroup(timestamp, $__interval) AS time,
  SUM(openai_cost) AS total_cost
FROM conversations
WHERE timestamp BETWEEN $__timeFrom() AND $__timeTo()
  AND openai_cost > 0
GROUP BY 1
ORDER BY 1

6. Recent Conversations Panel

This query retrieves the 5 most recent conversations within the selected time range:

SELECT
  timestamp AS time,
  question,
  answer,
  relevance
FROM conversations
WHERE timestamp BETWEEN $__timeFrom() AND $__timeTo()
ORDER BY timestamp DESC
LIMIT 5

7. Feedback Statistics Panel

This query calculates the total number of positive and negative feedback within the selected time range:

SELECT
  SUM(CASE WHEN feedback > 0 THEN 1 ELSE 0 END) as thumbs_up,
  SUM(CASE WHEN feedback < 0 THEN 1 ELSE 0 END) as thumbs_down
FROM feedback
WHERE timestamp BETWEEN $__timeFrom() AND $__timeTo()