Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[testbed] Misleading "Dropped Span Count" metric reported in results #35866

Open
bacherfl opened this issue Oct 18, 2024 · 2 comments
Open

[testbed] Misleading "Dropped Span Count" metric reported in results #35866

bacherfl opened this issue Oct 18, 2024 · 2 comments
Labels
bug Something isn't working needs triage New item requiring triage testbed

Comments

@bacherfl
Copy link
Contributor

Component(s)

testbed

What happened?

Description

Currently, the testbed stores several metrics, such as CPU and memory consumption in a benchmarks.json file after a test has been finished. These metrics also include a Dropped Span Count - this is however misleading, as this is also reported for tests where e.g. only logs or metrics are sent to the collector.
Since this metric calculated based on the data items sent by the datasender and the data items received by the receiver, a better name would be Dropped Data Item Count.

Steps to Reproduce

Execute a load test not related to spans, e.g. this one, and investigate the benchmarks.json file.

Expected Result

The resulting benchmarks.json should include a Dropped Data Item Count metric

Actual Result

The benchmarks.json file includes a Dropped Span Count metric which is misleading that case, e.g.:

[
  {
    "name": "cpu_percentage_avg",
    "unit": "%",
    "value": 1.4635678556630998,
    "extra": "TestMetric10kDPS/Carbon - Cpu Percentage"
  },
  {
    "name": "cpu_percentage_max",
    "unit": "%",
    "value": 1.9655741202201407,
    "extra": "TestMetric10kDPS/Carbon- Cpu Percentage"
  },
  {
    "name": "ram_mib_avg",
    "unit": "MiB",
    "value": 59,
    "extra": "TestMetric10kDPS/Carbon- RAM (MiB)"
  },
  {
    "name": "ram_mib_max",
    "unit": "MiB",
    "value": 103,
    "extra": "TestMetric10kDPS/Carbon - RAM (MiB)"
  },
  {
    "name": "dropped_span_count",
    "unit": "spans",
    "value": 0,
    "extra": "TestMetric10kDPS/Carbon - Dropped Span Count"
  }
]

Collector version

v0.111.0

Environment information

Environment

OS: (e.g., "Ubuntu 20.04")
Compiler(if manually compiled): (e.g., "go 14.2")

OpenTelemetry Collector configuration

No response

Log output

No response

Additional context

No response

@bacherfl bacherfl added bug Something isn't working needs triage New item requiring triage labels Oct 18, 2024
Copy link
Contributor

Pinging code owners:

  • testbed: @open-telemetry/collector-approvers

See Adding Labels via Comments if you do not have permissions to add labels yourself.

@VihasMakwana
Copy link
Contributor

@bacherfl I'll take a look at this and fix this, unless you're already working on submitting a PR. 😄

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working needs triage New item requiring triage testbed
Projects
None yet
Development

No branches or pull requests

2 participants