-
Notifications
You must be signed in to change notification settings - Fork 1.4k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Doc] Missing and outdated Airflow metrics >=2.7.0 #18584
Comments
Same for {
"match": "airflow\\.dag\\.(.*)\\.([^.]*)\\.scheduled_duration",
"match_type": "regex",
"name": "airflow.dag.task.scheduled_duration",
"tags": {"dag_id": "$1", "task_id": "$2"},
}, |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
The
DD_DOGSTATSD_MAPPER_PROFILES
config used by the Airflow integration is missing thequeued_duration
metric, and mishandlestask_instance_created
past 2.6.3.Queued duration
The
dag.<dag_id>.<task_id>.queued_duration
looks to have been introduced in Airflow 2.7.0, and the DogStatsD mapper profile provided on the Integrations page is missing its entry.As a result, it's exploding the number of metrics (+3k in my case).
I suggest adding the following entry
Task instance created
From version 2.6.3 to 2.7.0, the counter the task instance created metric changed format:
This results in 1 metric per operator, which makes it hardly usable.
The current mapping is
which could perhaps be
to handle both versions ?
Would it be worth adding a disclaimer, warning the user that the mapping was created for version X ?
The text was updated successfully, but these errors were encountered: