Custom metric does not get loaded into k8s/api not available

[fontexD]

[What] happened?:

Trying to add custom metric from prometheus, verified data and series is availaable.

What did you expect to happen?:
i expetced the metric to be available inside k8s and useable by hpa, it seems that adapter is getting data all good, but after that nothing, not collectable/viewable from kubectl nor the hpa deploy

Please provide the prometheus-adapter config:

prometheus-adapter config

apiVersion: v1
kind: ConfigMap
metadata:
name: adapter-config
namespace: ops-services
data:
config.yaml: |
rules:
- seriesQuery: 'rabbitmq_queue_messages{queue="med_persist_encoded_error", instance="rabbitmqexporter.p2l-demo-services.svc.cluster.local:9419"}'
resources:
overrides:
kubernetes_namespace:
resource: namespace
name:
as: "rabbitmq_queue_messages"
metricsQuery: sum(<<.Series>>{<<.LabelMatchers>>})

Please provide the HPA resource used for autoscaling:

HPA yaml

apiVersion: autoscaling/v2beta2
kind: HorizontalPodAutoscaler
metadata:
name: nginx-hpa
namespace: default
spec:
scaleTargetRef:
apiVersion: apps/v1
kind: Deployment
name: nginx
minReplicas: 1
maxReplicas: 10
metrics:

• type: Pods
  pods:
  metric:
  name: rabbitmq_queue_messages
  target:
  type: AverageValue
  averageValue: 1

Please provide the HPA status:
dosent really matter i cant even kubectl and show the metric, so ofc not even hpa is able to se it aither ..
Please provide the prometheus-adapter logs with -v=6 around the time the issue happened:

prometheus-adapter logs

i addded picture with logs, and adapter seems to be 100% working correct or 99% since the data is not "uploaded" into k8s/api so not accessable beside inside the adapter logs

Anything else we need to know?:

Environment:

• prometheus-adapter version: 0.12
• prometheus version: latest
• Kubernetes version1.30.0
• Cloud provider or hardware configuration: bare-metal :) vanilla
  
  
  

[dgrisonnet]

/kind support
/triage accepted

[Arv1nt3]

I have the same issue, it is detailed here: https://stackoverflow.com/questions/78787075/kubernetes-hpa-unable-to-fetch-custom-metrics-from-prometheus-adapter

[DPrakhin]

Guys, we also have the same issue but for external metrics - /apis/external.metrics.k8s.io/v1beta1
It's described here: #680