夜莺采用vm数据源,写入数据时有WARNING,现象即解决方案 #1252
FengZh61
started this conversation in
Show and tell
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
技术路线:Prometheus主动抓取exporter数据,然后Prometheus remote write写入数据到n9e server,n9e server采用vm集群版做为持久化存储。
日志中产生warning告警
2022-11-03 19:25:45.896105 WARNING writer/writer.go:118 push data with remote write request got error: Post "http://192.168.159.133:8480/insert/0/prometheus/api/v1/write": read tcp 192.168.159.133:50207->192.168.159.133:8480: read: connection reset by peer, response body:
2022-11-03 19:25:45.896137 WARNING writer/writer.go:79 post to http://192.168.159.133:8480/insert/0/prometheus/api/v1/write got error: Post "http://192.168.159.133:8480/insert/0/prometheus/api/v1/write": read tcp 192.168.159.133:50207->192.168.159.133:8480: read: connection reset by peer
2022-11-03 19:25:45.896154 WARNING writer/writer.go:118 push data with remote write request got error: Post "http://192.168.159.133:8480/insert/0/prometheus/api/v1/write": read tcp 192.168.159.133:50163->192.168.159.133:8480: read: connection reset by peer, response body:
2022-11-03 19:25:45.896163 WARNING writer/writer.go:80 example timeseries:labels:<name:"name" value:"promhttp_metric_handler_requests_total" > labels:<name:"code" value:"200" > labels:<name:"hostname" value:"mydev01" > labels:<name:"ident" value:"192.168.159.133:9256" > labels:<name:"instance" value:"192.168.159.133:9256" > labels:<name:"ip" value:"192.168.159.133" > labels:<name:"job" value:"process_exporter" > samples:<value:2076 timestamp:1667474745895 >
2022-11-03 19:25:45.896166 WARNING writer/writer.go:79 post to http://192.168.159.133:8480/insert/0/prometheus/api/v1/write got error: Post "http://192.168.159.133:8480/insert/0/prometheus/api/v1/write": read tcp 192.168.159.133:50163->192.168.159.133:8480: read: connection reset by peer
2022-11-03 19:25:45.896182 WARNING writer/writer.go:80 example timeseries:labels:<name:"name" value:"node_memory_Inactive_bytes" > labels:<name:"hostname" value:"mydev01" > labels:<name:"ident" value:"192.168.159.133:9100" > labels:<name:"instance" value:"192.168.159.133:9100" > labels:<name:"ip" value:"192.168.159.133" > labels:<name:"job" value:"node_exporter" > samples:<value:1.746665472e+09 timestamp:1667474745895 >
2022-11-03 19:25:45.896190 WARNING writer/writer.go:118 push data with remote write request got error: Post "http://192.168.159.133:8480/insert/0/prometheus/api/v1/write": read tcp 192.168.159.133:50168->192.168.159.133:8480: read: connection reset by peer, response body:
2022-11-03 19:25:45.896196 WARNING writer/writer.go:79 post to http://192.168.159.133:8480/insert/0/prometheus/api/v1/write got error: Post "http://192.168.159.133:8480/insert/0/prometheus/api/v1/write": read tcp 192.168.159.133:50168->192.168.159.133:8480: read: connection reset by peer
2022-11-03 19:25:45.896206 WARNING writer/writer.go:80 example timeseries:labels:<name:"name" value:"node_memory_HugePages_Surp" > labels:<name:"hostname" value:"mydev01" > labels:<name:"ident" value:"192.168.159.133:9100" > labels:<name:"instance" value:"192.168.159.133:9100" > labels:<name:"ip" value:"192.168.159.133" > labels:<name:"job" value:"node_exporter" > samples:<timestamp:1667474745895 >
解决方法:vminsert启动参数中添加 -vmstorageDialTimeout=300s 修改从vminsert到vmstorage建立RPC连接的超时时间(默认为5s)。
Beta Was this translation helpful? Give feedback.
All reactions