cant add kafka connect

[heniv96]

Issue submitter TODO list

• I've looked up my issue in FAQ
• I've searched for an already existing issues here
• I've tried running master-labeled docker image and the issue still persists there
• I'm running a supported version of the application which is listed here

Describe the bug (actual behavior)

add to the helmchart values.yaml the kafka connect but didnt see the connect in the ui.

Expected behavior

to see the kafka connect

Your installation details

replicaCount: 1

image:
registry: docker.io
repository: provectuslabs/kafka-ui
pullPolicy: IfNotPresent

Overrides the image tag whose default is the chart appVersion.

tag: "v0.7.1"

yamlApplicationConfig:
#{}

dynamic.config.enabled: true
dynamic.config.path: "/etc/kafkaui/dynamic_config.yaml"
kafka:
clusters:
- name: one-connect
bootstrapServers: apache-kafka-headless:9092
connect:
- name: one
url: http://cp-kafka-connect:8083

envs:
secret: {}
config: #{}
SERVER_SERVLET_CONTEXT_PATH: /kafkaui
LOGGING_LEVEL_ROOT: debug
LOGGING_LEVEL_COM_PROVECTUS: debug
DYNAMIC_CONFIG_ENABLED: 'true'
JAVA_OPTS: -XX:MaxDirectMemorySize=512M

Steps to reproduce

try to add this to env instade of the application.yaml , but same result.

also i notic that is /etc/kafkaui/dynamic_config.yaml dosent exist.

Screenshots

No response

Logs

2023-06-29 14:59:42,687 DEBUG [parallel-1] o.a.k.c.a.i.AdminMetadataManager: [AdminClient clientId=kafka-ui-admin-1688050782-1] Setting bootstrap cluster metadata Cluster(id = null, nodes = [apache-kafka-headless:9092 (id: -1 rack: null)], partitions = [], controller = null).
2023-06-29 14:59:42,740 INFO [parallel-1] o.a.k.c.u.AppInfoParser: Kafka version: 3.3.1
2023-06-29 14:59:42,740 INFO [parallel-1] o.a.k.c.u.AppInfoParser: Kafka commitId: e23c59d00e687ff5
2023-06-29 14:59:42,740 INFO [parallel-1] o.a.k.c.u.AppInfoParser: Kafka startTimeMs: 1688050782738
2023-06-29 14:59:42,782 DEBUG [parallel-1] o.a.k.c.a.KafkaAdminClient: [AdminClient clientId=kafka-ui-admin-1688050782-1] Kafka admin client initialized
2023-06-29 14:59:42,782 DEBUG [kafka-admin-client-thread | kafka-ui-admin-1688050782-1] o.a.k.c.a.KafkaAdminClient: [AdminClient clientId=kafka-ui-admin-1688050782-1] Thread starting
2023-06-29 14:59:42,787 DEBUG [kafka-admin-client-thread | kafka-ui-admin-1688050782-1] o.a.k.c.ClientUtils: Resolved host apache-kafka-headless as 10.42.159.170,10.42.159.174,10.42.159.190
2023-06-29 14:59:42,787 DEBUG [kafka-admin-client-thread | kafka-ui-admin-1688050782-1] o.a.k.c.NetworkClient: [AdminClient clientId=kafka-ui-admin-1688050782-1] Initiating connection to node apache-kafka-headless:9092 (id: -1 rack: null) using address apache-kafka-headless/10.42.159.170
2023-06-29 14:59:42,790 DEBUG [parallel-1] o.a.k.c.a.KafkaAdminClient: [AdminClient clientId=kafka-ui-admin-1688050782-1] Queueing Call(callName=listNodes, deadlineMs=1688050842789, tries=0, nextAllowedTryMs=0) with a timeout 30000 ms from now.
2023-06-29 14:59:42,805 DEBUG [kafka-admin-client-thread | kafka-ui-admin-1688050782-1] o.a.k.c.n.Selector: [AdminClient clientId=kafka-ui-admin-1688050782-1] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node -1
2023-06-29 14:59:43,283 DEBUG [kafka-admin-client-thread | kafka-ui-admin-1688050782-1] o.a.k.c.NetworkClient: [AdminClient clientId=kafka-ui-admin-1688050782-1] Completed connection to node -1. Fetching API versions.
2023-06-29 14:59:43,283 DEBUG [kafka-admin-client-thread | kafka-ui-admin-1688050782-1] o.a.k.c.NetworkClient: [AdminClient clientId=kafka-ui-admin-1688050782-1] Initiating API versions fetch from node -1.
2023-06-29 14:59:43,315 DEBUG [kafka-admin-client-thread | kafka-ui-admin-1688050782-1] o.a.k.c.NetworkClient: [AdminClient clientId=kafka-ui-admin-1688050782-1] Sending API_VERSIONS request with header RequestHeader(apiKey=API_VERSIONS, apiVersion=3, clientId=kafka-ui-admin-1688050782-1, correlationId=0) and timeout 3600000 to node -1: ApiVersionsRequestData(clientSoftwareName='apache-kafka-java', clientSoftwareVersion='3.3.1')
2023-06-29 14:59:43,412 DEBUG [kafka-admin-client-thread | kafka-ui-admin-1688050782-1] o.a.k.c.NetworkClient: [AdminClient clientId=kafka-ui-admin-1688050782-1] Received API_VERSIONS response from node -1 for request with header RequestHeader(apiKey=API_VERSIONS, apiVersion=3, clientId=kafka-ui-admin-1688050782-1, correlationId=0): ApiVersionsResponseData(errorCode=0, apiKeys=[ApiVersion(apiKey=0, minVersion=0, maxVersion=9), ApiVersion(apiKey=1, minVersion=0, maxVersion=13), ApiVersion(apiKey=2, minVersion=0, maxVersion=7), ApiVersion(apiKey=3, minVersion=0, maxVersion=12), ApiVersion(apiKey=8, minVersion=0, maxVersion=8), ApiVersion(apiKey=9, minVersion=0, maxVersion=8), ApiVersion(apiKey=10, minVersion=0, maxVersion=4), ApiVersion(apiKey=11, minVersion=0, maxVersion=9), ApiVersion(apiKey=12, minVersion=0, maxVersion=4), ApiVersion(apiKey=13, minVersion=0, maxVersion=5), ApiVersion(apiKey=14, minVersion=0, maxVersion=5), ApiVersion(apiKey=15, minVersion=0, maxVersion=5), ApiVersion(apiKey=16, minVersion=0, maxVersion=4), ApiVersion(apiKey=17, minVersion=0, maxVersion=1), ApiVersion(apiKey=18, minVersion=0, maxVersion=3), ApiVersion(apiKey=19, minVersion=0, maxVersion=7), ApiVersion(apiKey=20, minVersion=0, maxVersion=6), ApiVersion(apiKey=21, minVersion=0, maxVersion=2), ApiVersion(apiKey=22, minVersion=0, maxVersion=4), ApiVersion(apiKey=23, minVersion=0, maxVersion=4), ApiVersion(apiKey=24, minVersion=0, maxVersion=3), ApiVersion(apiKey=25, minVersion=0, maxVersion=3), ApiVersion(apiKey=26, minVersion=0, maxVersion=3), ApiVersion(apiKey=27, minVersion=0, maxVersion=1), ApiVersion(apiKey=28, minVersion=0, maxVersion=3), ApiVersion(apiKey=29, minVersion=0, maxVersion=3), ApiVersion(apiKey=30, minVersion=0, maxVersion=3), ApiVersion(apiKey=31, minVersion=0, maxVersion=3), ApiVersion(apiKey=32, minVersion=0, maxVersion=4), ApiVersion(apiKey=33, minVersion=0, maxVersion=2), ApiVersion(apiKey=34, minVersion=0, maxVersion=2), ApiVersion(apiKey=35, minVersion=0, maxVersion=4), ApiVersion(apiKey=36, minVersion=0, maxVersion=2), ApiVersion(apiKey=37, minVersion=0, maxVersion=3), ApiVersion(apiKey=42, minVersion=0, maxVersion=2), ApiVersion(apiKey=43, minVersion=0, maxVersion=2), ApiVersion(apiKey=44, minVersion=0, maxVersion=1), ApiVersion(apiKey=45, minVersion=0, maxVersion=0), ApiVersion(apiKey=46, minVersion=0, maxVersion=0), ApiVersion(apiKey=47, minVersion=0, maxVersion=0), ApiVersion(apiKey=48, minVersion=0, maxVersion=1), ApiVersion(apiKey=49, minVersion=0, maxVersion=1), ApiVersion(apiKey=55, minVersion=0, maxVersion=1), ApiVersion(apiKey=57, minVersion=0, maxVersion=1), ApiVersion(apiKey=60, minVersion=0, maxVersion=0), ApiVersion(apiKey=61, minVersion=0, maxVersion=0), ApiVersion(apiKey=64, minVersion=0, maxVersion=0), ApiVersion(apiKey=65, minVersion=0, maxVersion=0), ApiVersion(apiKey=66, minVersion=0, maxVersion=0)], throttleTimeMs=0, supportedFeatures=[SupportedFeatureKey(name='metadata.version', minVersion=1, maxVersion=8)], finalizedFeaturesEpoch=656127, finalizedFeatures=[FinalizedFeatureKey(name='metadata.version', maxVersionLevel=8, minVersionLevel=8)])
2023-06-29 14:59:43,519 DEBUG [kafka-admin-client-thread | kafka-ui-admin-1688050782-1] o.a.k.c.NetworkClient: [AdminClient clientId=kafka-ui-admin-1688050782-1] Node -1 has finalized features epoch: 656127, finalized features: [FinalizedFeatureKey(name='metadata.version', maxVersionLevel=8, minVersionLevel=8)], supported features: [SupportedFeatureKey(name='metadata.version', minVersion=1, maxVersion=8)], API versions: (Produce(0): 0 to 9 [usable: 9], Fetch(1): 0 to 13 [usable: 13], ListOffsets(2): 0 to 7 [usable: 7], Metadata(3): 0 to 12 [usable: 12], LeaderAndIsr(4): UNSUPPORTED, StopReplica(5): UNSUPPORTED, UpdateMetadata(6): UNSUPPORTED, ControlledShutdown(7): UNSUPPORTED, OffsetCommit(8): 0 to 8 [usable: 8], OffsetFetch(9): 0 to 8 [usable: 8], FindCoordinator(10): 0 to 4 [usable: 4], JoinGroup(11): 0 to 9 [usable: 9], Heartbeat(12): 0 to 4 [usable: 4], LeaveGroup(13): 0 to 5 [usable: 5], SyncGroup(14): 0 to 5 [usable: 5], DescribeGroups(15): 0 to 5 [usable: 5], ListGroups(16): 0 to 4 [usable: 4], SaslHandshake(17): 0 to 1 [usable: 1], ApiVersions(18): 0 to 3 [usable: 3], CreateTopics(19): 0 to 7 [usable: 7], DeleteTopics(20): 0 to 6 [usable: 6], DeleteRecords(21): 0 to 2 [usable: 2], InitProducerId(22): 0 to 4 [usable: 4], OffsetForLeaderEpoch(23): 0 to 4 [usable: 4], AddPartitionsToTxn(24): 0 to 3 [usable: 3], AddOffsetsToTxn(25): 0 to 3 [usable: 3], EndTxn(26): 0 to 3 [usable: 3], WriteTxnMarkers(27): 0 to 1 [usable: 1], TxnOffsetCommit(28): 0 to 3 [usable: 3], DescribeAcls(29): 0 to 3 [usable: 3], CreateAcls(30): 0 to 3 [usable: 3], DeleteAcls(31): 0 to 3 [usable: 3], DescribeConfigs(32): 0 to 4 [usable: 4], AlterConfigs(33): 0 to 2 [usable: 2], AlterReplicaLogDirs(34): 0 to 2 [usable: 2], DescribeLogDirs(35): 0 to 4 [usable: 4], SaslAuthenticate(36): 0 to 2 [usable: 2], CreatePartitions(37): 0 to 3 [usable: 3], CreateDelegationToken(38): UNSUPPORTED, RenewDelegationToken(39): UNSUPPORTED, ExpireDelegationToken(40): UNSUPPORTED, DescribeDelegationToken(41): UNSUPPORTED, DeleteGroups(42): 0 to 2 [usable: 2], ElectLeaders(43): 0 to 2 [usable: 2], IncrementalAlterConfigs(44): 0 to 1 [usable: 1], AlterPartitionReassignments(45): 0 [usable: 0], ListPartitionReassignments(46): 0 [usable: 0], OffsetDelete(47): 0 [usable: 0], DescribeClientQuotas(48): 0 to 1 [usable: 1], AlterClientQuotas(49): 0 to 1 [usable: 1], DescribeUserScramCredentials(50): UNSUPPORTED, AlterUserScramCredentials(51): UNSUPPORTED, DescribeQuorum(55): 0 to 1 [usable: 1], AlterPartition(56): UNSUPPORTED, UpdateFeatures(57): 0 to 1 [usable: 1], DescribeCluster(60): 0 [usable: 0], DescribeProducers(61): 0 [usable: 0], UnregisterBroker(64): 0 [usable: 0], DescribeTransactions(65): 0 [usable: 0], ListTransactions(66): 0 [usable: 0], AllocateProducerIds(67): UNSUPPORTED).
2023-06-29 14:59:43,520 DEBUG [kafka-admin-client-thread | kafka-ui-admin-1688050782-1] o.a.k.c.a.KafkaAdminClient: [AdminClient clientId=kafka-ui-admin-1688050782-1] Sending MetadataRequestData(topics=[], allowAutoTopicCreation=true, includeClusterAuthorizedOperations=false, includeTopicAuthorizedOperations=false) to apache-kafka-headless:9092 (id: -1 rack: null). correlationId=1, timeoutMs=29263
2023-06-29 14:59:43,520 DEBUG [kafka-admin-client-thread | kafka-ui-admin-1688050782-1] o.a.k.c.NetworkClient: [AdminClient clientId=kafka-ui-admin-1688050782-1] Sending METADATA request with header RequestHeader(apiKey=METADATA, apiVersion=12, clientId=kafka-ui-admin-1688050782-1, correlationId=1) and timeout 29263 to node -1: MetadataRequestData(topics=[], allowAutoTopicCreation=true, includeClusterAuthorizedOperations=false, includeTopicAuthorizedOperations=false)
2023-06-29 14:59:43,523 DEBUG [kafka-admin-client-thread | kafka-ui-admin-1688050782-1] o.a.k.c.NetworkClient: [AdminClient clientId=kafka-ui-admin-1688050782-1] Received METADATA response from node -1 for request with header RequestHeader(apiKey=METADATA, apiVersion=12, clientId=kafka-ui-admin-1688050782-1, correlationId=1): MetadataResponseData(throttleTimeMs=0, brokers=[MetadataResponseBroker(nodeId=0, host='apache-kafka-0.apache-kafka-headless.apache.svc.cluster.local', port=9092, rack=null), MetadataResponseBroker(nodeId=1, host='apache-kafka-1.apache-kafka-headless.apache.svc.cluster.local', port=9092, rack=null), MetadataResponseBroker(nodeId=2, host='apache-kafka-2.apache-kafka-headless.apache.svc.cluster.local', port=9092, rack=null)], clusterId='kafka_cluster_id_testw', controllerId=0, topics=[], clusterAuthorizedOperations=-2147483648)
2023-06-29 14:59:43,526 DEBUG [kafka-admin-client-thread | kafka-ui-admin-1688050782-1] o.a.k.c.a.i.AdminMetadataManager: [AdminClient clientId=kafka-ui-admin-1688050782-1] Updating cluster metadata to Cluster(id = kafka_cluster_id_testw, nodes = [apache-kafka-1.apache-kafka-headless.apache.svc.cluster.local:9092 (id: 1 rack: null), apache-kafka-2.apache-kafka-headless.apache.svc.cluster.local:9092 (id: 2 rack: null), apache-kafka-0.apache-kafka-headless.apache.svc.cluster.local:9092 (id: 0 rack: null)], partitions = [], controller = apache-kafka-0.apache-kafka-headless.apache.svc.cluster.local:9092 (id: 0 rack: null))
2023-06-29 14:59:43,581 DEBUG [kafka-admin-client-thread | kafka-ui-admin-1688050782-1] o.a.k.c.ClientUtils: Resolved host apache-kafka-1.apache-kafka-headless.apache.svc.cluster.local as 10.42.159.174
2023-06-29 14:59:43,582 DEBUG [kafka-admin-client-thread | kafka-ui-admin-1688050782-1] o.a.k.c.NetworkClient: [AdminClient clientId=kafka-ui-admin-1688050782-1] Initiating connection to node apache-kafka-1.apache-kafka-headless.apache.svc.cluster.local:9092 (id: 1 rack: null) using address apache-kafka-1.apache-kafka-headless.apache.svc.cluster.local/10.42.159.174
2023-06-29 14:59:43,583 DEBUG [kafka-admin-client-thread | kafka-ui-admin-1688050782-1] o.a.k.c.n.Selector: [AdminClient clientId=kafka-ui-admin-1688050782-1] Created socket with SO_RCVBUF = 65536, SO_SNDBUF = 131072, SO_TIMEOUT = 0 to node 1
2023-06-29 14:59:43,583 DEBUG [kafka-admin-client-thread | kafka-ui-admin-1688050782-1] o.a.k.c.NetworkClient: [AdminClient clientId=kafka-ui-admin-1688050782-1] Completed connection to node 1. Fetching API versions.
2023-06-29 14:59:43,583 DEBUG [kafka-admin-client-thread | kafka-ui-admin-1688050782-1] o.a.k.c.NetworkClient: [AdminClient clientId=kafka-ui-admin-1688050782-1] Initiating API versions fetch from node 1.

Additional context

No response

[github-actions[bot]]

Hello there heniv96! 👋

Thank you and congratulations 🎉 for opening your very first issue in this project! 💖

In case you want to claim this issue, please comment down below! We will try to get back to you as soon as we can. 👀

[Haarolean]

I can definitely tell this does work for us and this is a configuration issue.

I can also recommend joining our discord, some members of the community might help you out with your charts.