Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Hickups with Kafka Elasticsearch WorkerSinkTask initialization #3

Open
FlorianNachtigall opened this issue Jun 29, 2020 · 0 comments
Open
Labels
bug Something isn't working

Comments

@FlorianNachtigall
Copy link
Member

elasticsink connector fails and restarts regularly due to error in WorkerSinkTask initialization:

[2020-06-29 10:31:11,342] INFO Finished starting connectors and tasks (org.apache.kafka.connect.runtime.distributed.DistributedHerder)
ERROR StatusLogger No log4j2 configuration file found. Using default configuration: logging only errors to the console. Set system property 'log4j2.debug' to show Log4j2 internal initialization logging.
[2020-06-29 10:31:13,838] ERROR WorkerSinkTask{id=elasticsink-0} Task threw an uncaught and unrecoverable exception (org.apache.kafka.connect.runtime.WorkerTask)
java.lang.IllegalArgumentException: Address must be resolved but wasn't - InetSocketAddress#getAddress() returned null
	at org.elasticsearch.common.transport.TransportAddress.<init>(TransportAddress.java:64)
	at com.sksamuel.elastic4s.xpack.security.XPackElasticClient$$anonfun$apply$2.apply(XPackElasticClient.scala:25)
	at com.sksamuel.elastic4s.xpack.security.XPackElasticClient$$anonfun$apply$2.apply(XPackElasticClient.scala:24)
	at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:733)
	at scala.collection.immutable.List.foreach(List.scala:392)
	at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:732)
	at com.sksamuel.elastic4s.xpack.security.XPackElasticClient$.apply(XPackElasticClient.scala:24)
	at com.datamountaineer.streamreactor.connect.elastic6.KElasticClient$.getClient(KElasticClient.scala:69)
	at com.datamountaineer.streamreactor.connect.elastic6.ElasticWriter$.apply(ElasticWriter.scala:44)
	at com.datamountaineer.streamreactor.connect.elastic6.ElasticSinkTask.start(ElasticSinkTask.scala:56)
	at org.apache.kafka.connect.runtime.WorkerSinkTask.initializeAndStart(WorkerSinkTask.java:302)
	at org.apache.kafka.connect.runtime.WorkerSinkTask.execute(WorkerSinkTask.java:191)
	at org.apache.kafka.connect.runtime.WorkerTask.doRun(WorkerTask.java:175)
	at org.apache.kafka.connect.runtime.WorkerTask.run(WorkerTask.java:219)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
[2020-06-29 10:31:13,843] ERROR WorkerSinkTask{id=elasticsink-0} Task is being killed and will not recover until manually restarted (org.apache.kafka.connect.runtime.WorkerTask)
[2020-06-29 10:31:13,843] INFO Stopping Elastic sink. (com.datamountaineer.streamreactor.connect.elastic6.ElasticSinkTask)
@FlorianNachtigall FlorianNachtigall added the bug Something isn't working label Jun 29, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant