Kafka Error : Failed to send requests for topics test with correlation ids in [0,12]

Error Msg

1 2 3 4 5 6 7 8 9 10 11

Exception in thread "main" kafka.common.FailedToSendMessageException: Failed to send messages after 3 tries. at kafka.producer.async.DefaultEventHandler.handle(DefaultEventHandler.scala:90) [2016-01-15 17:18:25,759] ERROR Failed to send requests for topics test with correlation ids in [0,12] (kafka.producer.async.DefaultEventHandler:97) at kafka.producer.Producer.send(Producer.scala:77) at kafka.javaapi.producer.Producer.send(Producer.scala:33) at ProducerTest.main(ProducerTest.java:20) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at com.intellij.rt.execution.application.AppMain.main(AppMain.java:140)

Cause

• There are a lot of causes of this situation. In my case, this was because of absence of hostname of kafka server at client side.

Solution

• Added hostname of kafka server to the client machine. Suppose that the ip and hostname of kafka server are 111.111.111.111 and “kafkaserver”. I used Mac OSX client so I added this information to /private/etc/hosts file. You can easily find the location of host name management file in your OS.
  
  1 2 3 4 5 6 7 8 9 10 11 12

  ## # Host Database # # localhost is used to configure the loopback interface # when the system is booting.  Do not change this entry. ## 127.0.0.1       localhost 255.255.255.255 broadcasthost ::1             localhost   ## added here 111.111.111.111  kafkaserver