kafka-console-consumer custom deserializer

Question

I would like to use my custom value.deserializer when using the kafka-console-consumer command line tool. Something like this:

./kafka-console-consumer --bootstrap-server kafka2:29092 \
                         --property value.deserializer=My.Custom.KafkaDeserializer \
                         --topic TEST

But its unable to find my custom class...

Exception in thread "main" java.lang.ClassNotFoundException: My.Custom.KafkaDeserializer

How can I reference the appropriate jar file so that the script will recognize it?

You have to add this class into the classpath. Besides, even you do so, console-consumer tool still cannot use it since it's a known bug. See issues.apache.org/jira/browse/KAFKA-2526 — amethystic
– amethystic, Commented Aug 9, 2017 at 3:33

Cody Gray · Accepted Answer · 2019-04-20 03:30:40Z

4

You need to place the deserializer jar under the "libs" folder of your Kafka server.

edited Apr 20, 2019 at 3:30

Cody Gray♦

246k53 gold badges513 silver badges591 bronze badges

answered Apr 20, 2019 at 3:08

Nagarjuna Nag

413 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

ppatierno · Accepted Answer · 2017-08-09 05:40:20Z

3

As already said there is an opened JIRA for that (https://issues.apache.org/jira/browse/KAFKA-2526) and a custom deserializer can't be used yet.

answered Aug 9, 2017 at 5:40

ppatierno

10.2k2 gold badges35 silver badges49 bronze badges

1 Comment

Jingguo Yao Over a year ago

I have checked confluent-community-5.1.0-2.11. It honors --value-deserializer.

Collectives™ on Stack Overflow

kafka-console-consumer custom deserializer

2 Answers 2

Comments

1 Comment

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

1 Comment

Your Answer

Sign up or log in

Post as a guest

Linked

Related