AWS lambda from MSK cluster missing kafka message header

Question

I want to use AWS lambda to consumer kafka messages, but the events I received don't contain kafka headers, that are very critical. Is there a way to get messages with headers info?

Is that headers available in messages in kafka? or no headers in kafka also? — nipuna
– nipuna, Commented May 26, 2021 at 15:49
Is this solved? I see same behavior. The headers are there in kafka. Other consumers are able to receive headers — VamsiKrishna
– VamsiKrishna, Commented Jun 26, 2021 at 4:54

Justin · Accepted Answer · 2021-08-23 04:25:39Z

1

The Lambda Kafka integration did not support headers before, but they have (very recently, in the last few days) silently added support for headers. You can see this in the latest event example in the docs (or try it yourself): https://docs.aws.amazon.com/lambda/latest/dg/with-msk.html

answered Aug 23, 2021 at 4:25

Justin

1787 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

Eugene W. Over a year ago

but it came in encoded form: "headerKey": [1,2,3,4..]. It is a list of integers, corresponding to each character an integer number. It is not clear how to compare lists, how to trigger lambda only on specific list taking into account the order of elements.

Collectives™ on Stack Overflow

AWS lambda from MSK cluster missing kafka message header

1 Answer 1

1 Comment

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

1 Comment

Your Answer

Sign up or log in

Post as a guest

Related