How to write from DynamoDB to ElasticSearch using Lambda?

Question

I've been going through this tutorial posted by amazon. On the step titled "Enabling the lambda blueprint", it references a dynamodb-to-elasticsearch blueprint. In my AWS console, there is no such blueprint. Does anybody know what the Python code for this blueprint looks like? Am I unable to see this because of my specific AWS account, or has AWS removed this?

maybe they prefer this way now: docs.aws.amazon.com/elasticsearch-service/latest/developerguide/… — at0mzk
– at0mzk, Commented Dec 13, 2016 at 2:13
I tried that before taking a look into the lambda approach, but it led me down this path for which there doesn't appear to be a great solution — Cody Ma
– Cody Ma, Commented Dec 13, 2016 at 4:46

Alexander Patrikalakis · Accepted Answer · 2017-02-19 12:45:54Z

1

You need to make sure a DynamoDB stream is enabled on your table including both old and new images. First, pull the DynamoDB stream record out of the Kinesis stream record. Then, determine whether the DynamoDB stream record represents an insertion, update or deletion. Third, delegate appropriately and upsert the corresponding document in ES for insertions and updates, and delete the corresponding document in ES for deletions.

For the time being, you can adapt the Python lambda handler shared here on Github - it parses stream records and writes documents to ES.

edited Feb 19, 2017 at 12:45

answered Feb 14, 2017 at 8:09

Alexander Patrikalakis

5,2251 gold badge35 silver badges49 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

How to write from DynamoDB to ElasticSearch using Lambda?

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related