Initial sync of mongodb and Elasticsearch

Question

What is a easy way to do the initial sync between mongodb and elasticsearch. I use the https://github.com/richardwilly98/elasticsearch-river-mongodb to sync any updates. The river works by tracking the changes in the mongodb replica set logs and applying those to ES but how can I sync what is already in mongodb to elasticsearch.

A proposed solution I have seen is to dump ( mongodump) the data and restore ( mongorestore ) but not sure of its impact on a live mongo database.

Ramast · Accepted Answer · 2013-09-08 21:53:02Z

1

That is actually the solution. mongodump -u root -p 'yourpassword' --oplog the oplog will also copy the transaction log which I think is required for your script to work. after that you do mongorestore on the otherside mongorestore --oplogReplay

Also another solution is to use "OplogReplay" script instead of the one you are using This script does the initial sync from source to destination automatically when you run it for the first time https://pypi.python.org/pypi/OplogReplay/ I recommend that you download the latest code from github directly https://github.com/uberVU/mongo-oplogreplay

answered Sep 8, 2013 at 21:53

Ramast

7,8393 gold badges35 silver badges36 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Initial sync of mongodb and Elasticsearch

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related