Import Json file into Mongoose

Question

I need to import a JSON file to a data base Mongoose. This should be a script that should be run daily.

I have my JSON as follows :

[
 {
   "grant_title": "name SRL",
   "id": "30579843531",
   "total_amount": "551954"
},{
   "grant_title": "AADI CAPIF ASOCIACION CIVIL",
   "id": "30574449967",
   "total_amount": "37050"
},{
   "grant_title": "LA CAMPAÑOLA S.A",
   "id": "23311183419",
   "total_amount": "139292"
  }
]

I need this information to be stored in a database .

This should be whether or if a script NodeJS (express). Please be clear , because I am a beginner .

WHY ARE YOU SHOUTING?

user5832974
– user5832974

2016-08-25 14:03:15 +00:00
Commented Aug 25, 2016 at 14:03 — user5832974
– user5832974, Commented Aug 25, 2016 at 14:03
Sorry, my english is poor :( . I need help. :)

Manuel Paiva
– Manuel Paiva

2016-08-25 14:21:57 +00:00
Commented Aug 25, 2016 at 14:21 — Manuel Paiva
– Manuel Paiva, Commented Aug 25, 2016 at 14:21

dyouberg · Accepted Answer · 2016-08-25 15:37:43Z

7

Let's take this gradually. First off you are going to need to either create a CRON job, or use a NodeJS scheduler such as agenda to execute your function at a time interval.

Now... inside your function you need to load your JSON file into NodeJS.

var json = require('/path/to/file.json');

Finally... use insertMany to do a bulk insert into your collection.

db.collectionName.insertMany(json, function(err,result) {
   if (err) {
     // handle error
   } else {
     // handle success
   }
});

EDIT: Here is an example of using Agenda in NodeJS to run a program daily at 11:30 AM

var Agenda = require('agenda');

startScheduler = function() {
    // Set the scheduler utilizing Agenda
    var agenda = new Agenda({db: {address: 'url/to/database'}});

    agenda.define('RUN AT 1130 AM', function(job, done) {
        // your function goes here...
        done();
    });

    agenda.on('ready', function() {
        // CRON SYNTAX
        // * * * * * *
        // Minute / Hour / Day / Month / Day of week (0-6) Sunday-Saturday
        agenda.every('30 11 * * *', 'RUN AT 1130 AM'); // Run daily at 11:30 AM

        agenda.start();
    });
};

startScheduler();

edited Aug 25, 2016 at 15:37

answered Aug 25, 2016 at 15:31

dyouberg

2,3521 gold badge15 silver badges22 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

Maxime Pacary Over a year ago

After struggling a little bit with db.collectionName.insertMany(...) (error 'Cannot read property 'insertMany' of undefined'), I've ended up writing something equivalent to

const mongoose = require('mongoose'); /* ... DB connexion ... */ mongoose.connection.db.collection('collectionName').insertMany(...)

. However my suggestion is a completely schema-less approach (possibly Ok for ex. if you aim to import data from a reliable export without bothering with schemas declarations) ; in most situations using Mongoose Schemas would be safer.

Maxime Pacary Over a year ago

... furthermore if you use Mongoose Schemas, if you insert a date string in your JSON data, it will still have the type "Date" in Mongo (instead of being stored as a raw string). Same goes certainly for other data types.

Collectives™ on Stack Overflow

Import Json file into Mongoose

1 Answer 1

2 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

2 Comments

Your Answer

Sign up or log in

Post as a guest

Related