How to properly search data from a big database using angularjs

Question

I am trying to find a good way to search for data in a big database. I have an API which get the entire list of data from MongoDB

.get(function(req, res) {
        drinks.find({ }, function(err, drinksOrders) {
            if (err) {
                res.send(err);
                return;
            }
            res.json(drinksOrders);
        });
    });

And i have ng-repeat to display those data with some filters.

**Question 1 - ** if my database files is 1gb, before the page load, will the page wait until res.json(drinksOrders) have been completely downloaded?

**Question 2 - ** if the page is loading dynamically without having to wait for the big json file to load, how would my search filter behave? So if in my search field "cola", this query will stand and angular will continuously download json and filtering out and displaying "cola" only?

**Question 3 - ** Using angular limitTo, will this only download part of json files to a certain limit.

Thank you

David Votrubec · Accepted Answer · 2015-06-24 07:29:18Z

3

Well, I would say that this approach is wrong. If you load that much data to browser, you might kill it. The RAM and CPU consumption will be likely very high and your app will become unresponsive.

Better approach would be IMHO to use paging and always load say 50 items.

Do you REALLY need to load all data at once?

Ad 1) That depends on how you implement it. If you need ALL data to be loaded before user starts interacting with your page, then yes. Otherwise just add some loading indicator to the section which displays the drinks.

Ad 2) I am not sure, sorry :)

Ad 3) limitTo is a filter. It is used when rendering already loaded data. What it does it that it takes only first N items from available data. So all data needs to be loaded, before limitTo is applied

edited Jun 24, 2015 at 7:29

answered Jun 24, 2015 at 7:16

David Votrubec

4,1843 gold badges35 silver badges46 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

Photonic Over a year ago

Yes i dont want to load 1GB into a browser... that would be mad. Anyway thanks for the respond. What is IMHO?

David Votrubec Over a year ago

IMHO means "In my humble opinion" :)

Collectives™ on Stack Overflow

How to properly search data from a big database using angularjs

1 Answer 1

2 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

2 Comments

Your Answer

Sign up or log in

Post as a guest

Related