EF - Query Large Data Sets Causes Out Of Memory Exception

Question

I have a data table with several xml fields. I'm using EF to get the data using where:

List<tblMSASAN> msa = ctx.tblMSASANs.Where(s => s.LCMGSupportLevel != "decommissioned").ToList();

Then using a foreach to iterate the list and pulling the xml field into an xmldocument and querying each node updating an attribute, then saving the context.

However, the dataset is too large and I get an out of memory exception. So I need to be able to query the xml first to return a smaller dataset.

List<tblWinServer> servers = ctx.tblWinServers.AsNoTracking().Where(s => s.LCMGSupportLevel != "decommissioned" && ( Convert.ToString(s.TapeDrives).Contains("Calyx") ||Convert.ToString(s.DiskShelves).Contains("Calyx"))).ToList();

But this doesn't work with a NotSupportedException.

Any ideas?

possible duplicate of LINQ to Entities does not recognize the method 'System.String ToString()' method, - MVC4. — Gert Arnold
– Gert Arnold, Commented May 1, 2014 at 12:02

martinm · Accepted Answer · 2014-05-02 07:53:53Z

-1

AsNoTracking() method returns IQueryable but if you want to use ToString() method in Where clause you have to convert IQueryable to IEnumerable:

List<tblWinServer> servers = ctx.tblWinServers.AsNoTracking().AsEnumerable().Where(s => s.LCMGSupportLevel != "decommissioned" && ( Convert.ToString(s.TapeDrives).Contains("Calyx") ||Convert.ToString(s.DiskShelves).Contains("Calyx"))).ToList();

answered May 2, 2014 at 7:53

martinm

22.1k4 gold badges45 silver badges72 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

Gert Arnold Over a year ago

This is exactly what the OP does not want: " the dataset is too large".

Collectives™ on Stack Overflow

EF - Query Large Data Sets Causes Out Of Memory Exception

1 Answer 1

1 Comment

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

1 Comment

Your Answer

Sign up or log in

Post as a guest

Linked

Related