Read endless stream with HttpWebRequest C#

Question

I'm using C# to get data from endless http-stream. I used TCP Client before, but now I want to add status code exceptions, it's much easier to do it with HttpWebResponse. I got response, but problem is I can't read chunks coming from server. Everything looks fine, but I must be missed something. Debug shows execution is stucked at ReadLine(). Also I can see there's some data in stream buffer.

HttpWebRequest req = (HttpWebRequest)WebRequest.Create("http://" + url + "/stream/" + from + "?token=" + token);
using(HttpWebResponse res = (HttpWebResponse)req.GetResponse())
using(StreamReader streadReader = new StreamReader(res.GetResponseStream(),Encoding.UTF8)){
    //Start parsing cycle
    while(!streadReader.EndOfStream && !worker.CancellationPending) {
        string resultLine = streadReader.ReadLine();
        System.Diagnostics.Trace.WriteLine(resultLine);
        if(!resultLine.StartsWith("{")) continue;
        newQuote quote = JsonConvert.DeserializeObject<newQuote>(resultLine);
        worker.ReportProgress(0, quote);
    }
}

So is there maybe a very long line or no line break at all? Code looks fine. — usr
– usr, Commented Sep 10, 2015 at 15:21
This kind of error handling is really worrying: if(!resultLine.StartsWith("{")) continue;. Delete that. — usr
– usr, Commented Sep 10, 2015 at 15:22
@usr Or create a better magic to determine the end of the chunk. — Yuval Itzchakov
– Yuval Itzchakov, Commented Sep 10, 2015 at 15:23
Yeah, it's kinda hacky, must admit that. It left from TCP client, Not every chunk was an object there :) I will remove it, thank you. @usr, you was right. I was using ReadLine but never send \r\n from server-side. — BadVolt
– BadVolt, Commented Sep 10, 2015 at 15:30

BadVolt · Accepted Answer · 2015-09-10 16:50:09Z

1

I'v found the error. I was using ReadLine(), but never sent "\r\n" from server side. I patched my server to send \r\n after JSON object ant it works fine now. Another option is to use Read() method. It's not waiting for the end of line, but you must know chunk length. Thanks for the help :)

Upd: How to parse string using Read() method:

    while(!streamReader.EndOfStream && !worker.CancellationPending) {
    char[] buffer = new char[1024];
    streamReader.Read(buffer, 0, buffer.Length);
    string resultLine="";
    for(int i = 0; i < buffer.Length; i++) {
        if(buffer[i] != 0) resultLine += buffer[i].ToString();
    }
    newQuote quote = JsonConvert.DeserializeObject<newQuote>(resultLine);
    worker.ReportProgress(0, quote);
}

edited Sep 10, 2015 at 16:50

answered Sep 10, 2015 at 15:32

BadVolt

6371 gold badge7 silver badges19 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Read endless stream with HttpWebRequest C#

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related