HttpUrlConnection read inputstream - different output result

Question

Below method is designed to get source code of html page of given url, but it returns result in different charset in each call (in every call argument url is same), please, explain me why?

private String getSourceCode(URL url) {
    HttpURLConnection conn = (HttpURLConnection)url.openConnection();
    conn.setRequestProperty("User-Agent", "Mozilla/5.0 (Macintosh; U; Intel MacOS X 10.4; en-US; rv:1.9.2.2) Gecko/20100316 Firefox/3.6.2");

    return IOUtils.toString(conn.getInputStream()); 
}

maybe :) when I check response contect type charset is always UTF-8, but result is different... — Madi Sagimbekov
– Madi Sagimbekov, Commented Sep 7, 2015 at 18:26
first call: ...y??????Ywmm?Vs??B?0?/M??gJ?l?p.??n.??pBo??N... second call: normal html code url: http://habrahabr.ru/post/266163/ — Madi Sagimbekov
– Madi Sagimbekov, Commented Sep 7, 2015 at 18:37
difference is in output string encoding, but I don't know why its different at each call — Madi Sagimbekov
– Madi Sagimbekov, Commented Sep 7, 2015 at 18:42

czpona · Accepted Answer · 2015-09-07 20:20:51Z

1

Actually there are several possible reasons. For example behind the URL there can actually be several different servers with different default encoding of response. First call can be served by server with utf-8, the other can be served by another server with another encoding.

answered Sep 7, 2015 at 20:20

czpona

3301 silver badge10 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

HttpUrlConnection read inputstream - different output result

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related