How to get a HTML page using HtmlUnit

Question

I know you may think this question is stupid, but I need to use HtmlUnit. However, it returns a page either as XML or as text.

I don't how to get the pure HTML (the same as the source code that browsers return)

I need this, because I need to use some written modules. Any ideas?

mr. Vai asks if you can "provide fullcode which extracts webpage using HTMLUNIT" — John Dvorak
– John Dvorak, Commented Feb 17, 2013 at 18:33
I have save problem , Can u help me ? stackoverflow.com/questions/20781322/… — ducngm.hn
– ducngm.hn, Commented Dec 26, 2013 at 10:52

Ahmed Ashour · Accepted Answer · 2017-04-10 07:33:37Z

25

You can use the following piece of code to achieve your goal:

WebClient webClient = new WebClient();
Page page = webClient.getPage("http://example.com");
WebResponse response = page.getWebResponse();
String content = response.getContentAsString();

See javadocs of the WebResponse.html#getContentAsString() method.

edited Apr 10, 2017 at 7:33

Ahmed Ashour

5,66310 gold badges41 silver badges63 bronze badges

answered Feb 19, 2012 at 23:29

Dmytro Chyzhykov

1,8541 gold badge20 silver badges19 bronze badges

Sign up to request clarification or add additional context in comments.

3 Comments

Afshin Moazami Over a year ago

Thanks! :) I found it just before seeing your comment!

Afshin Moazami Over a year ago

but there is a problem, it doesn't show the texts in <nonscript> tags!

Panchal Deep Over a year ago

webClient.getOptions().setJavaScriptEnabled(true) - Add this

Collectives™ on Stack Overflow

How to get a HTML page using HtmlUnit

1 Answer 1

3 Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

3 Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related