Is there a way to run QtWebEngine in headless mode

Question

Im using QWebEnginePage to get content of some webpage. In the .pro file i have mentioned CONFIG-=gui.

However when i run the program in a headless system, it complains of being unable to connect to display:0. I also noticed that it requires libX11-xcb.so & related libs.

Is there anyway i can get the HTML of a page using QtWebEngine in headless mode without having to use xvfb?

I think there other alternatives to get the content of a webpage in Qt. — Redanium
– Redanium, Commented Feb 14, 2017 at 19:51
@Redanium My requirement is to get the html of an ajax site. So I was looking for a headless browser to execute the javascript to generate the HTML. Please suggest if there is any alternative — Pragalathan M
– Pragalathan M, Commented Feb 15, 2017 at 6:01
Why don't you use QNetworkAccessManager with QNetworkReply — Redanium
– Redanium, Commented Feb 15, 2017 at 8:00
@Redanium as for as i understand these classes, dont execute javascript and ajax call in the web page — Pragalathan M
– Pragalathan M, Commented Feb 18, 2017 at 17:01
have a look at thisQtwebengine How do I run web engine on a sever without a display? and this -SOLVED- QtWebEngine headless? — Redanium
– Redanium, Commented Feb 21, 2017 at 20:25

Pragalathan M · Accepted Answer · 2018-03-02 19:52:01Z

2

QtWebEngine is memory hungry compare to QtWebKit (single process version).

QtWebkit didnt render some sites properly.
QtWebEngine needed Xserver hence consumed more memory. Plus the multiple process design, even if you have a single tab

Finally switched to puppeteer. I know that this is not the direct answer to the question posted. But this solves the original problem of extracting DOM HTML of an ajax site in true headless mode.

answered Mar 2, 2018 at 19:52

Pragalathan M

1,8111 gold badge18 silver badges21 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

kingsting · Accepted Answer · 2017-12-20 02:53:43Z

1

"My requirement is to get the html of an ajax site. So I was looking for a headless browser to execute the javascript to generate the HTML. "

A spider may satisfy your requirement. With Scrapy and Chrome, you can do anything a browser can do.

answered Dec 20, 2017 at 2:53

kingsting

112 bronze badges

Collectives™ on Stack Overflow

Is there a way to run QtWebEngine in headless mode

2 Answers 2

Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related