Retrieving the source code of a page in javascript

Question

I'm making a greasemonkey script to extract video URL code from youtube result: I have this:

// ==UserScript==
// @name        extract
// @namespace   here
// @include     http://stackoverflow.com/
// @grant GM_xmlhttpRequest
// @version     0.1
// ==/UserScript==

window.setTimeout(conseguir_articulos_youtube, 5000);

function conseguir_articulos_youtube(){

    GM_xmlhttpRequest({
        method: "GET",
        url: "http://www.youtube.com/results?search_sort=video_date_uploaded&uni=3&search_type=videos&search_query=humor",
        onload: on_load_extract              
    });
}

function on_load_extract(data){
    var datos=data.responseText;
    alert(datos);
}

I use xmlHttpRequest to retrieve the content of youtube, but the code of the page present in the response is not complete. There is a form to retrieve the complete source code of a page in javascript?

Use the API. If you insist on doing it the hard way see How to get an AJAX get-request to wait for the page to be rendered before returning a response?. — Brock Adams
– Brock Adams, Commented Jan 13, 2013 at 20:38

Brock Adams · Accepted Answer · 2013-01-13 20:34:34Z

2

It seems you are receiving the whole source code of the page. The problem is that the page is using AJAX calls of its own to further load other resources, thus leaving you with an "incomplete" version of the page.

I recommend using the YouTube API for YouTube integration instead of scraping the HTML.

I've never used it myself, so I cannot give you a quick reference of it, but I'm sure it's quite simple to use. :) Hope it helps!

edited Jan 13, 2013 at 20:34

Brock Adams

94k23 gold badges242 silver badges312 bronze badges

answered Jan 13, 2013 at 15:20

CristianDonosoC

16910 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Retrieving the source code of a page in javascript

1 Answer 1

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related