Php Simple Html Dom Parser can't get content on pagination

Question

Hi i'm a beginner in using simple_html_dom. i'm trying to fetch list of href's from list of posts from this sample website having pagination using below code.

<?php
include('simple_html_dom.php');

$html = file_get_html('http://www.themelock.com/wordpress/elegantthemes/');

function getArticles($page) {

    global $articles;

    $html = new simple_html_dom();
    $html->load_file($page);

    $items = $html->find('h2[class=post-title]');  

    foreach($items as $post) {
        $articles[] = array($post->children(0)->href);
    }

    foreach($articles as $item) {
            echo "<div class='item'>";
            echo $item[0];
            echo "</div>";
        }
}

if($next = $html->find('div[class=navigation]', 0)->last_child() ) {
    $URL = $next->href;

    $html->clear();
    unset($html);

    getArticles($URL);
}

?>

As a result i'm getting

http://www.themelock.com/wordpress/908-minimal-elegantthemes-wordpress-theme.html
http://www.themelock.com/wordpress/892-event-elegantthemes-wordpress-theme.html
http://www.themelock.com/wordpress/882-askit-elegantthemes-wordpress-theme.html
http://www.themelock.com/wordpress/853-lightbright-elegantthemes-wordpress-theme.html
http://www.themelock.com/wordpress/850-inreview-elegantthemes-review-wordpress-theme.html
http://www.themelock.com/wordpress/807-boutique-elegantthemes-wordpress-theme.html
http://www.themelock.com/wordpress/804-elist-elegantthemes-directory-wordpress-theme.html
http://www.themelock.com/wordpress/798-webly-elegantthemes-wordpress-theme.html
http://www.themelock.com/wordpress/795-elegantestate-real-estate-elegantthemes-wordpress-theme.html
http://www.themelock.com/wordpress/786-notebook-elegantthemes-wordpress-theme.html

Above code fetching only Next page (Second page) contents. I'm wondering how to get first page post url's followed by next pages.

Did anyone know how to do this ?

You'll need two loops then: One to loop through page links, and another to loop their content and extract your data (which you already have)... Check this answer: stackoverflow.com/a/21207159/1519058 — Enissay
– Enissay, Commented Mar 26, 2014 at 19:29

Vinoth Pandiyan · Accepted Answer · 2014-03-27 06:24:58Z

1

Thanks for your support guys, I made this to work using below code,

<?php
include('simple_html_dom.php');

$url = "http://www.themelock.com/wordpress/yootheme-wordpress/";

// Start from the main page
$nextLink = $url;

// Loop on each next Link as long as it exsists
while ($nextLink) {
    echo "<hr>nextLink: $nextLink<br>";
    //Create a DOM object
    $html = new simple_html_dom();
    // Load HTML from a url
    $html->load_file($nextLink);

    $posts = $html->find('h2[class=post-title]');

    foreach($posts as $post) {
        // Get the link
        $articles = $post->children(0)->href;        
        echo $articles.'</br>';
    }

    // Extract the next link, if not found return NULL
    $nextLink = ( ($temp = $html->find('div[class=navigation]', 0)->last_child()) ? $temp->href : NULL );

    // Clear DOM object
    $html->clear();
    unset($html);
}

?>

answered Mar 27, 2014 at 6:24

Vinoth Pandiyan

2417 silver badges19 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

LeoTM Over a year ago

To convert relative URLs to absolute, this did the job for me. Just remember to rawurldecode the result.

Collectives™ on Stack Overflow

Php Simple Html Dom Parser can't get content on pagination

1 Answer 1

1 Comment

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

1 Comment

Your Answer

Sign up or log in

Post as a guest

Linked

Related