php curl execution time limitation

Question

While using PHP I am taking image links from my mysql database, and echoing them out. There are 600 or so, but it keeps stopping after running 100 or so. It is not a logic error, it seems there is a setting that is stopping php from continuing the curl. Please advise which setting I should expand to allow a longer CURL thanks!

Here is what I am using now:

function file_get_contents_curl($url)
{
$ch = curl_init();
curl_setopt($ch, CURLOPT_HEADER, 0);
curl_setopt($ch, CURLOPT_RETURNTRANSFER, 1);
curl_setopt($ch, CURLOPT_URL, $url);
curl_setopt($ch, CURLOPT_FOLLOWLOCATION, true);
curl_setopt($ch,CURLOPT_BINARYTRANSFER, true);
$data = curl_exec($ch);
return $data;
}

$htmlaa = file_get_contents_curl($getimagefrom);
$docaa = new DOMDocument();
@$docaa->loadHTML($htmlaa);

Again, it is worknig just fine but just keeps stopping after running for maybe 3 minutes.

raidenace · Accepted Answer · 2018-03-17 20:14:27Z

1

You can set the curl timeout like so:

curl_setopt($ch, CURLOPT_TIMEOUT, 1000); //seconds to live

Since there are multiple factors that influence execution time you should also check out these two as well:

http://php.net/manual/en/function.set-time-limit.php

http://php.net/manual/en/info.configuration.php#ini.max-execution-time

Also please note that CURLOPT_TIMEOUT defines the amount of time that any cURL function is allowed to take to execute. You should also checkout CURLOPT_CONNECTTIMEOUT option.

edited Mar 17, 2018 at 20:14

answered Mar 17, 2018 at 20:09

raidenace

12.8k1 gold badge34 silver badges35 bronze badges

Sign up to request clarification or add additional context in comments.

4 Comments

dixie motors Over a year ago

I added set_time_limit(0); to top of document but it still stops at same point each time. :(

raidenace Over a year ago

set_time_limit does not seem to be the problem here. Did you investigate the other timeout options?

dixie motors Over a year ago

I put curl_setopt($ch, CURLOPT_TIMEOUT, 2000000); curl_setopt($ch, CURLOPT_CONNECTTIMEOUT, 200000); still not working :(

dixie motors Over a year ago

please help i have no idea what to do

Collectives™ on Stack Overflow

php curl execution time limitation

1 Answer 1

4 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

4 Comments

Your Answer

Sign up or log in

Post as a guest

Related