PHP - Curl MultiRequest Timeout

Question

I'm using this following multiRequest function and sometimes the problem occurs, that the loop at

do {
curl_multi_exec($mh, $running);
} while ($running > 0);

seems endless and reach my php execution limit. I thought it had sth to do with the DNS Lookup, so I'm calling the ip addresses directly now.

But this problem sadly still occurs sometimes... Is there a way to set a timeout for each handle to avoid an endless loop? What else I could do to fix this problem?

Thank you very much!

function multiRequest($data, $options = array())
    {
        // array of curl handles
        $curly = array();
        // data to be returned
        $result = array();
        // multi handle
        $mh = curl_multi_init();
        // loop through $data and create curl handles
        // then add them to the multi-handle
        foreach ($data as $id => $d) {
            $curly[$id] = curl_init();
            $url = (is_array($d) && !empty($d['url'])) ? $d['url'] : $d;
            curl_setopt($curly[$id], CURLOPT_URL, $url);
            curl_setopt($curly[$id], CURLOPT_HEADER, 0);
            curl_setopt($curly[$id], CURLOPT_RETURNTRANSFER, 1);
            // post?
            if (is_array($d)) {
                if (!empty($d['post'])) {
                    curl_setopt($curly[$id], CURLOPT_POST, 1);
                    curl_setopt($curly[$id], CURLOPT_POSTFIELDS, $d['post']);
                }
            }
            // extra options?
            if (!empty($options[$id])) {
                curl_setopt_array($curly[$id], $options[$id]);
            }

            curl_multi_add_handle($mh, $curly[$id]);
        }
        // execute the handles
        $running = null;
        do {
            curl_multi_exec($mh, $running);
        } while ($running > 0);
        // get content and remove handles
        foreach($curly as $id => $c) {
            $result[$id] = curl_multi_getcontent($c);
            curl_multi_remove_handle($mh, $c);
        }
        // all done
        curl_multi_close($mh);
        return $result;
    }

Thank you, I had to update my libcurl version to make it work :-). — heuri
– heuri, Commented Jun 17, 2011 at 14:37

Daniel Stenberg · Accepted Answer · 2020-02-06 06:34:36Z

3

You can set an individual timeout on a handle with CURLOPT_TIMEOUT (and other options).
You can have your own timeout and just remove the handle from the multi handle (which thus cancels the operation) at any given time you think enough is enough.

edited Feb 6, 2020 at 6:34

answered Jun 16, 2011 at 20:29

Daniel Stenberg

59.1k19 gold badges160 silver badges232 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

PHP - Curl MultiRequest Timeout

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related