PHP: curl and stream forwarding

Question

Curl has lots of options that make it easier for my use-case to request data from another server. My script is similar to a proxy and so far it is requesting the data from another server and once the result data is complete, it's send to the client at once.

user visits http://te.st/proxy.php?get=xyz
proxy.php downloads xyz from external-server
when the download is completed 100%, it will output the data

Now I wonder whether 2 and 3 can also be done in parallel (with php5-curl), like a "proxy stream" that forwards data on the fly without waiting for the last line.

If the file size is 20MB in average, this makes a significant difference.

Is there an option for this in curl?

Nithi2023 · Accepted Answer · 2017-10-18 09:06:30Z

13

Here is the code that actually streams the files instead of waiting for full file to buffer.

$url = YOUR_URL_HERE;

$ch = curl_init();
curl_setopt($ch, CURLOPT_URL,$url);
curl_setopt($ch, CURLOPT_CONNECTTIMEOUT, 10);
curl_setopt($ch, CURLOPT_WRITEFUNCTION, function($curl, $data) {
    echo $data;
    ob_flush();
    flush();
    return strlen($data);
});
curl_exec($ch);
curl_close($ch);

answered Oct 18, 2017 at 9:06

Nithi2023

4335 silver badges13 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

Leo Smith Over a year ago

Total thuimbs up. Just worked first time and with digest auth too

Community · Accepted Answer · 2017-05-23 11:46:24Z

6

Take a look at http://www.php.net/manual/en/function.curl-setopt.php#26239

Something like that (not tested):

function myProgressFunc($ch, $str){ 
    echo $str;
    return strlen($str);
} 

curl_setopt($ch, CURLOPT_WRITEFUNCTION, "myProgressFunc");

Read also ParallelCurl with CURLOPT_WRITEFUNCTION

edited May 23, 2017 at 11:46

CommunityBot

11 silver badge

answered May 9, 2013 at 14:33

Andrey Volk

3,5792 gold badges19 silver badges29 bronze badges

1 Comment

user Over a year ago

Good but not perfect: it's buffered. This means that it may be used for file streaming, but when it is an event stream, latest events are hanging unreachable inside the curl (flush() doesn't help to echo them all). That's a pity. +1 to you anyway.

Collectives™ on Stack Overflow

PHP: curl and stream forwarding

2 Answers 2

1 Comment

1 Comment

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

1 Comment

1 Comment

Your Answer

Sign up or log in

Post as a guest

Linked

Related