How to fetch the url content using php curl or file_get_content on the same server?

Question

I have some code to convert a PHP page to HTML:

$dynamic = "http://website.net/home.php";
$out = "home.html" ;

$ch = curl_init();
curl_setopt($ch, CURLOPT_URL,"$dynamic");
curl_setopt($ch, CURLOPT_RETURNTRANSFER, 1);

$file = curl_exec($ch);

file_put_contents($out, $file);

This works perfect in localhost but it takes too much time/doesn't work on the live site.

I've tried php_get_contents, but that also doesn't work.

Note:

http://website.net/home.php page is in the same site where the code is hosted.
curl is enabled and allow_url_fopen is on as per phpinfo() in both localhost and at server.

EDIT:

It works fine when using other website's page instead of my website.
The site's target page perfectly loads in my browser.

The web page of my website is loading fast as usual but when I use curl or file_get_contents, it's too slow and even can't get output.

check your server phpinfo() curl support = enabled and allow_url_fopen=on — Rakesh Sharma
– Rakesh Sharma, Commented Sep 19, 2014 at 9:59
@rajeshujade The side loads as smooth as butter in my machine. Also the ping is good. — Sohan Patel
– Sohan Patel, Commented Sep 25, 2014 at 11:33

Bhavesh G · Accepted Answer · 2014-09-26 08:09:07Z

2

+50

I think you have DNS resolving problem.

There is two ways you can use your website's locahost instead of the external domain name.

1. If you have your own server / VPS / Dedicated server, Add entry in vim /etc/hosts for 127.0.0.1 website.net or try to fetch the content with localhost(127.0.0.1).

2. If you are using shared hosting, then try to use below url(s) in your code,

http://localhost.mywebsite.net/~username/home.php. 
OR
Try to call http://localhost.mywebsite.net/home.php

Try this to fetch the url content -

$dynamic = TRY_ABOVE_URL(S)
$out = "home.html" ;

$ch = curl_init();
curl_setopt($ch, CURLOPT_URL,$dynamic);
curl_setopt($ch, CURLOPT_RETURNTRANSFER, 1);

$file = curl_exec($ch);

if($file === false) {
    echo 'Curl error: ' . curl_error($ch);
}

file_put_contents($out, $file);

edited Sep 26, 2014 at 8:09

Bhavesh G

3,0285 gold badges47 silver badges69 bronze badges

answered Sep 25, 2014 at 6:16

Rajesh Ujade

2,73521 silver badges40 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

Bhavesh G Over a year ago

PHP error Warning: file_put_contents( .... html content ... at line file_put_contents($result['content'], $out);

Apul Gupta · Accepted Answer · 2014-09-21 19:56:23Z

0

To investigate the reason why is it not working on live server, Try this:

$dynamic = "http://website.net/home.php";

$out     = "home.html" ;

$ch = curl_init();
curl_setopt($ch, CURLOPT_URL, $dynamic);

curl_setopt($ch, CURLOPT_RETURNTRANSFER, 1);

$file = curl_exec($ch);

if($file === false)
{
    echo 'Curl error: ' . curl_error($ch);
}

curl_close($ch); 

file_put_contents($out, $file);

edited Sep 21, 2014 at 19:56

answered Sep 19, 2014 at 11:13

Apul Gupta

3,0344 gold badges24 silver badges30 bronze badges

3 Comments

Apul Gupta Over a year ago

are you able to see any error by curl_error function? Add <?php ini_set('display_errors', 1);error_reporting(E_ALL); ?> in the beginning of script.

Sohan Patel Over a year ago

Even curl function returns neight true nor false

Apul Gupta Over a year ago

did you added ini_set('display_errors', 1);error_reporting(E_ALL); in the beginning of script? Also, I updated the code, please use updated one.

Hendry Tanaka · Accepted Answer · 2014-09-25 06:13:05Z

0

I think it depends on the provider SSL configuration.

curl_setopt($ch, CURLOPT_SSL_VERIFYPEER, 0);
curl_setopt($ch, CURLOPT_SSLVERSION, 3);
curl_setopt($ch, CURLOPT_SSL_VERIFYHOST, 2);

Check for know smth. about SSL configuration of your provider.

answered Sep 25, 2014 at 6:13

Hendry Tanaka

4643 silver badges11 bronze badges

1 Comment

Bhavesh G Over a year ago

I don't thinks it will depend on provider SSL configuration

Skarpi Steinthorsson · Accepted Answer · 2014-09-25 10:25:01Z

0

Looks like it is a network routing issue, basically the server can't find a route to website.net(itself). This has is a server issue and not a PHP issue. The quickest solution is to edit the hosts file on the server and set website.net to 127.0.0.1.

On linux servers you will need to add the following line to the bottom of /etc/hosts to:

127.0.0.1 website.net

Alternatively you can try fetching http://127.0.0.1/home.php but that will not work if you have multiple virtual hosts on the server.

answered Sep 25, 2014 at 10:25

Skarpi Steinthorsson

5214 silver badges11 bronze badges

9 Comments

Bhavesh G Over a year ago

The php script is hosted at http://website.net itself.. it is not using external website

Bhavesh G Over a year ago

why can't server can't access itself

Bhavesh G Over a year ago

But at shared server editing hosts file is not possible

Skarpi Steinthorsson Over a year ago

It's trying to access the external IP address and can't find a way to it, it's similar to not finding the front door of your own house while looking out the window. By editing /etc/hosts you are telling the server that website.net is on the server itself and not outside it. If this is on a shared server then the service provider must fix the routing.

Skarpi Steinthorsson Over a year ago

Have you tried with external IP address? If that works then this is a routing issue, not PHP issue.

|

Ram Sharma · Accepted Answer · 2014-09-26 05:46:30Z

0

Try this one:

file_put_contents("home.html", fopen("http://website.net/home.php", 'r'));

but curl should work as well. If you have SSH access to the server, try to resolve your domain name using ping or something. It is possible to have a local DNS issue - it will explain why you can download from external domains.

For my example, you'll need allow_fopen_url to be On, so please verify that by phpinfo() first.

edited Sep 26, 2014 at 5:46

Ram Sharma

8,8157 gold badges48 silver badges59 bronze badges

answered Sep 25, 2014 at 7:02

Stanimir Stoyanov

1,22520 silver badges31 bronze badges

4 Comments

Bhavesh G Over a year ago

Page loading and loading and after several minutes it says Connection timed out in file.php at line xx.

Stanimir Stoyanov Over a year ago

And on line xx you have the file_put_contents... ? I think that your troubles are caused by an DNS issue. Could you do echo gethostbyname("yourdomainname.com"); and match it with the actual IP which your website translates into?

Bhavesh G Over a year ago

It returns the ip address of server, and yest it matches.

Stanimir Stoyanov Over a year ago

Please re-attempt with curl and file_put_contents, but add curl_setopt($ch, CURLOPT_VERBOSE, true); just before curl_exec($ch);, and also print_r(curl_getinfo($ch)); right after curl_exec($ch); and post the result.

Collectives™ on Stack Overflow

How to fetch the url content using php curl or file_get_content on the same server?

5 Answers 5

1 Comment

3 Comments

1 Comment

9 Comments

4 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

5 Answers 5

1 Comment

3 Comments

1 Comment

9 Comments

4 Comments

Your Answer

Sign up or log in

Post as a guest

Related