新聞財經娛樂♬資訊 News Economy

I get one php curl program to put in cron-job to do data extract
from one remote site on my hosting server company daily with
my domain name or IP address. It works fine everyday.

Yesterday my hosting company server is down for whole day and my worksite
is not working at all of course, since then the server is back to be normal or fixed but
I can't  connect to the remote site again, other remote sites are okay for connection.
 After debugging, I found I can  use my home PC connected to the remote site and
run the php program on xammp server at my home PC successfully.
(Be reminded, it is hard to block my ISP IP address at my home PC when I do the
the remote site connection, since my ISP IP can be dynamic when my phone line is on and off , the remote site is not easy to block my access)


Up to this moment, I still not be able to connect the remote site
from my website on my hosting company.

I think the remote site  blocked  my domain name to access into its
server because I guess my php program running  yesterday at the hosting company server down period will hang up the remote site server for long time. SO they
decided to block my domain name

How to avoid to  block my IP address when I access the remote site through
my php curl program. Some people tells me it may use proxy to filter out
remote site blocking but How.

Any idea to solve my issue
Please advise

Duncan

The problem with using proxies is that they are often infected with malware and are on blacklists that get routinely blocked.  You might find a proxy that works for a time, but overtime they all get blocked; and this kind of setup is much less efficient.

As for your right to  the information; you have none.  It may be a public site with free access, but the owner still has the right to restrict how it may be access and by whom.

The real problem is with your ISP.  They need to get the ip off of the blacklist and resolve the blocking issue with Yahoo; otherwise the problem will re-occur no matter what you do.

Cd&

BTW if that ip you posted is the one you are using the problem may also be because the ip is blacklisted by Spamhaus because of a PBL advisory for its mail server policy.

Cd&

I agree with Ray.  You do not have a technical issue.  You have a relationship issue.  The publisher owns the content.  If they charge for it or do not want you to have it, then then trying to go around the block is theft.

Cd&

Suggest you contact the publisher and request an API.  If you're taking their information without their permission, it is unethical and may have legal consequences.  If they want you to take and reuse their information they will give (or license) an API.

cURL can make any part of the request say anything you want it to say, and you can even make your script appear to be a Firefox client referred by Google.  But that aside, if the publisher is blocking your access to the data, the problem is not cURL -- it's your relationship with the publisher.

Do the remote site provides the info for free ?
Please provide the link so that i would check it from my ip too.
As many such site has there own limitation to provide the info to certain site. Even ur ip is dynamic  its not an public ip.
You ISP provides an public to your hosting company even if your ip has been changed at your end.
Some, company even capture the mac address and block the ips .
So, its advisable to inform customer support of the remote site.