A number of people involved with Internet Marketing and SEO find a need to scrap Google. I am not sure how, but it is useful to them in many ways.
After doing some search on internet, I did found some script, but none of them solved my purpose. There were many certain constrains which are as follows:-
- Google does not allow us to search for more than 1000 results for one keyword. That applies to my scraper as well.
- It detects multiple requests from the same IP address, so if proper care is not taken, it pops up with a CAPTCHA and in long run even blocks IP for a certain duration.
The solution to this was to be natural. Make sure that Google is not able to differentiate between the program and human behavior. That did the trick for me.
To check out the demo click here.
The code is published on phpclasses.org. Click here to download
Note: In case the script is not working, let me know. There might be a need to change the proxy.