<< <%SKIN-STRTRANS-SYNTOC%> >> Navigation: »No topics above this level« CAPTCHA & IP Blocking |
Some website owners do not want web-scraping agents to extract data from their websites. They may try to block access to their website if they believe the user is not human.
CAPTCHA and IP blocking are the two most common ways of blocking web scraping agents. You can configure a Content Grabber agent to manually or automatically bypass CAPTCHA, and also configure an agent to use proxy servers - which prevents IP blocking.
Read these topics for more information: