Release Notes

Release Notes

Version 2.16.1

Bug Fixes

  • Documentation for Wait for Content commands is missing in the manual.
  • The Content Grabber editor may crash on some script syntax errors.

Version 2.16.0

New Features

  • New command type Wait for Content can be used to force the parent action command to wait for specific URLs or web content.

Changes

  • The Action properties Wait For Regex and Wait For Urls have been combined into a single property Wait For Content.
  • The Action properties Wait For Regex Timeout and Wait For Urls Timeout have been combined into a single property Wait For Content Timeout.

Bug Fixes

  • JSON content returned by a web server is not recognized as JSON if the response Content Type is set to application/javascript which is used by many web servers.
  • Base meta tags are not always processed correctly when using a HTML Parser.

Version 2.15.2

Changes

  • Session cookies are no longer removed on agent start unless specifically configured in the agent command.

Version 2.15.1

Bug Fixes

  • Content Grabber crashes when trying to import a Visual Web Ripper project created with a recent version of Visual Web Ripper.
  • The Delete button in the File menu does not work.

Version 2.15.0

New Features

  • Values from Local Storage and Session Storage are now available using the Page Attribute command.

Bug Fixes

  • Content Grabber waits too long on some websites causing agents to run slower than they should.

Version 2.14.16

Bug Fixes

  • Custom HTML tags are not handles correctly.

Version 2.14.15

Bug Fixes

  • The option to limit pagination page loads with a fixed value is not saved correctly.

Version 2.14.14

New Features

  • New option to limit pagination page loads with a fixed value.

Bug Fixes

  • Crash when using a HTML Parser and setting a form field in design or debug mode.
  • Crash when setting an Exit or Retry command to use a specific command and then not specifying a command.

Version 2.14.13

Bug Fixes

  • Error exporting data to file formats when converting rows to columns and the converted list command generates no rows.

Version 2.14.12

Changes

The Wait for XPath option now allows page loads while waiting for an XPath selection to exist.

Version 2.14.11

Bug Fixes

  • Error executing Page Transformation commands in design and debug mode when loading content directly into HTML parsers.

Version 2.14.10

Bug Fixes

  • Error exporting historical data to MySQL.

Version 2.14.9

Bug Fixes

  • HTML Parser requests never times out, no matter the configured time out value. This is a serious issue, especially when processing a large number of different websites, because some websites never return a response, and Content Grabber will then hang until stopped manually.

Version 2.14.8

Bug Fixes

  • Number of threads used when running an agent is not always correct when using HTML Parsers.
  • It's not possible to see if a script is turned on or off on all command configurations screens.

Version 2.14.7

Bug Fixes

  • An error may occur at design time when converting a document that opens in a new window.
  • "base" HTML tags without href attributes cause HTML parsers to generate wrong URLs.
  • Database connection details saved in an agent maybe duplicated.

Version 2.14.6

Bug Fixes

  • An error may occur when a web page refreshes in a dynamic browser.

Version 2.14.5

New Features

  • New option to automatically add a capture command when creating a new Form Field command.

Version 2.14.4

Bug Fixes

  • Agent may fail to export when change tracking is turned on.

Version 2.14.3

New Features

  • CSV file content can now be edited directly from the Data Provider configuration window.

Version 2.14.2

Bug Fixes

  • Unable to cancel anchor selection mode.

Version 2.14.1

Bug Fixes

  • Exporting data since last successful run when using change trackikng does not work correctly.
  • An error occurs when choosing captured data as data provider.

Version 2.14.0

New Features

  • New action option Ignore error codes can be set to false to force an error when a website returns an error code, even when the website returns content. Content Grabber ignores status codes by default when content is returned, because some websites return incorrect error codes, or return error codes that have special meaning and should be handled by the Content Grabber agent.

Changes

  • HTML parsers no longer fail by default when an error code is returned from the web server, unless the option Ignore error codes is set to false. This makes the behavior the same as when using a dynamic browser. WARNING: this may cause existing agents to behave differently unless you set the option "Ignore error codes" to false.

Version 2.13.7

Bug Fixes

  • The ScriptUtils function GetData() makes a POST request instead of a GET request.

Version 2.13.6

New Features

  • New function insert_data is now available for Content Transformation regex scripts.

Bug Fixes

  • When certain errors occur in Content Grabber and an agent process is restarted, web browser processes may be left running and never shut down.

Version 2.13.5

Bug Fixes

  • Page to PDF commands may fail depending on timing.

Version 2.13.4

New Features

  • New option Deliver data files can be turned off when distributing data, so only extracted files are distributed.
  • New option Always update design value can be used on capture commands to make sure their design values are automatically updated when a new web page is loaded.
  • When posting data with a URL, the pattern [CG_FILE_UPLOAD_PATH:...] can be used instead of the actual file content when upload a file.

Version 2.13.3

Bug Fixes

  • The option Deliver Extracted Files has no effect when delivering extracted data to email or FTP.
  • Missing files may cause data export to fail when delivering data to email or FTP.
  • The options Default Email Settings and Default Email Addresses are not saved when saving the email delivery settings.
  • An agent may hang on websites that continuously make AJAX calls. 

Version 2.13.2

New Features 

  • Request method can now be specified when loading a web request.
  • Post, header and method parameters can now be specified in any order when loading a web request.

Version 2.13.1

New Features 

  • Additional information added to the web request editor to make it easier to create file upload requests.
  • Log settings can now be set in an Initialization script, but overriding the commandline parameters in the GlobalData object.

Version 2.13.0

New Features 

  • Response headers are not available in scripting.
  • Custom headers can now be set for all requests in web browsers.

Changes

  • The property LastBrowserMessage has been replaced with LastErrorResponse in scripting.

Bug Fixes

  • Screenshot commands don't work.
  • Error setting proxy to Fiddler.
  • The base meta tag is not taken into consideration when extracting URLs.

Version 2.12.3

New Features 

  • Proxicity proxy support.

Bug Fixes

  • Luminati proxy configuration is disabled.

Version 2.12.2

New Features 

  • Default email settings shared by all agents on a computer.
  • Messages can be sent from an agent to its hosting application when using the API.

Version 2.12.1

Bug Fixes

  • Outdated help file topics.

Version 2.12.0

New Features

  • Support for historical data when using change tracking.
  • New capture command option Exclude from change tracking.
  • New command type Page to PDF saves a web page as a PDF file.

Bug Fixes

  • Refresh Document commands cause the debugger to hang.
  • Content Grabber may crash when editing commands that consume data.
  • The Max. repeats option for link commands does not work.
  • The Close Browser command doesn't properly close a browser.

Version 2.11.9

Bug Fixes

  • JavaScript on a target website is sometimes able to close an agent browser, which can cause the agent to crash.

Version 2.11.8

Bug Fixes

  • Links on the startup page don't work when DPI is set to more than 100%.

Version 2.11.7

New Features 

  • Date range data provider.
  • New Change Tracking option Track Deletes. This option is turned on by default.

Changes

  • Input data from non-database sources is now loaded automatically when editing a command that depends on the input data

Bug Fixes

  • Combining the options Change tracking and Old data option Keep All and Export should not be allowed.

Version 2.11.6

Bug Fixes

  • Internal frames are sometimes incorrectly detected as external frames.

Version 2.11.5

New Features 

  • Content Grabber now detects if it should load and parse external frames.

Bug Fixes

  • Unable to set form fields with text containing some special characters.
  • Number Range data provider does not work when debugging.

Version 2.11.4

Bug Fixes

  • Content Grabber may crash when processing certain AJAX requests.

Version 2.11.3

Bug Fixes

  • Post and header URL parameters don't work when using a web browser.

Version 2.11.2

New Features 

  • The Request Editor now has the ability to test requests.

Bug Fixes

  • Content Grabber may crash when debugging Exit or Retry commands.

Version 2.11.1

Changes

  • Minor user interface corrections.

Version 2.11.0

New Features 

  • Easier trial activations.
  • Support for multiple hosts per serial key.

Bug Fixes

  • User Interface displays incorrectly on some screen resolutions.

Version 2.10.0

New Features 

  • New Web Request editor makes it easier to create complete web requests that include URL, post data and headers.
  • When clicking on AJAX URLs in the Browser Activity screen, the Web Request editor will open and provide info about post data and headers.
  • New Filter selection tool.
  • Exit Or Retry commands now have an option to delete the current data row when exiting.

Bug Fixes

  • Creating list selections while inside a Web Element List command sometimes does not work correctly.

Version 2.9.9

New Features 

  • New option to capture link text when creating a new Link command. 

Bug Fixes

  • Content Grabber may crash when a page is not loaded correctly.
  • Content Grabber may crash when exporting data to CSV if the agent contains a capture command with content type DateTime and the captured value is an invalid date.

Version 2.9.8

Bug Fixes

  • Minor layout issues on script dialog windows.
  • Data replacement does not always work for Regex scripts.

Version 2.9.7

Bug Fixes

  • Content Grabber may crash when executing a command with a selection condition if the selection does not exist.
  • Some icons are missing from the command tree when debugging an agent.

Version 2.9.6

New Features 

  • New application menu View HTML displays the raw HTML of the currently selected browser tab.
  • The JSON Transformation windows now allows testing transformations.

Bug Fixes

  • Minor layout fixes in the Content Grabber editor.

Version 2.9.5

Bug Fixes

  • Content Grabber crashes when using the option Close Browser After Use on the Agent command.

Version 2.9.4

Bug Fixes

  • Trial activation screens are displayed incorrectly on some screen resolutions.
  • The free Nohodo proxy plan is not automatically configured in Content Grabber for trial users.

Version 2.9.3

Bug Fixes

  • Page Transformation commands cause agents to fail.

Version 2.9.2

Bug Fixes

  • Form Field commands not executing an action can cause problems for some sub-commands, such as Download Document commands.
  • Page Transformation commands often does not work correctly.

Version 2.9.1

Bug Fixes

  • Condition script documentation is missing from the manual.

Version 2.9.0

New Features

  • New flow control commands If..ElseIf..Else and Exit or Retry.
  • New command Remove Duplicate.
  • New command Resolve CAPTCHA.
  • New command Manual Navigation.

Version 2.8.2

Bug Fixes

  • Visual Studio templates don't work after switching from 32bit to 64bit.

Version 2.8.1

Bug Fixes

  • An agent may stop or hang when retrying a URL using a Dynamic browser.

Version 2.8.0

API Changes

  • The ListNodes property has been removed from the ScriptParameters class.

Bug Fixes

  • The options Separate output and Export Method are not synchronized in the configuration panel for Group commands, Group in Page Area commands and Web Element List commands.
  • Nested Web Element List commands sometimes don't work properly.

Version 2.7.7

Bug Fixes

  • Data export to a separate table sometimes produces incorrect data.

Version 2.7.6

New Features 

  • Agent schedules can now be exported and imported from the Manage Schedules screen.

Version 2.7.5

Bug Fixes

  • The Save As file menu is missing.
  • Content Grabber crashes when trying to delete the internal database while no internal database connection is selected.

Version 2.7.4

Bug Fixes

  • Unable to select web elements in the web browser on some computers.
  • Unable to start the Content Grabber Windows service.
  • Self-contained agents don't work correctly.

Version 2.7.3

Bug Fixes

  • Unable to set the option SQLite Sync.

Version 2.7.2

Bug Fixes

  • Unable to cancel pagination set selection when creating a Pagination command with a pagination set selection.

Version 2.7.1

New Features 

  • When opening a trial agent in a full version of Content Grabber, a message is now displayed to ask if the agent should be converted to a full agent.

Bug Fixes

  • The installer always displays Professional edition, even when installing a Premium or Server edition.
  • When creating a 32-bit runtime package on 64-bit Windows, a message will say that a 64-bit runtime package was created, even though a 32-bit package was in fact created.
  • Unable to add agent commands in the 2.7.0 trial version.

Version 2.7.0

IMPORANT: Older versions of Content Grabber cannot be upgraded to 2.7.0. All previous installations of Content Grabber must be uninstalled and the full version of Content Grabber 2.7.0 must then be downloaded and installed.

New Features 

  • The software installers for the Premium, Professional and Server editions are now consolidated into a single installer.
  • Content Grabber now installs as a 64-bit application on 64-bit Windows.
  • The Content Grabber runtime is now available in both 64-bit and 32-bit versions.

Bug Fixes

  • Unable to set the option SQLite Sync when using SQLite as internal database.
  • When using SQLite as internal database, the option SQLite Sync is set to true by default instead of false as intended. This can result in some agents running much slower than they otherwise would.