Release Notes

Release Notes

Version 2.3.15 - Trial Edition

Bug Fixes

  • Error editing schedules from the Manage Schedules screen.
  • A "live" value for the scheduling option Run only when user logged in is no longer available, so a configured value is now shown.

Version 2.3.14 - Trial Edition

Bug Fixes

  • Agents scheduled to run without a user logged in don't take proper screenshots.

Version 2.3.13 - Trial Edition

Bug Fixes

  • An error may occur when exporting data, if an agent contains container links to container commands that exports data to a separate data table.
  • An error may occur when using a custom export script that accesses child tables of child tables.
  • The scroll() event function does not work.

Version 2.3.12 - Trial Edition

Bug Fixes

  • Cookies are always deleted on agent start and when opening the Content Grabber editor, even when In Memory cache is not used.

Version 2.3.11 - Trial Edition

Bug Fixes

  • Error exporting data to an Oracle database.

Version 2.3.11 - Trial Edition

Bug Fixes

  • Error exporting data to an Oracle database.

Version 2.3.10 - Trial Edition

New Features 

  • New event function removeCgAttributes can be used to remove all CG attributes from DOM objects. These attributes may in very rare scenarios cause problems.

Version 2.3.9 - Trial Edition

Bug Fixes

  • The default proxy rotation interval is set to 100 instead of the intended 1.

Version 2.3.8 - Trial Edition

Bug Fixes

  • The API functions GetAgentNotificationsAsJson and GetAgentNotificationsAsDataTable cause an error.

Version 2.3.7 - Trial Edition

New Features 

  • The agent property Load Images has a new option Default, which will not load images while an agent is running, but will refresh a page with images when the agent is being paused.

Changes

  • When using SQL Server or MySQL as internal database, an agent's internal database tables are no longer recreated when deleting existing data, but instead truncated.

Bug Fixes

  • The web browser is not always shown properly when pausing an agent.
  • An agent's internal database is always recreated when using the capture data type Boolean.
  • An error occurs when a agent supports sessions and it's internal database tables don't exist.
  • An error occurs when running an agent that's using SQL Server as internal database and also supports change tracking.

Version 2.3.6 - Trial Edition

Bug Fixes

  • Some script utility functions are not executed correctly at design time.
  • The browser target is set to New by default instead of Current for Download Document commands using Click to Download.
  • The Download Document configuration screen sometimes show wrong configuration tabs.

Version 2.3.5 - Trial Edition

New Features 

  • Download Document commands can now use a Web Browser when downloading documents with a direct URL.

Bug Fixes

  • Error restoring agent templates.

Version 2.3.4 - Trial Edition

Bug Fixes

  • Websites with invalid SSL certificates cannot be processed.

Version 2.3.3 - Trial Edition

New Features 

  • New ScriptUtils methods GetCookies and SetCookies can be used to easily set or get web browser cookies.

Bug Fixes

  • An error occurs when change tracking is turned on and an export table contains no data columns
  • The ScriptUtils methods ClearAllCookies and ResetBrowserSession are not working.

Version 2.3.2 - Trial Edition

Changes

  • Excel export now creates multiple worksheets by default.

Bug Fixes

  • Error exporting to multiple Excel worksheets.
  • Content Grabber may crash when starting.

Version 2.3.1 - Trial Edition

Bug Fixes

  • The option Rows Merge Method does not work correctly when set to Concatenate.

Version 2.3.0 - Trial Edition

New Features 

  • New command type Crawl Website can be used to follow all links on a website. The number of links to follow can be limited by domain name, link depth and number of links. The command selects all links by default, but the web selection can be modified so it only selects specific links.
  • New Capture command option Merge Rows Method. When the parent container command option Export Method is set to Add Columns and Merge Rows, this option specifies how to combine row values.
  • New regex function return if match ... otherwise ... can be used to return a specific value if a match is found and another value if a match is not found. For example, True could be returned if a match is found and False if a match is not found.

Breaking Changes

  • The container command option Merge Rows Value Separator has been moved to Capture commands. This option now works together with the new Capture command option Merge Rows Method.

Bug Fixes

  • XPath functions is-direct-url and is-same-domain don't work.
  • A command with multiple selection XPaths may select the same web element twice.

Version 2.2.9 - Trial Edition

Bug Fixes

  • Environment variables are not expanded in CSV input paths.
  • The Click to Download option in Download Document commands does not always work correctly.
  • Custom CSV export paths are not saved correctly.
  • An error may occur when installing a self-contained agent.

Version 2.2.8 - Trial Edition

New Features 

  • A Data Provider script can now use a regular expression to provide data.

Bug Fixes

  • The timeout option File Download Completed is duplicated.
  • The agent option Clear Cookies And Session is not saved correctly.

Version 2.2.7 - Trial Edition

New Features 

  • A new option Load Images can be used to specify when images should be downloaded and displayed in the web browser. An agent can still capture images even when they are not downloaded and displayed in the web browser, but images must be shown in the web browser to capture proper screenshots. An agent will perform better when not downloading and showing images in the web browser. The default option is to download and display images when designing and debugging an agent,m but not while running an agent. This option is only relevant when using a dynamic web browser.

Version 2.2.6 - Trial Edition

New Features 

  • A Download Document command cannot download content that is generated on-the-fly and written to a popup window.

Bug Fixes

  • Changing browser type does not take effect until an agent is reopened.

Version 2.2.5 - Trial Edition

Bug Fixes

  • Content Grabber installer does not work on some computers.

Version 2.2.4 - Trial Edition

Bug Fixes

  • Some Content Grabber processes may not always terminate at the end of an agent run.

Version 2.2.3 - Trial Edition

Bug Fixes

New browser target Popup will continue loading a page until a pop-up appears.

Some popup windows don't open properly.

XML and JSON parsers don't work when opened from a dynamic browser.

Version 2.2.2 - Trial Edition

Bug Fixes

  • Content transformations that return group matches that don't exist return incorrect results.

Version 2.2.1 - Trial Edition

New Features 

  • The Set Form Field command property Set Select Box Method replaces the property Set Select Box Text.
  • A query selector can now be specified for action events. This allows events to be fired on web elements other than the action web element.

Bug Fixes

  • Select box items cannot be selected if they have trailing or preceding white spaces.

Version 2.2.0 - Trial Edition

New Features 

IMPORTANT: The Content Grabber application database will be recreated when upgrading to this version. Current status information about agents on the computer will be lost.

  • Some API methods that retrieve extracted data or log data now have optional parameters offset and limit to enable data pagination. Offset is the index of the first data entry to return and limit is the index of the last data entry to return. Pagination of extracted data is only applied to the main table or the table specified by the option Row Count Container in Agent settings. 
  • API methods that return agent status now return a new value Export Row Count which is the number of exported rows in the main data table or the the data table specified by the option Row Count Container in Agent settings.

Bug Fixes

  • API export to DataSet sometimes fail.
  • The manual topic Export From Multiple Agents is empty.

Version 2.1.0 - Trial Edition

New Features 

  • New option to send extracted files along with the data files when distributing via Email or FTP.

Bug Fixes

  • Downloaded files are sometimes embedded in output when they shouldn't be.
  • The methods RenameSilent and SaveAsSilent are missing from the API.

Version 2.0.26 - Trial Edition

Bug Fixes

  • Small UI glitch on trial activation screen.

Version 2.0.25 - Trial Edition

Bug Fixes

  • CSV header row always uses comma as separator.
  • Readme file contains incorrect instructions.
  • Activation requests don't use gateway proxy when required.

Version 2.0.24 - Trial Edition

Bug Fixes

  • Distribution scripts are not executed when exporting to a database.
  • Duplicate checks are not performed on data extracted as dates or numbers.

Version 2.0.23 - Trial Edition

Bug Fixes

  • An error may occur when sending extracted data by email or uploading the data via FTP.
  • Unable to reinstall Content Grabber if a downloaded file is corrupt.

Version 2.0.22 - Trial Edition

Bug Fixes

  • Error executing Data Distribution scripts.

Version 2.0.21 - Trial Edition

New Features 

  • Warnings at startup if virus software has destroyed the Content Grabber installation or has blocked Internet access for the Content Grabber software.
  • New options for optimizing the way a parser tries to detect a web page's character encoding.

Version 2.0.20 - Trial Edition

Bug Fixes

  • Error loading input data from databases.
  • The HTML Parser is sometimes using the wrong encoding.

Version 2.0.19 - Trial Edition

Bug Fixes

  • A Content Grabber file was not properly signed and therefore more likely to be removed by anti-virus software.

Version 2.0.18 - Trial Edition

Bug Fixes

  • An error may occur when exporting to databases.

Version 2.0.17 - Trial Edition

Changes 

  • The property Download Headers Only has been moved to an option of the property Download Method on the Download Document command type.

Bug Fixes

  • Click to Download doesn't work correctly.
  • Popup windows are not processed correctly.
  • Executing Download Image commands in the Agent explorer can cause Content Grabber to hang.
  • Incorrect error codes returned by a web server causes web pages to be processed incorrectly.
  • Incorrect NULL control characters in web content causes web pages to be processed incorrectly.

Version 2.0.16 - Trial Edition

Bug Fixes

  • The click() event function doesn't fire the correct sequence of events.
  • Error inserting command templates.

Version 2.0.15 - Trial Edition

Bug Fixes

  • The 2.0.14 installer is not working on some computers.

Version 2.0.14 - Trial Edition

New Features 

  • Headers and post data can now be specified on file download URLs.
  • Decreased installer size.

Version 2.0.13 - Trial Edition

Bug Fixes

  • The Group Commands feature in the Content Grabber editor causes the software to crash.
  • Unable to shift-click on a selected list element to remove that element from the list.
  • Agent templates are missing.

Version 2.0.12 - Trial Edition

IMPORTANT: Content Grabber 1 cannot be upgraded to version 2, so you must download and install the full version of Content Grabber 2. Content Grabber 1 & 2 can run side-by-side on the same computer using the same license.

New Features 

Web Browser:

  • Chrome based web browser. The embedded web browser is now based on Chrome and is completely self-contained, so no existing web browser is required on the computer where Content Grabber is running, and agent behavior no longer depends on existing browser configuration on the computer.
  • Edge Selections. Click on the edge of a web element to select its parent. This is particular convenient when selecting web elements such as table rows, which cannot be selected directly in the web browser because they are completely covered by table cells.

Agents:

  • Data retention

    New data retention options. Old data can now be deleted, kept and exported, or kept for duplicate checks only. New default duplicate scripts can be used to copy old data to the current data set, so you end up with a complete current data set. Previously, using duplicate scripts would always make it impossible to know when data was deleted from the target website.
     
  • Change tracking

    An agent can now keep track of the latest changes that have been made to extracted data. The agent will mark extracted data as deleted, modified or added. If data is deleted but later returned, the data will be marked as "returned", or "returned modified" if the data returned in a modified state. An agent can be configured to only export data that has changed since last successful run, or only export data that has changed since since a specified number of days.

    Data will only be marked as deleted if an agent run successfully completes. This prevents data from being incorrectly marked as deleted if an agent fails halfway through a run.
     
  • Success criteria

    Success criteria can now be defined to control when an agent run is considered successfully completed. Success criteria can be used to control notifications and change tracking.
     
  • Export From Multiple Agents

    Multiple agents can now export to the same database tables.
     
  • Export script templates

    Script templates make it easier to build export scripts for agents. A script template will contain the C# code required to read all data from an agent, so all that needs added is the code required to write the data.
     
  • Export Settings

    Export Settings have been simplified. Data exported from a container can now be separated by setting a single option on the container. Exported data from list containers is now never separated by default, which should make the export data format more predictable.
     
  • File downloads

    More reliable file downloads when using "Click to Download".
     
  • Screenshots

    Agents running in a service are now able to take screenshots.
     
  • Retry errors

    After an agent stops, the agent can now continue data extraction, continue data extraction and retry errors, or just retry errors.

    The current version of an agent can now be used when continuing a data extraction or retrying errors. The current version of the agent can differ from the version at the time the data extraction started. An error occurs if the agent has been modified in a way that requires a new internal data structure. It's still possible to use a version of the agent that was current when the data extraction started.

User Interface:

  • Simplified action configuration.
  • Multiple command selections for easier delete/copy/move of multiple commands.
  • Group Commands feature allows you to move all selected commands inside a Group command.
  • Improved XPath editor. The XPath editor now has color highlighting and has been moved from the Ribbon menu to a docking window.

Self-Contained Agents:

  • New user interface for self-contained agents. The user interface is now pure HTML, and can be completely customized with a Premium edition of Content Grabber.

Version 1.26.19 - Trial Edition

New Features 

  • Headers and post data can now be specified on file download URLs.

Version 1.26.18 - Trial Edition

Bug Fixes

  • Activation windows display incorrectly on some screen resolutions.

Version 1.26.17 - Trial Edition

New Features 

  • New Data Provider option Hide Data in Editor can be used to hide sensitive data such as passwords in the Content Grabber editor.

Bug Fixes

  • Default exit scripts don't work properly when executed in a container command that executes sub-commands when it's selection doesn't exist.

Version 1.26.16 - Trial Edition

Bug Fixes

  • Generating agent commands for all table elements sometimes causes an error.

Version 1.26.15 - Trial Edition

Bug Fixes

  • The Wait For Java Script action option doesn't work properly.

Version 1.26.14 - Trial Edition

New Features 

  • New Action options WaitForJavaScript and WaitForJavaScriptTimeout.

Bug Fixes

  • An error may sometimes occur when importing an agent.

Version 1.26.13 - Trial Edition

New Features 

  • New Action properties WaitForUrlRegex and WaitForUrlTimeout. These properties can be used to wait for a particular URL.

Version 1.26.12 - Trial Edition

New Features 

  • Agent Save As now copies dependent assemblies and input files to the new agent location.

Version 1.26.11 - Trial Edition

Bug Fixes

  • Content Grabber may crash when executing a command with a selection that doesn't exist in the designer.

Version 1.26.10 - Trial Edition

Bug Fixes

  • An error may occur when executing an action command inside HTML List commands.

Version 1.26.9 - Trial Edition

Bug Fixes

  • Potential error when exporting data.

Version 1.26.8 - Trial Edition

Bug Fixes

  • Link commands that are executed asynchronously are not retried when error handling is set to retry.
  • An agent may hang when logging to file.

Version 1.26.7 - Trial Edition

New Features 

  • Minor adjustments to the export API.

Bug Fixes

  • The Data Export script in the help file contains syntax errors.

Version 1.26.6 - Trial Edition

Bug Fixes

  • Data Count values available in export scripts are incorrect.

Version 1.26.5 - Trial Edition

New Features 

  • A browser sequence number is now added to the log when logging to file. The sequence number is already added when logging to database.
  • Data count and Last data count are now added to notification emails.

Version 1.26.4 - Trial Edition

Bug Fixes

  • The debug menu is empty while debugging.

Version 1.26.3 - Trial Edition

Bug Fixes

  • Data Distribution scripts are not executed.

Version 1.26.2 - Trial Edition

Bug Fixes

  • The JSON Parser is not able to parse JSON that doesn't start with an object.
  • The Data Distribution script editor does not correctly save the script.

Version 1.26.1 - Trial Edition

Bug Fixes

  • Self-contained agents may not work on some computers.
  • Script library functionality is not available unless Visual Studio 2013 is installed, but should also be available if higher versions are installed. 

Version 1.26.0 - Trial Edition

New Features 

  • WMI is no longer used by the licensing system. IMPORTANT: It's not possible to downgrade from version 1.26.0 without first deactivating the current installation.

Bug Fixes

  • Content Grabber is not always able to determine the file extension of downloaded files when it should be able to.

Version 1.25.8 - Trial Edition

Bug Fixes

  • Proxies configured in Application Settings are not used during runtime.

Version 1.25.7 - Trial Edition

Bug Fixes

  • An error occurs during runtime when using MySQL as internal database.
  • Content Grabber crashes when trying to view HTML logged during debugging.

Version 1.25.6 - Trial Edition

New Features 

  • Capture commands now have a Sort Order property that can be used to control the positions of the corresponding export data columns.

Version 1.25.5 - Trial Edition

New Features 

  • html:// can now be used in a URL to load plain HTML directly into a web browser, in the same way as json://

Bug Fixes

  • Capture commands with a data length set to less than 3 causes an error.

Version 1.25.4 - Trial Edition

Bug Fixes

  • Logging sometimes slow down performance more than it should.

Version 1.25.3 - Trial Edition

Bug Fixes

  • The extension of downloaded files is sometimes wrong when debugging an agent.

Version 1.25.2 - Trial Edition

Bug Fixes

  • Content Grabber may crash when making certain selections in the web browser while designing an agent.

Version 1.25.1 - Trial Edition

Bug Fixes

  • Switching from a Dynamic Browser to a HTML Parser may cause the HTML Parser to never be released for reuse.
  • Content Grabber may crash when using the Execute all commands feature without first saving the agent.

Version 1.25.0 - Trial Edition

Bug Fixes

  • When using an internal database other than SQLite, an agent sometimes reports the internal database tables as being invalid when they are not.

Version 1.24.12 - Trial Edition

Bug Fixes

  • Input parameters are sometimes case sensitive which they shouldn't be.

Version 1.24.11 - Trial Edition

Bug Fixes

  • An error occurs when a Link command performs an action in the parent browser and closes the current browser.

Version 1.24.10 - Trial Edition

New Features 

  • A Link command can now be forced to open a link in a new web browser even if the link is posting multi-part data.

Version 1.24.9 - Trial Edition

Bug Fixes

  • An error may occur when JavaScript attempts to close a browser.

Version 1.24.8 - Trial Edition

Bug Fixes

  • Oracle connection strings are not saved correctly causing errors when exporting data to Oracle.

Version 1.24.7 - Trial Edition

Bug Fixes

  • An error may occur when downloading files.
  • An error occurs when getting a child table of a child table when export raw internal data.

Version 1.24.6 - Trial Edition

Bug Fixes

  • All API functions returning an agent's status as JSON cause an error.

Version 1.24.5 - Trial Edition

New Features 

  • Excel export can now generate multiple work sheets.
  • SQLite sync option now set to false by default.

Bug Fixes

  • URLs with the json:// prefix does not work when opened from a dynamic browser.

Version 1.24.4 - Trial Edition

Bug Fixes

  • A Form Field command with an optional XPath selection may cause an error.

Version 1.24.3 - Trial Edition

New Features 

  • json:// can be prefixed to a URL to load JSON directly into a static parser.
  • SourceIndex is now available on the DataRow object in scripting. The SourceIndex is the current list index for data lists and HTML lists.

Bug Fixes

  • A data duplicate maybe recorded incorrectly if an agent restarts.
  • When an agent logs to file, script debug messages are not written to the log file.

Version 1.24.2 - Trial Edition

New Features 

  • New action command option Error Retry Delay.

Bug Fixes

  • The agent option Run Health Monitor does not always work correctly.

Version 1.24.1 - Trial Edition

Bug Fixes

  • Error exporting data to MySQL.
  • Unable to continue an agent from the Run screen if it's not creating internal export data. 

Version 1.24.0 - Trial Edition

New Features 

  • New export target Raw Data Script exports the raw internal data directly without generating internal export data.
  • SQL Server connection pool size increased.

Bug Fixes

  • All script library templates contain errors.
  • The agent option Run Health Monitor does not always work correctly when turned off.

Version 1.23.1 - Trial Edition

Bug Fixes

  • Unable to export container commands in separate tables if one of the containers saves data to columns in a parent table.
  • Error exporting to columns in a parent table if header and value commands are specified, and the container has other capture commands not specified as header or value command.

Version 1.23.0 - Trial Edition

New Features 

  • New Capture command property Data Length can be used to set the maximum number of characters allowed for Short Text data types.
  • New Capture command property Create Index can be used to include the content in an internal index, which can boost performance when using duplicate checks.
  • New agent property Separate Session Tables creates separate internal tables for each agent session.
  • When performing duplicate checks, the ContainsData method now accepts a parameter searchAllSessions which will cause the duplicate check to search for duplicate data in all agent sessions.

Version 1.22.0 - Trial Edition

New Features 

  • All write operations are now synchronized to disk when using the default SQLite internal database. This results in a slower but more reliable SQLite database. Disk synchronization can be turned off in Agent Properties -> Data -> Internal Database -> SQLite Connection -> SQLite Sync.

Version 1.21.15 - Trial Edition

Bug Fixes

  • Certificate validation errors will cause a page load error when posting data using a HTML Parser.

Version 1.21.14 - Trial Edition

Bug Fixes

  • An error log entry is added when deleting a command.
  • Executing certain commands may cause an error in the Content Grabber designer if a page has not been loaded.

Version 1.21.13 - Trial Edition

New Features 

  • New agent option Keep connections alive can be set to false to allow proxy rotation services to properly rotate on HTTPS requests.

Version 1.21.12 - Trial Edition

Bug Fixes

  • Some assemblies cannot be added as script references.

Version 1.21.11 - Trial Edition

New Features 

  • Any URL can now be loaded using a URL command, even if its format is incorrect.

Version 1.21.10 - Trial Edition

New Features 

  • The API can now resume an agent.

Version 1.21.9 - Trial Edition

Bug Fixes

  • The time allowed to initialize the design browser maybe too short in some situations.

Version 1.21.8 - Trial Edition

Bug Fixes

  • When using a HTML Parser, an Add HTML page transformation replaces HTML instead of adding it to the page.
  • The Selection option IgnoreCommandExecuteSubCommands does not work correctly for Form Field commands.

Version 1.21.7 - Trial Edition

Bug Fixes

  • Always unable to continue an agent after closing the Run Agent screen.

Version 1.21.6 - Trial Edition

Bug Fixes

  • An error may occur when trying to download an image that doesn't exist.

Version 1.21.5 - Trial Edition

Bug Fixes

  • The feature to create a runtime package always create the package in the default location no matter the location selected from the file explorer.
  • Importing an agent from the Content Grabber user interface will never override an existing agent.

Version 1.21.4 - Trial Edition

Bug Fixes

  • Unable to configure Luminati proxy settings for specific agents.

Version 1.21.3 - Trial Edition

Bug Fixes

  • A database connection error occurs when using a Custom Data Storage.

Version 1.21.2 - Trial Edition

Bug Fixes

JavaScript files are not recognized as having potential embedded JSON content.

Version 1.21.1 - Trial Edition

Bug Fixes

  • Version 1.21.0 has several issues related to selecting web elements.

Version 1.21.0 - Trial Edition

New Features 

  • New file capture property Download Headers Only will capture the response headers only, and not download the entire file.

Version 1.20.10 - Trial Edition

New Features 

  • if the action property "Is override active element" is set to true, the web element selected by the command is now set as the active element.

Bug Fixes

  • The Command Script ExitListEntry return method only works correctly when exiting parent containers.

Version 1.20.9 - Trial Edition

Bug Fixes

Unable to save Oracle database connections in some situations.

Version 1.20.8 - Trial Edition

Bug Fixes

  • The API method GetLastAgentLogFileAsZip should not include a directory in the zip file.

Version 1.20.7 - Trial Edition

New Features 

  • New script utility class ScriptSettings can be used to load settings stored in XML files. 

Version 1.20.6 - Trial Edition

New Features 

  • Custom values can now be configured in application settings.

Bug Fixes

  • An agent stalls if an error occurs while firing an event.
  • Agent status information is now available in scripts.

Version 1.20.5 - Trial Edition

New Features 

  • New API methods GetLastAgentLogFileAsZip and GetLastAgentLogFileAsText.

Version 1.20.4 - Trial Edition

Bug Fixes

  • Content Grabber may crash when a HTML element is removed dynamically.

Version 1.20.3 - Trial Edition

Bug Fixes

  • The agent option "Clear Cookies And Session" is always reset to "Default".
  • Scheduling interval is not saved correctly in self-contained agents.

Version 1.20.2 - Trial Edition

Bug Fixes

  • New agents fail to start.

Version 1.20.1 - Trial Edition

New Features 

  • Agent import now takes existing agent version into account.

Bug Fixes

  • After terminating a running agent, the next run will fail for that agent.

Version 1.20.0 - Trial Edition

New Features 

  • When trying to run an agent export file directly, the exported agent will be automatically imported before being run.
  • Environment variables and relative paths are now allowed for agent export and input file paths.

Bug Fixes

  • XML export settings don't work correctly.

Version 1.19.8 - Trial Edition

New Features 

  • The API function StopAgent now has an optional parameter timeout that can be used to wait for the specified number of seconds or until the agent status changes from running to another status.
  • The agent status is now set to Stopping after a request has been made to stop the agent.
  • The Form Field option Always Execute Action on Value Change now causes the command to set the form field value even when this values is already set.

Bug Fixes

  • Agent data count is not always displayed correctly.

Version 1.19.7 - Trial Edition

Bug Fixes

  • Content Transformation sometimes displays an error at runtime.

Version 1.19.6 - Trial Edition

Bug Fixes

  • The option Export last data segment only does not always work correctly.
  • Column names are not written to a CSV file when exporting an empty data set to CSV.

Version 1.19.5 - Trial Edition

Bug Fixes

  • Error switching from any browser to a static parser.
  • The XPath function find-data does not always work correctly at design time.

Version 1.19.3 - Trial Edition

Bug Fixes

  • Some file downloads don't work.
  • An error may occur which causes the software to crash. "Error sending message to browser tab. System.ArgumentNullException: Value cannot be null."

Version 1.19.2 - Trial Edition

Bug Fixes

  • Self-contained agents don't always install properly on 64bit Windows systems.

Version 1.19.1 - Trial Edition

Bug Fixes

  • Most AJAX calls don't work in version 1.19.0.
  • JavaScript errors may occur when using the Override Active Element option.

Version 1.19.0 - Trial Edition

New Features 

  • The action options Override Active Element, Block URLs, Detect Async Script Loading and Block Known Ad Servers are now inherited from parent actions by default to make it easier to set the options agent wide.
  • The action options Override Active Element is now set to true by default.

Bug Fixes

  • Some tables using incorrect HTML syntax are not denormalized properly.

Version 1.18.0 - Trial Edition

New Features 

  • New agent option "Clear Browser Cache" will delete all files cached by all Internet Explorer based applications after an agent run.
  • New option to view the web browser when running a self-contained agent.

Bug Fixes

  • An error occurs when logging HTML while debugging.
  • A synchronization error may occur when starting multiple agent sessions at the same time if it takes a long time for an agent to create internal database structures.

Version 1.17.13 - Trial Edition

Bug Fixes

  • The HTML Parser fails to load file URLs.

Version 1.17.12 - Trial Edition

Bug Fixes

  • The action option Ignore Page Load Error Codes does not work when using a HTML Parser.

Version 1.17.11 - Trial Edition

Bug Fixes

  • An error occurs when debugging an agent that has an Action option Error Handling set to No Error Handling.

 

Version 1.17.10 - Trial Edition

New Features 

  • New options for mobile User Agents.

Bug Fixes

  • An error may occur when processing JSON content.

Version 1.17.9 - Trial Edition

New Features 

  • The AgentApi now returns times as universal times when returning agent info.
  • New User Agent option None will prevent the agent from setting the user agent.

Version 1.17.8 - Trial Edition

Bug Fixes

  • Agents that have been developed on one computer fail to run from the commandline on a different computer, unless they have first been opened in the Content Grabber editor. 
  • Unable to properly run agents from the Agent Management Screen.
  • Unable to properly view agent logs from the Agent Management Screen.

Version 1.17.7 - Trial Edition

Bug Fixes

  • The scheduler screen always show schedules as disabled even when they are not.

Version 1.17.6 - Trial Edition

Bug Fixes

  • Data export fails when using SQL Server if the agent contains an Download Image command and the first extracted image is empty.
  • The agent option Duplicate Check on Export should not be available, since it has no effect. 

Version 1.17.5 - Trial Edition

Bug Fixes

  • The Content Grabber Windows service fails to start.

Version 1.17.4 - Trial Edition

Bug Fixes

  • Using database input values causes an error in the editor.

Version 1.17.3 - Trial Edition

New Features 

  • New internal data option Group Session Files can be set to false to save all downloaded files in the same directory.

Bug Fixes

  • An error may occur when downloading files in a session.

Version 1.17.2 - Trial Edition

New Features 

  • The agent option Delete Downloaded Files will now delete downloaded files and any generated sub-directories, but will throw an error if the download directory is not a sub-directory of the agent directory.

Version 1.17.1 - Trial Edition

Bug Fixes

  • The manual CAPTCHA dialog sometimes hang in debug mode and is not always displayed in run mode.

Version 1.17.0 - Trial Edition

New Features 

  • IMPORTANT: The Content Grabber application database has changed and will be recreated when upgrading. This will delete all information about previous agent runs.

Bug Fixes

  • Several issues related to sessions, causing many agents to fail or work incorrectly.

Version 1.16.1 - Trial Edition

New Features 

  • Sessions cannot be set when running agents from the Content Grabber editor.

Bug Fixes

  • Several issues related to session, causing many agents to fail.

Version 1.16.0 - Trial Edition

New Features 

  • IMPORTANT: The Content Grabber application database has changed and will be recreated when upgrading. This will delete all information about previous agent runs.
  • IMPORTANT: The data output formats of the API methods RunAgentReturnDataAsXml and RunAgentReturnDataAsJson have changes, so they now include status information.
  • New API methods GetAgentRuntimeInfoAsJson, GetAgentScheduleInfoAsJson.
  • A timeout can now be specified when connecting to the Content Grabber Windows service. The default timeout has increased from 1 minute to 30 minutes.
  • New agent option Run Health Monitor can be set to false to prevent a web browser restart when debugging or designing an agent.
  • Session timeout can now be set to 0 to prevent any automatic session cleanup.

Version 1.15.1 - Trial Edition

Bug Fixes

  • Some new API methods introduced in version 1.5.0 do not work properly.
  • A error Value cannot be null may occur when a website does not use cookies.
  • An error log is sometimes generated when updating an existing version of Content Grabber.

Version 1.15.0 - Trial Edition

New Features 

  • New command property Increase Data Count can be used to count data extraction progress. Set this property on a command that is processed when one logical data entry has been extracted. This is often the last capture command in an agent.
  • New default script "Increase Data Count" for Execute Script commands.
  • The Run Agent window now displays the current data count value and the data count value for the last successful run. This information is only displayed if the agent is configured to count logical data entries.
  • The Data Count and Last Data Count values are now available to the API.
  • New API method GetInfoForAllAgentsInDirectoryAsJson can be used to get basic information about all agents in a directory. This information includes scheduling details.
  • New API method GetAgentInfoAsJson can be used to get basic information about an agent. This information includes scheduling details.
  • New API method SetAgentSchdule can be used to set the schedule for an agent.

Bug Fixes

  • Some JSON strings cannot be parsed with the JSON Parser.

Version 1.14.42 - Trial Edition

Bug Fixes

  • The internal data option Export Last Segment Only does not work properly.

Version 1.14.41 - Trial Edition

Bug Fixes

  • Minor user interface issues.

Version 1.14.40 - Trial Edition

Bug Fixes

  • Missing files in the v1.14.39 installer package causes Content Grabber to crash at startup.

Version 1.14.39 - Trial Edition

New Features 

  • An agent can now be opened with a specific browser. This makes it possible to open an agent that crashes when opened with its default browser. 
  • The default agent browser is now set to Optimized Dynamic Browser which means that Flash/ActiveX controls are not loaded by default.

Version 1.14.38 - Trial Edition

Bug Fixes

  • The CAPTCHA dialog for manual CAPTCHA processing may not show correctly at runtime.

Version 1.14.37 - Trial Edition

New Features 

  • New methods in the script utilities class to post data to a web server.

Bug Fixes

  • Running agents interactively fails on some versions of Windows.
  • Cookies cannot be set correctly when specifying headers in a direct URL.

Version 1.14.36 - Trial Edition

Bug Fixes

  • The Content Grabber DecaptcherService.dll file is now automatically added a assembly references.
  • Calls to the Content Grabber Windows service fail when no global data is sent with the call.

Version 1.14.35 - Trial Edition

Bug Fixes

  • Drop down boxes may appear below the main window in some environments such as Windows RemoteApp. Use the option "Drop Down Z-Order Calculation" to resolve this problem.

Version 1.14.34 - Trial Edition

New Features 

  • New Action option JSON Transformation can be used to transform invalid JSON content into valid JSON. For example, this can be used where the JSON of interest is only part of a full web response.

Version 1.14.33 - Trial Edition

Bug Fixes

  • Content Grabber crashes when loading invalid JSON.

Version 1.14.32 - Trial Edition

New Features

  • New Action option Ignore Page Load Error Codes can be used to continue loading a page when a web server returns an error code. 

Bug Fixes

  • Content Grabber crashes when trying to edit a Transform Page command with a selection that doesn't exist.

Version 1.14.31 - Trial Edition

Bug Fixes

  • Screenshot commands fail without writing an error log entry when running agents with a static parser.  
  • Command scripts that pause an agent causes the agent to hang when running agents with a static parser.
  • Unable to convert Screenshot commands to Download Image commands.

Version 1.14.30 - Trial Edition

Bug Fixes

  • Command Scripts that return Exit or Retry don't always work correctly when an agent contains multiple container commands with the same name. 

Version 1.14.29 - Trial Edition

Bug Fixes

  • Content Grabber does not always properly clean up temporary files.
  • Missing error code when setting or restoring a proxy fails.
  • Content Grabber may crash when failing to connect to a database while editing a Data list command. 

Version 1.14.28 - Trial Edition

Bug Fixes

  • Web forms are not always submitted correctly when using a static parser.

Version 1.14.27 - Trial Edition

Bug Fixes

  • Content Grabber does not always correctly upgrade VWR pagination templates and may crash trying to do so. 

Version 1.14.26 - Trial Edition

New Features

  • The default Convert Document script has been updated to include the IFilter converter. 

Version 1.14.25 - Trial Edition

New Features

New agent action property Override active element will set the JavaScript property document.activeElement to a fixed value. This prevents the activeElement property to be set to null when running scheduled tasks with the option Run whether user is logged on or not.

Version 1.14.24 - Trial Edition

Bug Fixes

  • An agent may generate file paths that are too long when converting documents.

Version 1.14.23 - Trial Edition

Bug Fixes

  • An agent does not always export empty parent rows when child data exists, which can cause some child data to be missing from exported data.  

Version 1.14.22 - Trial Edition

New Features

  • Some additional log info.

Version 1.14.21 - Trial Edition

Bug Fixes

  • Some errors display a Windows error reporting dialog which must be manually closed.

Version 1.14.20 - Trial Edition

Bug Fixes

  • Error exporting data through OleDB if the target database does not support TRUNCATE.

Version 1.14.19 - Trial Edition

Bug Fixes

OleDB connection settings are not saved correctly.

Version 1.14.18 - Trial Edition

Bug Fixes

  • Incorrect page load error messages are sometimes written to log, and some page load errors may not result in an actual error.
  • The browser size changes after executing a Screenshot command.

Version 1.14.17 - Trial Edition

Bug Fixes

  • Blank lines in a command action event list causes an error when opening an agent.

Version 1.14.16 - Trial Edition

Bug Fixes

  • An agent exporting data to a database will in some situations try to recreate database tables when it shouldn't.

Version 1.14.15 - Trial Edition

New Features

  • The premium edition now includes an installer for the Content Grabber runtime. This makes it easy to distribute the runtime to servers where you want to run agents from the command-line.
  • The premium edition now includes an option to generate a zip file with all runtime files required when using the Content Grabber desktop API. This makes it slightly easier to find the Content Grabber files you must distribute with your desktop application When using the API.

Version 1.14.14 - Trial Edition

Bug Fixes

  • The option Never delete external data does not work correctly.

Version 1.14.13 - Trial Edition

Bug Fixes

  • Websites that load multiple URLs in a popup are not processed correctly.
  • The property tab is not available to Page Transformation commands.
  • A HTML sub-folder is not created automatically when logging HTML files to a custom log folder.

Version 1.14.12 - Trial Edition

Bug Fixes

  • Unable to open a new URL in a new browser tab if the only difference between the new URL and the previous URL is an anchor.

Version 1.14.11 - Trial Edition

Bug Fixes

  • The option Scroll Steps does not always work correctly.

Version 1.14.10 - Trial Edition

New Features

  • New option Scroll Steps can be used to gradually scroll down a page instead of scrolling all the way down in one step. 

Version 1.14.8 - Trial Edition

Bug Fixes

  • An error may occur when assigning proxies without authentication to global data.
  • An agent failing to load some pages may log an empty error message

Version 1.14.7 - Trial Edition

Bug Fixes

  • Web browser profile rotation does not work with some proxy addresses.

Version 1.14.6 - Trial Edition

New Features

  • A specific content type can now be set on pages loaded using the HTML Parser browser. This option can be used to force the HTML Parser to always load RSS feeds as XML for example.
  • Proxy lists are now shuffled before use. This does not apply to proxy lists assigned to global data through scripting.

Version 1.14.5 - Trial Edition

New Features

  • Additional methods added to the ScriptUtilities class.

Version 1.14.4 - Trial Edition

Bug Fixes

  • Double quotes are not always escaped properly when using simple input data.
  • The Content Grabber editor fails to start if the custom layout file is corrupt. Content Grabber should instead reset the layout.
  • An agent may crash when using a wait XPath and no document is loaded.

Version 1.14.3 - Trial Edition

Bug Fixes

  • Output files are removed when using FTP to distribute the files.

Version 1.14.2 - Trial Edition

Bug Fixes

  • Web forms posted to a current HTML Parser browser are posted incorrectly in the Content Grabber editor. 

Version 1.14.1 - Trial Edition

New Features

  • It's now possible to choose not to regenerate export data when executing an export script manually.
  • Debug messages are now written to log file when executing an export script manually.

Version 1.14.0 - Trial Edition

New Features

  • New data export option "Never Delete External Data" prevents any external data from being deleted when exporting to a database.
  • Internal optimizations when retrying commands.

Version 1.13.7 - Trial Edition

Bug Fixes

  • Error running agents from the API. 

Version 1.13.6 - Trial Edition

Bug Fixes

  • Retry scripts don't always work correctly.
  • An error occurs when using SQLite as internal database on network share.

Version 1.13.5 - Trial Edition

Bug Fixes

  • Using Agent Settings from the API may cause a failure when starting an agent.

Version 1.13.4 - Trial Edition

Bug Fixes

  • The API method DataRow.DeleteParentRows does not work correctly.
  • An error The web browsers are not responding... may occur when continuing an agent that is processing a long running pagination.
  • CSV export uses GUID keys by default instead of numeric keys.

Version 1.13.3 - Trial Edition

Bug Fixes

  • The Content Grabber Run screen does not automatically reopen broken database connections. 
  • Error selecting web elements on HTML pages with unknown HTML tags.
  • Error setting an anchor on some table headers. 

Version 1.13.2 - Trial Edition

Bug Fixes

  • Self-contained agents cannot be scheduled properly.
  • The Scheduling screen in self-contained agents shows passwords in clear text. 

Version 1.13.1 - Trial Edition

Bug Fixes

  • When the agent monitor needs to restart and continue an agent it sets the agent status to failure instead of restarting the agent.

Version 1.13.0 - Trial Edition

New Features

  • A new option Log to file has been added to the Run window in the editor.
  • Agents now retries database operations that fail because of database deadlocks or broken connections.

Bug Fixes

  • The Open menu in the Content Grabber editor does not work.

Version 1.12.3 - Trial Edition

New Features

  • New URL command option Ignore Invalid URLs will not log an error when processing an invalid URL, but will simply ignore the URL.

Bug Fixes

  • An Access Denied error may occur when opening a HTML file that has just been converted from PDF.
  • Select boxes are not set correctly when using a HTML Parser browser.

Version 1.12.2 - Trial Edition

Bug Fixes

  • Double clicking on the content windows when editing HTML capture commands only shows the first list element when inside a list.
  • Content Grabber crashes when trying to open an agent file that doesn't exist or is inaccessible.

Version 1.12.1 - Trial Edition

Bug Fixes

  • An error occurs when attempting to clear cookies from an invalid URL.
  • Content Grabber crashes when running an agent which internal database is unavailable.

Version 1.12.0 - Trial Edition

New Features

  • Internal optimizations. 
  • A Run Script button has been added to the Data Export Script screen.

Bug Fixes

  • An error may occur when downloading large files causing the agent to restart.
  • A database connection error may occur in long running agents causing the agent to terminate. 

Version 1.11.0 - Trial Edition

IMPORTANT: The run history of all agents will be deleted when upgrading to this version. This only includes the history displayed in the Agent Management screen, and not log info. All agents will still function normally after the upgrade.

New Features

  • The agent management screen now includes a field that shows which user last ran the agent. 
  • New agent options to specify a random page load delay between all page loads.
  • New action command option to allow proxy rotation before a specific page load.
  • New Proxy List option to turn off automatic proxy rotation.
  • New agent option to control the size of the runtime web browser. 

Bug Fixes

  • Error loading agents that contain proxies with passwords.
  • Error loading some documents that have been converted from PDF.
  • An error occurs when a capture command that has been configured to extract short text is extracting long text that. 

Version 1.10.13 - Trial Edition

Bug Fixes

  • Content Grabber crashes when multiple Windows users with limited privileges run agents simultaneously.

Version 1.10.12 - Trial Edition

Bug Fixes

  • Some image and document files cannot be downloaded in the editor and while debugging. This includes CAPTCHA images which can cause CAPTCHA processing to fail.
  • Content Grabber crashes when multiple Windows users with limited privileges run agents simultaneously.

Version 1.10.11 - Trial Edition

Bug Fixes

  • A JavaScript error sometimes occur when executing a command in design mode.
  • An agent sometimes crashes when executing a HTML List command

Version 1.10.10 - Trial Edition

Bug Fixes

  • The Content Grabber editor sometimes crashes when adding a command using the Add button in the Agent Explorer. 

Version 1.10.9 - Trial Edition

Bug Fixes

  • Wrong version of Content Grabber system files are included in version 1.10.8.

Version 1.10.8 - Trial Edition

New Features

  • The Clean HTML capture attribute now produces slightly different HTML and is much faster.
  • A new capture attribute Styled HTML removes script tags, comment tags and class attributes from HTML, but retains inline styles.

Bug Fixes

  • Content Grabber related javascript is included when capturing HTML.
  • Cookies are not always set correctly when using a Static Parser browser.
  • Agents don't always switch correctly from a dynamic browser to a Static Parser.  

Version 1.10.7 - Trial Edition

Bug Fixes

  • Pages that open in a new window are not always processed correctly at runtime.
  • Not all cookies that should be removed are actually removed when configuring a command to remove cookies. 

Version 1.10.6 - Trial Edition

Bug Fixes

  • An agent crashes if an activity's timeout is set to 0. 

Version 1.10.5 - Trial Edition

New Features

  • New custom XPath function matches performs a regex match.

Version 1.10.4 - Trial Edition

Bug Fixes

  • An error occurs when using SQL server as internal database with logging turned on.  

Version 1.10.3 - Trial Edition

Bug Fixes

  • Transform Page commands don't work correctly and may cause Content Grabber to crash.
  • Changing the CSV delimiter causes Content Grabber to crash.  

Version 1.10.2 - Trial Edition

Bug Fixes

  • Content Grabber crashes if an error occurs when scheduling an agent.  

Version 1.10.1 - Trial Edition

New Features

  • The title text on some windows has changed to make it easier to work with multiple Content Grabber editors at the same time.

Bug Fixes

  • Optional Web Element List commands don't work correctly.
  • Links on the startup page only work the first time the page is displayed.
  • Web pages loaded in a new window cannot be redirected to a static parser.
  • Form input fields cannot be set to an empty value.

Version 1.10.0 - Trial Edition

New Features

  • Internal optimizations. Notice that the list of dependent files for the runtime has changed.

Version 1.9.7 - Trial Edition

Bug Fixes

  • Some error notifications can cause an agent to crash.
  • Some included agent templates no longer work correctly.

Version 1.9.6 - Trial Edition

Bug Fixes

  • Setting the same export name for the Agent command and a sub-command may result in an error when exporting data.

Version 1.9.5 - Trial Edition

Bug Fixes

  • Websites with JavaScript using certain methods on the console object may not load correctly.

Version 1.9.4 - Trial Edition

Bug Fixes

  • The API command GetAgentDataAsXml returns invalid XML.

Version 1.9.3 - Trial Edition

Bug Fixes

  • New method DistributeData is now available to export scripts, so the scripts can initiate data distribution to FTP, email or another script.
  • The API methods FindDataValue and FindAndSetDataValue don't always work correctly in design mode.
  • Content Grabber may crash when debugging an agent with logging turned on.

Version 1.9.2 - Trial Edition

Bug Fixes

  • Setting the internal database option Files Folder has no effect.

Version 1.9.1 - Trial Edition

Bug Fixes

  • The Content Grabber editor crashes when starting an agent with an internal database that is unavailable.

Version 1.9.0 - Trial Edition

Bug Fixes

  • Using MySQL as internal database may cause intermittent errors.
  • Clearing the CSV export option "Use default path" has no effect.

Version 1.8.3 - Trial Edition

New Features

  • Select box options are now valid web elements for Link actions that are configured to fire events. This can be used to process select box pagination. 
  • New Data Provider option "Discover Data" can be used to refresh data from the data source when no more cached data is available.

Bug Fixes

  • The debug files folder is always used when files are not embedded in the internal database.

Version 1.8.2 - Trial Edition

Bug Fixes

  • Sub-commands of Form Field commands are not always executed if the form field does not exists, even when configured to continue executing sub-commands.

Version 1.8.1 - Trial Edition

New Features

  • Command Transformation scripts can be used to modify agent commands at runtime.

Version 1.8.0 - Trial Edition

New Features

  • Nohodo proxy integration.

Bug Fixes

  • IMPORTANT: Proxy server passwords are not always saved encrypted. After upgrading to this version, you must re-enter all proxy passwords. If you have a long list of proxies, you can export the proxies, upgrade the software, and then import the proxies again.
  • IMPORTANT: Database passwords for OleDB, Oracle and MySQL databases are not always saved encrypted. After upgrading to this version, you must re-enter passwords for all Content Grabber connections to those databases.

Version 1.7.14 - Trial Edition

Bug Fixes

  • Error setting input data source to MySQL.
  • An error occurs when a script is referencing DLLs that exist in the installation folder.

Version 1.7.13 - Trial Edition

Bug Fixes

  • The default script for converting PDF and DOCX documents into HTML is wrong.
  • An error sometimes occur when trying to execute a Download Document command in the editor.

Version 1.7.12 - Trial Edition

New Features

  • New option "Wrap text" can be used to control text wrapping when exporting to MS Excel.

Bug Fixes

  • Proxy settings set in the API don't always work correctly.

Version 1.7.11 - Trial Edition

Bug Fixes

  • DateTime(6) column types for MySQL introduced in Content Grabber version 1.7.10 cause problems when using older versions of MySQL which only support datetime.

Version 1.7.10 - Trial Edition

Bug Fixes

DateTime column types in MySQL uses datetime instead of datetime(6) which causes problems when running agents that use MySQL as internal database.

Version 1.7.9 - Trial Edition

Bug Fixes

  • The column type of internal tables are not always checked when deciding if a table should be recreated, which can cause invalid tables and errors when running an agent.
  • Agents are not always updated in the Content Grabber system table, which can cause errors when viewing the log for agents in the Agent Management window.

Version 1.7.8 - Trial Edition

Bug Fixes

  • Some datetime values are stores as date values when using MySQL as internal database. This is causing numerous errors when running an agent.

Version 1.7.7 - Trial Edition

Bug Fixes

  • Some operations, such as logging, don't work correctly when using MySQL as internal database.
  • Debug log entries are not always displayed in correct order.

Version 1.7.6 - Trial Edition

Bug Fixes

  • A new action property Block URLs can be used to block all URLs matching a specified regular expression.

Version 1.7.5 - Trial Edition

Bug Fixes

  • Agents don't completely block doubleclick ads which can cause trouble on some websites.

Version 1.7.4 - Trial Edition

Bug Fixes

  • Functionality to detect infinite JavaScript loops is not working correctly and may break page load.

Version 1.7.3 - Trial Edition

Bug Fixes

  • Capture commands cannot be changed to a Web Element Content command.
  • Some regex operations don't work correctly.

Version 1.7.2 - Trial Edition

Bug Fixes

  • Default file download time-out values are not upgraded correctly from seconds to milliseconds causing most file downloads to fail.
  • The list of files required by the runtime is incorrect in the manual.

Version 1.7.1 - Trial Edition

Bug Fixes

  • A file is missing from the 1.7.0 installer package. 

Version 1.7.0 - Trial Edition

New Features

  • Agents can now extract data from JSON content. The agent editor allows you to easily select the data you want to extract similar to the way XML is handled.

Bug Fixes

  • Custom headers on direct URLs are not handled correctly.
  • Selecting web elements on some websites is slower than it should be.
  • Trying to use captured data that does not exist causes the agent to crash.
  • Error using MySQL as internal database.

Version 1.6.0 - Trial Edition

New Features

  • The following data types are now supported: Short Text, Long Text, Date/Time, Float, Integer, Boolean, Image, Document, Binary, GUID. The API has changed to support the new data types, and this may cause existing scripts to fail in rare cases.
  • A new option ExcelDataFormat can be used to specify data formatting when exporting to Excel or PDF.

Bug Fixes

  • Exporting to databases while supporting session may fail.
  • The option Export Rows To Parent Columns causes data export to fail.

Version 1.5.0 - Trial Edition

New Features

  • An agent can now export data to a PDF file.

Bug Fixes

  • Exporting to Excel 2007+ does not always work correctly.
  • Creating nested web element lists does not always work correctly.

Version 1.4.5 - Trial Edition

Bug Fixes

  • Exporting to Excel 2007+ generates an PDf file in the export folder.

Version 1.4.4 - Trial Edition

Bug Fixes

  • An agent may crash with a message about a duplicate key.

Version 1.4.3 - Trial Edition

Bug Fixes

  • Some dialog windows are not working correctly.

Version 1.4.2 - Trial Edition

New Features

  • All mouse events now accept mouse coordinates that are relative to the selected web element. This can be used to simulate a click on a specific location on a web element.

Bug Fixes

  • Editor specific JavaScript is not injected correctly, which means some AJAX calls are not detected correctly in the editor.

Version 1.4.1 - Trial Edition

Bug Fixes

  • Testing Luminati proxies always causes an error.
  • Dependant commands don't always work correctly.

Version 1.4.0 - Trial Edition

New Features

  • Proxy integration with Luminati.io and proxy rotation services such as Private Proxy Switch.

Bug Fixes

  • Nested HTML List commands don't always work correctly.

Version 1.3.0 - Trial Edition

New Features

  • New application option Use Conservative Timeouts. All new action commands will use conservative timeouts when this options is checked. This option is checked by default when using simplified layout, and cleared by default when using expert layout. Using conservative timeouts for each action command is slower, but increases the change an agent will run successfully without advanced configuration.
  • New application option Single Browser. All new agents will have Max. web browsers set to 1 when this options is checked. This option is checked by default when using simplified layout, and cleared by default when using expert layout. Using a single web browser for each action command is slower, but increases the change an agent will run successfully without advanced configuration.

Version 1.2.13 - Trial Edition

New Features

  • New browser type Uncached Dynamic Browser is similar to Full Dynamic Browser, but never loads pages from cache.

Bug Fixes

  • Some unexpected errors are not logged correctly.

Version 1.2.12 - Trial Edition

Bug Fixes

  • Content Grabber sometimes displays an error when being upgraded.
  • The default Download activity uses a regular expression that only matches Application mime types.
  • Download Document commands that use the Click to Download option may case Content Grabber to restart the web browser if the download takes a long time to start.

Version 1.2.11 - Trial Edition

Bug Fixes

  • Content Grabber crashes when attempting to open a Visual Web Ripper project file.

Version 1.2.10 - Trial Edition

Bug Fixes

  • Scheduled tasks are  created incorrectly causing all tasks to fail. After upgrading Content Grabber, schedules for all agents must be re-saved to resolve this issue.
  • Some properties are not set correctly in the Scheduling dialog window.

Version 1.2.9 - Trial Edition

Bug Fixes

  • The Scheduling dialog window is always disabled.
  • Some form fields containing text with line breaks or multiple white spaces are not processed correctly with default settings.

Version 1.2.8 - Trial Edition

New Features

  • Content Grabber can now open Visual Web Ripper projects and convert them into Content Grabber agents. This is NOT a fully automated conversion, and many agents will need manual adjustments after they have been converted. 

Bug Fixes

  • Error running agents that are saved on network drives.
  • Agents sometimes open too many browsers and threads at runtime.
  • Commands can be configured to consume data from Form Field commands that are not providing data.

Version 1.2.7 - Trial Edition

Bug Fixes

  • The installer fails to add correct permissions to some Content Grabber folders.

Version 1.2.6 - Trial Edition

Bug Fixes

  • Setting the option "Allow automatic overwrite of internal database" will cause an error when exporting data.
  • Agent data will always be invalid if an agent generates two export tables with the same name. 

Version 1.2.5 - Trial Edition

Bug Fixes

JavaScript injected into a page by the Content Grabber editor can cause some pages to work incorrectly.

Version 1.2.4 - Trial Edition

Bug Fixes

  • Data export is very slow when using Capture command names containing only Unicode characters, and will fail completely when using SQL Server or MySQL as internal database.

Version 1.2.3 - Trial Edition

Bug Fixes

  • Error processing HTML List commands in new threads. This will cause many agents to fail in run mode.

Version 1.2.2 - Trial Edition

New Features

  • New option Export Empty Data Row If No Data. This option can be set to true to ensure that parent and sibling data is exported when merged with data from a container command that is extracting no data.

Bug Fixes

  • Dependant commands do not work correctly when inside a HTML List command.

Version 1.2.1 - Trial Edition

Bug Fixes

  • An error occurs when switching the editor from navigation mode to selection mode.

Version 1.2.0 - Trial Edition

New Features

  • Improved multi-treading performance.

Bug Fixes

  • File name data consumer settings are not always saved correctly.
  • File Download commands can cause a web browser to hang if no file is available.

Version 1.1.21 - Trial Edition

Bug Fixes

  • Script content is not extracted when extracting the HTML of a single Script web element.

Version 1.1.20 - Trial Edition

New Features

  • Better proxy assignment when using a large number of concurrent HTML Parser browsers.
  • A Page Attribute command can now extract details of the proxy used to load the page.

Version 1.1.19 - Trial Edition

Bug Fixes

  • Pagination commands may fail when using a specific page limit of 1 or less.

Version 1.1.18 - Trial Edition

Bug Fixes

  • Many custom XPath functions don't work currently when a function parameter is resolved from a node set.
  • A few custom XPath functions don't follow the correct naming standard.

Version 1.1.17 - Trial Edition

Bug Fixes

  • File downloads are sometimes blocked.

Version 1.1.16 - Trial Edition

Bug Fixes

  • An agent may crash randomly at runtime if it uses the HTML Parser browser with proxies.
  • Error messages for unhandled script errors are incorrect.

Version 1.1.15 - Trial Edition

Bug Fixes

  • An agent may crash randomly at runtime if it uses Discover Activities.

Version 1.1.14 - Trial Edition

New Features

  • Timestamp added to the list of page attributes.

Bug Fixes

  • JavaScript error on some pages in the editor.
  • XPath function root() does not work as intended.
  • XPath function ends-with() is not implemented causing an error when using "Ends With" anchor condition.

Version 1.1.13 - Trial Edition

Bug Fixes

  • Self-contained agents and other agents that are using the log_to_file option fail to start.

Version 1.1.12 - Trial Edition

Bug Fixes

  • Editing a form field value directly in the web browser can be interrupted if a command already exists for that form field.
  • Container commands that contain no Capture sub-commands can result in undesirable export data.
  • Set Form Field commands that rely on custom events to set the form fields don't always fire those events.
  • The option Break HTML List does not always work when ignoring a container command, but processing sub-commands.

Version 1.1.11 - Trial Edition

Bug Fixes

  • Capture commands with names containing no ASCII characters causes an error.

Version 1.1.10 - Trial Edition

Bug Fixes

  • Dependant commands don't work for HTML List commands at runtime.

Version 1.1.9 - Trial Edition

Bug Fixes

  • Links on the editor start up page cannot be activated.
  • The action property "Add Force Refresh Header" causes an infinite loop that cannot be broken.
  • Cancelling a debugger warning has no effect, but will continue to display the warning.
  • Browser sessions and cookies are not cleared correctly in the editor and when debugging an agent.
  • Property window is not resizing correctly.
  • Content transformation script window is not resizing correctly.

Version 1.1.8 - Trial Edition

Bug Fixes

  • Some websites opening new browser windows are processed incorrectly at runtime with an error Popup Blocked.
  • Some websites with incorrect HTML syntax are not displayed correctly in the editor when using a Static Parser browser.
  • Web browser scroll bars are partly hidden in the editor.

Version 1.1.7 - Trial Edition

Bug Fixes

  • The editor web browser crashes on some websites where the mime type cannot be retrieved
  • Error exporting data if an agent contains a Pagination command that repeats a non-list command.
  • Editing a Pagination command when no page is loaded causes an error.

Version 1.1.6 - Trial Edition

Bug Fixes

  • The XPath methods find-data, get-data, get-input-data and get-global-data don't always work correctly when used in comparisons.

Version 1.1.5 - Trial Edition

New Features

  • A download timeout value can now be set on File Capture commands.

Bug Fixes

  • The editor crashes when executing a Transformation command while a page is loading.
  • Sometimes no data is exported when a list sub-command extracts no data.
  • An error occurs when executing File Capture commands in the editor.
  • An agent may fail when trying to download a file that is the result of a popup.

Version 1.1.4 - Trial Edition

Bug Fixes

  • The XPath function get-global-data does not work correctly.
  • Global data is supposed to be case insensitive, but that is not always the case.

Version 1.1.3 - Trial Edition

New Features

  • Content Grabber can now process XML documents when using the Static Parser browser.

Bug Fixes

  • Some websites hang or crash in the editor.
  • A wrong image name is sometimes used when using URL transformation to extract the image URL.

Version 1.1.2 - Trial Edition

Bug Fixes

  • Setting the Proxy List in global data can cause Content Grabber to crash.
  • A proxy server is not set initialy, but only when it's time to rotate the proxy.

Version 1.1.1 - Trial Edition

Bug Fixes

  • Content Grabber may crash when stopping a debug session that has processed an optional container command that is configured to open a new web browser.
  • Stopping a debug session that is scrolling a web page does not stop the scrolling.
  • Data is sometimes not exported even when data has been extracted.
  • Generating export data only generates the data, but does not actually export the data.
  • Minor screen flickering when starting a debug session.

Version 1.1.0 - Trial Edition

New Features

  • A proxy list can be specified when starting an agent from the API. This list overrides any other default proxy settings.
  • The name of export tables can now be specified. A plural name can also be specified, which will be used when exporting to XML.
  • Content Grabber will now always restart the web browser when starting a new debug sesison.

Bug Fixes

  • Content Grabber will never present a save dialog window if an agent named "New Agent" is found on disk.
  • Agent Initialization scripts are ignored.
  • Using an Application proxy with authentication will present a login dialog when starting up the Content Grabber editor.
  • Events are not always fired correctly on select boxes.
  • When opening an agent created with a later version of Content Grabber, an update dialog is shown when not wanting to update.
  • Command activities are not displayed correctly on the Activities options tab.
  • Basic windows authentication does not work.
  • A web browser may crash when failing to load a page.

Version 1.0.19 - Trial Edition

Bug Fixes

  • Unable to change the internal database. 

Version 1.0.18 - Trial Edition

Bug Fixes

  • Error opening agents with certain version numbers. 

Version 1.0.17 - Trial Edition

Bug Fixes

  • An error may occur when processing sub-commands after a page load error.
  • URL and error code is not logged when a page fails to load.
  • String values are not converted when retrieving values from global data in a script. For example, when using the method GetInterger on a string value, the value is not automatically converted into an Integer when possible, but instead an error is thrown.
  • Content Grabber does not display a warning when trying to open an agent that has been created with a newer version of Content Grabber than the one installed.

Version 1.0.15 - Trial Edition

New Features

  • Custom scripts now have access to a new property "LastBrowserMessage" which contains error messages if a page load fails.
  • New action property "Use conservative timeouts" causes an action command to waits twice as long as specified by the default timeout values. This can be a quick way to test if issues with an action are caused by timeout values being too short. Default timeouts are used when discovering activities, and when scrolling a page.

Bug Fixes

  • Page Attribute commands don't extract page HTML properly.

Version 1.0.13 - Trial Edition

Bug Fixes

  • Error setting proxies for static parsers. This causes all static parsers to fail, even when no proxies are used.
  • Excel export settings are not saved correctly.

Version 1.0.12 - Trial Edition

Bug Fixes

  • The default Agent Initialization VB.NET script has incorrect syntax.
  • The script editor may crash Content Grabber when double clicking on a script error to navigate to the error location.
  • Help file updates.
  • Database configuration is saved incorrectly, except for SQL Server.
  • Data is not exported correctly to databases, except for SQL server.
  • Debug data is always exported to databases, even when an agent has been configured not to do so.
  • Setting the internal database to anything other than SQLite may cause an error when exporting.

Version 1.0.11 - Trial Edition

Bug Fixes

  • Licensing issues can cause software activation to fail.

Version 1.0.10 - Trial Edition

Bug Fixes

  • Proxy lists are not rotated correctly.
  • Some popup windows are not opened correctly.

Version 1.0.9 - Trial Edition

Bug Fixes

  • Proxy lists are not saved correctly.
  • Extracted text contains content from style tags and noscript tags

Version 1.0.8 - Trial Edition

New

  • The Agent Explorer now colours commands yellow if their settings could cause unexpected behaviour. These settings currently include No data export and Disabled when debugging. Commands that are completely disabled are coloured red, instead of having their names striked out as was previously the case.
  • When exporting an agent, you will have an option to immediately open the folder where the exported agent file is located.

Bug Fixes

  • Debug list sets do not work correctly.
  • The property tab is not initialized correctly for Data Value commands.

Version 1.0.7 - Trial Edition

Bug Fixes

  • File capture commands with a click action don't work correctly at runtime.

New

  • New capture attribute Default File Name is used by file capture commands by default. This attribute captures any suggested file name sent in a response form a web server. If no suggested file name is sent, the file name is extracted from any associated file URL, or if that is not possible, a unique identifier is used as file name.

Version 1.0.5 - Trial Edition

Bug Fixes

  • The Action property Max. Repeats does not work correctly in design mode.
  • The Timeout property Ajax Content Render Delay does not work correctly when scrolling a window.
  • Download Document commands with a click action don't work correctly in design mode.
  • All file download commands ignore data values for both download URLs and file names.

Version 1.0.4 - Trial Edition

Bug Fixes

  • Some default unit tests always fail.
  • Wrong data is sometimes returned when using GetStringValue on an export data reader from the API.
  • Input parameters does not work when running agents from the commandline or through the API.

Version 1.0.3 - Trial Edition

Bug Fixes

  • Work-around for a bug in Internet Explorer where mouse coordinates are not posted with a form when simulating a click on an image submit button.
  • Extracting the Default URL does not work for URLs relative to a frame.
  • Pages loading in frames within the current browser are sometimes counted as a full page load instead of a frame load.
  • Repeating link actions causes an error in the editor.
  • Scroll actions may cause the editor to crash.

Version 1.0.2 - Trial Edition

Bug Fixes

  • Startup page is not displaying announcements and videos

Version 1.0.1 - Trial Edition

Bug Fixes

  • Error activating software.

Version 1.0.0 - Trial Edition

The initial public release of Content Grabber.