Release Notes

Release Notes

Version 2.39.8

Bugs

  • API methods GetAgentDataAsXslZip and GetAgentDataAsCsvZip don't always work correctly.

Version 2.39.7

Bugs

  • Pagination commands don't work correctly unless a fixed pagination limit is set.

Version 2.39.6

New Features

  • Additional command info added to Branch and Wait for Content commands.
  • Minor GUI enhancements.

Version 2.39.5

Bugs

  • Unable to clear export options "Export Rows to Columns Value Command" and "Export Rows to Columns Name Command".
  • Pagination commands repeat page 1 when pagination limit is set to 1. 
  • Content Grabber may crash when changing input data source.

Version 2.39.4

Bugs

  • Retry count has no effect when a custom script restarts and continue an agent.

Version 2.39.3

New Features

  • New Data added to Search data set option for Remove Duplicate commands.
  • Improved agent startup time. An agent must be saved before this performance improvement takes effect.

Bugs

  • Agents with many proxies are slow to load, and may even cause agents to fail to run because of startup timeout.

Version 2.39.2

Bugs

  • Unable to change Search data set for Remove Duplicate commands.
  • windowscrolls and scrolls functions stop scrolling if a scroll doesn't result in an AJAX call.

Version 2.39.1

Bugs

  • Screenshot Log commands are not documented in the manual.
  • Content Grabber may crash when opening an agent that uses a proxy list if there are no proxies in the list.
  • Content Grabber hangs when scrolling to the end of a web page.

Version 2.39.0

New Features

  • Added events windowscrolls and scrolls which will do multiple scrolls faster than repeated scroll actions.
  • Added option Auto vacuum to SQLite internal database configuration.

Changes

  • An action command with Wait for Content sub-commands, that has Wait for Content set to None, will not wait for content, but will complete the action once the content appears in the web browser. The command will also complete the action if the normal wait conditions are meet, even if the wait content hasn't yet appeared in the browser (or never appears in the browser).

Bugs

  • Wait for Content commands select web elements in the Content Grabber editor as if their XPaths were not restricted to strict XPath version 1.0.

 

Version 2.38.7

Bugs

  • Content Grabber fails to parse pages with IFrames.

Version 2.38.6

New Features

  • Cache Method added to agent properties. This option can be used to ensure parsers never retrieve pages from cache.

Bugs

  • JSON properties with null values are ignored by the JSON Parser.
  • Content Grabber does not block WebRTC leaks, which can allow JavaScript to retrieve a computer's IP address even when using proxies.

Version 2.38.5

Bugs

  • Screenshot log message is displayed every time debugging completes.

Version 2.38.4

New Features

  • Added button to open exported Excel spreadsheet to the Run screen.
  • Added New Line Encoding to CSV export.

Bugs

  • File name transformation does not work for Download Page commands.

Version 2.38.3

Bugs

  • Changing a Condition Script doesn't trigger an indication that the agent has changed.

Version 2.38.2

Bugs

  • The form field input value is not passed to exec events when executing a Form Field command.

Version 2.38.1

Bugs

  • CSV file export now uses the .txt file extension by default when values are delimited by tab.
  • The file encoding for CSV export causes problems when BOM is not included in UTF-8.

Version 2.38.0

New Features

  • Content Grabber editor performance improvements. 
  • An agent can now be configured to not export data.

Bugs

  • The file encoding for CSV export is set to UTF-8 BOM by default which causes problems in some applications. The encoding should be changed to UTF-8 without BOM.

Version 2.37.5

Bug Fixes

  • Incorrect icon for Download Image commands.
  • The Referer request header is set incorrectly.

Version 2.37.4

Bug Fixes

  • The transformed capture panel on most configuration screens cannot be resized.

Version 2.37.3

New Features

  • A description can now be added to commands, which will be displayed on the command info panel.

Bug Fixes

  • Command transformation scripts fail when used in a custom script library.
  • Unable to set a page load percentage as a success criteria.

Version 2.37.2

New Features

  • Agent loading screen added to self-contained agents.
  • Minor performance enhancements.

Changes

  • The message displayed when saving data export settings in self-contained agents has changed to make it clear the agent needs to be rerun to export data in a new format.

Bug Fixes

  • The start button in self-contained agents doesn't become inactive immediately after pressing it.

Version 2.37.1

New Features

  • Add Sub-Command and Edit buttons added to command info panel.

Bug Fixes

  • Unable to navigate files on the local file system, because file URIs are calculated incorrectly.

Version 2.37.0

New Features

  • Export Row Count now available in Post Status.

Changes

  • Agent multitreading options have changed to \"Max Active Browsers\" and \"Max Active Parsers\", and now more accurately controls the number of active parsers and dynamic browsers.

Bug Fixes

  • Email notifications include the wrong value for Export Row Count.

Version 2.36.3

Bug Fixes

  • The User Agent is not always set correctly for HTML Parsers at design time.

Version 2.36.2

Bug Fixes

  • The manual is missing a topic about the Post Status functionality.
  • Custom Content Grabber Regex operations fail if they are trailed or preceded by spaces. 
  • The default script library C# project has the Condition Script unit test in a wrong name space.

Version 2.36.1

Bug Fixes

  • Post Status does not work correctly at runtime. 

Version 2.36.0

Bug Fixes

  • Condition script is missing from the default script library.
  • The HTML Parser uses a different User Agent than the dynamic browser by default.
  • Unable to load a specific URL into a browser tab in some situations.
  • Incorrect scaling on many screens in the Content Grabber editor when using high DPI settings.
  • Post Status does not always work correctly at runtime. 

Version 2.35.5

New Features

  • Added Post Status screen.

Bug Fixes

  • HTML Parser User Agent is not set to the same user agent as the web browser by default, which causes issues on some websites when switching from dynamic browser to HTML Parser.

Version 2.35.4

New Features

Added Notify on successful data extraction and Success Email Addresses to the notification screen.

Version 2.35.3

Bug Fixes

  • Some agents export duplicate data when they shouldn't.

Version 2.35.2

Bug Fixes

  • Some websites fail to make AJAX requests in the Content Grabber editor, which may cause the website to load incorrectly.

Version 2.35.1

Bug Fixes

  • Continue & Retry Errors does not work correctly on the screen that shows all performance sessions.
  • Setting the Default values check box when editing a URL command does not disable data transformation.

Version 2.35.0

New Features

  • Improved reliability and performance when multi-threading.

Bug Fixes

  • Page load success criteria don't work correctly.
  • An error may occur when executing a Form Field command that doesn't execute an action.
  • Potential thread handle leak when multi-threading. This has the potential to cause stability issues when executing many high performance agents on a single server.

Version 2.34.1

Bug Fixes

The Continue & Retry All button on the screen that shows all performance sessions, will appempt to start sessions that are complete and have no errors.

Version 2.34.0

New Features

  • Performance session progress added to screen that shows all performance sessions.
  • Added Continue & Retry All button to screen that shows all performance sessions.
  • Added Start All button to screen that shows all performance sessions.
  • Added Stop All button to screen that shows all performance sessions.

Version 2.33.7

New Features

  • Added unescape_string method to Regex transformations.

Bug Fixes

  • The JSON Transformation Script Editor does not use the raw page content as input data, which can make it difficult to generate a correct transformation.
  • Unable to overwrite an existing agent in some situations.

Version 2.33.6

Bug Fixes

  • The script property DatabaseConnection is not available in Data Export scripts.
  • The method WriteDebug does not work correctly in Raw Data Export scripts.

Version 2.33.5

Bug Fixes

  • Changing debug speed during debugging doesn't take emmediate effect.

Version 2.33.4

Bug Fixes

  • The script library panel is expanded by default on the Script Editor screen.

Version 2.33.3

New Features

  • New property HasDoneAction available in most scripts.

Version 2.33.2

New Features

  • New methods in the RuntimeData Script Utilities class.

Bug Fixes

  • An error occurs when trying to import an agent or upgrade Content Grabber if the computer's TEMP or TMP environment variables are configured incorrectly, or points to paths that are inaccessible.

Version 2.33.1

Bug Fixes

  • Unable to upgrade templates.
  • Content Grabber icons are not associated with Content Grabber files.

Version 2.33.0

New Features

  • Command and script templates can now be referenced instead of copied into an agent.
  • Added suggested command types to the New Command drop-down panel.
  • Added Search button to the View Data screen.

Changes

  • Templates created with versions lower than 2.33.0 are no longer available, but can be upgraded to version 2.33.0+ from the Tools menu.
  • Templates are now stored in individual files instead of one big file. This makes it easier to copy or move templates between computers.
  • Some menu items have been moved from Application Settings to Tools.

Bug Fixes

  • Retrying commands doesn't always work as intended.
  • Logging does not work in self-contained agents.
  • Input data is always enclosed in double quotes in self-contained agents, even when it's not required.
  • Some web forms that shoud be able to be processed with a HTML Parser cannot.

Version 2.32.7

Bug Fixes

  • Error downloading files from direct HTML pages.

Version 2.32.6

Bug Fixes

  • Content Grabber crashes when pagination limit is set to one page.
  • The Form Field option Set Form Field Value has no effect. This causes checkboxes to be set incorrectly most of the time.
  • The action option Scroll to end of page does not always work correctly.

Version 2.32.5

Bug Fixes

  • The Content Grabber editor crashes when trying to open a link in a new browser if that link does not start an action and the browser does not already exist.
  • A page load error is not reported when an action command configured to open a new web browser fails to open a new web browser.
  • Unable to enable Min. page loads on Agent success criteria screen.
  • Unable to change default JSON export settings.
  • The Wait for Content timeout value keeps increasing automatically every time an agent is loaded.

Version 2.32.4

Bug Fixes

  • Error running an agent using MySQL as internal database.
  • A database lock error may occur when running multiple sessions.

Version 2.32.3

Bug Fixes

  • Switching from Dynamic browser to HTML Parser can make it impossible to configure an action command to load a page in a new browser.
  • Incorrect status information while running an agent.

Version 2.32.2

New Features

  • Performance optimizations.

Bug Fixes

  • Content Grabber is unable to handle websites that make exact copies of web elements. This is the case for certain areas of amazon.com.
  • Error retrying Pagination commands.

Version 2.32.1

New Features

  • New agent option Delay Between Performance Sessions can be used to specify a delay between session startups when starting multiple performance sessions at once.

Bug Fixes

  • The RuntimeData class is not documented in the manual.

Version 2.32.0

New Features

  • Performance improvements when using SQLite or SQL Server as internal database.

Version 2.31.9

New Features

  • Performance improvements.

Version 2.31.8

New Features

  • Performance improvements when adding many data rows per loaded page.

Changes

  • It's no longer required to execute a Web Element List to be able to select web elements inside the web element list.

Bug Fixes

  • No data is processed when a performance session specifies a data set larger than the total number of data entries.

Version 2.31.7

Bug Fixes

  • The action timeout value File Download Started has no effect and a default value that is often too low is used.

Version 2.31.6

Bug Fixes

  • An agent may exit prematurely after retrying a Link command.
  • An error may occur when Continuing an agent.

Version 2.31.5

Bug Fixes

  • The Agent option Keep Connection Alive has not effect.

Version 2.31.4

New Features

  • Added Use Test Set to the Agent Explorer context menu.

Bug Fixes

  • Error handling options on Download Document commands have no effect.

Version 2.31.3

New Features

  • Added Test Sets to data provider configuration, which makes it possible to run tests on a limited data set without having to change data source.

Version 2.31.2

Bug Fixes

  • Proxy API configuration doesn't always work correctly.
  • Some scripts are not executed correctly at design time when using the option Always Update Design Value.

Version 2.31.1

Bug Fixes

  • Status does not switch to the first session when starting all performance sessions from the Run screen.

Version 2.31.0

New Features

  • New option Always Separate Session Export Data can be used to ensure all session data is always exported separately.
  • New commandline and API parameters agent_import_path and agent_import_name can be used to control to where an agent is imported when running an exported agent.

Changes

  • Performance sessions now always log to different log files.
  • The Content Grabber runtime will now always log information to the agent's log folder or the specified log path. The runtime will no longer create default folders in the current user's document folder.

Bug Fixes

  • The default Data Export script has an error.
  • The Session ID available in data export scripts is always null when executing Data Export scripts from the Content Grabber editor.
  • An error occurs when downloading a file if the web server does not provide a suggested filename.

Version 2.30.1

New Features

The Session ID is now available to all scripts.

Action error handling now has an option to rotate, and optionally remove, the current proxy.

Exit or Retry commands now have an option to rotate, and optionally remove, the current proxy on retry.

Exit or Retry commands now have an option to delay retrying.

Version 2.30.0

New Features

  • New option Log error and exit on failure on Exit or Retry commands

Changes

  • The option Delete on exit on Exit or Retry commands can now be used when both retrying and exiting.
  • A column retry_count_ has been added to internal data tables. This means that some internal tables will need to be re-created, and agents that rely on internal data will be reset. To avoid the re-creation of the internal data tables, a column retry_count_ of type int can be manually added to the tables.

Bug Fixes

  • Retrying list commands does not work correctly.

Version 2.29.5

Bug Fixes

  • An error may occur when debugging an agent with an Exit Or Retry command.
  • The Retry Count property on Exit Or Retry commands are not saved properly.

Version 2.29.4

New Features

  • Added MPP proxy API support.

Bug Fixes

  • Error testing proxy APIs.

Version 2.29.3

Bug Fixes

  • The Content Grabber editor hangs or crashes if an application proxy error occurs at startup.

Version 2.29.2

New Features

  • Added runMethod option to the simple Web requests.

Bug Fixes

  • An error may occur when resuming agents using the API.

Version 2.29.1

Bug Fixes

  • An error may occur during file download.

Version 2.29.0

New Features

  • Server wide default paths can now be specified.
  • When importing an agent that already exists, a new name can be specified for the imported agent.
  • Multiple agents can now be exported at once.
  • Content Grabber browser updated to new version of Chromium.

Changes

  • The Block URLs option has been moved to agent settings, and is now applied agent wide. Also, multiple regular expressions separated by line break can be specified.

Bug Fixes

  • Some websites that change page URLs without loading a new page are processed incorrectly.
  • Converting a Visual Web Ripper project may crash Content Grabber.

Version 2.28.1

New Features

  • Logs can now be filtered by log level.
  • Log level is now added to file logs.

Changes

  • File logs are now tab delimited, so they can be loaded into Excel or other programs that can handle tab delimited files.

Version 2.28.0

New Features

  • All agent sessions or a specified range of agent sessions can now be started, viewed or deleted from the Run screen.
  • Added support for Proxy APIs.

Changes

  • The 3rd party proxy provider Proxicity has been removed. Proxy API with Proxicity as provider can be used instead.

Bug Fixes

  • Insufficient log information when an agent fails to start.
  • Web page redirect sometimes causes an error when using the HTML Parser.
  • All possible agent exit codes are not listed in the manual.

Version 2.27.4

New Features

  • New method SetPageLoadError is available to most scripts.
  • New Selection Missing option Log Page Load Error and Ignore Command.

Bug Fixes

  • Command names containing single quotes sometimes causes an error.

Version 2.27.3

Bug Fixes

  • The Page Load Completed timeout has no effect on page loads in a HTML Parser at design time.
  • Page load errors in the HTML Parser are sometimes lacking details about the error.

Version 2.27.2

Bug Fixes

  • The action option Block URLs has no effect.

Version 2.27.1

Changes

  • The export option Export Empty Row If No Data is now set to true by default.

Bug Fixes

  • Changing options on a Wait for Content command does not always activate the Save quick bar menu.
  • Some large web pages are not loaded correctly in a HTML Parser at design time.

Version 2.27.0

New Features

  • An Execute Script command can now remove the current proxy if the agent uses a proxy list.
  • Commands can now be copied/pasted between agents in different Content Grabber editors.
  • Multiple commands can now be added at once by specifying multiple command names separated by comma. Command names separated by new lines or tabs will be automatically converted to comma separated names when pasted into a command name field.

Bug Fixes

  • Pagination commands fails if a command inside the pagination loop refreshes the page containing the pagination link(s).

Version 2.26.5

Bug Fixes

  • Content Grabber fails to download an image if a target web server suggests an invalid file.
  • An incorrect warning is displayed every time a command is moved within the same browser sub-tab.

Version 2.26.4

Bug Fixes

  • Agents using performance sessions don't export any data.

Version 2.26.3

Bug Fixes

  • Content Grabber is unable to detect some methods in a default script library.

Version 2.26.2

Bug Fixes

  • Unable to scroll a web page in the Content Grabber editor by dragging the scroll bars.
  • Web pages that change the page URL without loading a new page are not always processed correctly.

Version 2.26.1

Changes

  • Manually removing internal data now also removes all agent status information.

Bug Fixes

  • Performance sessions with IDs containing odd numbers, or processing a data list with an odd number of entries, fail to loop through the entire data list.

Version 2.26.0

Changes

  • An agent exporting data to files and using performance sessions will now always export data from all sessions into a single file. An agent session will only export data if no other sessions of the same agent are currently running.

Version 2.25.4

Changes

  • The info panel on the Command Properties configuration window is now sized more appropriately.

Bug Fixes

  • Extracted data is sometimes exported incorrectly to Excel and CSV when converting rows to columns

Version 2.25.3

Bug Fixes

  • The Content Grabber editor sometimes fail to track DOM events.
  • Inline DOM events on delay loaded content are never tracked.
  • The action event click() does not fire mouseenter and mousemove DOM events.

Version 2.25.2

Bug Fixes

Navigate in Browser toolbar button does not work correctly in the Content Grabber editor.

Version 2.25.1

Bug Fixes

  • Content Grabber may crash when canceling a file download in the editor.

Version 2.25.0

Bug Fixes

  • Old browser processes are not closed properly when opening a new agent.
  • Restoring an agent backup does not work properly.

Version 2.24.1

Bug Fixes

  • Resolve CAPTCHA templates generate incorrect commands.

Version 2.24.0

New Features

  • Most scripts now have access to a new property RuntimeData which provides access to internal data while an agent is running.

Bug Fixes

  • Simple web requests to the Content Grabber service don't work.
  • Extracted boolean values are sometimes handled differently when designing and running an agent.

Version 2.23.5

Bug Fixes

  • Custom assemblies are not loaded correctly when used in scripts.

Version 2.23.4

Bug Fixes

  • Some pages are loaded incorrectly when using a JSON, HTML or XML parser.

Version 2.23.2

Bug Fixes

  • Some JSON content is not parsed correctly by the JSON parser.

Version 2.23.1

Bug Fixes

  • The Content Grabber web browser does not work on some Windows configurations.

Version 2.23.0

New Features

  • Added default logging options for agents.
  • A script library can now be any .NET assembly.
  • A custom parameter can not be passed to methods in a script library.
  • New script parameter IsParentCommandMissingSelectionOrData. This parameter is set to true if the parent container's selection was not found, or is iterating through an empty data list.

Changes

  • When an agent is run from the commandline or API, the agent now logs to files by default.

Bug Fixes

  • Content Grabber is unable to process local files.
  • The export option Export empty row if no data does not work correctly.
  • The Content Grabber web browser fails to load pages on some computers.

Version 2.22.3

New Features

  • Added support for browser zooming in the Content Grabber editor.

Bug Fixes

  • Help file updates.

Version 2.22.2

Bug Fixes

  • Content Grabber may cause a JavaScript error on some websites.
  • Content Grabber sub-processes may not shut down properly if Content Grabber crashes or if it's process is terminated.

Version 2.22.1

Bug Fixes

  • An error may occur when loading a URL with the HTML Parser.

Version 2.22.0

New Features

  • Added option to delete website cookies in the editor.

Bug Fixes

  • Cookies are not always set correctly in the HTML Parser.

Version 2.21.4

Bug Fixes

  • The ImportSilent method may import an agent incorrectly.

Version 2.21.3

Bug Fixes

  • Remove Duplicate commands don't work properly on DateTime data types.
  • The ImportSilent method may import an agent incorrectly.

Version 2.21.2

New Features

  • Content Grabber can now start multiple agent instances at once if the agent supports performance sessions. 

Bug Fixes

  • An agent will try to process multiple list commands in sessions if more than on command has the option "Process in Session" set to true.

Version 2.21.1

Bug Fixes

  • Content Grabber sometimes mark visible web elements as if they were hidden.

Version 2.21.0

New Features

  • Added Performance Sessions which makes it easier to get multiple instances of the same agent to work on the same task.

Version 2.20.3

New Features

  • Added action event key that takes a character as parameter.

Changes

  • Old action event key has been renamed keycode.

Bug Fixes

  • Unable to to clear the Pagination command option Limit page count with fixed value.

Version 2.20.2

New Features

  • Added agent option to not load style sheets. When using a HTML Parser all inline styles will be removed as well.

Bug Fixes

  • Some valid JSON content cannot be loaded in the JSON Parser.

Version 2.20.1

New Features

  • New override of API method ImportSilent makes it possible to import an agent to a specified location with a specified name.
  • New API method DeleteAgent.
  • New CSV export option Export Keys.

Bug Fixes

  • Some buggy websites, that load more content on scroll, make it possible to indefinitely scroll when a browser window is at a certain height. This can cause an agent to run indefinitely.

Version 2.20.0

New Features

  • Added Google Drive distribution option.
  • Added DropBox distribution option.
  • Added JSON export target.
  • Added options Has Headers and Ignore Parse Errors to CSV data providers.

Bug Fixes

  • Incorrect default document converter script.
  • Selections are not always marked correctly in the editor browser.
  • Unable to create new shared script libraries from an agent that is not located in the default agents folder.
  • Downloaded files are not distributed when exporting to Excel 2007+.
  • Empty columns are inserted when embedding images in Excel 2007+.

Version 2.19.0

New Features

  • New API setting AgentStartTimeout can be used to specify the number of seconds an agent is allowed to start processing before a timeout occurs.
  • Additional logging when an agent fails to start.

Version 2.18.0

New Features

  • New setting RuntimePath can be used in the API to specify the location of the Content Grabber runtime. If this setting is not specified, the runtime files must be copied to the same folder as the host application executable.

Changes

  • The Create Website Images button has been moved to the Tools menu.

Version 2.17.0

New Features

  • New feature Create Website Images can be used to take screenshots of all types of web pages an agent visits.
  • A warning message is now displayed when viewing data from an agent that converts rows into columns, since this functionality is only applied when exporting to file formats, and is not applied when viewing extracted data.

Changes

  • The Page to PDF command type has been renamed to Download Page and can now download a page as PDF or HTML.

Bug Fixes

  • Remove Duplicate commands don't work when debugging.
  • Screenshot commands don't work properly on right-to-left language websites.
  • Screenshot commands don't always work properly when Size of text, apps and other items is set to more than 100% in Windows.
  • Agents using the obsolete database export option Add To Existing Data may cause an error when exporting.
  • Agents with command names containing some special characters may cause an error.

Version 2.16.1

Bug Fixes

  • Documentation for Wait for Content commands is missing in the manual.
  • The Content Grabber editor may crash on some script syntax errors.

Version 2.16.0

New Features

  • New command type Wait for Content can be used to force the parent action command to wait for specific URLs or web content.

Changes

  • The Action properties Wait For Regex and Wait For Urls have been combined into a single property Wait For Content.
  • The Action properties Wait For Regex Timeout and Wait For Urls Timeout have been combined into a single property Wait For Content Timeout.

Bug Fixes

  • JSON content returned by a web server is not recognized as JSON if the response Content Type is set to application/javascript which is used by many web servers.
  • Base meta tags are not always processed correctly when using a HTML Parser.

Version 2.15.2

Changes

  • Session cookies are no longer removed on agent start unless specifically configured in the agent command.

Version 2.15.1

Bug Fixes

  • Content Grabber crashes when trying to import a Visual Web Ripper project created with a recent version of Visual Web Ripper.
  • The Delete button in the File menu does not work.

Version 2.15.0

New Features

  • Values from Local Storage and Session Storage are now available using the Page Attribute command.

Bug Fixes

  • Content Grabber waits too long on some websites causing agents to run slower than they should.

Version 2.14.16

Bug Fixes

  • Custom HTML tags are not handles correctly.

Version 2.14.15

Bug Fixes

  • The option to limit pagination page loads with a fixed value is not saved correctly.

Version 2.14.14

New Features

  • New option to limit pagination page loads with a fixed value.

Bug Fixes

  • Crash when using a HTML Parser and setting a form field in design or debug mode.
  • Crash when setting an Exit or Retry command to use a specific command and then not specifying a command.

Version 2.14.13

Bug Fixes

  • Error exporting data to file formats when converting rows to columns and the converted list command generates no rows.

Version 2.14.12

Changes

The Wait for XPath option now allows page loads while waiting for an XPath selection to exist.

Version 2.14.11

Bug Fixes

  • Error executing Page Transformation commands in design and debug mode when loading content directly into HTML parsers.

Version 2.14.10

Bug Fixes

  • Error exporting historical data to MySQL.

Version 2.14.9

Bug Fixes

  • HTML Parser requests never times out, no matter the configured time out value. This is a serious issue, especially when processing a large number of different websites, because some websites never return a response, and Content Grabber will then hang until stopped manually.

Version 2.14.8

Bug Fixes

  • Number of threads used when running an agent is not always correct when using HTML Parsers.
  • It's not possible to see if a script is turned on or off on all command configurations screens.

Version 2.14.7

Bug Fixes

  • An error may occur at design time when converting a document that opens in a new window.
  • "base" HTML tags without href attributes cause HTML parsers to generate wrong URLs.
  • Database connection details saved in an agent maybe duplicated.

Version 2.14.6

Bug Fixes

  • An error may occur when a web page refreshes in a dynamic browser.

Version 2.14.5

New Features

  • New option to automatically add a capture command when creating a new Form Field command.

Version 2.14.4

Bug Fixes

  • Agent may fail to export when change tracking is turned on.

Version 2.14.3

New Features

  • CSV file content can now be edited directly from the Data Provider configuration window.

Version 2.14.2

Bug Fixes

  • Unable to cancel anchor selection mode.

Version 2.14.1

Bug Fixes

  • Exporting data since last successful run when using change trackikng does not work correctly.
  • An error occurs when choosing captured data as data provider.

Version 2.14.0

New Features

  • New action option Ignore error codes can be set to false to force an error when a website returns an error code, even when the website returns content. Content Grabber ignores status codes by default when content is returned, because some websites return incorrect error codes, or return error codes that have special meaning and should be handled by the Content Grabber agent.

Changes

  • HTML parsers no longer fail by default when an error code is returned from the web server, unless the option Ignore error codes is set to false. This makes the behavior the same as when using a dynamic browser. WARNING: this may cause existing agents to behave differently unless you set the option "Ignore error codes" to false.

Version 2.13.7

Bug Fixes

  • The ScriptUtils function GetData() makes a POST request instead of a GET request.

Version 2.13.6

New Features

  • New function insert_data is now available for Content Transformation regex scripts.

Bug Fixes

  • When certain errors occur in Content Grabber and an agent process is restarted, web browser processes may be left running and never shut down.

Version 2.13.5

Bug Fixes

  • Page to PDF commands may fail depending on timing.

Version 2.13.4

New Features

  • New option Deliver data files can be turned off when distributing data, so only extracted files are distributed.
  • New option Always update design value can be used on capture commands to make sure their design values are automatically updated when a new web page is loaded.
  • When posting data with a URL, the pattern [CG_FILE_UPLOAD_PATH:...] can be used instead of the actual file content when upload a file.

Version 2.13.3

Bug Fixes

  • The option Deliver Extracted Files has no effect when delivering extracted data to email or FTP.
  • Missing files may cause data export to fail when delivering data to email or FTP.
  • The options Default Email Settings and Default Email Addresses are not saved when saving the email delivery settings.
  • An agent may hang on websites that continuously make AJAX calls. 

Version 2.13.2

New Features 

  • Request method can now be specified when loading a web request.
  • Post, header and method parameters can now be specified in any order when loading a web request.

Version 2.13.1

New Features 

  • Additional information added to the web request editor to make it easier to create file upload requests.
  • Log settings can now be set in an Initialization script, but overriding the commandline parameters in the GlobalData object.

Version 2.13.0

New Features 

  • Response headers are not available in scripting.
  • Custom headers can now be set for all requests in web browsers.

Changes

  • The property LastBrowserMessage has been replaced with LastErrorResponse in scripting.

Bug Fixes

  • Screenshot commands don't work.
  • Error setting proxy to Fiddler.
  • The base meta tag is not taken into consideration when extracting URLs.

Version 2.12.3

New Features 

  • Proxicity proxy support.

Bug Fixes

  • Luminati proxy configuration is disabled.

Version 2.12.2

New Features 

  • Default email settings shared by all agents on a computer.
  • Messages can be sent from an agent to its hosting application when using the API.

Version 2.12.1

Bug Fixes

  • Outdated help file topics.

Version 2.12.0

New Features

  • Support for historical data when using change tracking.
  • New capture command option Exclude from change tracking.
  • New command type Page to PDF saves a web page as a PDF file.

Bug Fixes

  • Refresh Document commands cause the debugger to hang.
  • Content Grabber may crash when editing commands that consume data.
  • The Max. repeats option for link commands does not work.
  • The Close Browser command doesn't properly close a browser.

Version 2.11.9

Bug Fixes

  • JavaScript on a target website is sometimes able to close an agent browser, which can cause the agent to crash.

Version 2.11.8

Bug Fixes

  • Links on the startup page don't work when DPI is set to more than 100%.

Version 2.11.7

New Features 

  • Date range data provider.
  • New Change Tracking option Track Deletes. This option is turned on by default.

Changes

  • Input data from non-database sources is now loaded automatically when editing a command that depends on the input data

Bug Fixes

  • Combining the options Change tracking and Old data option Keep All and Export should not be allowed.

Version 2.11.6

Bug Fixes

  • Internal frames are sometimes incorrectly detected as external frames.

Version 2.11.5

New Features 

  • Content Grabber now detects if it should load and parse external frames.

Bug Fixes

  • Unable to set form fields with text containing some special characters.
  • Number Range data provider does not work when debugging.

Version 2.11.4

Bug Fixes

  • Content Grabber may crash when processing certain AJAX requests.

Version 2.11.3

Bug Fixes

  • Post and header URL parameters don't work when using a web browser.

Version 2.11.2

New Features 

  • The Request Editor now has the ability to test requests.

Bug Fixes

  • Content Grabber may crash when debugging Exit or Retry commands.

Version 2.11.1

Changes

  • Minor user interface corrections.

Version 2.11.0

New Features 

  • Easier trial activations.
  • Support for multiple hosts per serial key.

Bug Fixes

  • User Interface displays incorrectly on some screen resolutions.

Version 2.10.0

New Features 

  • New Web Request editor makes it easier to create complete web requests that include URL, post data and headers.
  • When clicking on AJAX URLs in the Browser Activity screen, the Web Request editor will open and provide info about post data and headers.
  • New Filter selection tool.
  • Exit Or Retry commands now have an option to delete the current data row when exiting.

Bug Fixes

  • Creating list selections while inside a Web Element List command sometimes does not work correctly.

Version 2.9.9

New Features 

  • New option to capture link text when creating a new Link command. 

Bug Fixes

  • Content Grabber may crash when a page is not loaded correctly.
  • Content Grabber may crash when exporting data to CSV if the agent contains a capture command with content type DateTime and the captured value is an invalid date.

Version 2.9.8

Bug Fixes

  • Minor layout issues on script dialog windows.
  • Data replacement does not always work for Regex scripts.

Version 2.9.7

Bug Fixes

  • Content Grabber may crash when executing a command with a selection condition if the selection does not exist.
  • Some icons are missing from the command tree when debugging an agent.

Version 2.9.6

New Features 

  • New application menu View HTML displays the raw HTML of the currently selected browser tab.
  • The JSON Transformation windows now allows testing transformations.

Bug Fixes

  • Minor layout fixes in the Content Grabber editor.

Version 2.9.5

Bug Fixes

  • Content Grabber crashes when using the option Close Browser After Use on the Agent command.

Version 2.9.4

Bug Fixes

  • Trial activation screens are displayed incorrectly on some screen resolutions.
  • The free Nohodo proxy plan is not automatically configured in Content Grabber for trial users.

Version 2.9.3

Bug Fixes

  • Page Transformation commands cause agents to fail.

Version 2.9.2

Bug Fixes

  • Form Field commands not executing an action can cause problems for some sub-commands, such as Download Document commands.
  • Page Transformation commands often does not work correctly.

Version 2.9.1

Bug Fixes

  • Condition script documentation is missing from the manual.

Version 2.9.0

New Features

  • New flow control commands If..ElseIf..Else and Exit or Retry.
  • New command Remove Duplicate.
  • New command Resolve CAPTCHA.
  • New command Manual Navigation.

Version 2.8.2

Bug Fixes

  • Visual Studio templates don't work after switching from 32bit to 64bit.

Version 2.8.1

Bug Fixes

  • An agent may stop or hang when retrying a URL using a Dynamic browser.

Version 2.8.0

API Changes

  • The ListNodes property has been removed from the ScriptParameters class.

Bug Fixes

  • The options Separate output and Export Method are not synchronized in the configuration panel for Group commands, Group in Page Area commands and Web Element List commands.
  • Nested Web Element List commands sometimes don't work properly.

Version 2.7.7

Bug Fixes

  • Data export to a separate table sometimes produces incorrect data.

Version 2.7.6

New Features 

  • Agent schedules can now be exported and imported from the Manage Schedules screen.

Version 2.7.5

Bug Fixes

  • The Save As file menu is missing.
  • Content Grabber crashes when trying to delete the internal database while no internal database connection is selected.

Version 2.7.4

Bug Fixes

  • Unable to select web elements in the web browser on some computers.
  • Unable to start the Content Grabber Windows service.
  • Self-contained agents don't work correctly.

Version 2.7.3

Bug Fixes

  • Unable to set the option SQLite Sync.

Version 2.7.2

Bug Fixes

  • Unable to cancel pagination set selection when creating a Pagination command with a pagination set selection.

Version 2.7.1

New Features 

  • When opening a trial agent in a full version of Content Grabber, a message is now displayed to ask if the agent should be converted to a full agent.

Bug Fixes

  • The installer always displays Professional edition, even when installing a Premium or Server edition.
  • When creating a 32-bit runtime package on 64-bit Windows, a message will say that a 64-bit runtime package was created, even though a 32-bit package was in fact created.
  • Unable to add agent commands in the 2.7.0 trial version.

Version 2.7.0

IMPORANT: Older versions of Content Grabber cannot be upgraded to 2.7.0. All previous installations of Content Grabber must be uninstalled and the full version of Content Grabber 2.7.0 must then be downloaded and installed.

New Features 

  • The software installers for the Premium, Professional and Server editions are now consolidated into a single installer.
  • Content Grabber now installs as a 64-bit application on 64-bit Windows.
  • The Content Grabber runtime is now available in both 64-bit and 32-bit versions.

Bug Fixes

  • Unable to set the option SQLite Sync when using SQLite as internal database.
  • When using SQLite as internal database, the option SQLite Sync is set to true by default instead of false as intended. This can result in some agents running much slower than they otherwise would.