The Exit If Data Exist command checks extracted data against previously extracted data and exits a specified container command if it already exists. The current data row is deleted if the data already exist.
The behavior of the Exit If Data Exist command is very similar to the Remove Duplicate command, but the Exit If Data Exist command uses a list of SHA-256 hashes to determine if data has previously been extracted, while the Remove Duplicate command checks an existing full set of previously extracted data.
The list of SHA-256 hashes used by Exit If Data Exist commands is never deleted automatically, but can be deleted manually on the Internal Data Configuration screen.
The Exit If Data Exist command must be added after the capture commands that extract the data that should be checked.
When an Exit If Data Exist command detects that data has already been extracted, it will exit a specified parent command. By default, an Exit If Data Exist command exits the current list entry of the nearest parent list command, or the nearest parent command that exports data to a separate data table.
If the target data is displayed by descending order, then you can use an Exit If Data Exist command to extract only new data by exiting the Agent command when existing data is detected. For example, if the target data is ordered by newest date to oldest date and the Exit If Data Exist command detects that a specific date has already been extracted, then you know that all data after that date has already been extracted and you can exit the agent.