Data > Data Validation

Capture commands can be configured to capture data of a specified type, and can also perform simple validation using Regular Expressions. A validation error occurs if extracted data cannot be converted into the specified data type, or if extracted data does not match a specified Regular Expression. See Capture Commands for more information.

Data rows that contain one or more validation errors are excluded from exported data by default. The data export option Error Data can be set to Include to include error data in the exported data. Error data may be excluded from exported data even when the option Error Data is set to Include, if a capture command is configured not to allow empty values.

Error Data Logging

Error data can be logged to CSV files by setting the agent option Log Error Data to true. In addition to the normal data fields, the CSV file will contain a field validation_errors_ which will contain the names of all fields that caused a validation error.

The error data log files are delivered together with normal data files by default. This behavior can be changed by setting the agent option Deliver Error Data Files to false.