Data policy can be set in some Readers. Here we provide their list:
CSVReader
ParallelReader (Commercial Component)
XLSDataReader
DBFDataReader
DBInputTable
XMLXPathReader
MultiLevelReader (Commercial Component)
When you want to configure these components, you must first decide what should be done when incorrect or incomplete records are parsed. This can be specified with the help of this Data Policy attribute. You have three options according to what data policy you want to select:
Strict. This data policy is set by default. It means that data parsing stops if a record field with an incorrect value or format is read. Next processing is aborted.
Controlled. This data policy means that
every error is logged, but incorrect records are skipped and data
parsing continues. Generally, incorrect records with error information are
logged into stdout
. Only
CSVReader enables to sent them out
through the optional second port.
Important | |
---|---|
If you set the Data policy attribute
to |
Lenient. This data policy means that incorrect records are only skipped and data parsing continues.