Chapter 47. Common Properties of Readers

Readers are the initial components of graphs. They read data from data sources and send it to other graph components. This is the reason why each reader must have at least one output port through which the data flows out. Readers can read data from files or databases located on disk. They can also receive data through some connection using FTP, LDAP, or JMS. Some Readers can log the information about errors. Among the readers, there is also the Data Generator component that generates data according to some specified pattern. And, some Readers have an optional input port through which they can also receive data. They can also read data from dictionary.

Remember that you can see some part of input data when you right-click a reader and select the View data option. After that, you will be prompted with the same View data dialog as when debugging the edges. For more details see Viewing Debug Data. This dialog allows you to view the read data (it can even be used before graph has been run).

Here we present a brief overview of links to these options:

Here we present an overview of all Readers:

Table 47.1. Readers Comparison

Component Data source Input ports Output ports Each to all outputs1) Different to different outputs2) Transformation Transf. req. Java CTL
DataGeneratornone01-n
no
yes
yes
yes3)
yes
yes
CSVReaderflat file0-11-2
no
no
no
no
no
no
ParallelReaderflat file01
no
no
no
no
no
no
CloudConnectDataReaderCloudConnect binary file01-n
yes
no
no
no
no
no
SF ReaderSalesforce01
no
no
no
no
no
no
Google Analytics ReaderGoogle Analytics01
no
no
no
no
no
no
HTTPConnectorREST APIs0-11
no
no
no
no
no
yes
WebServiceClientSOAP APIs0-10-N
no
no
no
no
no
no
XLSDataReaderXLS(X) file0-11-n
yes
no
no
no
no
no
DBFDataReaderdBase file0-11-n
yes
no
no
no
no
no
DBInputTabledatabase01-n
yes
no
no
no
no
no
XMLExtractXML file0-11-n
no
yes
no
no
no
no
XMLXPathReaderXML file0-11-n
no
yes
no
no
no
no
JMSReaderjms messages01--
yes
no
yes
no
EmailReaderemail messages01--
yes
no
yes
no
LDAPReaderLDAP directory tree01-n
no
no
no
no
no
no
MultiLevelReaderflat file11-n
no
yes
yes
yes
yes
no
ComplexDataReaderflat file11-n
no
yes
yes
yes
yes
yes

Legend

1) Component sends each data record to all of the connected output ports.

2) Component sends different data records to different output ports using return values of the transformation (DataGenerator and MultiLevelReader). See Return Values of Transformations for more information. XMLExtract and XMLXPathReader send data to ports as defined in their Mapping or Mapping URL attribute.