Activities¶
Activity is the main building block of a job pipeline. Typical pipeline has one or more activities. There are several categories of activities such as connectors, flow controls, transformations and helper activities.
Connectors¶
Connectors are data readers and data writers. DataRow includes connectors for major Relational, NoSQL, Big Data and Cloud data stores.
Following is the complete list of DataRow connectors:
- Amazon S3 Reader
- Amazon S3 Writer
- Azure Blob Storage Reader
- Azure Blob Storage Writer
- Azure Data Lake Reader
- Azure Data Lake Writer
- File Reader
- File Writer
- MySQL Reader
- MySQL Writer
- MariaDB Reader
- MariaDB Writer
- PostgreSQL Reader
- PostgreSQL Writer
- SQL Server Reader
- SQL Server Writer
- Oracle Reader
- Oracle Writer
- Vertica Reader
- Vertica Writer
- Cassandra Reader
- Cassandra Writer
- HBase Reader
- HBase Writer
- Redshift Reader
- Redshift Writer
- Amazon Aurora Reader
- Amazon Aurora Writer
- MongoDB Reader
- MongoDB Writer
- Couchbase Reader
- Couchbase Writer
- CosmosDB Reader
- CosmosDB Writer
- Kafka Reader
Transformations¶
Data between reader and writer connectors could be transformed through these activities:
Flow Controls¶
Flow controls include iteration, condition and grouping activities:
Helper Activities¶
These are miscellaneous helper activities: