File Writer Activity¶
Writes specified view as file to target path. Optimal for writing to HDFS, FTP and Local file systems.
Parameters¶
Name |
Description |
Type |
Default |
---|---|---|---|
Title |
Title of the activity. Its displayed on the designer. |
text |
|
View |
Name of the DataRow view that is going to be written into the file. |
text |
|
Path |
File path. Please see below for supported file systems. |
text |
|
Format |
File format. Please see below for supported file formats. |
enum |
|
Partition By |
List of columns to partition the output by. |
enum |
error |
Mode |
Write mode. Please see blow for list modes and their meanings. |
enum |
error |
Options |
Additional options (e.g. delimiter for CSV file could be specified as [delimiter,\t] if file is tab delimited |
key-value |
Supported File Sources¶
Name |
Path Template |
---|---|
Local File System |
file://<path> |
HDFS |
hdfs://<namenodehost>/<path> |
FTP |
ftp://<username>:<password>@<host>/<path> |
Supported File Formats¶
Name |
Description |
---|---|
Parquet |
Apache Parquet is a columnar storage format. |
ORC |
ORC is also columnar storage format. |
Avro |
Apache Avro is a data serialization format. |
CSV |
CSV is a delimited text file format. |
JSON |
JSON is a lightweight data-interchange format. |
Supported Write Modes¶
Name |
Description |
---|---|
error |
Fail if file already exists. |
append |
Append to existing file or create new. |
overwrite |
Overwrite existing file or create new. |
ignore |
Ignore if file already exists or create new. |