File Writer Activity

Writes specified view as file to target path. Optimal for writing to HDFS, FTP and Local file systems.

Parameters

Name

Description

Type

Default

Title

Title of the activity. Its displayed on the designer.

text

View

Name of the DataRow view that is going to be written into the file.

text

Path

File path. Please see below for supported file systems.

text

Format

File format. Please see below for supported file formats.

enum

Partition By

List of columns to partition the output by.

enum

error

Mode

Write mode. Please see blow for list modes and their meanings.

enum

error

Options

Additional options (e.g. delimiter for CSV file could be specified as [delimiter,\t] if file is tab delimited

key-value

Supported File Sources

Name

Path Template

Local File System

file://<path>

HDFS

hdfs://<namenodehost>/<path>

FTP

ftp://<username>:<password>@<host>/<path>

Supported File Formats

Name

Description

Parquet

Apache Parquet is a columnar storage format.

ORC

ORC is also columnar storage format.

Avro

Apache Avro is a data serialization format.

CSV

CSV is a delimited text file format.

JSON

JSON is a lightweight data-interchange format.

Supported Write Modes

Name

Description

error

Fail if file already exists.

append

Append to existing file or create new.

overwrite

Overwrite existing file or create new.

ignore

Ignore if file already exists or create new.