FTP (ftp)
Upload events to FTP/SFTP/TFTP servers.
File Utility binary json raw
Minimal example
JSON
Contents
Connection
Connection
| Field | Type | Required | Description |
|---|
protocol | Protocol | | Transfer protocol to use (ftp, sftp, ftps, or tftp). Allowed values: ftp, ftps-explicit, ftps-implicit, sftp, tftp |
endpoint | Endpoint | ✅ | Remote endpoint settings (host, port, TLS requirements). |
credentials | FTP Credentials | | Credentials or key material needed to authenticate with the server. Allowed values: username-password, tls-client-cert, ssh-key, anonymous, none |
working-directory | string | | Optional working directory to CWD into before writing files. |
passive ✓ | boolean (bool) | | Enable passive FTP data connections when required by firewalls. |
ftps | Ftps | | FTPS-specific options (TLS certificates, modes) when protocol is FTPS. |
sftp | Sftp | | SFTP-specific options (key paths, algorithms) when using SSH-based transfer. |
tftp | Tftp | | TFTP-specific options such as blksize tuning. |
Reliability
Reliability
| Field | Type | Required | Description |
|---|
retry | Retry | | Retry policy to apply when uploads fail or time out. |
batch | Batch | | Batch multiple events into a single transfer when supported by the target. |
resume-checkpoint-variable | string | | Name of the variable used to persist resume checkpoints between runs. |
Transfer
Transfer
| Field | Type | Required | Description |
|---|
path | string | ✅ | Remote path or prefix (may include variables) where files are written. |
metadata | Metadata | | Extra metadata columns to include with each upload event. |
concurrency | number (integer) | | Maximum number of files to transfer concurrently. Examples: 42, 1.2e-10 |
tmp-suffix | string | | Temporary suffix applied to files while uploading; removed after completion. |
preprocessors | Output Preprocessor[] | | Output preprocessors to run before writing data (for example compression). Allowed values: gzip, parquet, base64 |
payload-mode ✓ | Payload Mode | | Payload mode describing how bytes are emitted (auto/json/raw/binary). Allowed values: auto, json, raw, binary |
append ✓ | boolean (bool) | | Append to existing remote files instead of overwriting them. Default: false |
checksum | Checksum | | Checksum verification strategy applied after a transfer completes. |
stream-buffer-size | number (integer) | | Size of the in-memory buffer used during streaming uploads. Examples: 42, 1.2e-10 |
Schema
FTP Credentials Options
Sftp - SFTP Host Key Verification Options
Endpoint Fields
| Field | Type | Required | Description |
|---|
host | string | ✅ | |
port | number (integer) | | Examples: 42, 1.2e-10 |
proxy | string | | |
bastion-host | string | | |
FTP Credentials - Username Password Fields
| Field | Type | Required | Description |
|---|
username-variable | string | ✅ | |
password-variable | string | ✅ | |
FTP Credentials - Tls Client Cert Fields
| Field | Type | Required | Description |
|---|
username-variable | string | ✅ | |
password-variable | string | ✅ | |
client-certificate-variable | string | ✅ | |
client-key-variable | string | ✅ | |
FTP Credentials - Ssh Key Fields
| Field | Type | Required | Description |
|---|
username-variable | string | ✅ | |
private-key-variable | string | ✅ | |
passphrase-variable | string | | |
Ftps Fields
| Field | Type | Required | Description |
|---|
ca-certificate-variable | string | | |
client-certificate-variable | string | | |
client-key-variable | string | | |
cipher-list | string | | |
verify-peer ✓ | boolean (bool) | | Default: false |
min-tls-version | string | | |
Sftp - SFTP Host Key Verification - Known Hosts File Fields
| Field | Type | Required | Description |
|---|
path | path (string) | ✅ | Examples: /path/to/file, c:\users\joe\data\file.txt |
Sftp - SFTP Host Key Verification - Fingerprint Fields
| Field | Type | Required | Description |
|---|
fingerprint | string | ✅ | |
Sftp Fields
| Field | Type | Required | Description |
|---|
agent-forwarding ✓ | boolean (bool) | | Default: false |
known-hosts-path | string | | |
host-key-verification | SFTP Host Key Verification | | Allowed values: known-hosts-file, fingerprint, accept-new |
jump-host | string | | |
Tftp Fields
| Field | Type | Required | Description |
|---|
block-size | number (integer) | | Examples: 42, 1.2e-10 |
timeout-ms | number (integer) | | Examples: 42, 1.2e-10 |
max-retries | number | | |
file-name | string | | |
Retry Fields
| Field | Type | Required | Description |
|---|
timeout | time-interval (string) | ✅ | timeout (e.g. 500ms, 2s etc. - default is 30). Examples: 500ms, 2h |
retries | number (integer) | | number of retries. Examples: 42, 1.2e-10 |
Batch Fields
| Field | Type | Required | Description |
|---|
fixed-size ✓ | number (integer) | | maximum number of events in an output batch. Examples: 42, 1.2e-10 |
mode | Mode | ✅ | If ‘document’ send on end of document generated by input. If ‘fixed’, use fixed_size. Allowed values: fixed, document |
timeout | time-interval (string) | ✅ | interval after which the batch is sent, to keep throughput going (default 100ms). Default: 100ms Examples: 500ms, 2h |
header | multiline-text (string) | | put a header line before the batch. |
footer | multiline-text (string) | | put a header line after the last line of the batch. |
use-document-marker ✓ | boolean (bool) | | Enrich the job metadata with a document marker (for document handling in batch mode). Default: false |
wrap-as-json ✓ | boolean (bool) | | Format the output batch as a JSON array. Default: false |
| Field | Type | Required | Description |
|---|
object-name-field | field (string) | | Examples: data_field |
content-length-field | field (string) | | Examples: data_field |
last-modified-field | field (string) | | Examples: data_field |
checksum-field | field (string) | | Examples: data_field |
content-type-field | field (string) | | Examples: data_field |
etag-field | field (string) | | Examples: data_field |
Checksum Fields
| Field | Type | Required | Description |
|---|
verify-remote ✓ | boolean (bool) | | Default: false |
algorithm | Algorithm | ✅ | Allowed values: md5, sha256 |
Protocol Options
| Value | Name | Description |
|---|
ftp | ftp | Ftp |
ftps-explicit | ftps-explicit | Ftps Explicit |
ftps-implicit | ftps-implicit | Ftps Implicit |
sftp | sftp | Sftp |
tftp | tftp | Tftp |
Batch - Mode Options
| Value | Name | Description |
|---|
fixed | fixed | Fixed |
document | document | Document |
Output Preprocessor Options
| Value | Name | Description |
|---|
gzip | gzip | Gzip the output data |
parquet | parquet | Extract the received data as JSON rows from a parquet file |
base64 | base64 | Decode base64 as binary |
Payload Mode Options
| Value | Name | Description |
|---|
auto | auto | Auto |
json | json | Json |
raw | raw | Raw |
binary | binary | Binary |
Checksum - Algorithm Options
| Value | Name | Description |
|---|
md5 | md5 | Md5 |
sha256 | sha256 | Sha256 |