Skip to content

FTP

FTP (ftp)

Upload events to FTP/SFTP/TFTP servers.

File Utility binary json raw

Minimal example

output:
ftp:
endpoint:
host: ~
path: ~
JSON
{
"output": {
"ftp": {
"endpoint": {
"host": null
},
"path": null
}
}
}

Contents

Connection

Connection
FieldTypeRequiredDescription
protocolProtocolTransfer protocol to use (ftp, sftp, ftps, or tftp).
Allowed values: ftp, ftps-explicit, ftps-implicit, sftp, tftp
endpointEndpointRemote endpoint settings (host, port, TLS requirements).
credentialsFTP CredentialsCredentials or key material needed to authenticate with the server.
Allowed values: username-password, tls-client-cert, ssh-key, anonymous, none
working-directorystringOptional working directory to CWD into before writing files.
passiveboolean (bool)Enable passive FTP data connections when required by firewalls.
ftpsFtpsFTPS-specific options (TLS certificates, modes) when protocol is FTPS.
sftpSftpSFTP-specific options (key paths, algorithms) when using SSH-based transfer.
tftpTftpTFTP-specific options such as blksize tuning.

Reliability

Reliability
FieldTypeRequiredDescription
retryRetryRetry policy to apply when uploads fail or time out.
batchBatchBatch multiple events into a single transfer when supported by the target.
resume-checkpoint-variablestringName of the variable used to persist resume checkpoints between runs.

Transfer

Transfer
FieldTypeRequiredDescription
pathstringRemote path or prefix (may include variables) where files are written.
metadataMetadataExtra metadata columns to include with each upload event.
concurrencynumber (integer)Maximum number of files to transfer concurrently.
Examples: 42, 1.2e-10
tmp-suffixstringTemporary suffix applied to files while uploading; removed after completion.
preprocessorsOutput Preprocessor[]Output preprocessors to run before writing data (for example compression).
Allowed values: gzip, parquet, base64
payload-modePayload ModePayload mode describing how bytes are emitted (auto/json/raw/binary).
Allowed values: auto, json, raw, binary
appendboolean (bool)Append to existing remote files instead of overwriting them.
Default: false
checksumChecksumChecksum verification strategy applied after a transfer completes.
stream-buffer-sizenumber (integer)Size of the in-memory buffer used during streaming uploads.
Examples: 42, 1.2e-10

Schema

FTP Credentials Options

OptionNameTypeDescription
username-passwordUsername Passwordobject
tls-client-certTls Client Certobject
ssh-keySsh Keyobject
anonymousAnonymousmap
noneNonemap

Sftp - SFTP Host Key Verification Options

OptionNameTypeDescription
known-hosts-fileKnown Hosts Fileobject
fingerprintFingerprintobject
accept-newAccept Newmap

Endpoint Fields

FieldTypeRequiredDescription
hoststring
portnumber (integer)Examples: 42, 1.2e-10
proxystring
bastion-hoststring

FTP Credentials - Username Password Fields

FieldTypeRequiredDescription
username-variablestring
password-variablestring

FTP Credentials - Tls Client Cert Fields

FieldTypeRequiredDescription
username-variablestring
password-variablestring
client-certificate-variablestring
client-key-variablestring

FTP Credentials - Ssh Key Fields

FieldTypeRequiredDescription
username-variablestring
private-key-variablestring
passphrase-variablestring

Ftps Fields

FieldTypeRequiredDescription
ca-certificate-variablestring
client-certificate-variablestring
client-key-variablestring
cipher-liststring
verify-peerboolean (bool)Default: false
min-tls-versionstring

Sftp - SFTP Host Key Verification - Known Hosts File Fields

FieldTypeRequiredDescription
pathpath (string)Examples: /path/to/file, c:\users\joe\data\file.txt

Sftp - SFTP Host Key Verification - Fingerprint Fields

FieldTypeRequiredDescription
fingerprintstring

Sftp Fields

FieldTypeRequiredDescription
agent-forwardingboolean (bool)Default: false
known-hosts-pathstring
host-key-verificationSFTP Host Key VerificationAllowed values: known-hosts-file, fingerprint, accept-new
jump-hoststring

Tftp Fields

FieldTypeRequiredDescription
block-sizenumber (integer)Examples: 42, 1.2e-10
timeout-msnumber (integer)Examples: 42, 1.2e-10
max-retriesnumber
file-namestring

Retry Fields

FieldTypeRequiredDescription
timeouttime-interval (string)timeout (e.g. 500ms, 2s etc. - default is 30).
Examples: 500ms, 2h
retriesnumber (integer)number of retries.
Examples: 42, 1.2e-10

Batch Fields

FieldTypeRequiredDescription
fixed-sizenumber (integer)maximum number of events in an output batch.
Examples: 42, 1.2e-10
modeModeIf ‘document’ send on end of document generated by input. If ‘fixed’, use fixed_size.
Allowed values: fixed, document
timeouttime-interval (string)interval after which the batch is sent, to keep throughput going (default 100ms).
Default: 100ms
Examples: 500ms, 2h
headermultiline-text (string)put a header line before the batch.
footermultiline-text (string)put a header line after the last line of the batch.
use-document-markerboolean (bool)Enrich the job metadata with a document marker (for document handling in batch mode).
Default: false
wrap-as-jsonboolean (bool)Format the output batch as a JSON array.
Default: false

Metadata Fields

FieldTypeRequiredDescription
object-name-fieldfield (string)Examples: data_field
content-length-fieldfield (string)Examples: data_field
last-modified-fieldfield (string)Examples: data_field
checksum-fieldfield (string)Examples: data_field
content-type-fieldfield (string)Examples: data_field
etag-fieldfield (string)Examples: data_field

Checksum Fields

FieldTypeRequiredDescription
verify-remoteboolean (bool)Default: false
algorithmAlgorithmAllowed values: md5, sha256

Protocol Options

ValueNameDescription
ftpftpFtp
ftps-explicitftps-explicitFtps Explicit
ftps-implicitftps-implicitFtps Implicit
sftpsftpSftp
tftptftpTftp

Batch - Mode Options

ValueNameDescription
fixedfixedFixed
documentdocumentDocument

Output Preprocessor Options

ValueNameDescription
gzipgzipGzip the output data
parquetparquetExtract the received data as JSON rows from a parquet file
base64base64Decode base64 as binary

Payload Mode Options

ValueNameDescription
autoautoAuto
jsonjsonJson
rawrawRaw
binarybinaryBinary

Checksum - Algorithm Options

ValueNameDescription
md5md5Md5
sha256sha256Sha256