Description:

Fetches files from an FTP Server and creates FlowFiles from them

Additional Details...

Tags: FTP, get, retrieve, files, fetch, remote, ingest, source, input

Properties:

In the list below, the names of required properties appear in bold. Anyother properties (not in bold) are considered optional. The table also indicates any default values, whether a property supports the NiFi Expression Language (or simply EL), and whether a property is considered "sensitive", meaning that its value will be encrypted. Before entering a value in a sensitive property, ensure that the nifi.properties file has an entry for the property nifi.sensitive.props.key.

NameDescriptionDefault ValueValid ValuesELSensitive
HostnameThe fully qualified hostname or IP address of the remote systemYesNo
PortThe port that the remote system is listening on for file transfers21NoNo
UsernameUsernameNoNo
PasswordPassword for the user accountNoYes
Connection ModeThe FTP Connection ModePassive
  • Active
  • Passive
NoNo
Transfer ModeThe FTP Transfer ModeBinary
  • Binary
  • ASCII
NoNo
Remote PathThe path on the remote system from which to pull or push filesYesNo
File Filter RegexProvides a Java Regular Expression for filtering Filenames; if a filter is supplied, only files whose names match that Regular Expression will be fetchedNoNo
Path Filter RegexWhen Search Recursively is true, then only subdirectories whose path matches the given Regular Expression will be scannedNoNo
Polling IntervalDetermines how long to wait between fetching the listing for new files60 secNoNo
Search RecursivelyIf true, will pull files from arbitrarily nested subdirectories; otherwise, will not traverse subdirectoriesfalse
  • true
  • false
NoNo
Ignore Dotted FilesIf true, files whose names begin with a dot (".") will be ignoredtrue
  • true
  • false
NoNo
Delete OriginalDetermines whether or not the file is deleted from the remote system after it has been successfully transferredtrue
  • true
  • false
NoNo
Connection TimeoutAmount of time to wait before timing out while creating a connection30 secNoNo
Data TimeoutAmount of time to wait before timing out while transferring data30 secNoNo
Max SelectsThe maximum number of files to pull in a single connection100NoNo
Remote Poll Batch SizeThe value specifies how many file paths to find in a given directory on the remote system when doing a file listing. This value in general should not need to be modified but when polling against a remote system with a tremendous number of files this value can be critical. Setting this value too high can result very poor performance and setting it too low can cause the flow to be slower than normal.5000NoNo
Use Natural OrderingIf true, will pull files in the order in which they are naturally listed; otherwise, the order in which the files will be pulled is not definedfalse
  • true
  • false
NoNo

Relationships:

NameDescription
successAll FlowFiles that are received are routed to success