The HDFS file "Write" activity provides options for "Append" and "Overwrite" in the general tab.

Case 1 - When both "Append" and "Overwrite" are not selected, if the specified file is not present in the HDFS -> Success, a new file is created
Case 2 - When "Append" is not selected and "Overwrite" is selected, if the specified file is not present in the HDFS -> Success, a new file is created.
Case 3 - When "Append" is selected and "Overwrite" is not selected (The "Overwrite" checkbox is hidden when "Append" is selected, hence it is not possible to select both "Append" and "Overwrite" together.), if the specified file is not present in the HDFS -> Failed, "exception":"FileNotFoundException" will be found in the log file.

The WebHDFS API expects file to be present for "Append" operation and the REST URL includes File path while submitting the "Append" request. For more details, please refer to https://hadoop.apache.org/docs/r1.0.4/webhdfs.html#"Append"

How to create a new file on the HDFS server using the Write activity

Product: TIBCO ActiveMatrix BusinessWorks Plug-in for Big Data Version: All supported versions OS: All Supported Operating Systems