How to create a new file on the HDFS server using the Write activity
Article ID: KB0078630
Updated On:
| Products | Versions |
|---|---|
| TIBCO ActiveMatrix BusinessWorks Plug-in for Big Data | all supported versions |
Description
The HDFS file "Write" activity provides options for "Append" and "Overwrite" in the general tab.
Case 1 - When both "Append" and "Overwrite" are not selected, if the specified file is not present in the HDFS -> Success, a new file is created
Case 2 - When "Append" is not selected and "Overwrite" is selected, if the specified file is not present in the HDFS -> Success, a new file is created.
Case 3 - When "Append" is selected and "Overwrite" is not selected (The "Overwrite" checkbox is hidden when "Append" is selected, hence it is not possible to select both "Append" and "Overwrite" together.), if the specified file is not present in the HDFS -> Failed, "exception":"FileNotFoundException" will be found in the log file.
The WebHDFS API expects file to be present for "Append" operation and the REST URL includes File path while submitting the "Append" request. For more details, please refer to https://hadoop.apache.org/docs/r1.0.4/webhdfs.html#"Append"
Environment
Issue/Introduction
Feedback
