Can we retrieve a CSV file from an FTP server using the File Delimited adapter in TIBCO Data Virtualization?

Can we retrieve a CSV file from an FTP server using the File Delimited adapter in TIBCO Data Virtualization?

book

Article ID: KB0070810

calendar_today

Updated On:

Products Versions
TIBCO Data Virtualization All supported versions.

Description

Usually, the File Delimited adapter is used for retrieving a locally stored CSV/TXT file in TIBCO Data Virtualization (TDV). However, the user may need to retrieve a CSV file from a remote FTP server.
In such a case, the File Delimited adapter fails to retrieve the file. An error as below is observed on the introspection summary window:
 Error occurred introspecting new resource: Resource not introspected. ADD Failed: Cannot open file at "<file location>".
User-added image

Issue/Introduction

This article will address whether it is possible for a user to connect to an FTP server, retrieve a CSV file, and, if not, explore alternative methods to achieve this.

Environment

All Supported Environments.

Resolution

Accessing local file:
If the CSV file is stored locally, the URL used is as below:
 file:///C:/projectstuff/build/trialrun/teststuff/flatfile/USPSaddresses.csv/txt
Here, the CSV/TXT file is imported successfully in TDV.

Accessing a file on an FTP Server:
On the other hand, if the file is imported from a remote server via FTP, then the URL is as below:
 ftp://ftp.varoa.fi/pests/standards/RFC/treatment_options.csv/txt
Now, the TXT file will be imported successfully but the CSV file will fail with an error as depicted in the description.
This is because the File Delimited adapter's limitation.

File Delimited adapter's Limitation:
The limitation is that it can only read and import TXT files via FTP and not any other format (including CSV).

Alternative:
CDATA's FTP adapter can be used which can be downloaded from  https://www.cdata.com/solutions/dv/tibco/#download.
 

Additional Information

1. Refer the File Datasource adapter documentation for more details -> https://docs.tibco.com/pub/tdv/8.8.0/doc/pdf/TIB_tdv_8.8.0_AdapterGuide_FileDatasources.pdf?id=81#page=6 and https://docs.tibco.com/pub/tdv/8.8.0/doc/pdf/TIB_tdv_8.8.0_AdapterGuide_FileDatasources.pdf?id=81#page=10

2. To know more about the CDATA adapters, refer -> https://support.tibco.com/s/article/000051148.