How to introspect tables from Apache Drill in TIBCO Data Virtualization for the schema created in the Drill Web UI?
Article ID: KB0072438
Updated On:
| Products | Versions |
|---|---|
| TIBCO Data Virtualization | All Supported Versions |
Description
Apache Drill Web UI can be used to connect to different datasource and the relevant schema name is created in the Drill Web UI. The tables from these sources can be queried from the Web UI. Using the Drill adapter in TDV, a connection can be made to the Apache Drill and the datasources added in apache drill can be queried through TDV. The process flow is as follows:
TDV -> Apache Drill -> Datasource(Postgres,S3 Bucket etc.)
When trying to introspect the required tables in TDV, instead of the tables, the tables containing metadata of the datasource are introspected. This article describes the steps to introspect the correct tables in TDV.
TDV -> Apache Drill -> Datasource(Postgres,S3 Bucket etc.)
When trying to introspect the required tables in TDV, instead of the tables, the tables containing metadata of the datasource are introspected. This article describes the steps to introspect the correct tables in TDV.
Issue/Introduction
This article describes the steps to introspect tables from Apache Drill in TIBCO Data Virtualization for the schemas created in the Drill Web UI.
Environment
Linux
Resolution
The drill adapter consists of the following fields:
If in Drill WebUI a connection is made to the PostgreSQL database with a schema name as Postgres, then using the same name in TDV drill adapter will result in a list of tables that consists of the metadata and not the actual data.
In order to add the tables under the Postgres DB, the schema name "postgresql.tutorial" needs to be used where "tutorial" is the schema inside of the Postgresql DB. This will result in a list of the tables present inside the database.
If in Drill WebUI a connection is made to the PostgreSQL database with a schema name as Postgres, then using the same name in TDV drill adapter will result in a list of tables that consists of the metadata and not the actual data.
In order to add the tables under the Postgres DB, the schema name "postgresql.tutorial" needs to be used where "tutorial" is the schema inside of the Postgresql DB. This will result in a list of the tables present inside the database.
Feedback
Yes
No
Powered by
