Parallelization in TIBCO Data Virtualization fails with reason - "Plan has scans with low estimated data volumes"

Parallelization in TIBCO Data Virtualization fails with reason - "Plan has scans with low estimated data volumes"

book

Article ID: KB0077298

calendar_today

Updated On:

Products Versions
TIBCO Data Virtualization All supported versions

Description

Parallelization in TDV fails with Reason: Plan has scans with low estimated data volumes. We can see this message on the top-level SELECT node in the Query Execution plan.
This indicates that the query seems to be fetching low volumes of data from the underlying data source. 

 

Issue/Introduction

Parallelization in TIBCO Data Virtualization fails with reason - "Plan has scans with low estimated data volumes"

Resolution

To resolve this, follow the steps:

1. Browse to Studio > Administration > Configuration > Server > Configuration > Debugging > Parallel Processing > Disable Low Data Volume Restriction
2. Change the value to “True”
3. Click “Apply” and close the window

Screenshot for reference:

User-added image

Change the configuration setting as mentioned above, and then test the query.

Note: 
Queries handling data of low volume are typically not handled by the parallel processing engine. This is because if the datasets are small, then using the MPP Engine will result in an overhead of setup time, unnecessary routing of data to different nodes and also to combine them back at runtime. In such a situation, using the classic engine gives the best results.

Additional Information

For more information on 'Configuring the TDV Massively Parallel Processing Engine', refer to the below document:
https://docs.tibco.com/pub/tdv/8.0.0/doc/pdf/TIB_tdv_8.0.0_UsersGuide.pdf?id=1