Multiple load data command executed during cache refresh (using bulk data load for MySQL adapter)
book
Article ID: KB0081682
calendar_today
Updated On:
Products
Versions
TIBCO Data Virtualization
7.0.5, 7.0.6
Description
By default native data loading for cache bulk upload uses default buffer size of 10,000 rows which means data load commands will be executed for each 10,000 rows when bulk loading is performed.
This setting can be changed and can be set as per the requirement using the below configuration:
Studio -> Administration -> Configuration -> Data Sources -> Common to Multiple Source Types -> Data Sources Data Transfer -> Buffer Flush Threshold
Changing this configuration doesn't required server restart. This is really helpful to improve the performance when bulk size of data (i.e. millions/billions of records) needs to cached.