Loading a text file with a large number of columns takes a long time.

Loading a text file with a large number of columns takes a long time.

book

Article ID: KB0080306

calendar_today

Updated On:

Products Versions
Spotfire Analyst All Versions

Description

When loading, add data into Spotfire via "Add data table > File", it takes an unexpectedly long time to load files with a very wide data set with many columns but not necessarily many rows (for example, thousands of columns, even if there are not many rows of data).

Issue/Introduction

Loading a text file with a large number of columns takes a long time.

Resolution

Spotfire is optimized to work with tall/skinny data sets (ie. many rows) vs horizontal data sets which have a very large number of columns. This is expected behavior.

Suggestions:
1. Confirm that you have applied the latest Spotfire client and server hotfixes.
2. Reduce the width of the data set (reduce the number of columns).
3. Increase the available system resources (CPU, RAM, and use of a 64-bit operating system).
4. Embed the data into the Spotfire analysis file.