How do you re-introspect the Spotfire Data Virtualization Default Cache database?

book

Article ID: KB0138794

calendar_today

Updated On:

Products Versions
Spotfire Data Virtualization Software All supported versions

Description

The option to 'Add / Remove resources' is grayed out for the Spotfire Data Virtualization(SDV) default cache database. 

Screenshot of the grayed out option for reference : 

image.png

This article provides a SDV configuration that can help re-introspect the default cache database, however it required a server restart. Enabling this configuration is recommended when the Default Cache data source exists, but its schema, tables, or column definitions are out of sync, corrupted, or missing:

  • Metadata Desynchronization: The underlying PostgreSQL cache repository contains physical cache tables, but TDV Studio does not display them, displays stale definitions, or fails to recognize existing cached objects.

  • Interrupted or Failed Prior Introspections: A previous manual or automatic introspection failed, timed out, or was interrupted during server shutdown, leaving the cache data source in a partially introspected or invalid state.

  • Direct Database Maintenance or Repair: Administrative maintenance, schema patching, or vacuum/repair tasks were executed directly against the underlying PostgreSQL cache repository, requiring TDV to refresh its internal table catalog to match the database state.

  • Cache Read/Write Metadata Errors: Query executions against cached resources fail with metadata-level errors such as Table not found in metadata, column mismatch errors, or unexpected schema validation failures when writing to cache targets.

  • Complement to Re-Creating the Data Source: If you previously had to recreate the default cache data source definition, or if the data source is healthy but its child tables/schemas are inaccessible, re-introspecting refreshes the object tree without recreating the entire data source from scratch.

Environment

All supported Operating Systems

Resolution

Note - It is advised to take a SDV Server machine snapshot / necessary backups before using this configuration. 

Follow below steps - 

(1) Open SDV Studio, navigate to Administration tab > Configuration > Server > Configuration > Debugging > Cache > 'Re-introspect Default Cache Datasource On Server Startup' > set to true. Click Apply to save the changes. 

Screenshot of the configuration for reference : 

image.png

(2) Restart SDV Server services. 

(3) After logging back in Studio, navigate to /lib/sources/defaultCacheDataSource for any new tables / columns that were added. 

Note - 

- Information regarding this configuration : 

Defaults to "false". When "true", the server will reintrospect the Default Cache Database on server startup, the value will be reset to "false" by the server after introspecting.

This value is locally defined. It will not be altered when restoring a backup and will not be replicated in a cluster.

- The existing data in the default cache db tables and cache management tables (csstatus and cstracking) still remain as it is. 

- If this server is part of a cluster, this process must be evaluated and executed individually on any other node experiencing the issue, as the setting does not replicate across the cluster. 

Issue/Introduction

How do you re-introspect the Spotfire Data Virtualization Default Cache database?