Tips For Better Replication Services (RS ) Solution Performance

Tips For Better Replication Services (RS ) Solution Performance

book

Article ID: KB0078917

calendar_today

Updated On:

Products Versions
TIBCO Cloud Integration - Connect ( Scribe ) -

Description

Replication Solutions replicate data from one datastore to another.  There are options when configuring your Replication Solution that can reduce the number of records replicated and increase performance.  Here are some things you need to know about Replication Solutions.
 

Selecting Entities

You have three options in the Replication Solution configuration for determining which entities are replicated:
 
  • Recommended entities — Replicates the entities that TIBCO Scribe® recommends. These entities are chosen based on dependencies between entities and criteria such as, whether or not the entity has a Last Modified date. Custom entities are included if they have a Last Modified Date.
Selecting Recommended entities ensures that you replicate all of the data needed without replicating internal tables and other target-specific data. Refer to the specific Connector information for a list of recommended entities.
  • All entities — Replicates all of the entities from your source data. This ensures that nothing is missed, however, you could be replicating data that is not needed. Custom entities are included.
  • Selected entities — Replicates only the entities you select. Best practice is to select your own entities only if you are very familiar with your data. Custom entities are available for selection.
If you are not sure which entities you need, but are also conscious of the records you are processing, your best bet is to select Recommended entities in the Entities section of the Solution Edit page.

Recommended entity selection includes the most popular entities that support a Last Modified Date. The Last Modified Date is used to replicate only new and updated records, reducing the number of overall records processed.
 
kA3320000004RruCAE_en_US_1_0

TIBCO Scribe® Online replicates updated or new records if it can:
 
  • Determine when the record was modified
  • Track deletes since the Scribe last execution  

Not every entity supports tracking both Last Date Modified and Deleted. TIBCO Scribe® Online replicates every record for those entities.
 
  • SalesForce “Recommended” entity – Any entity that has a LastModifiedDate field AND supports an API call to track deletes (Replicatable = TRUE). For a list of recommended entities, see the following in the TIBCO Scribe® Online Help: TIBCO Scribe Online Connector For Salesforce
  • Dynamics CRM “Recommended” entity
    • All custom entities
    • Specific base entities that have a CreatedOn field AND support our plug-in that tracks deletes.
For a list of recommended entities, see the following in the TIBCO Scribe® Online Help: TIBCO Scribe Online Connector For Microsoft Dynamics 365 / CRM

For other products, refer to the TIBCO Scribe® Online Help for the specific Connector.
 

Determining Which Entities Will Be Replicated

If you want to know whether an entity will be replicated or not, you can check the list in TIBCO Scribe® Online Help, or you can look at the entity descriptions on the Select Entities dialog. To access the dialog, open your Replication Solution, select Selected Entities, and click the Select link. The description column should indicate whether the entity has a Last Modified Date and whether it can track deletes.  For example, for Dynamics 365 / CRM you would see the following:
 
NOTE: Dynamics CRM does not support tracking deletes for this entity.

This note in the description of the entity indicates that TIBCO Scribe® Online does not include that entity in the list of Recommended Entities.

Example of a Dynamics CRM entity that would not be included in Recommended Entities.

kA3320000004RruCAE_en_US_1_1

Example of a Salesforce entity that would not be included in Recommended Entities.

kA3320000004RruCAE_en_US_1_2
 

Selecting A Sub-Set Entities

The list of entities available for selection can be quite long.  You can use a filter to display only those entities that are recommended, based on the description, and then select the individual entities you want.  You can also skip recommended entities and select from the remaining list, knowing that the entities you select will be replicated every time the Replication Solution runs.

On Dynamics 365 / CRM entities that do not support tracking deletes or do not have a Last Modified field, TIBCO Scribe®  adds a “NOTE:” in its entity description.

kA3320000004RruCAE_en_US_1_3
 
NOTE: Dynamics CRM does not support tracking deletes for this entity.
NOTE: This entity does not contain a field to indicate when it was modified.

Salesforce metadata also includes a description note:
Does not support retrieval of deleted items.

Use the Find option on your browser to search for the word NOTE: and locate the entities that are not included in Recommended Entities.

kA3320000004RruCAE_en_US_1_4

For additional information, see the following in TIBCO Scribe® Online Help:
 
 

Issue/Introduction

Here is a way you can streamline your Replication Solutions in TIBCO Scribe® Online