In TIBCO Scribe® Online, Net Change refers to new and updated records in a source datastore. Most Recent Record Processed is the datetime value used by TIBCO Scribe® Online to determine which records in a source datastore are new or have been updated.
If this option is enabled, each time a Solution executes, TIBCO Scribe® Online compares the Most Recent Record Processed value to a datetime value in each Source record. If the datetime value in the Source is newer than the Most Recent Record Processed value, the Source record is selected by the source query and processed by the Solution. Processing only new or updated records reduces the total number of records processed by TIBCO Scribe® Online.
When Solutions run automatically, the TIBCO Scribe® Online Agent updates the Most Recent Record Processed value for you and the value stored by the Agent is used the next time the Solution runs.
You can also choose to modify the Most Recent Record Processed value manually. Typically, you would do this to go further back in time and reprocess records. If you do not use this field carefully, you may cause records to be skipped during the next execution of the Solution.
Both methods for configuring the Most Recent Record Processed are valid. However, TIBCO Scribe® Online uses the last change entered based on the time the change was recorded regardless of whether it was entered by the Agent or manually.
NOTE: If the time on the server where the Agent is running differs from the time on the user's computer, TIBCO Scribe® Online may not correctly determine who made the last change. For example, if the User modifies the value at 1:00 based on their computer time, and the Agent modifies the value a minute before, but the Agent's computer time is 1:03, then TIBCO Scribe® Online would use the value entered by the Agent because the change was recorded at 1:03. If for any reason the changes were recorded with the same time, the Agent change is used.
A new feature included in the January 21st, 2017 TIBCO Scribe® Online release, logs the value of the Most Recent Record Processed when it is stored by the Agent. You can verify the ending datetime entered by the Agent when the Solution last ran by looking at the Agent logs. See
Editing Agent Settings for information on locating the datetime in the Agent log file.
NOTE: When a datetime is configured on the Query Block on the
Block Properties Net Change Tab to query for new and updated records, that configuration is treated as an additional filter. The Net Change datetime filter is appended as an AND to the end of the list of filters configured on the
Block Properties Filter Tab. TIBCO Scribe® Online builds a query combining both the Net Change filter and the filters on the Filter tab. See
Net Change And Filters for an example.
For additional information, see the following in the TIBCO Scribe® Online Help:
Most Recent Record Processed