Question:  Can you explain how the TIBCO Scribe® Online Connector For Microsoft SQL Server pulls in records from SQL for processing?  Does it pull the entire set of records that meet the criteria for the Query Block before beginning to process them through the Map, or does it pull in a subset of the overall dataset and process it before pulling in another subset of data to process?  Is there any threading involved?


Answer:  The TIBCO Scribe® Online Connector For Microsoft SQL Server first sends the query command to the SQL server using the System.Data.SqlClient.SqlCommand.  After the query command completes, the Connector uses the SqlDataReader object to read the stream and pull each record one by one as it is requested by the TIBCO Scribe® Online Core platform.

All records are processed serially for each Map.  No threading is involved.

In summary, the TIBCO Scribe® Online Connector For Microsoft SQL Server submits the entire Query to the SQL server, but records are read from the server and processed by the target operation blocks one by one.