Configuring a TIBCO Cloud Messaging (TCM) Kafka Service as the Data Source for a TIBCO Cloud Data Stream (TCDS)

Configuring a TIBCO Cloud Messaging (TCM) Kafka Service as the Data Source for a TIBCO Cloud Data Stream (TCDS)

book

Article ID: KB0072492

calendar_today

Updated On:

Products Versions
TIBCO Cloud Data Streams 1.2.0

Description

This article provides guidance on using a TIBCO Cloud Messaging (TCM) Kafka service as the data source for a TIBCO Cloud Data Stream (TCDS). The TCM configuration file is obtained from the TCM web ui, and is used to configure the Data Stream as described in detail below.

Resolution

In the TCM web ui, go to the ' Authentication' screen and select ' Create Role'. Provide a Role Name, and select the Kafka service. Also ensure this role is entitled to subscribe to messages.

create TCM subscriber role

When you are returned to the Authentication screen, you should now see the role you created in your role list. In the ' Configuration File' column, select the option to download the role configuration file ( tcm-config.yaml). This file contains the authentication key for this role, as well as the connection details for the Kafka TCM service.

download TCM config

In the TCDS web ui, select Create New > Apache Kafka, then click ' Continue'.

In the ' Brokers' field, enter the value of the ' kafka_broker' specfied in your tcm-config.yaml. For example:
  tib-sub-****.messaging.cloud.tibco.com:12345

In the ' Properties' section, add the following Kafka client properties:
 
 security.protocol = SASL_SSL sasl.mechanism = PLAIN sasl.jaas.config = org.apache.kafka.common.security.plain.PlainLoginModule required username="<kafka_username>" password="<kafka_password>";

..where <kafka_username> and <kafka_password> correspond to those values specified in the tcm-config.yaml. For example..
 
 sasl.jaas.config = org.apache.kafka.common.security.plain.PlainLoginModule required username="TIB_SUB_*****/channel" password="token:*****";

TCDS kafka data source

Click ' Continue', and specify the topic name. Then click ' Continue' again.

Add schema fields as needed. Then click ' Continue'.

For the Authentication method, choose ' TIBCO Cloud authentication'. Then click ' Continue' then ' Finish'.

Your Data Stream is now configured to consume messages from your TCM Kafka service.

Issue/Introduction

Provides the basic steps needed to configure a TIBCO Cloud Messaging (TCM) Kafka service as the data source for a TIBCO Cloud Data Stream (TCDS).