How to resolve issue with log pod deployment when Elastic forwarding is enabled in TIBCO Cloud API Management- Local Edition 5.6.1?

How to resolve issue with log pod deployment when Elastic forwarding is enabled in TIBCO Cloud API Management- Local Edition 5.6.1?

book

Article ID: KB0071477

calendar_today

Updated On:

Products Versions
TIBCO Cloud API Management - Local Edition 5.6.1

Description

When config for Elastic forwarding is enabled, fluentd does not start with the below error:
---------
2023-04-21 16:13:36 +0000 [error]: config error file=“/etc/td-agent/td-agent.conf” error_class=Fluent::NotFoundPluginError error=“Unknown filter plugin ‘tdagent_record’. Run ‘gem search -rd fluent-plugin’ to find plugins”
---------

The issue is because of dependency of ruby gem fluent-elastic-plugin on gem elasticsearch plugin.
The gem spec version does not specify the version of elasticsearch plugin which was updated after 561 GA date.
The version of fluent-elastic plugin does not work with updated elasticsearch plugin.

Issue/Introduction

This article provides info and a workaround for this issue in CAPIM-LE 5.6.1

Environment

All Supported Platforms

Resolution

Here are the steps to resolve this:
1. Login to installer container

docker exec -it tml-installer bash 

2. Navigate to log image build scripts folder

cd /var/jenkins_home/docker-build/tmgc-log/install 

3. Edit log TPCL installs script

vi log-tpcl.sh 

4. Search for text "adding elastic-search plugin"

5. Remove version from gem uninstall steps

BEFORE REMOVAL

=================Before===========================
gem install fluent-plugin-elasticsearch -v 5.2.4

 
gem uninstall elasticsearch -v 8.6.0 -I

 
gem uninstall elasticsearch-api -v 8.6.0 -I

 
gem uninstall elastic-transport -v 8.2.0 -I 

AFTER REMOVAL

gem install fluent-plugin-elasticsearch -v 5.2.4

 
gem uninstall elasticsearch -I

 
gem uninstall elasticsearch-api -I

 
gem uninstall elastic-transport -I 

6. Build the Log image

7. Proceed with deployment

Additional Information

EIN-10903