When config for Elastic forwarding is enabled, fluentd does not start with the below error:
---------
2023-04-21 16:13:36 +0000 [error]: config error file=“/etc/td-agent/td-agent.conf” error_class=Fluent::NotFoundPluginError error=“Unknown filter plugin ‘tdagent_record’. Run ‘gem search -rd fluent-plugin’ to find plugins”
---------

The issue is because of dependency of ruby gem fluent-elastic-plugin on gem elasticsearch plugin.
The gem spec version does not specify the version of elasticsearch plugin which was updated after 561 GA date.
The version of fluent-elastic plugin does not work with updated elasticsearch plugin.

Here are the steps to resolve this:
1. Login to installer container

docker exec -it tml-installer bash 

2. Navigate to log image build scripts folder

cd /var/jenkins_home/docker-build/tmgc-log/install 

3. Edit log TPCL installs script

vi log-tpcl.sh 

4. Search for text "adding elastic-search plugin"

5. Remove version from gem uninstall steps

BEFORE REMOVAL

=================Before===========================

gem install fluent-plugin-elasticsearch -v 5.2.4

gem uninstall elasticsearch -v 8.6.0 -I

gem uninstall elasticsearch-api -v 8.6.0 -I

gem uninstall elastic-transport -v 8.2.0 -I 

AFTER REMOVAL

gem install fluent-plugin-elasticsearch -v 5.2.4

gem uninstall elasticsearch -I

gem uninstall elasticsearch-api -I

gem uninstall elastic-transport -I 

6. Build the Log image

7. Proceed with deployment