How to assign yarn job to specific queue on TIBCO Data Science Team Studio?

How to assign yarn job to specific queue on TIBCO Data Science Team Studio?

book

Article ID: KB0077299

calendar_today

Updated On:

Products Versions
Spotfire Data Science 6.4.0, 6.4.1,6.5,6.3.2

Description

How to assign yarn job to specific queue on TIBCO Data Science Team Studio?

Issue/Introduction

How to assign yarn job to specific queue on TIBCO Data Science Team Studio?

Environment

Linux

Resolution

If the Hadoop cluster has Hadoop Capacity Scheduler enabled, then specific queues with limitations on cluster resources can be created. Add alpine.mapred.mapreduce.job.queuename = "queue name" parameter to the additional parameters of the data source configuration. 


 

Additional Information

The following link will provide more information about the Hadoop Capacity Schedule
https://hadoop.apache.org/docs/r2.7.1/hadoop-yarn/hadoop-yarn-site/CapacityScheduler.html