Streams YARN Configuration

The configuration file which needs to be present in the user's home directly contains various control knobs for the user to adjust. These are:

• streams.yarn.am.port: Thrift port for the Streams Application Master (StreamsAM)
• streams.yarn.am.cpu: The number of CPUs for StreamsAM container
• streams.yarn.am.mem: The amount of memory (in MBs) for StreamsAM container
• streams.yarn.am.heartbeat: The interval (in ms) for StreamsAM to Resource Manager heartbeat
• streams.yarn.resources.<x>.num: The number of containers for Streams service x, where x is nsr, srm, sam, sch, aas, sws, and hc.
• streams.yarn.resources.<x>.cpu: The number of CPUs for service x container
• streams.yarn.resources.<x>.mem: The amount of memory (in MBs) for service x container
• streams.yarn.resources.<x>.priority: The priority for service x container
• streams.yarn.instance.timeout: The timeout (in ms) for starting Streams services