WHERE DO I START?
You are here:Integrations > Hadoop

Hadoop

Hadoop is an open-source framework that distributes storage and processing of large data sets across computer clusters. Netuitive can be used to monitor the performance of your Hadoop systems.

Configuration

Collector Configuration

  1. Navigate to the collectors folder.
    Note   The default location is /opt/netuitive-agent/conf/collectors.
  2. Create and add a file named HadoopCollector.conf.
  3. Add the following lines to the file:
    enabled = True
    metrics = /var/log/hadoop/*-metrics.out,
  4. Save the configuration file.
  5. Restart the Netuitive Agent.

Additional Configuration Options

Collector Options

Option Default Description
byte_unit byte Default numeric output(s).
enabled False Enable collecting Hadoop metrics.
measure_collector_time False Measure the collector's run time in milliseconds.
metrics /var/log/hadoop/*-metrics.out, List of filepaths to process metrics from.
metrics_blacklist None Regex list to match metrics to block. Mutually exclusive with metrics_whitelist option.
metrics_whitelist None Regex list to match metrics to transmit. Mutually exclusive with metrics_blacklist option.
truncate False Enable truncating metric files after reading them.

Dependencies

OS

Redhat 6 and 7
CentOS 6 and 7
Amazon Linux (latest)
Ubuntu 12, 14, 15, and 16
Debian 7, 8, and 9

Miscellaneous

Linux Agent
Hadoop

Metrics

Fully Qualified Name (FQN) Statistic Units Min Max Sparse Data Strategy (SDS) BASE CORR UTIL
elasticsearch.cache.filter.evictions max count 0 none none