Hadoop 2.6 Historyserver Configuration

                                           Hadoop 2.6 Historyserver Configuration


1. Add below parameter in yarn-site.xml

[hadoop@adp031 hadoop]$ cat /usr/local/hadoop/hadoop/etc/hadoop/yarn-site.xml

<property>

    <name>yarn.log-aggregation-enable</name>

        <value>true</value>

        </property>

<property>

        <name>yarn.nodemanager.remote-app-log-dir</name>

            <value>/tmp/logs</value>

            </property>

<property>

    <name>yarn.log-aggregation.retain-seconds</name>

        <value>259200</value>

        </property>

<property>

    <name>yarn.log-aggregation.retain-check-interval-seconds</name>

        <value>3600</value>

        </property>

<property>

<name>yarn.log.server.url</name>

<value>http://adp031:19888/jobhistory/logs/</value>

</property>

2. Add Below parameter in mapred-site.xml

[hadoop@adp031 hadoop]$ cat /usr/local/hadoop/hadoop/etc/hadoop/mapred-site.xml

<property>

<name>mapreduce.jobhistory.address </name>

<value>adp031:10020</value>

</property>

<property>

<name>mapreduce.jobhistory.webapp.address</name>

<value>adp031:19888</value>

</property>

<property>

<name>mapreduce.jobhistory.intermediate-done-dir</name>

<value>/mr-history/tmp</value>

</property>

<property>

<name>mapreduce.jobhistory.done-dir</name>

<value>/mr-history/done</value>

</property>

3.  Start historyserver

[hadoop@adp031 hadoop]$ mr-jobhistory-daemon.sh start historyserver

4. Run a job 

yarn  jar /usr/local/hadoop/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.6.0.jar  wordcount /user/hadoop/IN_wordcount /user/hadoop/out_wordcount_12/

5. Go to web UI type http://<history server name>:19888/jobhistory