How to Configure YARN Fair Scheduler on a MAPR Cluster

1) Add below line is yarn-site.xml

<property><name>yarn.scheduler.fair.allocation.file</name><value>/opt/mapr/hadoop/hadoop-2.7.0/etc/hadoop/fair-scheduler.xml</value></property>

<property><name>yarn.acl.enable</name><value>true</value></property>

<property><name>yarn.admin.acl</name><value>mapr mapr</value></property>

<property><name>yarn.resourcemanager.scheduler.class</name><value>org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.FairScheduler</value></property>

2) Configure fair scheduler:

[root@mfs071 ~]#  vim /opt/mapr/hadoop/hadoop-2.7.0/etc/hadoop/fair-scheduler.xml

<allocations>


 <queuePlacementPolicy>
                 <rule name="specified" create="false"/>
                <rule name="primaryGroup" create="false"/>
                <rule name="secondaryGroupExistingQueue" create="false"/>
                <!--Create interactive queue for generic shape group?-->
                <rule name="user" create="false" />
                 <rule name="reject" />
  </queuePlacementPolicy>
  <queue name="root">
    <minResources>2000 mb, 1 vcores,1 disks</minResources>
    <maxResources>5000 mb, 1 vcores,2 disks</maxResources>
    <maxRunningApps>10</maxRunningApps>
    <weight>2.0</weight>
    <schedulingPolicy>fair</schedulingPolicy>
    <aclSubmitApps> </aclSubmitApps>
    <aclAdministerApps>root</aclAdministerApps>
  <!--  <aclAdministerApps>mapr mapr</aclAdministerApps> -->
    <queue name="sample_sub_queue1">
        <minResources>1024 mb, 1 vcores,1 disks</minResources>
        <aclSubmitApps>nitin</aclSubmitApps>
        <aclAdministerApps>root</aclAdministerApps>
    </queue>
    <queue name="sample_sub_queue2">
        <minResources>1024 mb, 1 vcores,1 disks</minResources>
        <aclSubmitApps>mapr</aclSubmitApps>
        <aclAdministerApps>root</aclAdministerApps>
    </queue>
    <queue name="sample_sub_queue3">
        <minResources>1024 mb, 1 vcores,1 disks</minResources>
        <aclSubmitApps>kunal</aclSubmitApps>
        <aclAdministerApps>root</aclAdministerApps>
    </queue>
</queue>

</allocations>


3) Restart resourcemanager

4) Login via nitin and submit job to  sample_sub_queue3.

[nitin@mfs071 ~]$ yarn jar "/opt/mapr/hadoop/hadoop-2.7.0/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.0-mapr-1602.jar" teragen  -Dmapred.map.tasks=20 -Dmapred.reduce.tasks=0 -Dmapred.job.queue.name=sample_sub_queue3 1000 /tmp/teragen1

Job will fail with following exception

java.io.IOException: org.apache.hadoop.yarn.exceptions.YarnException: Failed to submit application_1460957957156_0002 to YARN : User nitin cannot submit applications to queue root.sample_sub_queue3

5) Try to submit job in sample_sub_queue1. It will be successful.

6) Login via kunal and try to kill the job.

[kunal@mfs072 ~]$ yarn application -kill application_1460957957156_0001

Job will fail with following exception

Exception in thread "main" org.apache.hadoop.yarn.exceptions.YarnException: java.security.AccessControlException: User kunal cannot perform operation MODIFY_APP on application_1460957957156_0001

Hiveserver2 high availability from beeline

Step 1:

 Edit hive-site.xml on every hs2 node

<property>
        <name>hive.server2.support.dynamic.service.discovery</name>
        <value>true</value>
</property>


<property>
        <name>hive.zookeeper.quorum</name>
        <value>mfs071:5181,mfs072:5181,mfs073:5181</value>
</property>

<property>
        <name>hive.server2.zookeeper.namespace</name>
        <value>hiveserver2</value>
</property>


Steps 2

Restart hs2


Steps 3

 Connect via beeline

!connect jdbc:hive2://mfs071:5181,mfs072:5181,mfs073:5181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2


[mapr@mfs072 ~]$ /opt/mapr/hive/hive-1.2/bin/beeline
Beeline version 1.2.0-mapr-1601 by Apache Hive
beeline> !connect jdbc:hive2://mfs071:5181,mfs072:5181,mfs073:5181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2
Connecting to jdbc:hive2://mfs071:5181,mfs072:5181,mfs073:5181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2
Enter username for jdbc:hive2://mfs071:5181,mfs072:5181,mfs073:5181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2: mapr
Enter password for jdbc:hive2://mfs071:5181,mfs072:5181,mfs073:5181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2: ****
Connected to: Apache Hive (version 1.2.0-mapr-1601)
Driver: Hive JDBC (version 1.2.0-mapr-1601)
Transaction isolation: TRANSACTION_REPEATABLE_READ
0: jdbc:hive2://mfs071:5181,mfs072:5181,mfs07> show databases;
+----------------+--+
| database_name  |
+----------------+--+
| default        |
+----------------+--+
1 row selected (0.178 seconds)

Configure HUE with OpenLdap

Step 1:

Add below lines in ldap section in hue.ini

[[ldap]]
    base_dn="dc=tuxhub,dc=com"
    ldap_url=ldap://adp034.tuxhub.com:389
    use_start_tls=false
    bind_dn="uid=nitin,ou=Users,dc=tuxhub,dc=com"
    bind_password=nitin
    ldap_username_pattern="uid=<username>,ou=Users,dc=tuxhub,dc=com"
    search_bind_authentication=false

Impala openldap configuration

Step 1:

Add below line in impala env.sh


[root@mfs022 ~]# vim /opt/mapr/impala/impala-1.4.1/conf/env.sh
 
   IMPALA_SERVER_ARGS=
 
    -enable_ldap_auth \
    -ldap_uri ldap://adp034.tuxhub.com:389 \
    -ldap_bind_pattern "uid=#UID,ou=Users,dc=tuxhub,dc=com" \

Step 2 :

Connect to imapla shell 

[root@mfs022 ~]# impala-shell -l -u nitin

Starting Impala Shell using LDAP-based authentication

LDAP password for nitin:

Connected to mfs022.tuxhub.com:21000

Server version: impalad version 1.4.1 RELEASE (build 2b626c8e9f4c666d23872c228cf43daae4c9acbb)

Welcome to the Impala shell. Press TAB twice to see a list of available commands.

Copyright (c) 2012 Cloudera, Inc. All rights reserved.

(Shell build version: Impala Shell v1.4.1 (2b626c8) built on Thu Feb  5 14:53:44 PST 2015)

[mfs022.tuxhub.com:21000] >

Impala through a Proxy for High Availability

Step 1
       
       Installing HAProxy

       [root@mfs021 ~]# yum install haproxy

Steps 2

      Edit Config file for haproxy

      [root@mfs021 ~]# cat /etc/haproxy/haproxy.cfg

#---------------------------------------------------------------------
# Example configuration for a possible web application.  See the
# full configuration options online.
#
#   http://haproxy.1wt.eu/download/1.4/doc/configuration.txt
#
#---------------------------------------------------------------------

#---------------------------------------------------------------------
# Global settings
#---------------------------------------------------------------------
global
    # to have these messages end up in /var/log/haproxy.log you will
    # need to:
    #
    # 1) configure syslog to accept network log events.  This is done
    #    by adding the '-r' option to the SYSLOGD_OPTIONS in
    #    /etc/sysconfig/syslog
    #
    # 2) configure local2 events to go to the /var/log/haproxy.log
    #   file. A line like the following can be added to
    #   /etc/sysconfig/syslog
    #
    #    local2.*                       /var/log/haproxy.log
    #
    log         127.0.0.1 local2

    chroot      /var/lib/haproxy
    pidfile     /var/run/haproxy.pid
    maxconn     4000
    user        haproxy
    group       haproxy
    daemon

    # turn on stats unix socket
    stats socket /var/lib/haproxy/stats

#---------------------------------------------------------------------
# common defaults that all the 'listen' and 'backend' sections will
# use if not designated in their block
##---------------------------------------------------------------------

defaults
    mode                    tcp
    log                     global
    retries                 3
    maxconn                 3000
    timeout connect 5000ms
    timeout client 50000ms
    timeout server 50000ms

#---------------------------------------------------------------------
# main frontend which proxys to the backends
#---------------------------------------------------------------------
frontend  main *:5000
    acl url_static       path_beg       -i /static /images /javascript /stylesheets
    acl url_static       path_end       -i .jpg .gif .png .css .js

    use_backend static          if url_static
    default_backend             impala

#---------------------------------------------------------------------
# static backend for serving up images, stylesheets and such
#---------------------------------------------------------------------
backend static
    balance     roundrobin
    server      static 127.0.0.1:4331 check

#---------------------------------------------------------------------
# round robin balancing between the various backends
#---------------------------------------------------------------------

backend impala
    mode tcp
    option tcplog
    balance leastconn

    server impala1 mfs022.tuxhub.com:21000
    server impala2 mfs023.tuxhub.com:21000

Step 3 :

       Connect to impala:

root@mfs021 ~]# impala-shell

Starting Impala Shell without Kerberos authentication

Error connecting: TTransportException, Could not connect to mfs021.tuxhub.com:21000

Welcome to the Impala shell. Press TAB twice to see a list of available commands.

Copyright (c) 2012 Cloudera, Inc. All rights reserved.

(Shell build version: Impala Shell v1.4.1 (2b626c8) built on Thu Feb  5 14:53:44 PST 2015)

[Not connected] > connect localhost:5000;

Connected to localhost:5000

Server version: impalad version 1.4.1 RELEASE (build 2b626c8e9f4c666d23872c228cf43daae4c9acbb)

[localhost:5000] > show tables;

     

  

Apache sentry configuration on MapR Hadoop

Step  1) Please add below property in hive-site.xml

[root@mfs021 ~]# vim /opt/mapr/hive/hive-0.13/conf/hive-site.xml

<property>
  <name>hive.server2.session.hook</name>
  <value>org.apache.sentry.binding.hive.HiveAuthzBindingSessionHook</value>
</property>

<property>
  <name>hive.sentry.conf.url</name>
   <value>file:///opt/mapr/sentry/sentry-1.4.0/conf/sentry-site.xml</value>
 </property>

<property>
  <name>hive.security.authorization.task.factory</name>
  <value>org.apache.sentry.binding.hive.SentryHiveAuthorizationTaskFactoryImpl</value>
</property>

<property>
  <name> hive.metastore.execute.setugi </name>
   <value> true </value>
 </property>

Step 2) Please add below property in sentry-site.xml

[root@mfs021 ~]# vim /opt/mapr/sentry/sentry-1.4.0/conf/sentry-site.xml


<property>
        <name>sentry.hive.provider.backend</name>
        <value>org.apache.sentry.provider.file.SimpleFileProviderBackend</value>
      </property>

    <property>
        <name>sentry.hive.provider.resource</name>
        <value>file:///opt/mapr/sentry/sentry-1.4.0/conf/global-policy.ini</value>
    </property>

Step 3) Please add below property in global-policy.ini

[root@mfs021 ~]# vim /opt/mapr/sentry/sentry-1.4.0/conf/global-policy.ini

[groups]
mapr = admin_role
sentry_user = user_role

[roles]
admin_role = server=HS2
user_role = server=HS2->db=default->table=*->action=Select


Step 4) Add user and group

groupadd sentry_user
useradd -G sentry_user sentry_user1


Stpe 5) Check you configuration




[mapr@maprdemo ~]$ /opt/mapr/hive/hive-0.13/bin/beeline
beeline> !connect jdbc:hive2://localhost:10000
scan complete in 4ms
Connecting to jdbc:hive2://localhost:10000
Enter username for jdbc:hive2://localhost:10000: sentry_user1
Enter password for jdbc:hive2://localhost:10000: *
Connected to: Apache Hive (version 0.13.0-mapr-1510)
Driver: Hive JDBC (version 0.13.0-mapr-1510)
Transaction isolation: TRANSACTION_REPEATABLE_READ
0: jdbc:hive2://localhost:10000> show tables;
+-----------+
| tab_name  |
+-----------+
+-----------+
No rows selected (0.409 seconds)
0: jdbc:hive2://localhost:10000> create table xyz(id int);
Error: Error while compiling statement: FAILED: SemanticException No valid privileges
 Required privileges for this query: Server=HS2->Db=default->action=*; (state=42000,code=40000)
0: jdbc:hive2://localhost:10000> show tables;
+-----------+
| tab_name  |
+-----------+
| mno       |
+-----------+
1 row selected (0.346 seconds)
0: jdbc:hive2://localhost:10000> drop table mno;
Error: Error while compiling statement: FAILED: SemanticException No valid privileges
 Required privileges for this query: Server=HS2->Db=default->Table=mno->action=*; (state=42000,code=40000)
0: jdbc:hive2://localhost:10000> select * from mno;
+---------+
| mno.id  |
+---------+
+---------+
No rows selected (0.616 seconds)
0: jdbc:hive2://localhost:10000>

Hive configuration to access hiveserver2

<property>
<name>hive.support.concurrency</name>
<value>true</value>
</property>

<property>
<name>hive.zookeeper.quorum</name>
<value>adp031.tuxhub.com</value>
</property>

<property>
<name>hive.server2.thrift.port</name>
<value>10000</value>
</property>