Hadoop Eco System Installation – Contents

Here is the list of pages, that can help you to install Hadoop and its ecosystem products

Distributed HBASE & ZooKeeper Installation and Configuration

Hue Installation and Configuration

Hue Installation and Configuration

Hi,

Here is the outcome of the final exercise of Unit 2 of my training.

2000px-wikipedia-logo-v2-en-svg1Hue is an open-source Web interface that supports Apache Hadoop and its ecosystem, licensed under the Apache v2 license.

This is one of the painful exercise we have done so far in the Hadoop eco system. Because it uses python compilation process as part of the installment. It has n number of dependencies as well. Hence we need to browse to find the right dependencies to make it working. I have given those dependencies below.

Download and extraction

hadoop@gandhari:~$ wget https://archive.cloudera.com/cdh5/cdh/5/hue-3.9.0-cdh5.5.1.tar.gz

hadoop@gandhari:~$ gunzip hue-3.9.0-cdh5.5.1.tar.gz

hadoop@gandhari:~$ tar -xvf hue-3.9.0-cdh5.5.1.tar

hadoop@gandhari:~$ ln -s hue-3.9.0-cdh5.5.1/ hue

Make process

hadoop@gandhari:~/hue$ sudo apt-get install libxml2-dev libxslt1-dev

hadoop@gandhari:~/hue$ sudo apt-get install lib32z1-dev

hadoop@gandhari:~/hue$ sudo apt-get install libssl-dev

hadoop@gandhari:~/hue$ sudo apt-get install python2.7-dev

hadoop@gandhari:~/hue$ sudo apt-get install python-dev

hadoop@gandhari:~/hue$ sudo apt-get install gcc libxml2-dev libxslt-dev libsasl2-dev libsasl2-modules-gssapi-mit libmysqlclient-dev python-dev python-setuptools python-simplejson libsqlite3-dev ant

hadoop@gandhari:~/hue$ sudo ln -s /usr/lib/python2.7/plat-*/_sysconfigdata_nd.py /usr/lib/python2.7/

hadoop@gandhari:~/hue$ sudo apt-get installpython2.7-dev \
make\
libkrb5-dev \
libxml2-dev \
libffi-dev \
libxslt-dev \
libsqlite3-dev \
libssl-dev \
libldap2-dev \
python-pip
hadoop@gandhari:~/hue$ sudo apt-get install ant gcc g++ libkrb5-dev libffi-dev libmysqlclient-dev libssl-dev libsasl2-dev libsasl2-modules-gssapi-mit libsqlite3-dev libtidy-0.99-0 libxml2-dev libxslt-dev make libldap2-dev maven python-dev python-setuptools libgmp3-dev

hadoop@gandhari:~/hue$ make apps

Pls make sure the make process is completed successfully without any error.

Hue console configuration

hadoop@gandhari:~/hue$ ./build/env/bin/hue runserver

Starting development server at http://127.0.0.1:8000/

hue

hadoop@gandhari:~/hue$ vi desktop/conf/hue.ini

[[yarn_clusters]]
[[[default]]]
resourcemanager_host=gandhari
submit_to=True
resourcemanager_api_url=http://gandhari:8088
history_server_api_url=http://gandhari:19888

[beeswax]

hive_server_host=gandhari

hadoop@gandhari:~/hive/bin$ hive –service metastore
hadoop@gandhari:~/hive/bin$ hive –service hiveserver2

[hadoop]

fs_defaultfs=hdfs://gandhari:9000
webhdfs_url=http://gandhari:50070/webhdfs/v1
resourcemanager_host=gandhari
resourcemanager_api_url=http://gandhari:8088
history_server_api_url=http://gandhari:19888

hue-hive

hue