How to install latest HDP cluster using Ambari

Below steps are some important points while doing installing HDP using Ambari. process was followed on RHEL 7.x on AWS. I have consider 1 ambari node, 1 master node and 2 slaves nodes

1. Collect Information

The fully qualified domain name (FQDN) of each host in your system. The Ambari Cluster Install wizard supports using IP addresses. You can use

$ hostname -f

Start VMs on AWS and jot down below

example
10.0.0.116 ip-10-0-0-116.us-west-2.compute.internal ambari
10.0.0.164 ip-10-0-0-164.us-west-2.compute.internal master1
10.0.0.145 ip-10-0-0-145.us-west-2.compute.internal slave1
10.0.0.123 ip-10-0-0-123.us-west-2.compute.internal slave2
 example
HOSTNAME=ip-10-0-0-116.us-west-2.compute.internal
HOSTNAME=ip-10-0-0-164.us-west-2.compute.internal
HOSTNAME=ip-10-0-0-145.us-west-2.compute.internal
HOSTNAME=ip-10-0-0-123.us-west-2.compute.internal

2.  Set Up Password-less SSH


Steps
1. Generate public and private SSH keys on the Ambari Server host. ssh-keygen
2. Copy the SSH Public Key (id_rsa.pub) to the root account on your target hosts. .ssh/id_rsa .ssh/id_rsa.pub
3. Add the SSH Public Key to the authorized_keys file on your target hosts. cat id_rsa.pub >> authorized_keys
4. Depending on your version of SSH, you may need to set permissions on the .ssh directory (to 700) and the authorized_keys file in that directory (to 600) on the target hosts. chmod 700 ~/.ssh chmod 600 ~/.ssh/authorized_keys
5. From the Ambari Server, make sure you can connect to each host in the cluster using SSH, without having to enter a password. ssh root@ where has the value of each host name in your cluster. 

NOTE: if above does not work simple 'cat id-rsa.pub' from ambari and copy explicitly on other authorized keys file.



3> Enable NTP on the Cluster and on the Browser Host

$ systemctl status firewalld on each hosts


4> Edit the Network Configuration File

vi /etc/sysconfig/network

Modify the HOSTNAME property to set the fully qualified domain name

NETWORKING=yes
HOSTNAME= < copy from step1 on each host >


5> Configuring iptables
systemctl disable firewalld


6>  Disable SELinux and PackageKit and check the umask Value

on each VM
vi /etc/selinux/config

SELINUX=disabled
comment
# SELINUX=enforcing

echo umask 0022 >> /etc/profile


Restart all nodes

shutdown -r now

7> Installing Ambari

#on Ambari server
$ Log in to your host as root.

$ yum install wget

$ wget -nv http://public-repo-1.hortonworks.com/ambari/centos7/2.x/updates/2.6.0.0/ambari.repo -O /etc/yum.repos.d/ambari.repo
yum repolist

$ yum install ambari-server

#start ambari server
ambari-server start

8>
put private key of ambari in ambari console
i.1. cat id_rsa of ambari host

9>

install services as you want on Nodes


END  

Comments

Post a Comment

Popular posts from this blog

Cloud Architecture Notes

Image
The architectural priorities and needs of every app are different, but the four pillars of architecture are an excellent guidepost you can use to make sure that you have given enough attention to every aspect of your application: Security : Safeguarding access and data integrity and meeting regulatory requirements Performance and scalability : Efficiently meeting demand in every scenario Availability and recoverability : Minimizing downtime and avoiding permanent data loss Efficiency and operations : Maximizing maintainability and ensuring requirements are met with monitoring A layered approach to security Defense in depth is a strategy that employs a series of mechanisms to slow the advance of an attack aimed at acquiring unauthorized access to information The common principles used to define a security posture are confidentiality, integrity, and availability, known collectively as CIA. Confidentiality - Principle of least privilege. Restricts access to informa
Read more

Qlik Sense Important Links

Qlik Sense learning https://learning.qlik.com/ https://www.qlik.com/us/services/training/self-paced-learning Qlik sense pricing   https://www.capterra.com/p/145530/QlikSense/#pricing https://www.qlik.com/us/pricing/qlik-sense-client-managed Qlik Sense Server Installation Document preview of Qlik Sense Server Installation Step By Step Guide.pdf https://community.qlik.com/t5/Documents/Qlik-Sense-Server-Installation-Step-By-Step-Guide/ta-p/1480562 https://community.qlik.com/t5/New-to-Qlik-Sense/how-to-download-Qlik-Sense-server/td-p/869140 Support Portal https://support.qlik.com/QS_Home_Page Qlik FIPS Support FIPS mode is not supported out of the box for Qlik Sense, QlikView, and Qlik NPrinting. Workarounds exist for NPrinting and Sense.  For general information about FIPS and Microsoft's statement around it, see  Microsoft's Security Guidance blog. https://community.qlik.com/t5/Knowledge-Base/Qlik-Software-and-FIPS-mode/ta-p/1717239 https://docs.microsoft.com/en-US/windows/securi
Read more