How to install latest HDP cluster using Ambari

Below steps are some important points while doing installing HDP using Ambari. process was followed on RHEL 7.x on AWS. I have consider 1 ambari node, 1 master node and 2 slaves nodes

1. Collect Information

The fully qualified domain name (FQDN) of each host in your system. The Ambari Cluster Install wizard supports using IP addresses. You can use

$ hostname -f

Start VMs on AWS and jot down below

example
10.0.0.116 ip-10-0-0-116.us-west-2.compute.internal ambari
10.0.0.164 ip-10-0-0-164.us-west-2.compute.internal master1
10.0.0.145 ip-10-0-0-145.us-west-2.compute.internal slave1
10.0.0.123 ip-10-0-0-123.us-west-2.compute.internal slave2
 example
HOSTNAME=ip-10-0-0-116.us-west-2.compute.internal
HOSTNAME=ip-10-0-0-164.us-west-2.compute.internal
HOSTNAME=ip-10-0-0-145.us-west-2.compute.internal
HOSTNAME=ip-10-0-0-123.us-west-2.compute.internal

2.  Set Up Password-less SSH


Steps
1. Generate public and private SSH keys on the Ambari Server host. ssh-keygen
2. Copy the SSH Public Key (id_rsa.pub) to the root account on your target hosts. .ssh/id_rsa .ssh/id_rsa.pub
3. Add the SSH Public Key to the authorized_keys file on your target hosts. cat id_rsa.pub >> authorized_keys
4. Depending on your version of SSH, you may need to set permissions on the .ssh directory (to 700) and the authorized_keys file in that directory (to 600) on the target hosts. chmod 700 ~/.ssh chmod 600 ~/.ssh/authorized_keys
5. From the Ambari Server, make sure you can connect to each host in the cluster using SSH, without having to enter a password. ssh root@ where has the value of each host name in your cluster. 

NOTE: if above does not work simple 'cat id-rsa.pub' from ambari and copy explicitly on other authorized keys file.



3> Enable NTP on the Cluster and on the Browser Host

$ systemctl status firewalld on each hosts


4> Edit the Network Configuration File

vi /etc/sysconfig/network

Modify the HOSTNAME property to set the fully qualified domain name

NETWORKING=yes
HOSTNAME= < copy from step1 on each host >


5> Configuring iptables
systemctl disable firewalld


6>  Disable SELinux and PackageKit and check the umask Value

on each VM
vi /etc/selinux/config

SELINUX=disabled
comment
# SELINUX=enforcing

echo umask 0022 >> /etc/profile


Restart all nodes

shutdown -r now

7> Installing Ambari

#on Ambari server
$ Log in to your host as root.

$ yum install wget

$ wget -nv http://public-repo-1.hortonworks.com/ambari/centos7/2.x/updates/2.6.0.0/ambari.repo -O /etc/yum.repos.d/ambari.repo
yum repolist

$ yum install ambari-server

#start ambari server
ambari-server start

8>
put private key of ambari in ambari console
i.1. cat id_rsa of ambari host

9>

install services as you want on Nodes


END  

Comments

Post a Comment

Popular posts from this blog

Qlik Sense Important Links

Qlik Sense learning https://learning.qlik.com/ https://www.qlik.com/us/services/training/self-paced-learning Qlik sense pricing   https://www.capterra.com/p/145530/QlikSense/#pricing https://www.qlik.com/us/pricing/qlik-sense-client-managed Qlik Sense Server Installation Document preview of Qlik Sense Server Installation Step By Step Guide.pdf https://community.qlik.com/t5/Documents/Qlik-Sense-Server-Installation-Step-By-Step-Guide/ta-p/1480562 https://community.qlik.com/t5/New-to-Qlik-Sense/how-to-download-Qlik-Sense-server/td-p/869140 Support Portal https://support.qlik.com/QS_Home_Page Qlik FIPS Support FIPS mode is not supported out of the box for Qlik Sense, QlikView, and Qlik NPrinting. Workarounds exist for NPrinting and Sense.  For general information about FIPS and Microsoft's statement around it, see  Microsoft's Security Guidance blog. https://community.qlik.com/t5/Knowledge-Base/Qlik-Software-and-FIPS-mode/ta-p/1717239 https://docs.microsoft.com/en-US/windows/...
Read more

Cloud Architecture Notes

Image
The architectural priorities and needs of every app are different, but the four pillars of architecture are an excellent guidepost you can use to make sure that you have given enough attention to every aspect of your application: Security : Safeguarding access and data integrity and meeting regulatory requirements Performance and scalability : Efficiently meeting demand in every scenario Availability and recoverability : Minimizing downtime and avoiding permanent data loss Efficiency and operations : Maximizing maintainability and ensuring requirements are met with monitoring A layered approach to security Defense in depth is a strategy that employs a series of mechanisms to slow the advance of an attack aimed at acquiring unauthorized access to information The common principles used to define a security posture are confidentiality, integrity, and availability, known collectively as CIA. Confidentiality - Principle of least privilege. Restricts access to informa...
Read more

AWS Rout53 NS records do not match with whois dns records OR Your site NOT working with registered domain name? Check this...

  Log in to your AWS web console Select Route53 service Select Hosted Zones in the left pane Select domain name (but do not click on the domain name, just select the radio button) Notice the 4 name servers in the right pane. Next, go to domain registrar site (in your case stay in Route53), log in and configure name servers for your domain. In Route53: select 'Registered domains' in the left pane, click on your domain name, verify that in the upper right you have name servers from step 5, if they don't exactly match, click 'Add/Edit Name servers' and enter name servers from step 5) After this you will receive email on your registered email id with AWS. Once the sync os done you will get notified. After notification you can try your ULR <some-name>.com or www.<some-name>.com "A" records created during route 53
Read more