Step-by-step upgrades to Cloudera Manager and CDH

# wget -r --no-parent --reject "index.html*" "https://archive.cloudera.com/cm5/redhat/6/x86_64/cm/5.5/"

# wget "https://archive.cloudera.com/cm5/redhat/6/x86_64/cm/RPM-GPG-KEY-cloudera"

2. Copy downloaded files to pub/repos/cloudera-manager directory on Local Repository Host. After that start a local web server with pub/repos root directory. You may use any webserver including Python SimpleHTTPServer or Apache. Following are steps to use the SimpleHTTPServer:

# cd pub/repos

# nohup python -m SimpleHTTPServer 8000 &

Expected output for https://Local Repository Host:8000/pub/repos/cloudera-manager

Expected output for https://Local Repository Host:8000/pub/repos/cloudera-manager/RPMS/x86_64

3. Make sure the local repository for Cloudera Manager is set as:

$ cat /etc/yum.repos.d/cloudera-manager.repo [cloudera-manager] name=Cloudera Manager package mirror baseurl=https://Local Repository Host:8000/pub/repos/cloudera-manager gpgkey=https://Local Repository Host:8000/pub/repos/cloudera-manager/RPM-GPG-KEY-cloudera gpgcheck=1

4. Log on to Cloudera Manager. Stop Cloudera Management Service:

5. Make sure all services are stopped. Sample screens after stopping below:

6. Stop the Hadoop Cluster:

7. SSH to Cloudera Manager Server. Stop Cloudera Manager Service:

# sudo service cloudera-scm-server status cloudera-scm-server (pid 6963) is running... # sudo service cloudera-scm-server stop Stopping cloudera-scm-server: [ OK ] # sudo service cloudera-scm-server status cloudera-scm-server is stopped

8. Before proceeding with the upgrade make sure you backup the Cloudera Manager Databases used by CDH services like Hive Metastore, Oozie, Sentry etc.

9. When you are ready to upgrade issue command to upgrade Cloudera Manager:

# yum upgrade cloudera-manager-server cloudera-manager-daemons

Make sure the Upgrade Version for Cloudera Manager is as below:

10. To verify if the upgrade is successful issue the following command:

# rpm -qa 'cloudera-manager-*' cloudera-manager-daemons-5.5.0-1.cm550.p0.61.el6.x86_64 cloudera-manager-agent-5.5.0-1.cm550.p0.61.el6.x86_64 cloudera-manager-server-5.5.0-1.cm550.p0.61.el6.x86_64

11. Start the Cloudera Manager:

# service cloudera-scm-server start Starting cloudera-scm-server: [ OK ]

12. Monitor the Cloudera Manager Server Log for errors. The Cloudera Manager Server console is ready for use once you see the "Started Jetty Server" message in the log:

# tail -f /var/log/cloudera-scm-server/cloudera-scm-server.log

13. Log on to Cloudera Manager. You should now see the following screen. Note the running version:

14. Choose Option as below to upgrade Cloudera Manager Agents. Press Continue:

15. Choose Custom Repository:

Press Continue.

17. Provide SSH credentials and Press Continue:

18. Cloudera Manager will now upgrade the Agents:

19. Verify Completion. Press Continue:

20. Inspect Hosts for Correctness. Press Continue:

21. You should now see a Confirmation Screen as below:

22. Upgrade Cloudera Management Service. Press Continue:

23. Confirm Restart of Cloudera Management Service:

24. Verify Cloudera Management Service restarted. Press Finish:

25. On the Cloudera Manager Home Screen. Choose Deploy Client Configuration:

26. Verify Client Configurations Deployed:

27. Start the Cluster:

28. Verify Services on the Cluster are Active:

29. Verify Cloudera Manager Version:

30. Verify Agents Upgraded. Issue the following commands on all nodes:

# rpm -qa 'cloudera-manager-*' cloudera-manager-daemons-5.5.0-1.cm550.p0.61.el6.x86_64 cloudera-manager-agent-5.5.0-1.cm550.p0.61.el6.x86_64

31. Congratulations. Upgrade of Cloudera Manager was successful:

Now that the Cloudera Manager has been upgraded lets upgrade CDH to version 5.5.

1. Download latest version of CDH from link below on Local Repository Host:

wget https://archive.cloudera.com/cdh5/parcels/5.5/CDH-5.5.0-1.cdh5.5.0.p0.8-el6.parcel wget https://archive.cloudera.com/cdh5/parcels/5.5/CDH-5.5.0-1.cdh5.5.0.p0.8-el6.parcel.sha1 wget https://archive.cloudera.com/cdh5/parcels/5.5//manifest.json

2. Create/Refresh the local repository for Cloudera Manager by copying the downloaded files to pub/repos/cloudera-cdh5/ directory on Local Repository Host. Expected output for https://Local Repository Host:8000/pub/repos/cloudera-cdh5/

3. Back up HDFS metadata using the following command:

$ whoami hdfs $ hdfs dfsadmin -fetchImage ~ 15/11/27 19:23:58 INFO namenode.TransferFsImage: Opening connection to https://ip-10-169-250-118.ec2.internal:50070/imagetransfer?getimage=1&txid=latest 15/11/27 19:23:58 INFO namenode.TransferFsImage: Image Transfer timeout configured to 60000 milliseconds 15/11/27 19:23:58 INFO namenode.TransferFsImage: Transfer took 0.09s at 2715.91 KB/s $ ls -l total 244 -rw-rw-r--. 1 hdfs hdfs 244838 Nov 27 19:23 fsimage_0000000000000015418

4. Backup databases used for the various CDH services. The following screen shows the databases details used for various services like Oozie, HUE, Sentry etc:

5. Log on to Cloudera Manager.

6. Verify the parcel download setting is pointing to the local repository for CDH. Press the Parcels icon on the Cloudera Manager Home Page. Press Edit settings:

7. Choose the following Option to start upgrade of CDH:

8. Choose version 5.5:

9. Make sure you have backed up all databases:

10. The following screen indicates that we are all set to proceed. Press Continue:

11. CDH Version 5.5 parcels will now be downloaded, distributed to all nodes and unpacked. Press Continue:

12. Hosts will be inspected for correctness. Press Continue:

13. Verify that no party is using the HH-TEST Cluster. Choose Full Cluster Restart. Press Continue:

14. The HH-TEST cluster will now be stopped. Upgraded and restarted. Press Continue:

15. Confirmation screen show now show the upgraded version of CDH. Press Continue:

16. Review additional post-upgrade instructions. Press Finish.

17. Verify CDH version on Cloudera Manager Home Page:

18. Verify CDH version on back-end. SSH to any node in the cluster:

$ hadoop version Hadoop 2.6.0-cdh5.5.0 Subversion https://github.com/cloudera/hadoop -r fd21232cef7b8c1f536965897ce20f50b83ee7b2 Compiled by jenkins on 2015-11-09T20:37Z Compiled with protoc 2.5.0 From source with checksum 98e07176d1787150a6a9c087627562c This command was run using /opt/cloudera/parcels/CDH-5.5.0-1.cdh5.5.0.p0.8/jars/hadoop-common-2.6.0-cdh5.5.0.jar $ hadoop fs -ls / Found 3 items drwxrwxr-x - solr solr 0 2015-11-26 20:58 /solr drwxrwxrwt - hdfs supergroup 0 2015-11-27 02:29 /tmp drwxr-xr-x - hdfs supergroup 0 2015-11-27 02:29 /user

19. This completes the upgrade of CDH: