INSTALLATION DOCUMENTS BY RAVI

Sunday, October 15, 2017

Step by step Installing Apache Oozie in Hadoop single node

Prerequisites:


1. Java jdk 1.6+





2. Maven 3.3.9








3. Hadoop 2.x







Installing Oozie 4.3.0
















Setting the environment variables:




















Save and close the file

Running Oozie Build
Modify the pom.xml under /u01/hadoop/oozie-4.3.0 as below
















Now run the below command























Oozie server setup
Add or modify hadoop core-site.xml under /u01/hadoop/hadoop-2.7.2/etc/hadoop as below












Create a libext folder under the oozie directory





Move downloaded ext-2.2.zip to libext folder





Copy Hadoop libraries into libext folder of oozie

























Preparing war file


















Creating Oozie Sharelib

Copy the hadoop core-site.xml file properties to core-site.xml file in /u01/hadoop/oozie-4.3.0/distro/target/oozie-4.3.0-distro/oozie-4.3.0/conf/hadoop-conf 






















Copy mapred-site.xml and yarn-site.xml files to /u01/hadoop/oozie-4.3.0/distro/target/oozie-4.3.0-distro/oozie-4.3.0/conf/hadoop-conf








Add or modify oozie-site.xml file under /u01/hadoop/oozie-4.3.0/distro/target/oozie-4.3.0-distro/oozie-4.3.0/conf as below























Now run the below command

































Creating Oozie database















Setting environment variables for Oozie




















Starting Oozie daemon
Run the below command to start Oozie daemon



















Run the below command to run as a process



Setting up client node for Oozie







Starting Oozie client node




Oozie web console url

















Checking the status of the Oozie process














Checking the what sharelib is being used by oozie while the daemon is running









Running the example Oozie jobs and testing the installation













We see different example folders such as pig,hive,mapreduce etc..,
Taking mapreduce to explain below steps. 
In the job.properties files of each folder, change the name node port and job tracker port as below



















save and close the file
Copying the examples folder to hdfs







Run the below command to check the status of the job






















To check the log run the below command






















42 comments:

  1. For an individual who is terrible that both of these, destiny chose my fate yet a tad of support at my end, getting the course I needed. data science course in pune

    ReplyDelete
    Replies
    1. Google sees high potential in reinforcement learning techniques using deep neural networks for qubit control optimization. Their abilities to harness non-local regularities of noisy control trajectories and to facilitate transfer learning between tasks have inspired researchers to adopt control methods built on deep reinforcement learning.Skyrocket in your Artificial Intelligence career with the twin engines of Python and R programmings. Join our Machine Learning using Python and R program and learn to script winning Machine Learning algorithms in Python and R. Use Python and R to enable regression analysis and to build predictive models. Orient yourself with Black Box techniques like Neural Networks and SVM.
      machine learning courses

      Delete
  2. Attend The Machine Learning course in Bangalore From ExcelR. Practical Machine Learning course in Bangalore Sessions With Assured Placement Support From Experienced Faculty. ExcelR Offers The Machine Learning course in Bangalore.
    Machine Learning course in Bangalore

    ReplyDelete
  3. Well, the most on top staying topic is Data Science. Data science is one of the most promising technique in the growing world. I would like to add Data science training to the preference list. Out of all,Data science course in Mumbai
    is making a huge difference all across the country. Thank you so much for showing your work and thank you so much for this wonderful article.

    ReplyDelete
  4. This is a wonderful article, Given so much info in it, These type of articles keeps the users interest in the website, and keep on sharing more ... good luck.
    Data science course in Mumbai

    ReplyDelete
  5. Well, the most on top staying topic is Data Analytics. Data Analytics is one of the most promising technique in the growing world. I would like to add Data Analytics training to the preference list.
    Out of all, data analytics course in hyderabad is making a huge difference all across the country. Thank you so much for showing your work and thank you so much for this wonderful article.

    ReplyDelete
  6. Nice Post...I have learn some new information.thanks for sharing.
    data analytics course hyderabad

    ReplyDelete
  7. Great post i must say and thanks for the information. Education is definitely a sticky subject. However, is still among the leading topics of our time. I appreciate your post and look forward to more.
    data analytics course mumbai

    ReplyDelete
  8. Actually I read it yesterday but I had some thoughts about it and today I wanted to read it again because it is very well written.
    .Please check ExcelR Data Science Course in Pune

    ReplyDelete
  9. It's really nice and meanful. it's really cool blog. Linking is very useful thing.you have really helped lots of people who visit blog and provide them usefull information.

    data science course
    360DigiTMG

    ReplyDelete
  10. You might comment on the order system of the blog. You should chat it's splendid. Your blog audit would swell up your visitors. I was very pleased to find this site.I wanted to thank you for this great read!!

    data analytics courses

    data science interview questions

    business analytics courses

    data science course in mumbai

    ReplyDelete
  11. Great post i must say and thanks for the information. Education is definitely a sticky subject. However, is still among the leading topics of our time. I appreciate your post and look forward to more.
    ExcelR data analytics courses

    ReplyDelete
  12. Study ExcelR Data Analytics Course in Bangalore where you get a great experience and better knowledge.
    Data Analytics Course in Bangalore

    ReplyDelete
  13. It has fully emerged to crown Singapore's southern shores and undoubtedly placed her on the global map of residential landmarks. I still scored the more points than I ever have in a season for GS. I think you would be hard pressed to find somebody with the same consistency I have had over the years so I am happy with that.
    artificial intelligence course

    ReplyDelete
  14. I was just browsing through the internet looking for some information and came across your blog. I am impressed by the information that you have on this blog. It shows how well you understand this subject. Bookmarked this page, will come back for more.
    artificial intelligence course

    ReplyDelete
  15. Its as if you had a great grasp on the subject matter, but you forgot to include your readers. Perhaps you should think about this from more than one angle.
    artificial intelligence course in bangalore

    ReplyDelete
  16. I have to search sites with relevant information on given topic and provide them to teacher our opinion and the article.

    Simple Linear Regression

    Correlation vs covariance

    KNN Algorithm

    Logistic Regression explained

    ReplyDelete
  17. Through this post, I know that your good knowledge in playing with all the pieces was very helpful. I notify that this is the first place where I find issues I've been searching for. You have a clever yet attractive way of writing.
    artificial intelligence course

    ReplyDelete
  18. Confederation of Indian Industry is a not-for-profit, industry led and industry managed organization, playing a proactive role in Indian business development process. Founded over 114 years ago, it is a premier business association, data science course in india

    ReplyDelete
  19. Great post i must say and thanks for the information. Education is definitely a sticky subject. However, is still among the leading topics of our time. I appreciate your post and look forward to more.data scientist course in pune

    ReplyDelete

  20. Great blog found to be well written in a simple manner that everyone will understand and gain the enough knowledge from your blog

    DevOps Training in Hyderabad

    ReplyDelete
  21. Good and step by step content shared, keep writing and sharing.

    Data Science Training in Pune

    ReplyDelete
  22. Selecting a solid website hosting service is critical. Whether you want to publish a website in support of a business or for noncommercial reasons, you want the web hosting service to offer the best possible features in bandwidth and uptime. Most would be website publishers realize they must work with a solid website hosting service. The main problem they face is finding the best possible cheap website hosting service. https://onohosting.com/

    ReplyDelete
  23. your content is very inspiring and appriciating I really like it please visit my site for Satta King Result also check Satta king 24X7 and also check sattaking and for quick result check my site Satta matka and for super fast result check Satta king ohttp://sattavipkingg.moonfruit.com/r delhi satta king

    ReplyDelete
  24. Good to become visiting your weblog again, it has been months for me. Nicely this article that i've been waited for so long. I will need this post to total my assignment in the college, and it has exact same topic together with your write-up. Thanks, good share. business analytics course in surat

    ReplyDelete
  25. I am really happy to say it’s an interesting post to read. I learn new information from your article, you are doing a great job. Keep it up
    Software Testing Tools Training in Hyderabad

    ReplyDelete
  26. It's clear that step-by-step instructions are essential for a smooth installation and can be a significant help to developers and administrators. Thank you
    Data Analytics Courses In Chennai

    ReplyDelete
  27. Clear instructions like these are invaluable for a smooth installation, and they're greatly appreciated by developers and administrators. Thanks for sharing this valuable information.
    Data Analytics Courses In Chennai

    ReplyDelete
  28. The insights that you have given is so wonderful I really loved it.
    Visit - Data Analytics Courses in Delhi

    ReplyDelete
  29. good blog

    Data Analytics Courses In Vadodara

    ReplyDelete
  30. nice blog

    Data Analytics Courses In Vadodara

    ReplyDelete
  31. A step-by-step guide to installing Apache Oozie in a Hadoop single node setup is essential for managing and scheduling workflows, ensuring efficient data processing in a Hadoop environment. For those interested in mastering Hadoop and related tools, Glasgow offers specialized Data Analytics courses that cover topics like Oozie, providing a solid foundation for data professionals. Please also read Data Analytics courses in Glasgow.

    ReplyDelete
  32. Great insights! Your blog provides valuable information on the topic
    Data Analytics Courses in Nigeria </a

    ReplyDelete
  33. Great insights! Your blog provides valuable information on the topic
    Data Analytics Courses in Nigeria

    ReplyDelete
  34. Thanks for sharing incredible and outstanding tutorial for installing Apache Oozie in Hadoop single node.
    data analyst courses in limerick

    ReplyDelete
  35. Thank you for providing fantastic and insightful tutorial on Installing Apache Oozie in Hadoop single node.

    Adwords marketing

    ReplyDelete

  36. "Your guide on installing Apache Oozie in a Hadoop single node setup is a clear and concise lifesaver for those navigating big data orchestration. The step-by-step approach demystifies the process, making it accessible even for beginners. Thanks for simplifying the complexities and contributing to a smoother integration of Apache Oozie in the Hadoop ecosystem!"
    Investment banking as a career in India

    ReplyDelete

  37. "Your step-by-step guide on installing Apache Oozie in a Hadoop single node environment is a beacon for those venturing into the world of big data orchestration. The meticulous instructions and clear insights not only simplify the process but also empower readers to seamlessly integrate Oozie into their Hadoop setup. Thanks for illuminating the path to efficient workflow management in the realm of data processing."
    Investment banking as a career in India

    ReplyDelete

  Opatch reports 'Cyclic Dependency Detected' error when patching ODI   Issue: When applying a Patch Set Update (PSU) to WebLogic Se...