Tuesday, October 31, 2017

Basic hadoop commands

1. Creating a directory in hdfs

$ hdfs dfs -mkdir <paths>

2. List the directories in hdfs
$ hdfs dfs  -ls  <args>

3. Permissions

4. Putting a file in to hdfs file system
$ hdfs dfs -put <local-src> ... <HDFS_dest_path>

5. Space utilization in hdfs directory
$ hdfs dfs -du URI

6. Downloading files from hdfs to local file system
$ hdfs dfs -get <hdfs_src> <localdst>

7. Merging two files
We can merge two files in hdfs file system into a single file to the local file system as below
$ hdfs dfs -getmerge <src1> <src2> <localdst> [addnl]

8. Copying files or directories recursively
$ hdfs dfs -cp <src-url> <dest-url>

9. Help command
Use help command to access hadoop command manual

10. Seeing the contents of a file
$ hdfs dfs -cat <path[filename]>

11. Copying a file from source to destination in hdfs file system
$ hdfs dfs -cp <source> <dest>

12. Copy a file using copyFromLocal and copyToLocal
$ hdfs dfs -copyFromLocal <localsrc> URI

$ hdfs dfs -copyToLocal [-ignorecrc] [-crc] URI <localdst>

13. Move file from source to destination in hdfs file system
$ hdfs dfs -mv <src> <dest>

14. Remove a file or directory from hdfs file system
$ hdfs dfs -rm <arg>

15. Remove files recursively

16. To display last few lines of a file
$ hdfs dfs -tail <path[filename]>

17. Hadoop version

18. To check amount of space used by hdfs file system

19. To count the number of files and directories in hdfs


  1. Thank you a lot for providing individuals with a very spectacular possibility to read critical reviews from this site.

  2. Appreciation for really being thoughtful and also for deciding on certain marvelous guides most people really want to be aware of.
    Best Hadoop Training Institute In chennai

  3. This comment has been removed by the author.

  4. I have to voice my passion for your kindness giving support to those people that should have guidance on this important matter.

  5. Thanks for your article on Android technology. Android is an open source platform that allows developers to create stunning website loaded with various advanced features and functionalities.
    No.1 Vacation Classes for Multimedia in Chennai | Perfect Summer Courses for IT in Chennai

  6. A course in information science can enable you to have that additional edge over different representatives, and it can likewise enable you to expand your current bundle. ExcelR Data Science Courses

  7. Awesome blog. I enjoyed reading your articles. This is truly a great read for me. I have bookmarked it and I am looking forward to reading new articles. Keep up the good work!

    Correlation vs Covariance

  8. I want to say thanks to you. I have bookmark your site for future updates.
    Data Science Course in Bangalore

  9. I have been searching to find a comfort or effective procedure to complete this process and I think this is the most suitable way to do it effectively.
    Data Science Training in Bangalore

  10. This is a wonderful article, Given so much info in it, These type of articles keeps the users interest in the website, and keep on sharing more ... good luck.

    Simple Linear Regression

    Correlation vs Covariance

  11. Thank you for helping people get the information they need. Great stuff as usual. Keep up the great work!!!
    data analytics certification training course

  12. I think this is the minimum value to earn more than just commit
    ai training in noida

  13. Thanks for a marvelous posting! I seriously enjoyed reading it, you are
    a great author.I will be sure to bookmark your blog and will often come back in the future.
    I want to encourage yourself to continue your great job, have a
    nice weekend!

    data science training in chennai

    data science training in velachery

    android training in chennai

    android training in velachery

    devops training in chennai

    devops training in velachery

    artificial intelligence training in chennai

    artificial intelligence training in velachery

  14. Really nice and interesting post. I was looking for this kind of information and enjoyed reading this one. Keep posting. Thanks for sharing.

    Simple Linear Regression

    Correlation vs covariance

    KNN Algorithm

    Logistic Regression explained

  15. Very nice blogs!!! i have to learning for lot of information for this sites…Sharing for wonderful information.Thanks for sharing this valuable information to our vision. You have posted a trust worthy blog keep sharing, data scientist course in hyderabad with placement

  16. I am looking for and I love to post a comment that "The content of your post is awesome" Great work!

    data science interview questions

  17. Thanks a lot very much for the high quality and results-oriented help. I won’t think twice to endorse your blog post to anybody who wants and needs support about this area. data science training in Hyderabad

  18. I am looking for and I love to post a comment that "The content of your post is awesome" Great work!

    Simple Linear Regression

    Correlation vs Covariance

  19. I just stumbled upon your blog and wanted to say that I have really enjoyed reading your blog posts. ExcelR Data Scientist Course In Pune With Placement Any way I’ll be subscribing to your feed and I hope you post again soon. Big thanks for the useful info.

  20. Truly mind blowing blog went amazed with the subject they have developed the content. These kind of posts really helpful to gain the knowledge of unknown things which surely triggers to motivate and learn the new innovative contents. Hope you deliver the similar successive contents forthcoming as well.

    data science in bangalore

  21. It is imperative that we read blog post very carefully. I am already done it and find that this post is really amazing.
    data scientist training and placement in hyderabad


  22. Great blog found to be well written in a simple manner that everyone will understand and gain the enough knowledge from your blog

    DevOps Training in Hyderabad

  23. Thanks for posting the best information and the blog is very science institutes in hyderabad

  24. Extremely overall quite fascinating post. I was searching for this sort of data and delighted in perusing this one. Continue posting. A debt of gratitude is in order for sharing. data scientist course in delhi


SQL query to find whether OdiSendMail is configured or not ODI 12c

In the SQL developer connect to the ODI work repository user (Ex: DEV_ODI_REPO) and run the below query. select SCEN_NAME,TASK_NAME3,DE...