Posted by on
Categories: Hadoop Linux Yarn

#Hadoop has a built-in process and resource scheduler #YARN for managing job allocation to various physical systems and storage volumes. Hadoop workflow managers allow IT teams to create complex scripts that control job creation, execution and output. Using a workflow manager with YARN is akin to using a #Linux scripting language like Awk, Bash, Perl or Python in conjunction with the operating system’s native cron scheduler. IT teams that need to execute complex Hadoop tasks should understand the major features and various options of a workflow manager on Hadoop, including some that are native to a particular Hadoop distribution.

Leave a Reply

This site uses Akismet to reduce spam. Learn how your comment data is processed.