Hadoop Administrator - Hive/Cloudera

We are seeking a highly skilled and experienced Hadoop Administrator to join our dynamic team. The ideal candidate will have extensive experience in managing and optimizing Hadoop clusters, ensuring high performance and availability. You will work with a variety of big data technologies and play a pivotal role in managing data integration, troubleshooting infrastructure issues, and collaborating with cross-functional teams to streamline data workflows.
Key Responsibilities :- Install, configure, and maintain Hadoop clusters, ensuring high availability, scalability, and performance.- Manage and monitor various Hadoop ecosystem components, including HDFS, YARN, Hive, Impala, and other related technologies.- Oversee the integration of data from Oracle Flexcube and other source systems into the Cloudera Data Platform.- Troubleshoot and resolve complex issues related to Hadoop infrastructure, performance, and applications.- Collaborate with cross-functional teams including data engineers, analysts, and architects to optimize data workflows and processes.- Implement and manage data backup, recovery plans, and disaster recovery strategies for Hadoop clusters.- Perform regular health checks on the Hadoop ecosystem, including managing logs, capacity planning, and system updates.- Develop, test, and optimize scripts to automate system maintenance and data management tasks.- Ensure compliance with internal security policies and industry best practices for data protection.- Provide training and guidance to junior team members and help in knowledge sharing within the team.- Create and maintain documentation related to Hadoop administration processes, system configurations, troubleshooting steps, and best practices.- Stay updated with the latest trends in Hadoop technologies and suggest improvements and new tools as necessary.Qualifications :- Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.- 5+ years of hands-on experience in Hadoop administration, with a preference for candidates from the banking or financial sectors.- Strong knowledge of Oracle Flexcube, Cloudera Data Platform, Hadoop, Hive, Impala, and other big data technologies.- Proven experience in managing and optimizing large-scale Hadoop clusters, including cluster upgrades and performance tuning.- Expertise in configuring and tuning Hadoop-related services (e.g., HDFS, YARN, MapReduce).- Strong understanding of data security principles and implementation of security protocols within Hadoop.- Excellent analytical, troubleshooting, and problem-solving skills.- Strong communication and interpersonal skills with the ability to work collaboratively within cross-functional teams.- Ability to work independently, manage multiple priorities, and meet deadlines.- Certification in Hadoop administration or related fields is a plus.- Experience with scripting languages such as Python, Shell, or Perl is desirable.