Hadoop Administrator

Roles and Responsibilities :

• Manage Hadoop clusters on Cloudera platform, ensuring high availability and performance.
• Design, implement, and maintain ETL processes using Hive, Impala, Spark, and Python scripts.
• Troubleshoot issues related to HDFS, HBase, and other Big Data technologies in the stack.
• Configure and manage data storage policies, replication, and fault tolerance.
• Implement and manage security policies, including Kerberos for authentication and Ranger or Sentry for authorization.
• Conduct regular security audits and compliance checks.
• Deploy Cloudera clusters from scratch, including hardware and software configuration.
• Configure clusters to meet specific business requirements and workloads.
• Plan and execute cluster upgrades to ensure systems are up-to-date with the latest features and security patches.
• Perform necessary tests to ensure system stability post-upgrade. 

Job Requirements :

1. More than 8+ years of experience in information technology, Minimum of 6+ years of experience in managing and administering Hadoop/Cloudera environments.
2. Proven experience with Cloudera CDP (Cloudera Data Platform), Cloudera Manager, and related tools.
3. Strong knowledge of Hadoop ecosystem components (HDFS, YARN, Hive, HBase, Spark, Impala, etc.).
4. Proficiency in Linux system administration with experience with scripting languages (Python, Bash, etc.) and configuration management tools (Ansible, Puppet, etc.).
5. Familiarity with data security practices and tools (Kerberos, Ranger, Sentry).
6. Excellent problem-solving and analytical with strong communication and interpersonal skills. Ability to work independently and in a team environment.
7. Cloudera Certified Administrator for Apache Hadoop (CCAH) or similar certification.
8. Experience with DevOps practices and tools (Docker, Kubernetes, Jenkins).