Big Data Developer

Job Descritpion of Big Data Developer

8+ Years Relevant Experience

We are looking for a seasoned Big Data Developer with strong hands-on experience in Hadoop ecosystems, Python, HDFS, Hive, and associated big data tools. The ideal candidate will have a solid background in data warehousing environments, excellent problem-solving capabilities, and strong SQL and scripting skills. If you are a self-motivated individual who thrives in fast-paced, data-intensive projects, we want to hear from you.

Key Responsibilities:

• Develop and maintain robust data pipelines using tools such as Python, Hive, Sqoop, NiFi, and Airflow.
• Perform in-depth troubleshooting and performance optimization across the Hadoop ecosystem.
• Collaborate with data analysts, engineers, and business users to understand requirements and translate them into technical solutions.
• Work in Data Warehouse (DWH) environments with large-scale datasets and data integration workflows.
• Design and implement data ingestion, cleansing, transformation, and loading processes.
• Contribute to requirements gathering, technical analysis, and documentation.
• Write efficient SQL queries, Shell scripts, and manage HDFS data storage and retrieval.

Required Skills & Experience:

• 8+ years of hands-on experience in Big Data development and Hadoop ecosystems.
• Proficiency with:
  • Python, HDFS, Hive, Sqoop, NiFi, Airflow
• Strong experience in SQL and Shell scripting.
• Solid understanding of Hadoop internals and distributed computing principles.
• Previous experience working in a Data Warehousing environment.
• Excellent problem-solving, communication, and multitasking skills.
• Ability to learn and adapt quickly through self-education and on-the-job experience.

Good to Have:

• Experience with PySpark, HBase, and Oracle databases.
• Exposure to cloud-based big data platforms (AWS, GCP, or Azure) is a plus.

Soft Skills:

• Strong analytical mindset and attention to detail.
• Ability to work both independently and collaboratively in cross-functional teams.
• Effective time management and organizational skills.

Required Skills for Big Data Developer Job

Python

HDFS

Hive

Sqoop

Nifi

Airflow

PySpark

HBase

Oracle