Big Data Engineer - Python/Java/Scala

Employment Type : Full-timeOpen only for women candidates

About The Role

We are looking for a highly experienced Big Data Engineer with strong hands-on expertise in Python, Java, or Scala, and proven ability to manage and deliver on complex data engineering projects. This is an excellent opportunity for someone passionate about big data technologies and cloud platforms to work on scalable data solutions in a collaborative environment.

Key Responsibilities

• Design, build, and maintain scalable data pipelines and data lake architectures.
• Develop robust data engineering solutions using Python, Java, or Scala.
• Work extensively with Apache Spark, Hadoop, Hive, HBase, Kafka, Airflow, and Oozie.
• Collaborate with cross-functional teams to ensure high data quality and governance.
• Leverage cloud platforms like AWS, Azure, or GCP for data processing and infrastructure.
• Manage and optimize data warehouses, data lakes, and RDBMS such as PostgreSQL or SQL Server.
  

Required Skills

• 10+ years of experience in Information Technology, specifically in the Big Data ecosystem.
• Strong programming skills in Python, Java, or Scala.
• Deep knowledge and hands-on experience with Apache Spark, Hadoop, Hive, HBase, Kafka, Airflow, and Oozie.
• Experience with cloud environments (AWS, Azure, or GCP).
• Good understanding of data modeling, data architecture, and data governance principles.
• Familiarity with version control (Git), Docker, and orchestration tools like Kubernetes is a plus.
  

Preferred Qualifications

• Experience in real-time data processing using Kafka or Spark Streaming.
• Exposure to NoSQL databases such as MongoDB or Cassandra.
• Certification in AWS Big Data or equivalent is a strong advantage.
  

(ref:hirist.tech)