Big Data Engineer - Python/Java/Scala

10 - 14 years

0 Lacs

Posted:6 days ago| Platform: Shine logo

Apply

Work Mode

On-site

Job Type

Full Time

Job Description

The role is seeking a highly experienced Big Data Engineer with a strong background in Python, Java, or Scala. You will be responsible for designing, building, and maintaining scalable data pipelines and data lake architectures. The ideal candidate should have a proven ability to manage and deliver on complex data engineering projects. This position offers an excellent opportunity to work on scalable data solutions in a collaborative environment. Key responsibilities include developing robust data engineering solutions, working with various technologies such as Apache Spark, Hadoop, Hive, HBase, Kafka, Airflow, and Oozie. Collaboration with cross-functional teams is essential to ensure high data quality and governance. You will also be expected to leverage cloud platforms like AWS, Azure, or GCP for data processing and infrastructure, as well as manage and optimize data warehouses, data lakes, and RDBMS like PostgreSQL or SQL Server. Required skills for this position include 10+ years of experience in Information Technology, particularly in the Big Data ecosystem. Strong programming skills in Python, Java, or Scala are a must, along with deep knowledge and hands-on experience with Apache Spark, Hadoop, Hive, HBase, Kafka, Airflow, and Oozie. Experience with cloud environments (AWS, Azure, or GCP) is highly desirable, as well as a good understanding of data modeling, data architecture, and data governance principles. Familiarity with version control (Git), Docker, and orchestration tools like Kubernetes is considered a plus. Preferred qualifications include experience in real-time data processing using Kafka or Spark Streaming, exposure to NoSQL databases such as MongoDB or Cassandra, and certification in AWS Big Data or equivalent, which is a strong advantage. This position is full-time and open only to women candidates.,

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now

RecommendedJobs for You