Immediate Job Openings For Big Data Engineer | Chennai/Pune

Photon

5 - 10 years

7 - 17 Lacs

Pune Chennai

Posted:1 day ago| Platform:

Apply

Skills Required

SCALA Spark Big Data

Work Mode

Work from Office

Job Type

Full Time

Job Description

Big Data Developer

Key Responsibilities:

Design and develop scalable and robust data processing pipelines using Apache Spark (Core & SQL).
Write efficient and maintainable code in Scala and Python for data transformation and ETL processes.
Work with Hive for data warehousing and querying large datasets.
Optimize performance of big data applications and troubleshoot production issues.
Collaborate with data engineers, analysts, and business stakeholders to understand data requirements.
Implement data quality checks, validation, and monitoring mechanisms.
Participate in code reviews, design discussions, and contribute to best practices.
Ensure data security, compliance, and governance standards are met.

Required Skills:

Strong hands-on experience with Apache Spark (RDD, DataFrame, Spark SQL).
Proficiency in Scala and Python programming languages.
Solid understanding of Hive, including HiveQL and performance tuning.
Experience with distributed computing and big data ecosystems (HDFS, YARN, etc.).
Familiarity with version control systems like Git.
Experience with job orchestration tools like Apache Airflow, Oozie, or similar is a plus.
Good understanding of data modeling, data warehousing, and ETL concepts.
Strong problem-solving skills and ability to work in a fast-paced environment.

Preferred Qualifications:

Bachelors or Masters degree in Computer Science, Engineering, or a related field.
Experience working in Agile/Scrum development environments.

More Jobs at Photon

Backend Java Developer

Chennai, Bengaluru, Hyderabad

8 - 12 yrs

INR 8 - 17 Lacs

Java Developer + Angular

Chennai, Bengaluru

4 - 9 yrs

INR 0 - 0 Lacs

Full Stack Developer

Chennai, Bengaluru

6 - 10 yrs

INR 16 - 19 Lacs

SDET Engineer

Chennai

7 - 12 yrs

INR 11 - 12 Lacs

Delivery Manger/Delivery Head

Chennai

14 - 24 yrs

INR 27 - 42 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Big Data Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.