Pyspark Data Engineer

Impetus Technologies

5 - 8 years

8 - 12 Lacs

Bengaluru

Posted:3 days ago| Platform:

Apply

Skills Required

unit testing pyspark sql streaming apache spark optimization design patterns oops big data programming python sql queries software testing data processing machine learning data engineering nosql core framework concepts tdd performance optimization object nosql databases

Work Mode

Work from Office

Job Type

Full Time

Job Description

Strong experience working with the Apache Spark framework, including a solid grasp of core concepts, performance optimizations, and industry best practices
Proficient in PySpark with hands-on coding experience; familiarity with unit testing, object-oriented programming (OOP) principles, and software design patterns
Experience with code deployment and associated processes
Proven ability to write complex SQL queries to extract business-critical insights
Hands-on experience in streaming data processing
Familiarity with machine learning concepts is an added advantage
Experience with NoSQL databases
Good understanding of Test-Driven Development (TDD) methodologies
Demonstrated flexibility and eagerness to learn new technologies

Roles and Responsibilities

Design and implement solutions for problems arising out of large-scale data processing
Attend/drive various architectural, design and status calls with multiple stakeholders
Ensure end-to-end ownership of all tasks being aligned including development, testing, deployment and support
Design, build & maintain efficient, reusable & reliable code
Test implementation, troubleshoot & correct problems
Capable of working as an individual contributor and within team too
Ensure high quality software development with complete documentation and traceability
Fulfil organizational responsibilities (sharing knowledge & experience with other teams/ groups)

More Jobs at Impetus Technologies

DotNet Developer

Indore, Gurugram, Bengaluru

5 - 10 yrs

INR 8 - 12 Lacs

Business Intelligence Engineer

Noida, Pune, Bengaluru

3 - 6 yrs

INR 9 - 16 Lacs

Senior Marketing Manager

Noida, Indore, Bengaluru

10 - 16 yrs

INR 30 - 40 Lacs

Java backend Developer

Indore, Gurugram, Bengaluru

4 - 7 yrs

INR 5 - 15 Lacs

Senior Dot net Developer

Noida, Indore, Pune, Gurugram

8 - 13 yrs

INR 25 - 30 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.