Associate Process Manager

9 years

0 Lacs

Posted:2 days ago| Platform: Linkedin logo

Apply

Work Mode

On-site

Job Type

Full Time

Job Description

Role Overview:

We are seeking a

Senior Data Engineer with strong developer DNA

— someone who codes daily in

PySpark, SQL, and Python

, builds

end-to-end data solutions

, and leads design of

robust, production-grade data platforms

on

Microsoft Fabric

,

Azure Databricks

, and

ADF

. This is a hands-on leadership role for engineers who can think architecturally and code efficiently.

Key Responsibilities:

  • Design, develop, and optimize complex data pipelines and lakehouse architectures.
  • Lead development of batch and streaming ingestion frameworks using ADF, Databricks, and Event Hubs.
  • Write optimized PySpark/SQL transformations for performance, scalability, and cost efficiency.
  • Build reusable data frameworks and automation scripts for continuous integration and deployment.
  • Establish unit testing, code review, and versioning standards across engineering teams.
  • Integrate with DevOps CI/CD pipelines for automated releases and environment management.
  • Mentor junior engineers on coding practices and architecture design.
  • Collaborate with data architects on Fabric-based Lakehouse implementations.

Skills & Qualifications:

  • 6–9 years of strong hands-on experience in data engineering and development.
  • Expertise in:
    • PySpark, SQL, Python, and performance tuning of large-scale transformations.
    • Databricks, ADF, ADLS, Fabric Data Pipelines, and Delta Lake.
  • Deep understanding of data architecture, schema design, job orchestration, and data governance.
  • Strong knowledge of CI/CD (Azure DevOps) and infrastructure-as-code for data pipelines.
  • Optional: Exposure to GCP BigQuery, Dataproc, or Dataflow as secondary platforms.

Preferred Certifications:

  • Databricks Certified Data Engineer Professional
  • Microsoft Certified: Fabric Analytics Engineer Associate (DP-600)
  • Microsoft Certified: Azure Solutions Architect Expert (AZ-305)
  • Optional:Google Cloud Certified – Professional Data Engineer

About The Team

eClerx is a global leader in productized services, bringing together people, technology and domain expertise to amplify business results. Our mission is to set the benchmark for client service and success in our industry. Our vision is to be the innovation partner of choice for technology, data analytics and process management services. Since our inception in 2000, we've partnered with top companies across various industries, including financial services, telecommunications, retail, and high-tech. Our innovative solutions and domain expertise help businesses optimize operations, improve efficiency, and drive growth. With over 18,000 employees worldwide, eClerx is dedicated to delivering excellence through smart automation and data-driven insights. At eClerx, we believe in nurturing talent and providing hands-on experience.eClerx is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability or protected veteran status, or any other legally protected basis, per applicable law.

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now
eClerx logo
eClerx

IT Services and IT Consulting

Mumbai Maharashtra

RecommendedJobs for You

mumbai, maharashtra, india

mumbai, maharashtra, india

mumbai, maharashtra, india

mumbai, maharashtra, india