Jobs

Interviews
Job Alerts
Tools

Upskill and Grow with AI

Mock Interview Practice interviews in realistic simulations

Coding Practice Improve your coding skills with challenges

Certification Earn certifications to validate your skills

AI Learning Get trained with AI expert sessions

Career Path AI insights for smarter career decisions

AI Job Match Score AI-Powered Job Match Against Your Resume and Optimize Your Resume

Career Tools and Resources

Resume Builder Build Professional Resume with Ease

ATS Friendliness Check Check Resume Friendliness for Applicant Tracking Systems

Auto Apply Apply to hundreds of jobs on any platform effortlessly

Co-Pilot (Chrome Extension) Your AI Assistant for Seamless Browsing Efficiency

Interview Questions Streamline interviews with ready-to-use questions

Salaries Discover market-driven salary insights across skillsets and geographies

Companies Explore leading companies actively hiring talent
For Employers

Jobs

Interviews

Home
>
Jobs in Chennai
>
Papigen
>
Senior Data Engineer (Azure Databricks, ADF, PySpark)

Senior Data Engineer (Azure Databricks, ADF, PySpark)

Papigen

7 - 12 years

12 - 22 Lacs

Chennai

Posted:1 week ago| Platform:

Apply

Skills Required

Pyspark Azure Databricks Azure Data Factory Lineage Data Bricks SQL PLSQL Azure Data Lake Spark Data Modeling Data Warehousing ETL Data Governance Python

Work Mode

Hybrid

Job Type

Full Time

Job Description

About Company:

Papigen

About the Role:

Senior Data Engineer

Key Responsibilities:

Design, develop, and optimize scalable
data pipelines
using
Databricks
,
ADF
,
PySpark
,
Spark SQL
, and
Python
Build robust
ETL workflows
to transform and load data into a
lakehouse architecture
on Azure
Ensure data quality, security, and compliance with data governance and privacy standards
Collaborate with stakeholders to gather business requirements and deliver technical data solutions
Create and maintain
technical documentation
for workflows, architecture, and data models
Work within an Agile environment and track tasks using tools like
Azure DevOps

Required Skills & Experience:

8+ years
of experience in data engineering and enterprise data platform development
Proven expertise in
Azure Databricks
,
Azure Data Factory
,
PySpark
, and
Spark SQL
Strong understanding of
Data Warehouses
,
Data Marts
, and
Operational Data Stores
Proficient in writing complex
SQL / PL-SQL queries
and understanding data models and data lineage
Knowledge of data management best practices:
data quality
,
lineage
,
metadata
,
reference/master data
Experience working in Agile teams with tools like
Azure DevOps
Strong problem-solving skills, attention to detail, and the ability to multi-task effectively
Excellent communication skills for interacting with both technical and business teams

Benefits and Perks:

Opportunity to work with leading global clients
Exposure to modern technology stacks and tools
Supportive and collaborative team environment
Continuous learning and career development opportunities

More Jobs at Papigen

PowerBI Developer

Tamil Nadu, India

Experience: Not specified

Salary: Not disclosed

ServiceNow ITOM Discovery & Service Mapping

India

6.0 - 6.0 yrs

Salary: Not disclosed

AI Developer

India

Experience: Not specified

Salary: Not disclosed

Python Developer

India

7.0 - 7.0 yrs

Salary: Not disclosed

Azure Data Engineer

India

5.0 - 5.0 yrs

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.