Jobs

Interviews
Job Alerts
Tools

Upskill and Grow with AI

Mock Interview Practice interviews in realistic simulations

Coding Practice Improve your coding skills with challenges

Certification Earn certifications to validate your skills

AI Learning Get trained with AI expert sessions

Career Path AI insights for smarter career decisions

AI Job Match Score AI-Powered Job Match Against Your Resume and Optimize Your Resume

Career Tools and Resources

Resume Builder Build Professional Resume with Ease

ATS Friendliness Check Check Resume Friendliness for Applicant Tracking Systems

Auto Apply Apply to hundreds of jobs on any platform effortlessly

Co-Pilot (Chrome Extension) Your AI Assistant for Seamless Browsing Efficiency

Interview Questions Streamline interviews with ready-to-use questions

Salaries Discover market-driven salary insights across skillsets and geographies

Companies Explore leading companies actively hiring talent
For Employers

Jobs

Interviews

Home
>
Jobs in Gurugram
>
Srijan
>
Senior Data Engineer - Databricks

Senior Data Engineer - Databricks

Srijan

4 - 9 years

6 - 11 Lacs

Gurugram

Posted:6 hours ago| Platform:

Apply

Skills Required

Performance tuning Data validation orchestration Strategic partnerships Schema data governance Global Strategy Data processing Data quality Python

Work Mode

Work from Office

Job Type

Full Time

Job Description

About Us

We turn customer challenges into growth opportunities. Material is a global strategy partner to the world s most recognizable brands and innovative companies. Our people around the globe thrive by helping organizations design and deliver rewarding customer experiences. We use deep human insights, design innovation and data to create experiences powered by modern technology. Our approaches speed engagement and growth for the companies we work with and transform relationships between businesses and the people they serve. Srijan, a Material company, is a renowned global digital engineering firm with a reputation for solving complex technology problems using their deep technology expertise and leveraging strategic partnerships with top-tier technology partners

Job Summary:

We are seeking a

Senior Data Engineer Databricks

with a strong development background in

Azure Databricks

and Python, who will be instrumental in building and optimising scalable data pipelines and solutions across the Azure ecosystem. This role requires hands-on development experience with

PySpark

, data modelling, and Azure Data Factory. You will collaborate closely with data architects, analysts, and business stakeholders to ensure reliable and high-performance data solutions.

Experience Required: 4+ Years

Lead/Senior Data Engineer

(Microsoft Azure, Databricks, Data Factory, Data Engineer, Data Modelling)

Key Responsibilities:

Develop and Maintain Data Pipelines:
Design, implement, and optimise scalable data pipelines using
Azure Databricks (PySpark)
for both batch and streaming use cases.
Azure Platform Integration:
Work extensively with Azure services including
Data Factory
,
ADLS Gen2
,
Delta Lake
, and
Azure Synapse
for end-to-end data pipeline orchestration and storage.
Data Transformation & Processing:
Write efficient, maintainable, and reusable
PySpark
code for data ingestion, transformation, and validation processes within the Databricks environment.
Collaboration:

Partner with data architects, analysts, and data scientists to understand requirements and deliver robust, high-quality data solutions.
Performance Tuning and Optimisation:

Optimise Databricks cluster configurations, notebook performance, and resource consumption to ensure cost-effective and efficient data processing.
Testing and Documentation:

Implement unit and integration tests for data pipelines. Document solutions, processes, and best practices to enable team growth and maintainability.
Security and Compliance:

Ensure data governance, privacy, and compliance are upheld across all engineered solutions, following Azure security best practices.

Preferred Skills :

Strong hands-on experience with
Delta Lake
, including table management, schema evolution, and implementing
ACID-compliant
pipelines.
Skilled in developing and maintaining
Databricks notebooks
and
jobs
for large-scale batch and streaming data processing.
Experience writing
modular, production-grade PySpark and Python code
, including reusable functions and libraries for data transformation.
Experience in
streaming data ingestion
and
Structured Streaming
in Databricks for near real-time data solutions.
Knowledge of
performance tuning techniques
in Spark including job optimization, caching, and partitioning strategies.
Exposure to
data quality frameworks
and testing practices (e.g.,
pytest
, data validation libraries, custom assertions).
Basic understanding of
Unity Catalog
for managing data governance, access controls, and lineage tracking from a developer s perspective.
Familiarity with
Power BI
- able to structure data models and views in Databricks or Synapse to support
BI consumption
.

More Jobs at Srijan

Senior Solution Architect

Gurugram

13 - 18 yrs

INR 40 - 60 Lacs

Senior QA Engineer

Gurugram

5 - 10 yrs

INR 0 - 1 Lacs

Technical Architect (AWS Glue)

Gurugram

10.0 - 15.0 yrs

INR 9 - 13 Lacs

Hiring Sr Software Engineer(Drupal) For MaterialPlus_Gurgaon location!

Noida, Gurugram, Delhi / NCR

5.0 - 10.0 yrs

INR 10 - 16 Lacs

Senior QA Automation Engineer (AWS Glue)

Noida, Gurugram, Delhi / NCR

4.0 - 8.0 yrs

INR 10 - 20 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now

Srijan

Information Technology and Services

New Delhi

Before You Leave... Find Your Perfect Job!

Login to

Please Verify Your Phone or Email

Confirm Action

Contact Us

Search

Profile

Upskill and Grow with AI

Personal Settings

Personal Settings

Senior Data Engineer - Databricks

Experience & Salary

Skills Required

Work Mode

Job Type

Job Description

About Us

Job Summary:

Senior Data Engineer Databricks

Azure Databricks

PySpark

Experience Required: 4+ Years

Lead/Senior Data Engineer

Key Responsibilities:

Develop and Maintain Data Pipelines:

Azure Databricks (PySpark)

Azure Platform Integration:

Data Factory

ADLS Gen2

Delta Lake

Azure Synapse

Data Transformation & Processing:

PySpark

Collaboration:

Performance Tuning and Optimisation:

Testing and Documentation:

Security and Compliance:

Preferred Skills :

Delta Lake

ACID-compliant

Databricks notebooks

jobs

modular, production-grade PySpark and Python code

streaming data ingestion

Structured Streaming

performance tuning techniques

data quality frameworks

pytest

Unity Catalog

Power BI

BI consumption

More Jobs at Srijan