Jobs

Interviews
Job Alerts
Tools

Upskill and Grow with AI

Mock Interview Practice interviews in realistic simulations

Coding Practice Improve your coding skills with challenges

Certification Earn certifications to validate your skills

AI Learning Get trained with AI expert sessions

Career Path AI insights for smarter career decisions

AI Job Match Score AI-Powered Job Match Against Your Resume and Optimize Your Resume

Career Tools and Resources

Resume Builder Build Professional Resume with Ease

ATS Friendliness Check Check Resume Friendliness for Applicant Tracking Systems

Auto Apply Apply to hundreds of jobs on any platform effortlessly

Co-Pilot (Chrome Extension) Your AI Assistant for Seamless Browsing Efficiency

Interview Questions Streamline interviews with ready-to-use questions

Salaries Discover market-driven salary insights across skillsets and geographies

Companies Explore leading companies actively hiring talent
For Employers

Jobs

Interviews

Home
>
Jobs in mumbai
>
IBM
>
Data Engineer-Data Platforms-Azure

Data Engineer-Data Platforms-Azure

IBM

7 - 12 years

14 - 18 Lacs

mumbai

Posted:1 day ago| Platform:

Apply

Skills Required

data architecture security framework data engineering data bricks aws rest python azure data lake cyber security glue amazon redshift catalog information security pyspark microsoft azure kinesis cism sql spring java oracle adf kafka terraform

Work Mode

Work from Office

Job Type

Full Time

Job Description

Key Responsibilities

Lead the architecture and design of Databricks-based data lakehouse platforms.

Implement Delta Lakehouse patterns (time travel, schema evolution, CDC).

Drive adoption of Delta Live Tables, Auto Loader, Unity Catalog for enterprise-scale governance and automation.

Optimize Spark workloads and Photon-powered queries for performance and cost efficiency.

Oversee data governance, RBAC, lineage, and compliance via Unity Catalog.

Enable real-time pipelines using Structured Streaming (Kafka, Event Hub, Kinesis).

Partner with business teams to define data strategy, standards, and best practices .

Mentor junior engineers, perform code reviews, and drive engineering excellence.

Integrate Databricks with DevOps (CI/CD, GitOps) and automate provisioning via Terraform/ARM/CloudFormation .

Collaborate with AI/ML teams to enable ML model deployment and monitoring with MLflow and Feature Store.

Required education Bachelor's Degree Preferred education Bachelor's Degree Required technical and professional expertise Mandatory Skills

7+ years of data engineering experience , with at least 3+ in Databricks .

Deep knowledge of Databricks ecosystem PySpark, Delta Lake, Delta Live Tables, Auto Loader, Unity Catalog, MLflow, Photon.

Strong experience with Azure (ADF, ADLS, Synapse, Event Hub) or AWS (Glue, S3, Redshift, Lake Formation, Kinesis) .

Expertise in SQL, Python , and performance optimization .

Strong knowledge of data architecture, governance, and security frameworks .

Proven track record of leading teams and delivering enterprise-grade solutions .

Preferred technical and professional experience Good to Have

Databricks Professional Data Engineer certification .

Experience with Databricks REST APIs and advanced automation.

Exposure to multi-cloud Databricks deployments .

More Jobs at IBM

Delivery Manager - RISK & Compliance - AML

Bengaluru

3 - 5 yrs

INR 5 - 7 Lacs

Delivery Manager-HUMAN Resources Operations

Bengaluru

6 - 10 yrs

INR 11 - 16 Lacs

Application Developer-Java & Web Technologies

Hyderabad

2 - 5 yrs

INR 7 - 11 Lacs

Deputy Manager Data Engineer - Analytics

Bengaluru

4 - 7 yrs

INR 10 - 15 Lacs

Data Scientist-Artificial Intelligence

Bengaluru

3 - 7 yrs

INR 14 - 18 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now

IBM

Information Technology

Armonk

Login to

Please Verify Your Phone or Email

Confirm Action

Search

Profile

Upskill and Grow with AI

Data Engineer-Data Platforms-Azure