Jobs

Interviews
Job Alerts
Tools

Upskill and Grow with AI

Mock Interview Practice interviews in realistic simulations

Coding Practice Improve your coding skills with challenges

Certification Earn certifications to validate your skills

AI Learning Get trained with AI expert sessions

Career Path AI insights for smarter career decisions

AI Job Match Score AI-Powered Job Match Against Your Resume and Optimize Your Resume

Career Tools and Resources

Resume Builder Build Professional Resume with Ease

ATS Friendliness Check Check Resume Friendliness for Applicant Tracking Systems

Auto Apply Apply to hundreds of jobs on any platform effortlessly

Co-Pilot (Chrome Extension) Your AI Assistant for Seamless Browsing Efficiency

Interview Questions Streamline interviews with ready-to-use questions

Salaries Discover market-driven salary insights across skillsets and geographies

Companies Explore leading companies actively hiring talent
For Employers

Jobs

Interviews

Azure Databricks

Viraaj HR Solutions Private Limited

4 years

8 - 30 Lacs

Chennai Tamil Nadu India

Posted:1 week ago| Platform:

Apply

Skills Required

azure databricks technology analytics data engineering ai finance manufacturing tooling design spark sql nosql rest orchestration management devops reliability monitoring code security apache pyspark storage git testing tuning mlflow scripting terraform kafka learning certifications collaborative etl

Work Mode

On-site

Job Type

Full Time

Job Description

Azure Databricks Engineer
A fast-growing information technology & analytics services firm within the cloud data engineering sector, we architect and deliver high-throughput data platforms, real-time analytics, and AI-ready pipelines for Fortune 500 customers across finance, retail, and manufacturing. Leveraging the Microsoft Azure ecosystem and open-source big-data tooling, we transform massive datasets into actionable insight at enterprise scale.Role & Responsibilities

Design, develop, and optimise scalable data pipelines on Azure Databricks using Spark, Delta Lake, and PySpark.
Integrate diverse data sources—Azure Data Lake, SQL/NoSQL, REST APIs—into unified, high-quality datasets for analytics and BI.
Implement job orchestration, cluster management, and automated CI/CD deployments through Azure DevOps and Terraform.
Tune Spark jobs for performance, cost, and reliability, proactively monitoring with Azure Monitor and Log Analytics.
Collaborate with data architects, analysts, and business stakeholders to translate requirements into technical solutions.
Document standards, mentor junior engineers, and champion best practices in code quality, security, and governance.

Skills & Qualifications

Must-Have

4+ years building production data pipelines with Azure Databricks and Apache Spark.
Strong proficiency in PySpark, SQL, and Delta Lake optimisation techniques.
Hands-on experience with Azure Data Factory, Data Lake Storage Gen2, and ADLS security.
Knowledge of DevOps pipelines, Git, and automated testing within Azure environments.
Understanding of data modelling, partitioning, and performance tuning in big-data systems.

Preferred

Exposure to MLflow, Feature Store, or MLOps workflows on Databricks.
Experience scripting infrastructure as code with Terraform or Bicep.
Familiarity with real-time streaming Kafka, Event Hubs and structured streaming in Spark.

Benefits & Culture Highlights

Work on greenfield petabyte-scale projects for global brands.
Continuous learning budget for certifications in Azure and Databricks.
Collaborative high-ownership culture with fast career progression.

Workplace Type: On-Site | Location: India
Skills: mlflow,kafka,sql,bicep,git,azure,adls security,devops pipelines,delta lake,terraform,data modelling,etl,apache spark,mlops workflows,automated testing,pyspark,azure data factory,partitioning,feature store,structured streaming,azure databricks,performance tuning,data lake storage gen2,event hubs

Mock Interview

Practice Video Interview with JobPe AI

Start DevOps Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now

Viraaj HR Solutions Private Limited

Login to

Please Verify Your Phone or Email

Confirm Action

Search

Profile

Upskill and Grow with AI

Azure Databricks