Home
Jobs

Posted:1 day ago| Platform: Linkedin logo

Apply

Work Mode

On-site

Job Type

Full Time

Job Description

Azure Databricks Engineer

Industry & Sector:

We are a fast-growing cloud data and analytics consultancy serving global enterprises across finance, retail, and manufacturing. Our teams design high-throughput lakehouse platforms, predictive analytics, and AI services on Microsoft Azure, unlocking data-driven decisions at scale.
Role & Responsibilities
  • Design, develop, and optimise end-to-end data pipelines on Azure Databricks using PySpark/Scala and Delta Lake.
  • Build scalable ETL workflows to ingest structured and semi-structured data from Azure Data Lake, SQL, and API sources.
  • Implement lakehouse architectures, partitioning, and performance tuning to ensure sub-second query response.
  • Collaborate with Data Scientists to prepare feature stores and accelerate model training and inference.
  • Automate deployment with Azure DevOps, ARM/Bicep, and Databricks CLI for secure, repeatable releases.
  • Monitor pipeline health, cost, and governance, applying best practices for security, lineage, and data quality.

Skills & Qualifications

Must-Have

  • 3+ years building large-scale Spark or Databricks workloads in production.
  • Expert hands-on with PySpark/Scala, Delta Lake, and SQL optimisation.
  • Deep knowledge of Azure services—Data Lake Storage Gen2, Data Factory/Synapse, Key Vault, and Event Hub.
  • Proficiency in CI/CD, Git, and automated testing for data engineering.
  • Understanding of data modelling, partitioning, and performance tuning strategies.

Preferred

  • Exposure to MLflow, feature store design, or predictive model serving.
  • Experience implementing role-based access controls and GDPR/PCI compliance on Azure.
  • Certification: Microsoft DP-203 or Databricks Data Engineer Professional.
Benefits & Culture
  • Work on cutting-edge Azure Databricks projects with Fortune 500 clients.
  • Flat, learning-centric culture that funds certifications and conference passes.
  • Hybrid leave policy, comprehensive health cover, and performance bonuses.
Skills: performance tuning,pyspark,event hub,sql,ci/cd,data factory,automated testing,key vault,azure data lake storage gen2,data modelling,azure databricks,git,delta lake,scala,devops,sql optimisation,spark,data synapse

Mock Interview

Practice Video Interview with JobPe AI

Start Azure Interview Now
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now

RecommendedJobs for You

Hyderabad, Pune, Bengaluru