Data Engineer (Databricks)

Azure Data Engineer – Databricks & Data Fabric

Experience:

Job Overview:

Azure Data Engineer

Key Responsibilities:

• Design, build, and manage

  ETL/ELT pipelines

  using

  Azure Data Factory

  and

  Azure Databricks

• Implement and manage data flows across

  Azure Data Fabric

  , ensuring consistency and discoverability
• Work with

  structured and unstructured data

  across on-prem and cloud sources
• Collaborate with data architects, analysts, and business users to understand requirements and deliver high-quality data solutions
• Optimize and scale data pipelines using

  PySpark

  and

  Delta Lake

• Monitor, troubleshoot, and improve data pipeline performance using

  Azure Monitor

  and

  Log Analytics

• Ensure

  data security, governance, and compliance

  practices across all data flows
• Contribute to architectural decisions and cloud modernization strategy

Required Skills & Experience:

• Strong experience with

  Azure Databricks

  ,

  PySpark

  , and

  Delta Lake

• Hands-on with

  Azure Data Factory (ADF)

  and

  Dataflows

• Solid understanding of

  Azure Data Fabric

  concepts and implementation
• Experience working with

  Azure Synapse Analytics

  ,

  ADLS Gen2

  , and

  Azure SQL

• Proficiency in

  SQL

  and

  Python

• Knowledge of

  DevOps practices

  and CI/CD using

  Azure DevOps

  or GitHub
• Familiarity with

  data governance

  ,

  metadata management

  , and

  cataloging

• Good understanding of

  data modeling

  ,

  data security

  , and

  compliance (GDPR, HIPAA)

Nice-to-Have:

• Experience with

  Power BI

  ,

  Azure Purview

  , or

  Microsoft Fabric

• Exposure to

  Snowflake

  or other modern cloud data platforms
• Azure certification:

  DP-203 – Azure Data Engineer Associate

  or equivalent