Azure Data Engineer

Job Title:

Experience Required:

Work Location:

Employment Type:

Job Summary:

Azure Data Engineer

Key Responsibilities:

• Design, build, and maintain robust data pipelines and ETL/ELT solutions using

  Azure Data Factory

  ,

  Azure Databricks

  ,

  Azure Synapse Analytics

  , and related services.
• Architect scalable data lake and data warehouse solutions on

  Azure Data Lake Storage (ADLS)

  and

  Azure SQL / Synapse

  .
• Optimize data workflows for performance, reliability, and cost-efficiency.
• Implement data governance practices, ensuring data quality, lineage, and security across all layers of the data stack.
• Work closely with data scientists, analysts, and business stakeholders to understand and translate data requirements into scalable solutions.
• Ensure end-to-end monitoring, logging, and performance tuning of data pipelines.
• Contribute to automation efforts using

  CI/CD pipelines

  with

  Azure DevOps

  or equivalent tools.
• Create and maintain detailed technical documentation for architecture, pipelines, and governance.

Required Skills & Experience:

• Minimum

  8 years of hands-on experience

  in data engineering roles.
• Proven expertise with

  Azure data services

  , including:
• Azure Data Factory (ADF)
• Azure Databricks / Apache Spark
• Azure Synapse Analytics
• Azure Data Lake Storage (Gen2)
• Azure SQL Database / Dedicated SQL Pool
• Strong SQL skills, including data modeling and query optimization.
• Proficiency in

  Python

  ,

  PySpark

  , or

  Scala

  for data engineering.
• Solid understanding of

  CI/CD practices

  and experience using

  Azure DevOps

  .
• Good understanding of

  data governance

  ,

  data privacy

  , and

  security

  principles in cloud environments.
• Experience with monitoring and logging tools for data pipeline health and diagnostics.

Nice to Have:

• Familiarity with

  Infrastructure-as-Code

  tools like

  Terraform

  or

  ARM templates

  .
• Exposure to

  Power BI

  or other business intelligence platforms.
• Understanding of

  event-driven architectures

  using

  Azure Event Hubs

  ,

  Kafka

  , or

  Service Bus

  .
• Experience working with

  machine learning pipelines

  or supporting data science teams.

Educational Qualifications:

• Bachelor’s or Master’s degree in

  Computer Science

  ,

  Information Systems

  , or a related field.