Azure Data Engineer

Job Title: Azure Data Engineer

Experience: 6+ Years

Location: Remote (Full-Time)

Job Type: Permanent / Full-Time

Job Summary:

Azure Data Engineer

Key Responsibilities:

• Design and develop end-to-end data pipelines using

  Azure Data Factory (ADF)

  ,

  Azure Synapse

  ,

  Databricks

  , and

  Azure SQL/Blob Storage

  .
• Build scalable ETL/ELT workflows integrating structured and semi-structured data from various sources.
• Implement and manage

  data lakes

  ,

  data warehouses

  , and

  real-time streaming

  solutions using Azure-native tools.
• Collaborate with data scientists, analysts, and business teams to understand data needs and deliver robust solutions.
• Develop reusable components, automate workflows, and optimize performance of data pipelines.
• Monitor and troubleshoot production data workflows ensuring data quality, lineage, and availability.
• Ensure security, compliance, and governance across data solutions with tools like

  Purview

  ,

  RBAC

  , and

  Azure Key Vault

  .
• Implement DevOps and CI/CD pipelines using

  Azure DevOps

  ,

  ARM templates

  ,

  Terraform

  , or

  GitHub Actions

  for infrastructure and data jobs.

Required Skills:

• Azure Data Factory (ADF)

  – pipelines, triggers, mapping data flows.

• Azure Synapse Analytics

  /

  SQL DW

  , Azure SQL,

  Cosmos DB

  .

• Azure Databricks / PySpark

  – for data processing and transformation.

• Azure Storage Services

  – Blob, ADLS Gen2.
• Proficient in

  SQL

  ,

  T-SQL

  ,

  Python

  or

  Scala

  .
• Experience in

  CI/CD pipelines

  for data engineering.
• Hands-on with

  data modeling

  ,

  data partitioning

  , and

  performance tuning

  .
• Experience with

  version control (Git)

  and

  Agile/Scrum

  methodologies.