Azure Data Engineer - Hybrid/Remote/Pune

Azure Data Engineer

Remote/Pune-Hybrid

Full time Permanent

Company: Academian

Data Engineer

Key Responsibilities:

• Design, develop, and maintain scalable

  ETL/ELT pipelines

  in Azure. 
• Work with Azure services such as

  Azure Data Factory, Azure Data Lake, Synapse Analytics, Azure SQL, and Databricks

  . 
• Implement and optimize

  data storage and retrieval solutions

  in the cloud. 
• Ensure data quality, consistency, and governance through robust validation and monitoring. 
• Develop and manage

  CI/CD pipelines

  for data workflows using tools like

  Azure DevOps

  . 
• Collaborate with cross-functional teams to understand data requirements and translate them into technical solutions. 
• Support and troubleshoot data issues and ensure high availability of data infrastructure. 
• Follow best practices in data security, privacy, and compliance 
• Develop and maintain data architectures (data lakes, data warehouses). 
• Integrate data from a wide variety of sources (APIs, logs, third-party platforms). 
• Monitor data workflows and troubleshoot data-related issues. 

Required Skills & Experience

• Bachelors degree in computer science, Information Technology, or related field 
• 5+ years of experience in data engineering or similar role 
• Strong hands-on experience with Azure Data Factory, Azure Data Lake, Azure Synapse Analytics, and Databricks. 
• Proficiency in SQL, Python, and PySpark. 
• Experience with data modeling, schema design, and data warehousing. 
• Familiarity with CI/CD processes, version control (e.g., Git), and deployment in Azure DevOps. 
• Knowledge of data governance tools and practices (e.g., Azure Purview, RBAC). 
• Strong SQL skills and experience with relational databases 
• Proficiency with Apache Kafka and streaming data architectures 
• Knowledge of ETL tools and processes 
• Familiarity with DW-BI Tools PowerBI  
• Strong knowledge of database systems (PostgreSQL, MySQL, NoSQL). 
• Understanding of distributed systems like Kafka or MSK 

Preferred Skills:

• Experience of data visualization tools 
• Experience with NoSQL databases 
• Understanding of machine learning pipelines and workflows

Regards

Manisha Koul

mkoul@academian.com

www.linkedin.com/in/koul-manisha