Azure Data Engineer

SUMMARY

We are looking for a highly motivated Azure Data engineer to join our dynamic development team. This is an exciting opportunity for an individual who is passionate about working on trending technology and wants to contribute to the growth of our company.

KEY RESPONSIBILITIES

Design, develop, and maintain scalable data pipelines and use Azure Data Factory and Azure Stream Analytics
• Collaborate with data scientists and analysts to understand data requirements and implement solutions that support analytics and machine learning initiatives.• Optimize data storage and retrieval mechanisms to ensure performance, reliability, and cost-effectiveness.• Implement data governance and security best practices to ensure compliance and data integrity.• Troubleshoot and debug data pipeline issues, providing timely resolution and proactive monitoring.Proven experience as a Data Engineer or in a similar role.• Experience in designing and hands-on development in cloud-based (Azure) analytics solutions.• Expert level understanding on Azure Data Factory, Azure Synapse, Azure SQL, Azure Data Lake, Azure App Service, Azure Databricks, Azure IoT, Azure HDInsight + Spark, Azure Stream Analytics• Knowledge of Dev-Ops processes (including CI/CD) and Infrastructure as code is essential.• Experience in SQL server and procedures.• Thorough understanding of Azure Infrastructure offerings.• Strong experience in common data warehouse modelling principles including Kimball, Inmon.• Experience in additional Modern Database terminologies.• Working knowledge of Python or Java or Scala is desirable• Strong knowledge of data modeling, ETL processes, and database technologies• Solid understanding of data governance, data security, and data quality best practices.• Strong analytical and problem-solving skills, with attention to detail.

MANDATORY SKILLS

Azure Data Factory, Azure Synapse, Azure SQL, Azure Data Lake, Azure App Service, Azure Databricks, Azure IoT, Azure HDInsight + Spark, Azure Stream Analytics