Azure Data Engineer

Your Role and Responsibilities

• Responsible for implementing a robust data estate using Microsoft Azure Stack.
• Responsible for creating reusable and scalable data pipelines.
• Responsible for developing and deploying Big Data BI Solutions across industries and functions.
• Responsible for the development and deployment of new data platforms.
• Responsible for creating reusable components for rapid development of data platform.
• Responsible to create high-level architecture and data modelling.
• Responsible to guide and mentor the development teams.
• Responsible for getting UAT and Go Live for Data platform projects.
• Play an active role in team meetings and workshops with clients.
  

Required Technical and Professional Expertise

• Minimum of 4+ years of experience in Data Warehousing with Big Data or Cloud.
• Graduate degree educated in computer science or a relevant subject.
• Good software engineering principals.
• Strong in SQL queries and data models.
• Good understanding of OLAP & OLTP concepts and implementations.
• Experience in working on Azure Services like Azure Data Factory, Azure Function, Azure SQL, Azure Data Bricks, Azure Data Lake, Synapse Analytics etc.
• Knowledge of Power shell is good to have.
• Experience of working in Agile delivery model.
• Knowledge of Big Data technologies, such as Spark, Hadoop/MapReduce is good to have.
• Knowledge and practical experience of cloud-based at forms and their ML/DL offerings (such as Google GCP, AWS, and Azure) would be advantageous.

Understanding of infrastructure (including hosting, container-based deployments, and storage architectures) would be advantage.

Preferred Technical and Professional Experience

• 6+ years of experience in ELT/Data Integration for Data Warehousing, Data Lakes, and Business Intelligence.
• Expertise in data storage, ETL/ELT, and data analytics tools and technologies.
• Proven hands-on experience in designing, modelling, testing, and optimizing data warehousing & data lake solutions.
• Proficiency in SQL and Spark-based data processing.
• Experience with Azure cloud big data technologies Like Azure Data Factory, Azure Databricks, Fabric, Synapse, ADLS Gen2, etc.
• Strong understanding of data and analytics data architecture.
• Experience working with Agile methodologies (Scrum, Kanban) and in large transformational programs.
• Ability to document architecture and present solutions effectively.
• Strong data modelling skills (conceptual, logical, and physical).
• Experience with Python.