Azure Data Engineer

We are seeking a skilled Azure Data Engineer with strong Power BI capabilities to design, build, and maintain enterprise data lakes on Azure, ingest data from diverse sources, and develop insightful reports and dashboards. This role requires hands-on experience in Azure data services, ETL processes, and BI visualization to support data-driven decision-making.

Key Responsibilities

• Design and implement end-to-end data pipelines using Azure Data Factory (ADF) for batch ingestion from various enterprise sources.
• Build and maintain a multi-zone Medallion Architecture data lake in Azure Data Lake Storage Gen2 (ADLS Gen2), including raw staging with metadata tracking, silver layer transformations (cleansing, enrichment, schema standardization), and gold layer curation (joins, aggregations).
• Perform data processing and transformations using Azure Databricks (PySpark/SQL) and ADF, ensuring data lineage, traceability, and compliance.
• Integrate data governance and security using Databricks Unity Catalog, Azure Active Directory (Azure AD), Role-Based Access Control (RBAC), and Access Control Lists (ACLs) for fine-grained access.
• Develop and optimize analytical reports and dashboards in Power BI, including KPI identification, custom visuals, responsive designs, and export functionalities to Excel/Word.
• Conduct data modeling, mapping, and extraction during discovery phases, aligning with functional requirements for enterprise analytics.
• Collaborate with cross-functional teams to define schemas, handle API-based ingestion (REST/OData), and implement audit trails, logging, and compliance with data protection policies.
• Participate in testing (unit, integration, performance), UAT support, and production deployment, ensuring high availability and scalability.
• Create training content and provide knowledge transfer on data lake implementation and Power BI usage.
• Monitor and troubleshoot pipelines, optimizing for batch processing efficiency and data quality.

Required Qualifications

• Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field.
• 5+ years of experience in data engineering, with at least 3 years focused on Azure cloud services.
• Proven expertise in Azure Data Factory (ADF) for ETL/orchestration, Azure Data Lake Storage Gen2 (ADLS Gen2) for data lake management, and Azure Databricks for Spark-based transformations.
• Strong proficiency in Power BI for report and dashboard development, including DAX, custom visuals, data modeling, and integration with Azure data sources (e.g., DirectQuery or Import modes).
• Hands-on experience with Medallion Architecture (raw/silver/gold layers), data wrangling, and multi-source joins.
• Familiarity with API ingestion (REST, OData) from enterprise systems.
• Solid understanding of data governance tools like Databricks Unity Catalog, Azure AD for authentication, and RBAC/ACLs for security.
• Proficiency in SQL, PySpark, and data modeling techniques for dimensional and analytical schemas.
• Experience in agile methodologies, with the ability to deliver phased outcomes.

Preferred Skills

• Certifications such as Microsoft Certified: Azure Data Engineer Associate (DP-203) or Power BI Data Analyst Associate (PL-300).
• Knowledge of Azure Synapse Analytics, Azure Monitor for logging, and integration with hybrid/on-premises sources.
• Experience in domains like energy, mobility, or enterprise analytics, with exposure to moderate data volumes.
• Strong problem-solving skills, with the ability to handle rate limits, pagination, and dynamic data in APIs.
• Familiarity with tools like Azure DevOps for CI/CD and version control of pipelines/notebooks.

What We Offer

• Opportunity to work on cutting-edge data transformation projects.
• Competitive salary and benefits package.
• Collaborative environment with access to advanced Azure tools and training.
• Flexible work arrangements and professional growth opportunities.

Role & responsibilities

Preferred candidate profile