Azure Data Engineer

Job Description

Data Engineer Experience: 5+ Years Location : Gurugram (On-site) Notice Period: Immediate to 15 Days (Preferred) Key Responsibilities: Data ingestion from source through ADF. Batch and Realtime loads to Bronze layer or Silver respectively basis level of transformation required according to use-case. Data residing in ADLS Gen 2 is processed by Databricks compute and Delta Live Tables Cleaned data is available in Silver layer and is further transformed according to business relevance to form data marts in the Final gold layer. Cleaned data is ingested in to MLFlow (optional) for machine learning / predictive use-cases. Data from MLFlow can be provisioned through APIs to provide scoring or other data use cases involving model serving etc. Data of Gold layer can further be consumed by Databricks SQL to provide SQL endpoints to BI apps. Databricks SQL provides data to Power BI Delta sharing (optional) can be used to provision data securely to 3rd parties. Mandatory Skills: Azure Data Bricks, data warehouse, Data Modeling, Delta Table, Azure SQL, Data Lake Job Type: Full-time Pay: ₹700,000.00 - ₹1,800,000.00 per month Schedule: Day shift Monday to Friday Ability to commute/relocate: Gurugram, Haryana: Reliably commute or planning to relocate before starting work (Required) Application Question(s): What is your notice period? What is your current CTC? Experience: Azure Data Engineer: 5 years (Required) Azure Data Factory: 3 years (Required) Databricks: 4 years (Required) Work Location: In person