Sr Data Engineer

veralto

13 - 18 years

50 - 55 Lacs

bengaluru

Posted:1 day ago| Platform:

Apply

Skills Required

erp data management focus reconciliation ssis microsoft sql crm recruitment python

Work Mode

Work from Office

Job Type

Full Time

Job Description

Experience summary

ETL experience: 13 years total
Minimum 5 years hands-on with: Azure Data Factory (ADF), notebooks, PySpark, Python, AI/ML, data management, data quality, data architecture, data modelling, Microsoft Fabric, Medallion architecture, CI/CD pipelines, data governance, and MDM
Additional stack exposure: SSIS, SQL Server, ERP, CRM
Fabric experience is a must
Knowledge of Profisee (MDM) and Microsoft Purview (data governance/catalog) is an added advantage

Technical focus

20% Data Architecture / 80% Data Engineering

Key responsibilities

Architect, develop, and operate enterprise-grade data pipelines using Microsoft Fabric, ADF, PySpark, and Python, aligned to Medallion architecture
Rationalize and modernize the BI data landscape; deliver curated bronze/silver/gold layers and performant semantic models
Implement data quality, governance, lineage, and observability across pipelines; embed controls for auditability and compliance
Prepare validated, high-quality datasets to support ERP migration waves and MDM mastering workflows, including reconciliation processes
Migrate/retire legacy SSIS/SQL Server integrations to cloud-native, testable, and cost-efficient solutions
Apply CI/CD for data engineering (branching, PRs, automated testing, environment promotion) using Azure DevOps/Git
Enable AI/ML workloads by provisioning feature-ready datasets and operationalizing model data flows in collaboration with data science
Diagnose and resolve complex integration issues across cloud-native and legacy platforms; optimize performance and costs
Collaborate effectively with business analysts, transformation leads, and external partners; communicate progress and risks clearly
Contribute to Agile delivery cycles, showing initiative and independence in problem solving

Required expertise

Advanced proficiency in Azure-based data engineering: ADF, notebooks, PySpark, Python, Delta/Lakehouse patterns, and Microsoft Fabric
Demonstrated success building resilient, scalable, and observable pipelines with Medallion architecture and solid data modelling
Minimum 5 years applying data management, data quality, data governance, and MDM practices in production environments
Strong SQL skills; experience transitioning from SQL Server/SSIS to Azure/Fabric
Hands-on CI/CD for data solutions (e.g., Azure DevOps), including automated deployments and quality gates
Exposure to ERP/CRM integrations and data migration best practices
Familiarity with Profisee (preferred) and Microsoft Purview for governance, lineage, and cataloging
Strong communication, stakeholder engagement, and teamwork; integrity and ownership mindset
Able to pass rigorous employment background verification

More Jobs at veralto

Migration Support Engineer Trainee

Bengaluru

Experience: Not specified

INR 1 - 4 Lacs

Engineering Manager

Bengaluru

16.0 - 21.0 yrs

INR 20 - 25 Lacs

Service Desk Engineer

Bengaluru

Experience: Not specified

INR 2 - 5 Lacs

Software Engineer II

Bengaluru

5.0 - 10.0 yrs

INR 11 - 13 Lacs

Senior QA Engineer

Bengaluru

7.0 - 9.0 yrs

INR 6 - 10 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.