Data Engineer

Job Title: Data Engineer

Exp Range: 6- 15 Yrs

Job Location: Pan India - TCS Location

Job Description:

Required skill

Azure Data Factory, Databricks, Delta Live Tables, Python, SQL, Terraform, YAML, Azure Services, Data Warehousing, CI/CD, Data Governance, Purview, Informatica

• Strong proficiency in Azure Data Factory, Databricks, Delta Live Tables
• Solid experience with Python, SQL, YAML, and Terraform
• Hands-on experience in building and optimizing scalable data pipelines
• Expertise in Data Warehousing, Lakehouse Architecture, and Data Modelling
• Knowledge of CI/CD practices and data governance tools like Purview or Informatica

Roles and Responsibility

Design, build, and optimize scalable data pipelines using Azure Data Factory, Databricks, and Delta Live Tables.

Implement ETL processes across diverse data assets ensuring data quality and performance.

Develop and manage data warehouses and lake houses for structured and semi-structured data.

Ensure compliance with data security, governance, and privacy standards using Purview and Informatica.

Collaborate with data scientists and ML engineers to operationalize machine learning pipelines.

Implement CI/CD pipelines for automating data pipeline deployments.

Translate complex technical solutions into business insights for stakeholders.

Troubleshoot and resolve performance bottlenecks in data workflows.