Senior Data Engineer

TCS has been a great pioneer in feeding the fire of Young techies like you. We are global leaders in the technology arena and there's nothing that can stop us from growing together.

TCS Hiring for skill "

Role:

Required Technical Skill Set:

Experience:

Work Location:

Must-Have:

· Strong proficiency in Azure Data Factory, Databricks, Delta Live Tables

· Solid experience with Python, SQL, YAML, and Terraform

· Hands-on experience in building and optimizing scalable data pipelines

· Expertise in Data Warehousing, Lakehouse Architecture, and Data Modelling

· Knowledge of CI/CD practices and data governance tools like Purview or Informatica

Good-to-Have:

· Experience in Machine Learning integration and collaboration with data scientists

· Knowledge of metadata management and observability frameworks

· Strong stakeholder engagement and communication skills

· Experience in Australian Energy or Utilities domain

Responsibility of / Expectations from the Role

1. Design, build, and optimize scalable data pipelines using Azure Data Factory, Databricks, and Delta Live Tables.
2. Implement ETL processes across diverse data assets ensuring data quality and performance.
3. Develop and manage data warehouses and lakehouses for structured and semi-structured data.
4. Ensure compliance with data security, governance, and privacy standards using Purview and Informatica.
5. Collaborate with data scientists and ML engineers to operationalize machine learning pipelines.
6. Implement CI/CD pipelines for automating data pipeline deployments.
7. Translate complex technical solutions into business insights for stakeholders.
8. Troubleshoot and resolve performance bottlenecks in data workflows.

Note: