Azure Data Engineer( .Net, C#)

Greetings from TCS!

Job Title: Azure Data Engineer having hands on experience with .NET & C#.

Required Skillset:

• Proficiency in Azure Data Factory, Azure Databricks (including Spark and Delta Lake), and other Azure data services.
• Strong programming skills in Python, with experience in data processing libraries such as Pandas, PySpark, and NumPy.

• Mandatory Experience with .NET, C#

• Familiarity with data warehousing concepts and tools (e.g., Azure Synapse Analytics).

Location: Pune (Kharadi)

Experience Range: 6-12 years

Must-Have**

• Proven experience as an Azure Data Engineer, .NET, C#

• Strong proficiency in Azure Databricks, including Spark and Delta Lake.
• Experience with Azure Data Factory, Azure Data Lake Storage, and Azure SQL Database.
• Proficiency in Data Warehousing concepts and Python

Good To Have:

• Experience with distributed data/computing tools: Map/Reduce, Hadoop, Hive, Spark
• Experience creating SQL queries for ETL and reporting

• Experience with DevOps practices and tools, including CI/CD pipelines for data engineering workflows.
• Knowledge of big data technologies and data processing workflows.

Responsibility of / Expectations from the Role :

• Design, develop, and maintain scalable data pipelines and ETL processes using Azure Databricks, Azure Data Factory, and other Azure services.

• Leverage existing C# code and libraries within Azure Databricks, connect to Databricks using .NET applications via ODBC or JDBC, and even develop Spark applications in C#

• Create and maintain optimal data pipeline architecture to support data-driven decision-making.
• Assemble large, complex datasets that meet functional and non-functional business requirements.
• Implement data flows to connect operational systems, data for analytics, and BI systems.
• Develop and optimize data models on Azure data platforms.
• Stay updated with the latest industry trends and best practices in data engineering and big data technologies.
• Participate in code reviews and ensure adherence to coding standards and best practices.
• Collaborate with cross-functional teams to define and implement data solutions that align with business objectives.
• Document data processes, architectures, and workflows for future reference and knowledge sharing.

Kindly Share your updated Resumes

Thanks & Regards,

Shilpa Silonee

BFSI A&I TAG