Senior Data Engineer

We are seeking a Senior Azure Data Engineer with hands-on expertise in Azure Databricks, Azure Data Factory (ADF), Python/PySpark, and SQL. The ideal candidate should have strong experience designing and building scalable data pipelines in the Azure cloud.

Primary Responsibilities:

• Design and develop scalable ETL/ELT pipelines using ADF and Databricks (PySpark).
• Write efficient, production-grade PySpark and SQL code for data transformations.
• Build and maintain data models, ingestion frameworks, and processing pipelines.
• Collaborate with cross-functional teams to gather requirements and implement solutions.
• Ensure performance tuning, error handling, and monitoring of data workflows.

Mandatory Skills:

• Strong hands-on experience with Azure Databricks and Azure Data Factory (ADF).
• Proficiency in Python and PySpark.
• Excellent SQL skills for data extraction, transformation, and analysis.
• Good understanding of data lake architecture and best practices.

Good to Have / Secondary Skills:

• Experience with CI/CD pipelines and GitHub-based version control.
• Exposure to DevOps practices in data engineering.
• Knowledge of data quality frameworks and orchestration tools is a plus.

Soft Skills:

• Strong analytical and problem-solving skills.
• Effective communication and stakeholder collaboration.
• Agile mindset and ability to adapt to evolving data needs.