Senior Data Engineer

Dreaming big is in our DNA. It’s who we are as a company. It’s our culture. It’s our heritage. And more than ever, it’s our future. A future where we’re always looking forward. Always serving up new ways to meet life’s moments. A future where we keep dreaming bigger. We look for people with passion, talent, and curiosity, and provide them with the teammates, resources and opportunities to unleash their full potential. The power we create together – when we combine your strengths with ours – is unstoppable. Are you ready to join a team that dreams as big as you do?

Job Title: Azure Data Engineer

Location: Bengaluru

Reporting to: Senior Manager Data Engineering

• Purpose of the role
  

• Key tasks & accountabilities
  

Data Pipeline Development:

• Design and implement efficient ETL/ELT pipelines using Azure Data Factory (ADF) and Azure Databricks (ADB).
• Ensure high performance and scalability of data pipelines.
  

Relational Database Management:

• Work with relational databases to structure and query data efficiently.
• Design, optimize, and maintain database schemas.
  

Programming and Scripting:

• Write, debug, and optimize Python, PySpark, and SQL code to process large datasets.
• Develop reusable code components and libraries for data processing.
  

Data Quality and Governance:

• Implement data validation, cleansing, and monitoring mechanisms.
• Ensure compliance with data governance policies and best practices.
  

Performance Optimization:

• Identify and resolve bottlenecks in data processing and storage.
• Optimize resource utilization on Azure services.
  

Collaboration and Communication:

• Work closely with cross-functional teams, including AI, analytics, and product teams.
• Document processes, solutions, and best practices for future use.
• Qualifications, Experience, Skills
  

Previous Work Experience

• 4+ years of experience in data engineering.
• Proficiency in Azure Data Factory (ADF) and Azure Databricks (ADB).
• Expertise in relational databases and advanced SQL.
• Strong programming skills in Python and PySpark.
• Experience with GenAI solutions is a plus.
• Familiarity with data governance and best practices.
  

Level Of Educational Attainment Required

• Bachelor's degree in Computer Science, Information Technology, or a related field.
  

Technical Expertise:

• Knowledge of machine learning pipelines and GenAI workflows.
• Experience with Azure Synapse or other cloud data platforms.
• Familiarity with CI/CD pipelines for data workflows.