Senior Data Quality Engineer

Data Quality Engineer (Automation)

The candidate will bring expertise in ETL automation, data warehouse testing, and cloud data services, as well as hands-on knowledge of test automation frameworks and CI/CD methodologies.

Responsibilities

• Define and implement automated test scripts to validate ETL workflows and data pipelines
• Ensure end-to-end data validation, reconciliation, and testing across large data sets and DWH systems
• Collaborate with cross-functional teams, including data engineers, analysts, and stakeholders, to establish and meet data quality standards
• Create reusable and scalable test automation frameworks leveraging Python and SQL
• Embed automated tests into CI/CD pipelines to enable continuous testing and delivery cycles
• Ensure data transformation accuracy and consistency across various cloud platforms
• Contribute to Agile ceremonies, sprint planning, retrospectives, and backlog refinement

Requirements

• 5.5+ years of relevant experience
• Background in ETL automation and Data Warehouse/Data Lake testing
• Proficiency in SQL for data validation and automated testing purposes
• Skills in Python for scripting and framework development
• Familiarity with one or more Test Automation Frameworks
• Exposure to cloud data services, including Azure, AWS, and GCP
• Knowledge of CI/CD concepts, tools, and practices such as Jenkins, Git, and Azure DevOps
• Understanding of Agile or Scrum methodologies

Nice to have

• Familiarity with data observability or data quality tools such as Great Expectations or Deequ
• Understanding of data governance principles and metadata management practices
• Background in cloud platform certifications such as Azure, AWS, or GCP