Senior QA Engineer

About Aventra:

Work Location:

Role Description:

We are seeking a Senior QA Engineer with strong data testing expertise to ensure the quality, reliability, and accuracy of our Azure-based data engineering pipelines.

The candidate will work closely with Data Engineers to validate data ingestion, transformation, and storage across ADF, Synapse Notebooks, PySpark, Delta tables, Postman, ETL Testing, and SQL Pools

Work Experience:

• 4 to 8 Years of Good Hands-on Experience on projects with a focus on data engineering and ETL validation

Responsibilities:

• Design and execute test cases to validate data ingestion pipelines built in Azure Data Factory (ADF).
• Validate PySpark transformations performed in Synapse Notebooks.
• Verify data consistency and quality in silver-layer Delta tables stored in Azure Storage.
• Test gold-layer data stored in Dedicated SQL Pools, ensuring accuracy and performance.
• Create and maintain SQL queries to validate business rules, aggregations, and transformations.
• Perform end-to-end data validation across multiple sources and target systems.
• Collaborate with the Data Engineering team to identify issues and ensure timely resolution.
• Document test plans, test cases, and results for audit and compliance.
• (Good to have) Validate data stored in Cosmos DB where applicable.

Skills & Competencies Requirements

• 47 years of experience in QA/testing with a focus on data engineering and ETL validation.
• Bachelors degree in Computer Science, Information Technology, or a related field.
• Strong experience in Data Testing / ETL Testing.
• Proficiency in SQL for data validation, reconciliation, and analysis.
• Hands-on experience with Azure Data Factory (ADF) and Synapse Analytics.
• Understanding of PySpark transformations and ability to validate logic.
• Experience in validating Delta Lake data stored in Azure Storage.
• Knowledge of fact-dimension models, star/snowflake schemas.
• Strong analytical and problem-solving skills.
• Excellent communication skills to work with developers, business analysts, and stakeholders.

Preferred (Nice-to-Have)

• Exposure to Cosmos DB or other NoSQL databases.
• Familiarity with automation frameworks for data validation.
• Knowledge of CI/CD testing practices in data engineering environments