ETL Tester- Python & SQL | Immediate Joiner | To THE New

Job Summary:

ETL Quality Engineer

Responsibilities:

• Validate data movement and transformation between source and target tables (ETL/ELT testing).
• Perform **end-to-end data testing** across data warehouses, lakes, and streaming platforms.
• Verify schema, data types, constraints, and relationships between systems.
• Test messages published and consumed via **Kafka topics** for accuracy, schema adherence, and ordering.
• Validate real-time data ingestion and downstream consumption.
• Conduct **integration tests** between multiple data systems (databases, APIs, Kafka, external services).
• Ensure correct functionality of data pipelines in batch and streaming modes.
• Implement and execute **data quality checks** (completeness, uniqueness, accuracy, consistency, timeliness).
• Collaborate with data engineers to integrate **data quality frameworks** into pipelines.
• Build and maintain **automated test scripts** for regression and continuous testing.
• Use SQL, Python, or similar scripting for test automation.
• Integrate tests with CI/CD pipelines
• Identify, document, and track defects in JIRA (or similar).
• Prepare detailed test plans, test cases, and reports.
• Collaborate with stakeholders (data engineers, product managers, analysts) to resolve issues.

Requirements

• 3 to 6 years** of experience in **QA/Data Testing** (preferably in data engineering or analytics environments).
• Strong hands-on experience with **SQL** for data validation and analysis.
• Experience testing **ETL/ELT pipelines** across RDBMS, data warehouses, and cloud platforms (Snowflake, Redshift, Databricks, BigQuery, etc.).
• Proficiency in testing **Kafka or other streaming platforms**.
• Familiarity with **data quality tools/frameworks** (e.g., Great Expectations, Deequ, Soda, etc.).
• Knowledge of **integration testing methodologies** across APIs, services, and data layers.
• Strong scripting skills in **Python/Java/Scala** for automation.
• Exposure to **CI/CD pipelines** and QA automation frameworks.
• Excellent problem-solving, debugging, and communication skills.