ETL Testing (Python\PySpark)

About the job

Primary skills: ETL Testing with Python\PySpark

Experience: 5 -7 Years

About the Company

At ValueMomentum’s Engineering Center, we are a team of passionate engineers who thrive on tackling complex business challenges with innovative solutions while transforming the P&C insurance value chain. We achieve this through strong engineering foundation and continuously refining our processes, methodologies, tools, agile delivery teams, and core engineering archetypes. Our core expertise lies in six key areas: Cloud Engineering, Application Engineering, Data Engineering, Core Engineering, Quality Engineering, and Domain expertise. Join a team that invests in your growth. Our Infinity Program empowers you to build your career with role-specific skill development leveraging immersive learning platforms. You'll have the opportunity to showcase your talents by contributing to impactful projects.

Key Responsibilities:

• Design, develop, and execute automated ETL test scripts using

  Python

  or

  PySpark

  .
• Perform data validation, data integrity, and data quality checks across complex ETL processes.
• Write and optimize

  complex SQL queries

  for validating data pipelines and transformations.
• Collaborate closely with data engineers, business analysts, and QA teams to understand requirements and ensure test coverage.
• Identify, document, and track defects using test management tools.
• Participate in requirement reviews, test case design, and impact analysis discussions.
• Provide regular updates to stakeholders and effectively manage communication across teams.
• Proactively identify test process improvement opportunities and implement best practices in test automation.

Required Skills & Experience:

• 5+ years of experience

  in ETL/Data Warehouse testing.
• Strong experience in

  SQL

  (preferably across multiple RDBMS like Oracle, SQL Server, etc.).
• Hands-on experience in

  Python

  or

  PySpark

  for test automation.
• Familiarity with big data ecosystems such as Hadoop, Hive, or Spark is a strong plus.
• Strong understanding of data warehousing concepts and ETL workflows.
• Experience with version control systems like Git and test management tools such as JIRA, TestRail, or HP ALM.
• Excellent verbal and written communication skills.
• Ability to interact with customers and stakeholders effectively.