Senior AI Python Quality Analyst

Job Title : Senior AI Python Quality Analyst

Experience:

Location:

Contract Type:

Work Shift:

About the Role:

Senior Python Quality Analyst

Key Responsibilities:

• Design, implement, and maintain robust test suites for AI and agentic systems.
• Build automated testing frameworks in

  Python

  to validate AI model outputs and system behavior.
• Develop test cases for edge cases, failure modes, and model misbehavior (e.g., hallucinations, biases).
• Perform thorough

  regression testing

  for all releases and updates.
• Ensure AI systems meet performance benchmarks and functional requirements.
• Collaborate with AI engineers to understand architectures and identify weak points.
• Document and track bugs with detailed reproduction steps.
• Support development in debugging and issue resolution.
• Participate in agentic development during reduced QA workload.

Requirements:

• 5+ years of experience in

  Software QA

  , especially with

  Python

  .
• Proficiency in

  Python testing frameworks

  like pytest, unittest.
• Familiarity with

  AI/ML workflows

  and evaluation methodologies.
• Experience testing

  complex, integrated systems

  .
• Solid understanding of

  CI/CD pipelines

  , version control (Git), and test automation.
• Comfortable with bug tracking tools and collaborative development environments.