QA Agents Manager

About Us

Empirical.run is revolutionizing software testing by building AI agents that write, run, and maintain end-to-end UI level tests. We're a fast-growing startup creating intelligent testing solutions that help development teams automate their QA processes while maintaining high-quality user experiences.

The Role

We're seeking a detail-oriented Quality Assurance Agents Manager to join our team as the primary validator of our AI agents' testing outputs. You'll be responsible for ensuring our AI agents correctly follow instructions and produce accurate test results, while conducting thorough analysis of failed test runs to improve our system's reliability.

What You'll Do:

• Review and validate AI agent outputs to ensure they accurately follow provided instructions and requirements
• Analyze failed test runs to identify root causes, including debugging test execution issues and AI agent behavior
• Perform detailed analysis of test execution logs, screenshots, and failure patterns
• Collaborate with engineers to refine agent instructions and improve test generation quality
• Document test scenarios where manual intervention or AI training improvements are needed
• Monitor test execution trends and provide insights on system reliability

What We're Looking For:

• 1+ years of experience in manual software testing and quality assurance
• Strong debugging and analytical skills with experience troubleshooting complex test failures
• Experience with test execution analysis, log review, and failure pattern identification
• Familiarity with testing frameworks and tools (Playwright etc.)
• Ability to interpret test execution data and provide meaningful insights
• Knowledge of software development lifecycle and testing best practices

What We Offer:

• Competitive salary and equity package
• Opportunity to directly influence the accuracy and reliability of AI testing agents
• Direct impact on the evolution of AI-powered QA practices

If interested, write to us at hey@empirical.run.

Location: Gurgaon