Senior Manager

Job Title: Quality Assurance (QA) Engineer – Conversational & Agentic AI

Overview

Key Responsibilities

• Develop and execute test cases, scripts, and procedures for both Conversational AI applications and Agentic AI/LLM systems.
• Collaborate with product managers, developers, and stakeholders to maintain quality standards throughout the product lifecycle.
• Conduct functional, regression, integration, and performance testing on Conversational AI platforms, agentic AI frameworks, and LLM-based solutions.
• Identify, document, and track defects using JIRA, providing detailed insights and reports on testing outcomes.
• Analyze business and technical requirements to design test strategies tailored to Conversational AI and Agentic AI/LLM use cases.
• Evaluate the usability, effectiveness, and scalability of AI-driven applications, offering actionable feedback.
• Generate comprehensive test reports and summaries for stakeholders, highlighting key findings and recommendations.
• Continuously improve QA methodologies to meet the evolving demands of Conversational AI and Agentic AI technologies.
  

Required Qualifications

• 3–7 years of experience in software testing and quality assurance, with expertise in Conversational AI and Agentic AI/LLMs.
• Strong understanding of standard testing practices, methodologies, and tools for AI applications.
• Hands-on experience with JIRA for defect tracking and project management.
• Proficiency in Excel for data analysis and reporting.
• Knowledge of functional and non-functional testing, including performance and security testing.
• In-depth familiarity with LLMs, agentic AI systems, and conversational technologies.
• Proven ability to work effectively in cross-functional teams within fast-paced environments.
• Excellent problem-solving and analytical skills.
  

Desired Qualifications

• Experience with automated testing tools and scripting languages.
• Exposure to natural language processing (NLP) testing and validation of intelligent agents.
• Familiarity with version control systems.
  

Personal Attributes

• Exceptional attention to detail and a strong commitment to quality.
• Excellent communication skills, both written and verbal.
• Self-driven and motivated to innovate within the AI domain.
• Ability to prioritize and manage multiple tasks in a dynamic, fast-evolving environment.