QA Analyst

QA Analyst

Apply and get a chance to work with one of the Big4 companies #PwC AC.

Job Titl

Years of Experience

Shift Timing

Qualificatio

About PwC CTIO – EmTech

Commercial Technology and Innovation Office (CTIO)

LLMOps

Role Overview

We are seeking Test Automation QA

Key Responsibilities:

• Design, develop, and maintain scalable and reliable test automation frameworks utilizing Python, Java/C##. Expertise in designing and implementing AI-driven test strategies using advanced tools like OpenAI, GitHub Copilot, etc.
• Demonstrate understanding of or possess hands-on experience with testing methodologies specific to Generative AI and large language model (LLM)-based systems.
• Perform thorough manual testing across web applications, APIs, and backend services to ensure functional stability and performance.
• Collaborate closely with software engineers and business analysts to gather and interpret requirements, ensuring comprehensive test coverage and alignment with business objectives.
• Execute various types of testing including functional, regression, integration, and system-level testing to ensure product quality and reliability.
• Develop and manage test plans, create detailed test cases, and document clear, actionable defect reports.
• Integrate automated test suites into CI/CD pipelines to enable continuous testing and quality assurance throughout the development lifecycle.
• Actively participate in Agile ceremonies such as sprint planning, daily stand-ups, and retrospectives, contributing to continuous improvement initiatives.

Mandatory Skills:

• Over 3 to 7 years of professional experience in the IT industry, with a strong focus on test automation management.
• A minimum of 1.5 years of hands-on experience in testing Generative AI systems.
• Proven expertise in both automated and manual testing methodologies across diverse application landscapes.
• Sound understanding and/or practical experience in testing strategies specific to Generative AI and Large Language Model (LLM)-based applications.
• Strong proficiency in API testing and backend system validation to ensure data integrity and service reliability.
• Skilled in developing and maintaining test automation scripts using Python and Java.
• Extensive experience with automation frameworks such as Pytest, Selenium, Playwright, Rest Assured.
• Well-versed in Continuous Integration/Continuous Deployment (CI/CD) practices, with familiarity in integrating test suites into CI/CD pipelines using industry-standard tools.

Good to Have:

• Experience with Azure DevOps (ADO) for comprehensive test management, task tracking, and collaboration within Agile development environments.
• Solid experience in leveraging AI and LLM evaluation frameworks like RAGAS for quality assessment, combined with proficiency in developing and validating custom GPT models for domain-specific applications.

Soft Skills & Team Expectations

• Strong communication and documentation skills; ability to clearly articulate technical concepts to both technical and non-technical audiences.
• Demonstrated ability to work independently as well as collaboratively in a fast-paced environment.
• A builder's mindset with a strong desire to

  innovate, automate, and scale

  .
• Comfortable in an agile, iterative development environment.
• Willingness to mentor junior engineers and contribute to team knowledge growth.

Why Join PwC CTIO?

• Work at the

  cutting edge of AI engineering

  , deploying real solutions at production scale.
• Collaborate with

  visionary AI researchers

  , engineers, and product leaders to redefine what’s possible.
• Be part of a team that values both

  rapid experimentation

  and

  engineering excellence

  .
• Gain exposure to

  LLMOps and GenAI infrastructure

  at an enterprise scale.
• Join a culture that encourages

  continuous learning, bold thinking

  , and

  inclusive innovation

  .