QA Engineer (Immediate joiner )

As a QA Engineer, you will play a critical role in ensuring the quality, performance, and reliability of our AI-driven product built using Retrieval Augmented Generation (RAG) architecture. You will work closely with our engineering team to test APIs, evaluate end-to-end workflows involving local LLMs, and validate data retrieval accuracy. This role requires a strong foundation in automated testing and performance benchmarking, as well as a proactive mindset to identify potential issues before they reach production.

Responsibilities:

• Design and implement test plans for API endpoints, data retrieval workflows, and user interactions
• Conduct

  manual and automated testing

  to validate features and catch bugs early
• Evaluate

  LLM-integrated workflows

  for functional correctness and response quality
• Perform

  performance and scalability testing

  to assess system behaviour under different loads
• Conduct

  integration testing

  across components (e.g., FastAPI, vector DB, LLM, data sources)
• Report and track bugs with clear documentation and reproduction steps
• Collaborate closely with developers to suggest improvements and validate fixes
• Contribute to maintaining test coverage as the product evolves

Requirements:

• 34 years of experience in QA, with at least 1+ year in API/product testing
• Proficiency with

  Python

  and test automation tools like pytest, unittest, or similar
• Hands-on experience with

  API testing tools

  (Postman, Swagger, or similar)
• Experience with

  performance testing tools

  like Locust, JMeter, or custom scripts
• Familiarity with CI/CD pipelines and test reporting
• Strong understanding of SDLC and bug-tracking tools (e.g., Jira, Trello)
• Excellent communication skills and attention to detail

Good to Have:

• Exposure to LLMs, NLP models, or working with RAG architecture
• Knowledge of vector databases or embedding-based search
• Experience testing AI-driven products
• Understanding of security testing principles — including prompt injection, data leakage, and API security vulnerabilities