QA Engineer with Machine Learning _Contract role

Role: QA Engineer with Machine Learning

Experience: 2-4 Years

Notice Period: Immediate Joiners only

Location: Remote

Role & responsibilities

Job description for QA Engineer

We have a position for a Test Engineer to test modern Web, Mobile applications and AI/ML/GenAI solutions including Chatbots, ETL & Data Pipelines, and Conversational Agents. The ideal candidate will help with functional, E2E, security, and performance test design and execution of applications built using the latest Front-end technologies, SQL/NoSQL, Vector databases, REST/Graph APIs, and LLM/ML model deployments. This is a remote position for our India office.

Candidate Skills:

• Excellent interpersonal and communication skills
• Strong in Functional, Integration, and E2E Testing from GUI and REST API
• Experience with ML model evaluation metrics and testing frameworks
• Hands-on experience testing Chatbots, NLP applications, and Vector Search implementations
• Prompt Engineering expertise for test design and validation
• Experience with ML model validation techniques and A/B testing
• Knowledge of ML monitoring tools and observability platforms
• ETL pipelines testing and data quality validation
• REST API Testing and Test automation using Postman/JMeter
• Hands-On Working Exposure to Cloud Platforms (Azure/AWS)
• Version control systems and CI/CD pipelines
• SQL and NoSQL databases
• Python, Pandas, NumPy, and Scikit-Learn
• Experience with Vector databases (e.g., Pinecone, Weaviate)
• Familiarity with ML frameworks (TensorFlow, PyTorch)
• Understanding of AI safety and responsible AI practices

Responsibilities:

• Design and execute comprehensive test strategies for AI/ML applications, including data validation, model accuracy, and bias testing
• Develop and deploy automation tests for APIs and ML model endpoints
• Implement testing frameworks for evaluating LLM outputs, including factual accuracy, consistency, and safety
• Help accelerate testing practices using ML/GenAI capabilities to speed up time to market
• Design and implement tests to detect and prevent issues with AI/ML/NLP solutions
• Perform creative and critical thinking to identify and address issues arising from LLMs/SLMs including hallucination, bias, and accuracy

Reach us:

.